Derivative-free optimization of high-dimensional non-convex functions by sequential random embeddings

PAL: Program-aided Language Models

ICML'23, 2023. [All Versions]. Paper presenting an approach that uses the LLM to read natural language problems and generate programs as the intermediate reasoning steps, but offloads the solution step to a runtime such as a Python interpreter. With PAL, decomposing the natural language problem into runnable steps remains the only learning task for the LLM, while solving is delegated to the interpreter

Large Language Models for Software Engineering: A Systematic Literature Review

2023. [All Versions]. A systematic literature review on LLM4SE, with a particular focus on understanding how LLMs can be exploited to optimize processes and outcomes

Second-order and Higher-order Logic

Plato Stanford

Towards combining inductive logic programming with Bayesian networks

ILP'01, 2001. [All Versions]