Program Synthesis

PAL: Program-aided Language Models

ICML'23, 2023. [All Versions]. Paper presenting an approach that uses the LLM to read natural language problems and generate programs as the intermediate reasoning steps, but offloads the solution step to a runtime such as a Python interpreter. With PAL, decomposing the natural language problem into runnable steps remains the only learning task for the LLM, while solving is delegated to the interpreter

Large Language Models for Software Engineering: A Systematic Literature Review

2023. [All Versions]. A systematic literature review on LLM4SE, with a particular focus on understanding how LLMs can be exploited to optimize processes and outcomes

Derivative-free optimization of high-dimensional non-convex functions by sequential random embeddings

IJCAI'16, 2016. [All Versions]

Second-order and Higher-order Logic

Plato Stanford