George Tsoukalas

dblp:383/8015 · DBLP profile ↗
← Back
4ranked-venue papers
2as first author
4since 2021 · last 2026
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 2 first-author · 3 since 2021Theory of computation · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Software engineering, system software, and programming languages
1 paper
Program synthesis and code generation · 50% Requirements engineering and software design · 25% Program verification · 25%
Theoretical computer science
2 papers
Automated reasoning and model checking · 100%
Artificial intelligence
1 paper
Reinforcement learning · 100%

Topics — the 7 heaviest of 9, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning › reinforcement learning environment
environment design
0.912025
Learning Interestingness in Automated Mathematical Theory Formation · NeurIPS 2025
Program synthesis and code generation
code generation with language models
0.912025
CLEVER: A Curated Benchmark for Formally Verified Code Generation · NeurIPS 2025
Program verification
proof assistants
0.912025
CLEVER: A Curated Benchmark for Formally Verified Code Generation · NeurIPS 2025
Requirements engineering and software design › specification
specification generation
0.912025
CLEVER: A Curated Benchmark for Formally Verified Code Generation · NeurIPS 2025
Program synthesis and code generation › formal synthesis
verified code generation
0.912025
CLEVER: A Curated Benchmark for Formally Verified Code Generation · NeurIPS 2025
Automated reasoning and model checking › automated theorem proving
neural theorem proving
0.812024
PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competition · NeurIPS 2024
Automated reasoning and model checking
theorem proving
0.812024
PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competition · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

large language model · 2.6reinforcement learning · 1.7evolutionary algorithm · 1.7type checking · 0.9agentic approaches · 0.9symbolic theorem prover · 0.8neural theorem prover · 0.8
YearPublicationVenuePosition
2026 ProofWala: A Framework for Multilingual Proof Data Synthesis and Theorem-Proving
abstract
In proof assistants, the physical proximity between two formal mathematical concepts is a strong predictor of their mutual relevance. Furthermore, lemmas with close proximity regularly exhibit similar proof structures. We show that this locality property can be exploited through online learning techniques to obtain solving agents that far surpass offline learners when asked to prove theorems in an unseen mathematical setting. We extensively benchmark two such online solvers implemented in the Tactician platform for the Coq proof assistant: First, Tactician's online $k$-nearest neighbor solver, which can learn from recent proofs, shows a $1.72\times$ improvement in theorems proved over an offline equivalent. Second, we introduce a graph neural network, Graph2Tac, with a novel approach to build hierarchical representations for new definitions. Graph2Tac's online definition task realizes a $1.5\times$ improvement in theorems solved over an offline baseline. The $k$-NN and Graph2Tac solvers rely on orthogonal online data, making them highly complementary. Their combination improves $1.27\times$ over their individual performances. Both solvers outperform all other general-purpose provers for Coq, including CoqHammer, Proverbot9001, and a transformer baseline by at least $1.48\times$ and are available for practical use by end-users.
Amitayush Thakur, George Tsoukalas, Greg Durrett, Swarat Chaudhuri
ITP2
2025 CLEVER: A Curated Benchmark for Formally Verified Code Generation
abstract
We introduce ${\rm C{\small LEVER}}$, a high-quality, manually curated benchmark of 161 problems for end-to-end verified code generation in Lean. Each problem consists of (1) the task of generating a specification that matches a held-out ground-truth specification, and (2) the task of generating a Lean implementation that provably satisfies this specification. Unlike prior benchmarks,${\rm C{\small LEVER}}$ avoids test-case supervision, LLM-generated annotations, and specifications that leak implementation logic or allow vacuous solutions. All outputs are verified post-hoc using Lean's type checker to ensure machine-checkable correctness. We use ${\rm C{\small LEVER}}$ to evaluate several few-shot and agentic approaches based on state-of-the-art language models. These methods all struggle to achieve full verification, establishing it as a challenging frontier benchmark for program synthesis and formal reasoning. Our benchmark can be found on [GitHub](https://github.com/trishullab/clever) as well as [HuggingFace](https://huggingface.co/datasets/amitayusht/clever). All our evaluation code is also available [online](https://github.com/trishullab/clever-prover).
Amitayush Thakur, Jasper Lee, George Tsoukalas, Meghana Aparna Sistla, Matthew Zhao, Stefan Zetzsche, Greg Durrett, Yisong Yue, Swarat Chaudhuri
NeurIPS3
2025 Learning Interestingness in Automated Mathematical Theory Formation
abstract
We take two key steps in automating the open-ended discovery of new mathematical theories, a grand challenge in artificial intelligence. First, we introduce Fermat, a reinforcement learning (RL) environment that models concept discovery and theorem-proving using a set of symbolic actions, opening up a range of RL problems relevant to theory discovery. Second, we explore a specific problem through Fermat: automatically scoring the interestingness of mathematical objects. We investigate evolutionary algorithms for synthesizing nontrivial interestingness measures. In particular, we introduce an LLM-based evolutionary algorithm that features function abstraction, leading to notable improvements in discovering elementary number theory and finite fields over hard-coded baselines. We open-source the \fermat environment at github.com/trishullab/Fermat.
George Tsoukalas, Rahul Saha, Amitayush Thakur, Sabrina Reguyal, Swarat Chaudhuri
NeurIPS1
2024 PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competition
abstract
We present PutnamBench, a new multi-language benchmark for evaluating the ability of neural theorem-provers to solve competition mathematics problems. PutnamBench consists of 1692 hand-constructed formalizations of 640 theorems sourced from the William Lowell Putnam Mathematical Competition, the premier undergraduate-level mathematics competition in North America. All the problems have formalizations in Lean 4 and Isabelle; a substantial subset also has Coq formalizations. PutnamBench requires significant problem-solving ability and proficiency in a broad range of topics taught in undergraduate mathematics courses. We use PutnamBench to evaluate several established neural and symbolic theorem-provers. These approaches can only solve a handful of the PutnamBench problems, establishing the benchmark as a difficult open challenge for research on neural theorem-proving. PutnamBench is available at https://github.com/trishullab/PutnamBench.
George Tsoukalas, Jasper Lee, John Jennings, Jimmy Xin, Michelle Ding, Michael Jennings, Amitayush Thakur, Swarat Chaudhuri
NeurIPS1