Oleg Somov

dblp:339/3375 · DBLP profile ↗
← Back
3ranked-venue papers
2as first author
3since 2021 · last 2025
0009-0007-1209-9131ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 2 first-author · 3 since 2021Databases, data management, data science and information retrieval · 2 · 1 first-author · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Trustworthy machine learning · 67% Learning theory · 33%
Software engineering, system software, and programming languages
1 paper
Program synthesis and code generation · 50% Program analysis · 50%
Databases, data mining, and information retrieval
1 paper
Data models and query languages · 100%

Topics — the 6 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Trustworthy machine learning › calibration
confidence calibration
0.912025
Confidence Estimation for Error Detection in Text-to-SQL Systems · AAAI 2025
Machine learning › Learning theory
generalization
0.912025
The Generalization and Error Detection in LLM-based Text-to-SQL Systems · WSDM 2025
Machine learning › Trustworthy machine learning
uncertainty estimation
0.912025
Confidence Estimation for Error Detection in Text-to-SQL Systems · AAAI 2025
Data models and query languages › natural language interface › natural language interface to database
text-to-SQL
0.912025
Confidence Estimation for Error Detection in Text-to-SQL Systems · AAAI 2025
Program analysis
error detection
0.912025
The Generalization and Error Detection in LLM-based Text-to-SQL Systems · WSDM 2025
Program synthesis and code generation › code generation from natural language
text-to-SQL generation
0.912025
The Generalization and Error Detection in LLM-based Text-to-SQL Systems · WSDM 2025

Methods — techniques the papers use, named apart from their topics

large language model · 3.5selective classification · 1.7entropy-based confidence estimation · 1.7calibration · 1.7
YearPublicationVenuePosition
2025 Confidence Estimation for Error Detection in Text-to-SQL Systems
abstract
Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL queries, their broader adoption is limited by two main challenges: achieving robust generalization across diverse queries and ensuring interpretative confidence in their predictions. To tackle these issues, our research investigates the integration of selective classifiers into Text-to-SQL systems. We analyse the trade-off between coverage and risk using entropy based confidence estimation with selective classifiers and assess its impact on the overall performance of Text-to-SQL models. Additionally, we explore the models' initial calibration and improve it with calibration techniques for better model alignment between confidence and accuracy. Our experimental results show that encoder-decoder T5 is better calibrated than in-context-learning GPT 4 and decoder-only Llama 3, thus the designated external entropy-based selective classifier has better performance. The study also reveal that, in terms of error detection, selective classifier with a higher probability detects errors associated with irrelevant questions rather than incorrect query generations.
Oleg Somov, Elena Tutubalina
AAAI1
2025 The Benefits of Query-Based KGQA Systems for Complex and Temporal Questions in LLM Era
Artem Alekseev, Mikhail Chaichuk, Miron Butko, Alexander Panchenko, Elena Tutubalina, Oleg Somov
NLDB (1)6
2025 The Generalization and Error Detection in LLM-based Text-to-SQL Systems
Oleg Somov
WSDM1