Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Ved Sriraman

dblp:409/7830 · DBLP profile ↗
← Back
1ranked-venue papers
1as first author
1since 2021 · last 2026
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Language models and text generation · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation › decoding › decoding strategy
best-of-n sampling
1.012026
Revisiting the (Sub)Optimality of Best-of-N for Inference-Time Alignment · COLT 2026
Natural language and speech › Language models and text generation › alignment
inference-time alignment
1.012026
Revisiting the (Sub)Optimality of Best-of-N for Inference-Time Alignment · COLT 2026
Natural language and speech › Language models and text generation › alignment
reward hacking
1.012026
Revisiting the (Sub)Optimality of Best-of-N for Inference-Time Alignment · COLT 2026

Methods — techniques the papers use, named apart from their topics

statistical optimality analysis · 1.0reward modeling · 1.0
YearPublicationVenuePosition
2026 Revisiting the (Sub)Optimality of Best-of-N for Inference-Time Alignment
abstract
Best-of-$N$ (BoN) sampling is a widely used inference-time alignment method for language models, whereby $N$ candidate responses are sampled from a reference model and the one with the highest predicted reward according to a learned reward model is selected. Despite its widespread practical use, recent theoretical work has suggested that it is statistically suboptimal and vulnerable to reward hacking, the process by which models exploit weaknesses in the learned reward model to achieve high estimated reward without genuinely improving performance. We revisit this question under assumptions that more closely reflect practice than that of prior work. In particular, in contradistinction to earlier analyses that focused on expected true reward, which may not be meaningful in many practical settings, we investigate how inference-time alignment affects the \emph{win-rate}, a pairwise comparison-based metric more closely aligned with how reward models are trained and evaluated in practice. We demonstrate that, under minimal conditions on the quality of the reference model and learned reward model, properly tuned BoN is both computationally and statistically optimal in achieving high win-rate, partially explaining its widespread practical success. Because BoN remains susceptible to reward-hacking in this setting, we propose a simple and practical variant that provably eliminates reward-hacking while maintaining optimal statistical performance. Finally, we show that prior approaches are provably \emph{suboptimal} when considering win-rate, highlighting the importance of choosing appropriate objectives when analyzing inference-time alignment methods.
Ved Sriraman, Adam Block
COLT1