Demo Data from VLDB 2026 / reviewers in the wild / expert
Josh Seltzer
dblp:323/9652
· DBLP profile ↗
2ranked-venue papers
1as first author
2since 2021 · last 2024
0009-0000-0762-1721ORCID · corroborated
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 2 · 1 first-author · 2 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Information extraction and text analysis · 50% Learning theory · 50% | |
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computational social science and digital humanities · 100% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Learning theory › classification
multiclass classification |
0.8 | 1 | 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024 |
Natural language and speech › Information extraction and text analysis
text classification |
0.8 | 1 | 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024 |
Information retrieval › interactive information retrieval
conversational information seeking |
0.6 | 1 | 2022 | Flipping the Script: Inverse Information Seeking Dialogues for Market Research · SIGIR 2022 |
Information retrieval
interactive information retrieval |
0.6 | 1 | 2022 | Flipping the Script: Inverse Information Seeking Dialogues for Market Research · SIGIR 2022 |
Computational social science and digital humanities › marketing
market research |
0.2 | 1 | 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024 |
Methods — techniques the papers use, named apart from their topics
zero-shot learning · 1.5large language model · 1.5natural language processing · 0.6
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research SurveysabstractThe remarkable success of large language models (LLMs) has drawn people's great interest in their deployment in specific domains and downstream applications. In this paper, we present the first systematic study of applying large language models (in our case, GPT-3.5 and GPT-4) for the automatic coding (multi-class classification) problem in market research. Our experimental results show that large language models could achieve a macro F1 score of over 0.5 for all our collected real-world market research datasets in a zero-shot setting. We also provide in-depth analyses of the errors made by the large language models. We hope this study sheds light on the lessons we learn and the open challenges large language models have when adapting to a specific market research domain. Shi Zong, Santosh Kolagati, Amit Chaudhary, Josh Seltzer, Jimmy Lin |
SIGIR | 4 |
| 2022 | Flipping the Script: Inverse Information Seeking Dialogues for Market ResearchabstractInformation retrieval has traditionally been framed in terms of searching and extracting information from mostly static resources. Interactive information retrieval (IIR) has widened the scope, with interactive dialogues largely playing the role of clarifying (i.e., making explicit, and/or refining) the information search space. Informed by market research practices, we seek to reframe IIR as a process of eliciting novel information from human interlocutors, with a chatbot-inspired virtual agent playing the role of an interviewer. This reframing flips conventional IIR into what we call an inverse information seeking dialogue, wherein the virtual agent recurrently extracts information from human utterances and poses questions intended to elicit related information. In this work, we introduce and provide a formal definition of an inverse information seeking agent, outline some of its unique challenges, and propose our novel framework to tackle this problem based on techniques from natural language processing (NLP) and IIR. Josh Seltzer, Kathy Cheng, Shi Zong, Jimmy Lin |
SIGIR | 1 |