Demo Data from EDBT 2026 / reviewers in the wild / expert
Amit Chaudhary
dblp:161/6955
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
0009-0008-6964-5444ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Information extraction and text analysis · 50% Learning theory · 50% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computational social science and digital humanities · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Learning theory › classification
multiclass classification |
0.8 | 1 | 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024 |
Natural language and speech › Information extraction and text analysis
text classification |
0.8 | 1 | 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024 |
Computational social science and digital humanities › marketing
market research |
0.2 | 1 | 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024 |
Methods — techniques the papers use, named apart from their topics
zero-shot learning · 1.5large language model · 1.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Reflections on the Coding Ability of LLMs for Analyzing Market Research SurveysabstractThe remarkable success of large language models (LLMs) has drawn people's great interest in their deployment in specific domains and downstream applications. In this paper, we present the first systematic study of applying large language models (in our case, GPT-3.5 and GPT-4) for the automatic coding (multi-class classification) problem in market research. Our experimental results show that large language models could achieve a macro F1 score of over 0.5 for all our collected real-world market research datasets in a zero-shot setting. We also provide in-depth analyses of the errors made by the large language models. We hope this study sheds light on the lessons we learn and the open challenges large language models have when adapting to a specific market research domain. Shi Zong, Santosh Kolagati, Amit Chaudhary, Josh Seltzer, Jimmy Lin |
SIGIR | 3 |