Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Amit Chaudhary

dblp:161/6955 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
0009-0008-6964-5444ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Information extraction and text analysis · 50% Learning theory · 50%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Computational social science and digital humanities · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Learning theory › classification
multiclass classification
0.812024
Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024
Natural language and speech › Information extraction and text analysis
text classification
0.812024
Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024
Computational social science and digital humanities › marketing
market research
0.212024
Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys · SIGIR 2024

Methods — techniques the papers use, named apart from their topics

zero-shot learning · 1.5large language model · 1.5
YearPublicationVenuePosition
2024 Reflections on the Coding Ability of LLMs for Analyzing Market Research Surveys
abstract
The remarkable success of large language models (LLMs) has drawn people's great interest in their deployment in specific domains and downstream applications. In this paper, we present the first systematic study of applying large language models (in our case, GPT-3.5 and GPT-4) for the automatic coding (multi-class classification) problem in market research. Our experimental results show that large language models could achieve a macro F1 score of over 0.5 for all our collected real-world market research datasets in a zero-shot setting. We also provide in-depth analyses of the errors made by the large language models. We hope this study sheds light on the lessons we learn and the open challenges large language models have when adapting to a specific market research domain.
Shi Zong, Santosh Kolagati, Amit Chaudhary, Josh Seltzer, Jimmy Lin
SIGIR3