Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Erik Haake

dblp:387/3186 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Language models and text generation · 39% Multi-agent systems · 30% Trustworthy machine learning · 30%

Topics — the 3 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Trustworthy machine learning
hallucination
0.812024
When Context Leads but Parametric Memory Follows in Large Language Models · EMNLP 2024
Knowledge, reasoning and agents › Multi-agent systems › distributed problem solving
knowledge allocation
0.812024
When Context Leads but Parametric Memory Follows in Large Language Models · EMNLP 2024
Natural language and speech › Language models and text generation › large language model › knowledge in language models
parametric vs contextual knowledge
0.812024
When Context Leads but Parametric Memory Follows in Large Language Models · EMNLP 2024
YearPublicationVenuePosition
2024 When Context Leads but Parametric Memory Follows in Large Language Models
abstract
Large language models (LLMs) have demonstrated remarkable progress in leveraging diverse knowledge sources. This study investigates how nine widely used LLMs allocate knowledge between local context and global parameters when answering open-ended questions in knowledge-consistent scenarios. We introduce a novel dataset, WikiAtomic, and systematically vary context sizes to analyze how LLMs prioritize and utilize the provided information and their parametric knowledge in knowledge-consistent scenarios. Additionally, we also study their tendency to hallucinate under varying context sizes. Our findings reveal consistent patterns across models, including a consistent reliance on both contextual (around 70%) and parametric (around 30%) knowledge, and a decrease in hallucinations with increasing context. These insights highlight the importance of more effective context organization and developing models that use input more deterministically for robust performance.
Yufei Tao 0004, Adam Hiatt, Erik Haake, Antonie J. Jetter, Ameeta Agrawal
EMNLP3