Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Mehrdad Farahani

dblp:259/0836 · DBLP profile ↗
← Back
2ranked-venue papers
2as first author
2since 2021 · last 2024
0000-0002-5162-1718ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 2 first-author · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Language models and text generation · 67% Probabilistic and Bayesian machine learning · 33%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation › large language model
knowledge in language models
0.812024
Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models · EMNLP 2024
Machine learning › Probabilistic and Bayesian machine learning › causal inference › causal effect estimation
mediation analysis
0.812024
Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models · EMNLP 2024
Natural language and speech › Language models and text generation
retrieval-augmented generation
0.812024
Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models · EMNLP 2024

Methods — techniques the papers use, named apart from their topics

controlled experiment · 0.8causal mediation analysis · 0.8
YearPublicationVenuePosition
2024 Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models
abstract
Generative language models often struggle with specialized or less-discussed knowledge.A potential solution is found in Retrieval-Augmented Generation (RAG) models which act like retrieving information before generating responses.In this study, we explore how the ATLAS approach, a RAG model, decides between what it already knows (parametric) and what it retrieves (non-parametric).We use causal mediation analysis and controlled experiments to examine how internal representations influence information processing.Our findings disentangle the effects of parametric knowledge and the retrieved context.They indicate that in cases where the model can choose between both types of information (parametric and nonparametric), it relies more on the context than the parametric knowledge.Furthermore, the analysis investigates the computations involved in how the model uses the information from the context.We find that multiple mechanisms are active within the model and can be detected with mediation analysis: first, the decision of whether the context is relevant, and second, how the encoder computes output representations to support copying when relevant. 1
Mehrdad Farahani, Richard Johansson
EMNLP1
2021 ParsBERT: Transformer-based Model for Persian Language Understanding
Mehrdad Farahani, Mohammad Gharachorloo, Marzieh Farahani, Mohammad Manthouri
Neural Process. Lett.1