Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Liyuan Geng

dblp:386/2311 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
1 paper
Information retrieval · 100%
Artificial intelligence
1 paper
Generative modeling · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling › diffusion model › discrete diffusion model
diffusion language model
0.912025
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective · EMNLP 2025
Information retrieval › document processing › document analysis › document representation
text embedding
0.912025
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective · EMNLP 2025
Information retrieval
document retrieval
0.312025
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective · EMNLP 2025

Methods — techniques the papers use, named apart from their topics

diffusion language model · 1.7bidirectional attention · 1.7
YearPublicationVenuePosition
2025 Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective
abstract
Large language model (LLM)-based embedding models, benefiting from large scale pretraining and post-training, have begun to surpass BERT and T5-based models on generalpurpose text embedding tasks such as document retrieval.However, a fundamental limitation of LLM embeddings lies in the unidirectional attention used during autoregressive pre-training, which misaligns with the bidirectional nature of text embedding tasks.To this end, we propose adopting diffusion language models for text embeddings, motivated by their inherent bidirectional architecture and recent success in matching or surpassing LLMs especially on reasoning tasks.We present the first systematic study of the diffusion language embedding model, which outperforms the LLM-based embedding model by 20% on long-document retrieval, 8% on reasoning-intensive retrieval, 2% on instruction-following retrieval, and achieve competitive performance on traditional text embedding benchmarks.Our analysis verifies that bidirectional attention is crucial for encoding global context in long and complex text.
Siyue Zhang, Yilun Zhao 0001, Liyuan Geng, Arman Cohan, Anh Tuan Luu, Chen Zhao 0013
EMNLP3