Zheye Deng

dblp:248/8937 · DBLP profile ↗
← Back
7ranked-venue papers
1as first author
7since 2021 · last 2026
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 6 · 1 first-author · 6 since 2021Systems, architecture and hardware · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
5 papers
Language models and text generation · 50% Knowledge representation and reasoning · 41% Information extraction and text analysis · 9%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Computational science and engineering · 100%

Topics — the 11 heaviest of 12, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation
large language model evaluation
1.012026
XToM: Exploring the Multilingual Theory of Mind for Large Language Models · ACL (1) 2026
Knowledge, reasoning and agents › Knowledge representation and reasoning
theory of mind
1.012026
XToM: Exploring the Multilingual Theory of Mind for Large Language Models · ACL (1) 2026
Natural language and speech › Language models and text generation
LLM agents
0.912025
From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery · EMNLP 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning › logic-based reasoning
logical entailment
0.912025
Enhancing Transformers for Generalizable First-Order Logical Entailment · ACL (1) 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning
scientific discovery
0.912025
From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery · EMNLP 2025
Natural language and speech › Language models and text generation
large language model
0.812024
GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory · EMNLP 2024
Natural language and speech › Language models and text generation › text generation
large language model generation
0.812024
Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extraction · EMNLP 2024
Knowledge, reasoning and agents › Knowledge representation and reasoning › normative reasoning
legal reasoning
0.812024
GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory · EMNLP 2024
Natural language and speech › Information extraction and text analysis › structure prediction
text-to-table generation
0.812024
Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extraction · EMNLP 2024
Computational science and engineering › AI for science
AI for scientific discovery
0.312025
From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery · EMNLP 2025
Privacy and data protection › differential privacy › privacy auditing
privacy violation detection
0.212024
GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory · EMNLP 2024

Methods — techniques the papers use, named apart from their topics

survey · 1.7synthetic scenario generation · 1.5contextual integrity theory · 1.5LLM grounding · 1.5multilingual benchmarking · 1.0transformer architecture · 0.9in-context learning · 0.8fine-tuning · 0.8
YearPublicationVenuePosition
2026 XToM: Exploring the Multilingual Theory of Mind for Large Language Models
abstract
Theory of Mind (ToM), the ability to infer mental states in others, is pivotal for human social cognition. Existing evaluations of ToM in LLMs are largely limited to English, neglecting the linguistic diversity that shapes human cognition. This limitation raises a critical question: can LLMs exhibit Multilingual Theory of Mind, which is the capacity to reason about mental states across diverse linguistic contexts? To address this gap, we present XToM, a rigorously validated multilingual benchmark that evaluates ToM across five languages and incorporates diverse, contextually rich task scenarios. Using XToM, we systematically evaluate LLMs (e.g., DeepSeek R1), revealing a pronounced dissonance: while models excel in multilingual language understanding, their ToM performance varies across languages. Our findings expose limitations in LLMs' ability to replicate human-like mentalizing across linguistic contexts.
Chunkit Chan, Yauwai Yim, Hongchuan Zeng, Zhiying Zou, Xinyuan Cheng, Zhifan Sun, Zheye Deng, Kawai Chung, Yuzhuo Ao, Yixiang Fan, Cheng Jiayang, Ercong Nie, Ginny Y. Wong, Helmut Schmid, Hinrich Schütze, Simon See, Yangqiu Song
ACL (1)7
2025 Enhancing Transformers for Generalizable First-Order Logical Entailment
abstract
Tianshi Zheng, Jiazheng Wang, Zihao Wang, Jiaxin Bai, Hang Yin, Zheye Deng, Yangqiu Song, Jianxin Li. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Tianshi Zheng, Zihao Wang 0001, Jiaxin Bai, Hang Yin 0008, Zheye Deng, Yangqiu Song, Jianxin Li 0002
ACL (1)6
2025 From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery
abstract
Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents and fundamentally redefining research processes and human-AI collaboration.This survey systematically charts this burgeoning field, placing a central focus on the changing roles and escalating capabilities of LLMs in science.Through the lens of the scientific method, we introduce a foundational three-level taxonomy-Tool, Analyst, and Scientist-to delineate their escalating autonomy and evolving responsibilities within the research lifecycle.We further identify pivotal challenges and future research trajectories such as robotic automation, self-improvement, and ethical governance.Overall, this survey provides a conceptual architecture and strategic foresight to navigate and shape the future of AI-driven scientific discovery, fostering both rapid innovation and responsible advancement.
Tianshi Zheng, Zheye Deng, Hong Ting Tsang, Weiqi Wang 0001, Jiaxin Bai, Zihao Wang 0001, Yangqiu Song
EMNLP2
2024 Audience Persona Knowledge-Aligned Prompt Tuning Method for Online Debate
abstract
Debate is the process of exchanging viewpoints or convincing others on a particular issue. Recent research has provided empirical evidence that the persuasiveness of an argument is determined not only by language usage but also by communicator characteristics. Researchers have paid much attention to aspects of languages, such as linguistic features and discourse structures, but combining argument persuasiveness and impact with the social personae of the audience has not been explored due to the difficulty and complexity. We have observed the impressive simulation and personification capability of ChatGPT, indicating a giant pre-trained language model may function as an individual to provide personae and exert unique influences based on diverse background knowledge. Therefore, we propose a persona knowledge-aligned framework for argument quality assessment tasks from the audience side. This is the first work that leverages the emergence of ChatGPT and injects such audience personae knowledge into smaller language models via prompt tuning. The performance of our pipeline demonstrates significant and consistent improvement compared to competitive architectures.
Chunkit Chan, Cheng Jiayang, Xin Liu 0039, Yauwai Yim, Zheye Deng, Haoran Li 0003, Yangqiu Song, Ginny Y. Wong, Simon See
ECAI6
2024 Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extraction
abstract
The task of condensing large chunks of textual information into concise and structured tables has gained attention recently due to the emergence of Large Language Models (LLMs) and their potential benefit for downstream tasks, such as text summarization and text mining.Previous approaches often generate tables that directly replicate information from the text, limiting their applicability in broader contexts, as text-to-table generation in real-life scenarios necessitates information extraction, reasoning, and integration.However, there is a lack of both datasets and methodologies towards this task.In this paper, we introduce LIVESUM, a new benchmark dataset created for generating summary tables of competitions based on real-time commentary texts.We evaluate the performances of state-of-the-art LLMs on this task in both fine-tuning and zero-shot settings, and additionally propose a novel pipeline called T3 (Text-Tuple-Table ) to improve their performances.Extensive experimental results demonstrate that LLMs still struggle with this task even after fine-tuning, while our approach can offer substantial performance gains without explicit training.Further analyses demonstrate that our method exhibits strong generalization abilities, surpassing previous approaches on several other text-to-table datasets.
Zheye Deng, Chunkit Chan, Weiqi Wang 0001, Yuxi Sun 0010, Wei Fan 0001, Tianshi Zheng, Yauwai Yim, Yangqiu Song
EMNLP1
2024 GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory
abstract
Privacy issues arise prominently during the inappropriate transmission of information between entities.Existing research primarily studies privacy by exploring various privacy attacks, defenses, and evaluations within narrowly predefined patterns, while neglecting that privacy is not an isolated, context-free concept limited to traditionally sensitive data (e.g., social security numbers), but intertwined with intricate social contexts that complicate the identification and analysis of potential privacy violations.The advent of Large Language Models (LLMs) offers unprecedented opportunities for incorporating the nuanced scenarios outlined in privacy laws to tackle these complex privacy issues.However, the scarcity of open-source relevant case studies restricts the efficiency of LLMs in aligning with specific legal statutes.To address this challenge, we introduce a novel framework, GOLDCOIN 1 , designed to efficiently ground LLMs in privacy laws for judicial assessing privacy violations.Our framework leverages the theory of contextual integrity as a bridge, creating numerous synthetic scenarios grounded in relevant privacy statutes (e.g., HIPAA), to assist LLMs in comprehending the complex contexts for identifying privacy risks in the real world.Extensive experimental results demonstrate that GOLD-COIN markedly enhances LLMs' capabilities in recognizing privacy risks across real court cases, surpassing the baselines on different judicial tasks.
Wei Fan 0001, Haoran Li 0003, Zheye Deng, Weiqi Wang 0001, Yangqiu Song
EMNLP3
2022 MegTaiChi: dynamic tensor-based memory management optimization for DNN training
abstract
In real applications, it is common to train deep neural networks (DNNs) on modest clusters. With the continuous increase of model size and batch size, the training of DNNs becomes challenging under restricted memory budget. The tensor partition and tensor rematerialization are two major memory optimization techniques to enable larger model size and batch size within the limited-memory constrain. However, the related algorithms failed to fully extract the memory reduction opportunity, because they ignored the invariable characteristics of dynamic computational graphs and the variation among the same size tensors at different memory locations. In this work, we propose MegTaiChi, a dynamic tensor-based memory management optimization module for the DNN training, which first achieves an efficient coordination of tensor partition and tensor rematerialization. The key feature of MegTaiChi is that it makes memory management decisions based on dynamic tensor access pattern tracked at runtime. This design is motivated by the observation that the access pattern to tensors is regular during training iterations. Based on the identified patterns, MegTaiChi exploits the total memory optimization space and achieves the heuristic, adaptive and fine-grained memory management. The experimental results show, MegTaiChi can reduce the memory footprint by up to 11% for ResNet-50 and 10.5% for GL-base compared with DTR. For the training of 6 representative DNNs, MegTaiChi outperforms MegEngine and Sublinear by 5X and 2.4X of the maximum batch sizes. Compared with FlexFlow, Gshard and ZeRo-3, MegTaiChi achieves 1.2X, 1.8X and 1.5X performance speedups respectively on average. For the million-scale face recognition application, Meg-TaiChi achieves 1.8X speedup compared with the optimal empirical parallelism strategy on 256 GPUs.
Zhongzhe Hu, Junmin Xiao, Zheye Deng, Ninghui Sun, Guangming Tan
ICS3