Demo Data from VLDB 2026 / reviewers in the wild / expert
Meidai Xuanyuan
dblp:345/8100
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2026
0009-0000-1581-8743ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Speech recognition and synthesis · 46% Question answering and dialogue systems · 30% 3D vision · 23% |
Topics — the 4 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Question answering and dialogue systems › dialogue generation
multimodal dialogue generation |
1.0 | 1 | 2026 | Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026 |
Natural language and speech › Speech recognition and synthesis
speech synthesis |
1.0 | 1 | 2026 | Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026 |
Natural language and speech › Speech recognition and synthesis › speech synthesis
voice cloning |
1.0 | 1 | 2026 | Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026 |
Natural language and speech › Question answering and dialogue systems
dialogue generation |
0.3 | 1 | 2026 | Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026 |
Methods — techniques the papers use, named apart from their topics
speech synthesis model · 1.0large language model · 1.03d talking head model · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and BaselineabstractIn this paper, we introduce a novel framework for creating multimodal interactive digital twin characters, from dialogue videos of TV shows. Specifically, these digital twin characters are capable of responding to user inputs with harmonious textual, vocal, and visual content. They not only replicate the external characteristics, such as appearance and tone, but also capture internal attributes, including personality and habitual behaviors. To support this ambitious task, we collect the Multimodal Character-Centric Conversation Dataset, named MCCCD, which includes character-specific and high-quality multimodal dialogue data with detailed annotations, featuring 6.8 k utterances and 4.6 hours of audio/video per character. Notably, the MCCCD dataset is approximately ten times larger than existing datasets in terms of per-character data volume, facilitating the detailed modeling of complex character-centric traits. Further, we propose a baseline framework to create digital twin characters, consists of dialogue generation through large language models, voice generation via speech synthesis models, and visual representation with 3D talking head models. Experimental results demonstrate that our approach significantly outperforms existing methods in generating consistent and character-specific responses, setting a new benchmark for digital character creation. Our collected dataset and proposed baseline have paved the way for the creation of highly interactive and natural digital avatars, opening the door to extensive and practical applications of digital humans. Meidai Xuanyuan, Yuwang Wang, Hanshi Qu, Zhongming Li, Danping Yan, Jianhua Tao 0001, Qionghai Dai |
IEEE Trans. Pattern Anal. Mach. Intell. | 1 |