Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Meidai Xuanyuan

dblp:345/8100 · DBLP profile ↗
← Back
1ranked-venue papers
1as first author
1since 2021 · last 2026
0009-0000-1581-8743ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Speech recognition and synthesis · 46% Question answering and dialogue systems · 30% 3D vision · 23%

Topics — the 4 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Question answering and dialogue systems › dialogue generation
multimodal dialogue generation
1.012026
Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Natural language and speech › Speech recognition and synthesis
speech synthesis
1.012026
Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Natural language and speech › Speech recognition and synthesis › speech synthesis
voice cloning
1.012026
Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Natural language and speech › Question answering and dialogue systems
dialogue generation
0.312026
Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline · IEEE Trans. Pattern Anal. Mach. Intell. 2026

Methods — techniques the papers use, named apart from their topics

speech synthesis model · 1.0large language model · 1.03d talking head model · 1.0
YearPublicationVenuePosition
2026 Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline
abstract
In this paper, we introduce a novel framework for creating multimodal interactive digital twin characters, from dialogue videos of TV shows. Specifically, these digital twin characters are capable of responding to user inputs with harmonious textual, vocal, and visual content. They not only replicate the external characteristics, such as appearance and tone, but also capture internal attributes, including personality and habitual behaviors. To support this ambitious task, we collect the Multimodal Character-Centric Conversation Dataset, named MCCCD, which includes character-specific and high-quality multimodal dialogue data with detailed annotations, featuring 6.8 k utterances and 4.6 hours of audio/video per character. Notably, the MCCCD dataset is approximately ten times larger than existing datasets in terms of per-character data volume, facilitating the detailed modeling of complex character-centric traits. Further, we propose a baseline framework to create digital twin characters, consists of dialogue generation through large language models, voice generation via speech synthesis models, and visual representation with 3D talking head models. Experimental results demonstrate that our approach significantly outperforms existing methods in generating consistent and character-specific responses, setting a new benchmark for digital character creation. Our collected dataset and proposed baseline have paved the way for the creation of highly interactive and natural digital avatars, opening the door to extensive and practical applications of digital humans.
Meidai Xuanyuan, Yuwang Wang, Hanshi Qu, Zhongming Li, Danping Yan, Jianhua Tao 0001, Qionghai Dai
IEEE Trans. Pattern Anal. Mach. Intell.1