Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Kaicheng Luo

dblp:333/0487 · DBLP profile ↗
← Back
3ranked-venue papers
1as first author
3since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 1 first-author · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
2 papers
Audio and music processing · 92% Virtual and augmented reality · 8%
Artificial intelligence
2 papers
Generative modeling · 33% Vision and language · 33% Language models and text generation · 33%

Topics — the 8 heaviest of 8, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation
chain-of-thought reasoning
0.912025
ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing · NeurIPS 2025
Computer vision › Vision and language › vision-language model
multimodal large language model
0.912025
ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing · NeurIPS 2025
Machine learning › Generative modeling › audio generation
video-to-audio generation
0.912025
OmniAudio: Generating Spatial Audio from 360-Degree Video · ICML 2025
Audio and music processing
sound synthesis
0.912025
ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing · NeurIPS 2025
Audio and music processing › spatial audio
spatial audio generation
0.912025
OmniAudio: Generating Spatial Audio from 360-Degree Video · ICML 2025
Audio and music processing › sound synthesis
video-to-audio generation
0.912025
ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing · NeurIPS 2025
Virtual and augmented reality › immersive video
360-degree video
0.312025
OmniAudio: Generating Spatial Audio from 360-Degree Video · ICML 2025
Audio and music processing
audio editing
0.312025
ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing · NeurIPS 2025

Methods — techniques the papers use, named apart from their topics

multimodal large language model · 1.7dual-branch framework · 1.7chain-of-thought · 1.7audio foundation model · 1.7self-supervised pretraining · 0.9self-supervised pre-training · 0.9
YearPublicationVenuePosition
2025 StellarTTS: Sparse Temporal Embedding for Low-Latency and Robust Speech Synthesis
Kaicheng Luo, Xuefei Gong, Yutao Sun, Jinling He, Yujie Hou, Xiaoyang Xing, Huiyan Li, Bing Han 0008, Yanmin Qian
ASRU1
2025 OmniAudio: Generating Spatial Audio from 360-Degree Video
abstract
Traditional video-to-audio generation techniques primarily focus on perspective video and non-spatial audio, often missing the spatial cues necessary for accurately representing sound sources in 3D environments. To address this limitation, we introduce a novel task, 360V2SA, to generate spatial audio from 360-degree videos, specifically producing First-order Ambisonics (FOA) audio - a standard format for representing 3D spatial audio that captures sound directionality and enables realistic 3D audio reproduction. We first create Sphere360, a novel dataset tailored for this task that is curated from real-world data. We also design an efficient semi-automated pipeline for collecting and cleaning paired video-audio data. To generate spatial audio from 360-degree video, we propose a novel framework OmniAudio, which leverages self-supervised pre-training using both spatial audio data (in FOA format) and large-scale non-spatial data. Furthermore, OmniAudio features a dual-branch framework that utilizes both panoramic and perspective video inputs to capture comprehensive local and global information from 360-degree videos. Experimental results demonstrate that OmniAudio achieves state-of-the-art performance across both objective and subjective metrics on Sphere360. Code and datasets are available at https://github.com/liuhuadai/OmniAudio. The project website is available at https://OmniAudio-360V2SA.github.io.
Huadai Liu, Tianyi Luo, Kaicheng Luo, Qikai Jiang, Peiwen Sun, Rongjie Huang 0001, Qian Chen 0003, Wen Wang 0001, Xiangtai Li, Shiliang Zhang, Zhijie Yan, Zhou Zhao 0001, Wei Xue 0002
ICML3
2025 ThinkSound: Chain-of-Thought Reasoning in Multimodal LLMs for Audio Generation and Editing
abstract
While end-to-end video-to-audio generation has greatly improved, producing high-fidelity audio that authentically captures the nuances of visual content remains challenging. Like professionals in the creative industries, this generation requires sophisticated reasoning about items such as visual dynamics, acoustic environments, and temporal relationships. We present **ThinkSound**, a novel framework that leverages Chain-of-Thought (CoT) reasoning to enable stepwise, interactive audio generation and editing for videos. Our approach decomposes the process into three complementary stages: foundational foley generation that creates semantically coherent soundscapes, interactive object-centric refinement through precise user interactions, and targeted editing guided by natural language instructions. At each stage, a multimodal large language model generates contextually aligned CoT reasoning that guides a unified audio foundation model. Furthermore, we introduce **AudioCoT**, a comprehensive dataset with structured reasoning annotations that establishes connections between visual content, textual descriptions, and sound synthesis. Experiments demonstrate that ThinkSound achieves state-of-the-art performance in video-to-audio generation across both audio metrics and CoT metrics, and excels in the out-of-distribution Movie Gen Audio benchmark. The project page is available at https://ThinkSound-Project.github.io.
Huadai Liu, Kaicheng Luo, Wen Wang 0001, Qian Chen 0003, Zhou Zhao 0001, Wei Xue 0002
NeurIPS2