VLDB 2026 Research / reviewers in the wild / expert
Yuan Wang 0052
dblp:41/3241-52
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
0009-0007-8604-6243ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Computer graphics and multimedia
1 paper |
Computer animation and physical simulation · 67% Audio and music processing · 33% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computer animation and physical simulation › motion capture
markerless motion capture |
0.8 | 1 | 2024 | Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture · ACM Trans. Graph. 2024 |
Computer animation and physical simulation
motion capture |
0.8 | 1 | 2024 | Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture · ACM Trans. Graph. 2024 |
Audio and music processing › music analysis
music performance analysis |
0.8 | 1 | 2024 | Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture · ACM Trans. Graph. 2024 |
Methods — techniques the papers use, named apart from their topics
hand-string contact detection · 0.8audio-guided multi-modal learning · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance CaptureabstractIn this paper, we touch on the problem of markerless multi-modal human motion capture especially for string performance capture which involves inherently subtle hand-string contacts and intricate movements. To fulfill this goal, we first collect a dataset, named String Performance Dataset (SPD), featuring cello and violin performances. The dataset includes videos captured from up to 23 different views, audio signals, and detailed 3D motion annotations of the body, hands, instrument, and bow. Moreover, to acquire the detailed motion annotations, we propose an audio-guided multi-modal motion capture framework that explicitly incorporates hand-string contacts detected from the audio signals for solving detailed hand poses. This framework serves as a baseline for string performance capture in a completely markerless manner without imposing any external devices on performers, eliminating the potential of introducing distortion in such delicate movements. We argue that the movements of performers, particularly the sound-producing gestures, contain subtle information often elusive to visual methods but can be inferred and retrieved from audio cues. Consequently, we refine the vision-based motion capture results through our innovative audio-guided approach, simultaneously clarifying the contact relationship between the performer and the instrument, as deduced from the audio. We validate the proposed framework and conduct ablation studies to demonstrate its efficacy. Our results outperform current state-of-the-art vision-based algorithms, underscoring the feasibility of augmenting visual motion capture with audio modality. To the best of our knowledge, SPD is the first dataset for musical instrument performance, covering fine-grained hand motion details in a multi-modal, large-scale collection. It holds significant implications and guidance for string instrument pedagogy, animation, and virtual concerts, as well as for both musical performance analysis and generation. Our code and SPD dataset are available at https://github.com/Yitongishere/string_performance. Yitong Jin, Zhiping Qiu, Yi Shi 0009, Shuangpeng Sun, Chongwu Wang, Donghao Pan, Zhenghao Liang, Yuan Wang 0052, Feng Yu 0032, Tao Yu 0007, Qionghai Dai |
ACM Trans. Graph. | 9 |