Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Iek-Heng Chu

dblp:320/0301 · DBLP profile ↗
← Back
3ranked-venue papers
0as first author
3since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 3 · 3 since 2021Artificial intelligence and machine learning · 2 · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
2 papers
Visual content generation and editing · 54% Multimedia analysis and retrieval · 46%
Artificial intelligence
1 paper
Generative modeling · 100%
Human-computer interaction and pervasive computing
1 paper
Usability and user experience research · 100%

Topics — the 4 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
diffusion model
0.912025
Co-Speech Gesture Video Generation with Implicit Motion-Audio Entanglement · CVPR 2025
Visual content generation and editing › video generation
co-speech gesture video generation
0.912025
Co-Speech Gesture Video Generation with Implicit Motion-Audio Entanglement · CVPR 2025
Multimedia analysis and retrieval › multimedia analysis
multimodal conversation analysis
0.812024
Dialogue Cross-Enhanced Central Engagement Attention Model for Real-Time Engagement Estimation · IJCAI 2024
Usability and user experience research › user modeling
engagement estimation
0.812024
Dialogue Cross-Enhanced Central Engagement Attention Model for Real-Time Engagement Estimation · IJCAI 2024

Methods — techniques the papers use, named apart from their topics

two-stage training · 1.7implicit motion-audio entanglement · 1.7attention model · 1.5
YearPublicationVenuePosition
2025 Co-Speech Gesture Video Generation with Implicit Motion-Audio Entanglement
abstract
Co-speech gestures are essential to non-verbal communication, enhancing both the naturalness and effectiveness of human interaction. Although recent methods have made progress in generating co-speech gesture videos, many rely on strong visual controls, such as pose images or TPS key-point movements, which often lead to artifacts like blurry hands and distorted fingers. In response to these challenges, we present the Implicit Motion-Audio Entanglement (IMAE) method for co-speech gesture video generation. IMAE strengthens audio control by entangling implicit motion parameters, including pose and expression, with audio inputs. Our method utilizes a two-branch framework that combines an audio-to-motion generation branch with a video diffusion branch, enabling realistic gesture generation without requiring additional inputs during inference. To improve training efficiency, we propose a two-stage slow-fast training strategy that balances memory constraints while facilitating the learning of meaningful gestures from long frame sequences. Extensive experimental results demonstrate that our method achieves state-of-the-art performance across multiple metrics. Project Page.
Xinjie Li 0002, Ziyi Chen 0005, Xinlu Yu, Iek-Heng Chu, Peng Chang 0002, Jing Xiao 0006
CVPR4
2024 Dialogue Cross-Enhanced Central Engagement Attention Model for Real-Time Engagement Estimation
Jun Yu 0001, Keda Lu, Ji Zhao 0020, Zhihong Wei, Iek-Heng Chu, Peng Chang 0002
IJCAI5
2022 Transformer-Based Multi-Aspect Multi-Granularity Non-Native English Speaker Pronunciation Assessment
abstract
Automatic pronunciation assessment is an important technology to help self-directed language learners. While pronunciation quality has multiple aspects including accuracy, fluency, completeness, and prosody, previous efforts typically only model one aspect (e.g., accuracy) at one granularity (e.g., at the phoneme-level). In this work, we explore modeling multi-aspect pronunciation assessment at multiple granularities. Specifically, we train a Goodness Of Pronunciation feature-based Transformer (GOPT) with multi-task learning. Experiments show that GOPT achieves the best results on speechocean762 with a public automatic speech recognition (ASR) acoustic model trained on Librispeech.
Yuan Gong 0001, Ziyi Chen 0005, Iek-Heng Chu, Peng Chang 0002, James R. Glass
ICASSP3