Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Heng Jia

dblp:324/8343 · DBLP profile ↗
← Back
4ranked-venue papers
3as first author
4since 2021 · last 2026
0000-0001-8062-9455ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 3 · 3 first-author · 3 since 2021Artificial intelligence and machine learning · 2 · 1 first-author · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
3D vision · 34% Representation and self-supervised learning · 20% Vision and language · 11%
Computer graphics and multimedia
1 paper
Rendering · 100%

Topics — the 14 heaviest of 16, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › 3D vision
3d reconstruction
0.912025
H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025
Computer vision › 3D vision › 3d reconstruction
multi-view reconstruction
0.912025
H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025
Rendering › gaussian splatting
3d gaussian splatting
0.912025
H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025
Rendering
neural rendering
0.912025
H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025
Machine learning › Deep learning architectures and training
mixture of experts
0.812024
MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning
0.812024
MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024
Computer vision › Vision and language
video captioning
0.812024
MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024
Machine learning › Representation and self-supervised learning › representation learning
behavior representation learning
0.712023
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023
Machine learning › Representation and self-supervised learning › representation learning › unsupervised representation learning
self-supervised representation learning
0.712023
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023
Computer vision › Video understanding and tracking
video representation learning
0.712023
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023
Computer vision › 3D vision › depth estimation › multi-task depth estimation
depth and pose estimation
0.312025
H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025
Computer vision › 3D vision › 3d reconstruction › learning-based 3d reconstruction
feed-forward reconstruction
0.312025
H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025
Machine learning › Generative modeling
synthetic data generation
0.212024
MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024
Bioinformatics and computational biology › behavioral analysis
animal behavior analysis
0.212023
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023

Methods — techniques the papers use, named apart from their topics

transformer · 1.7plücker coordinates · 1.7latent volume fusion · 1.7epipolar constraint · 1.7self-supervised learning · 1.3pose tracking · 1.3scale and shift adaptation · 0.8mixture of experts · 0.8large language model prompting · 0.8
YearPublicationVenuePosition
2026 GAS: Geometry-Appearance Synergy for Consistent Video Customization
Heng Jia, Na Zhao 0004, Yunqiu Xu, Linchao Zhu, Yi Yang 0001
MMM (1)1
2025 H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction
abstract
Despite recent advances in feed-forward 3D Gaussian Splatting, generalizable 3D reconstruction remains challenging, particularly in multi-view correspondence modeling. Existing approaches face a fundamental trade-off: explicit methods achieve geometric precision but struggle with ambiguous regions, while implicit methods provide robustness but suffer from slow convergence. We present H3R, a hybrid framework that addresses this limitation by integrating volumetric latent fusion with attention-based feature aggregation. Our framework consists of two complementary components: an efficient latent volume that enforces geometric consistency through epipolar constraints, and a camera-aware Transformer that leverages Plücker coordinates for adaptive correspondence refinement. By integrating both paradigms, our approach enhances generalization while converging 2$\times$ faster than existing methods. Furthermore, we show that spatial-aligned foundation models (e.g., SD-VAE) substantially outperform semantic-aligned models (e.g., DINOv2), resolving the mismatch between semantic representations and spatial reconstruction requirements. Our method supports variable-number and high-resolution input views while demonstrating robust cross-dataset generalization. Extensive experiments show that our method achieves state-of-the-art performance across multiple benchmarks, with significant PSNR improvements of 0.59 dB, 1.06 dB, and 0.22 dB on the RealEstate10K, ACID, and DTU datasets, respectively. Code is available at https://github.com/JiaHeng-DLUT/H3R.
Heng Jia, Linchao Zhu, Na Zhao 0004
ICCV1
2024 MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning
abstract
Video captioning is a challenging task and typically requires paired video-text data for training. However, manually annotating coherent textual descriptions for videos is laborious and time-consuming. To address this challenge, we propose a novel approach that enhances video captioning using only synthetic text data. Leveraging the exceptional text generation capabilities of large language models (LLMs), we produce high-quality and diverse video captions tailored to the target domain. Our approach employs a two-stage prompting strategy: first prompt GPT-4 with few-shot target-domain captions to create a set of high-quality captions, and then continue prompting with the generated captions to acquire large-scale synthetic data. To effectively utilize these captions, we introduce Mixture of Scale and Shift experts (MoS2), an efficient adaptation method for pre-trained captioning models. MoS2 employs lightweight routing networks to estimate probability distributions over a collection of scale and shift experts, dynamically allocating tokens to the appropriate experts. This dynamic adjustment mechanism enhances the model's ability to handle data variations and mitigates the distribution shift between synthetic and real captions. Moreover, our method reduces the number of learnable parameters, facilitating more efficient adaptation. Our method achieves superior performance with only synthetic text data, narrowing the gap between zero-shot and fine-tuned models and reducing the dependency on paired data from the target domain.
Heng Jia, Yunqiu Xu, Linchao Zhu, Yi Yang 0001
ACM Multimedia1
2023 MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior
abstract
We introduce MABe22, a large-scale, multi-agent video and trajectory benchmark to assess the quality of learned behavior representations. This dataset is collected from a variety of biology experiments, and includes triplets of interacting mice (4.7 million frames video+pose tracking data, 10 million frames pose only), symbiotic beetle-ant interactions (10 million frames video data), and groups of interacting flies (4.4 million frames of pose tracking data). Accompanying these data, we introduce a panel of real-life downstream analysis tasks to assess the quality of learned representations by evaluating how well they preserve information about the experimental conditions (e.g. strain, time of day, optogenetic stimulation) and animal behavior. We test multiple state-of-the-art self-supervised video and trajectory representation learning methods to demonstrate the use of our benchmark, revealing that methods developed using human action datasets do not fully translate to animal datasets. We hope that our benchmark and dataset encourage a broader exploration of behavior representation learning methods across species and settings.
Jennifer J. Sun, Markus Marks, Andrew Ulmer, Dipam Chakraborty, Brian Geuther, Edward Hayes, Heng Jia, Sebastian Oleszko, Zachary Partridge, Milan Peelman, Alice Robie, Catherine E. Schretter, Keith Sheppard, Param Uttarwar, Julian Morgan Wagner, Erik Werner, Joseph Parker, Pietro Perona, Yisong Yue, Kristin Branson, Ann Kennedy
ICML7