Demo Data from SIGIR 2026 / reviewers in the wild / expert
Heng Jia
dblp:324/8343
· DBLP profile ↗
4ranked-venue papers
3as first author
4since 2021 · last 2026
0000-0001-8062-9455ORCID · corroborated
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 3 · 3 first-author · 3 since 2021Artificial intelligence and machine learning · 2 · 1 first-author · 2 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
3 papers |
3D vision · 34% Representation and self-supervised learning · 20% Vision and language · 11% | |
| Computer graphics and multimedia
1 paper |
Rendering · 100% |
Topics — the 14 heaviest of 16, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computer vision › 3D vision
3d reconstruction |
0.9 | 1 | 2025 | H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025 |
Computer vision › 3D vision › 3d reconstruction
multi-view reconstruction |
0.9 | 1 | 2025 | H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025 |
Rendering › gaussian splatting
3d gaussian splatting |
0.9 | 1 | 2025 | H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025 |
Rendering
neural rendering |
0.9 | 1 | 2025 | H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025 |
Machine learning › Deep learning architectures and training
mixture of experts |
0.8 | 1 | 2024 | MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024 |
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning |
0.8 | 1 | 2024 | MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024 |
Computer vision › Vision and language
video captioning |
0.8 | 1 | 2024 | MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024 |
Machine learning › Representation and self-supervised learning › representation learning
behavior representation learning |
0.7 | 1 | 2023 | MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023 |
Machine learning › Representation and self-supervised learning › representation learning › unsupervised representation learning
self-supervised representation learning |
0.7 | 1 | 2023 | MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023 |
Computer vision › Video understanding and tracking
video representation learning |
0.7 | 1 | 2023 | MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023 |
Computer vision › 3D vision › depth estimation › multi-task depth estimation
depth and pose estimation |
0.3 | 1 | 2025 | H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025 |
Computer vision › 3D vision › 3d reconstruction › learning-based 3d reconstruction
feed-forward reconstruction |
0.3 | 1 | 2025 | H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction · ICCV 2025 |
Machine learning › Generative modeling
synthetic data generation |
0.2 | 1 | 2024 | MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning · ACM Multimedia 2024 |
Bioinformatics and computational biology › behavioral analysis
animal behavior analysis |
0.2 | 1 | 2023 | MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior · ICML 2023 |
Methods — techniques the papers use, named apart from their topics
transformer · 1.7plücker coordinates · 1.7latent volume fusion · 1.7epipolar constraint · 1.7self-supervised learning · 1.3pose tracking · 1.3scale and shift adaptation · 0.8mixture of experts · 0.8large language model prompting · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | GAS: Geometry-Appearance Synergy for Consistent Video Customization
Heng Jia, Na Zhao 0004, Yunqiu Xu, Linchao Zhu, Yi Yang 0001 |
MMM (1) | 1 |
| 2025 | H3R: Hybrid Multi-view Correspondence for Generalizable 3D ReconstructionabstractDespite recent advances in feed-forward 3D Gaussian Splatting, generalizable 3D reconstruction remains challenging, particularly in multi-view correspondence modeling. Existing approaches face a fundamental trade-off: explicit methods achieve geometric precision but struggle with ambiguous regions, while implicit methods provide robustness but suffer from slow convergence. We present H3R, a hybrid framework that addresses this limitation by integrating volumetric latent fusion with attention-based feature aggregation. Our framework consists of two complementary components: an efficient latent volume that enforces geometric consistency through epipolar constraints, and a camera-aware Transformer that leverages Plücker coordinates for adaptive correspondence refinement. By integrating both paradigms, our approach enhances generalization while converging 2$\times$ faster than existing methods. Furthermore, we show that spatial-aligned foundation models (e.g., SD-VAE) substantially outperform semantic-aligned models (e.g., DINOv2), resolving the mismatch between semantic representations and spatial reconstruction requirements. Our method supports variable-number and high-resolution input views while demonstrating robust cross-dataset generalization. Extensive experiments show that our method achieves state-of-the-art performance across multiple benchmarks, with significant PSNR improvements of 0.59 dB, 1.06 dB, and 0.22 dB on the RealEstate10K, ACID, and DTU datasets, respectively. Code is available at https://github.com/JiaHeng-DLUT/H3R. Heng Jia, Linchao Zhu, Na Zhao 0004 |
ICCV | 1 |
| 2024 | MoS2: Mixture of Scale and Shift Experts for Text-Only Video CaptioningabstractVideo captioning is a challenging task and typically requires paired video-text data for training. However, manually annotating coherent textual descriptions for videos is laborious and time-consuming. To address this challenge, we propose a novel approach that enhances video captioning using only synthetic text data. Leveraging the exceptional text generation capabilities of large language models (LLMs), we produce high-quality and diverse video captions tailored to the target domain. Our approach employs a two-stage prompting strategy: first prompt GPT-4 with few-shot target-domain captions to create a set of high-quality captions, and then continue prompting with the generated captions to acquire large-scale synthetic data. To effectively utilize these captions, we introduce Mixture of Scale and Shift experts (MoS2), an efficient adaptation method for pre-trained captioning models. MoS2 employs lightweight routing networks to estimate probability distributions over a collection of scale and shift experts, dynamically allocating tokens to the appropriate experts. This dynamic adjustment mechanism enhances the model's ability to handle data variations and mitigates the distribution shift between synthetic and real captions. Moreover, our method reduces the number of learnable parameters, facilitating more efficient adaptation. Our method achieves superior performance with only synthetic text data, narrowing the gap between zero-shot and fine-tuned models and reducing the dependency on paired data from the target domain. Heng Jia, Yunqiu Xu, Linchao Zhu, Yi Yang 0001 |
ACM Multimedia | 1 |
| 2023 | MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of BehaviorabstractWe introduce MABe22, a large-scale, multi-agent video and trajectory benchmark to assess the quality of learned behavior representations. This dataset is collected from a variety of biology experiments, and includes triplets of interacting mice (4.7 million frames video+pose tracking data, 10 million frames pose only), symbiotic beetle-ant interactions (10 million frames video data), and groups of interacting flies (4.4 million frames of pose tracking data). Accompanying these data, we introduce a panel of real-life downstream analysis tasks to assess the quality of learned representations by evaluating how well they preserve information about the experimental conditions (e.g. strain, time of day, optogenetic stimulation) and animal behavior. We test multiple state-of-the-art self-supervised video and trajectory representation learning methods to demonstrate the use of our benchmark, revealing that methods developed using human action datasets do not fully translate to animal datasets. We hope that our benchmark and dataset encourage a broader exploration of behavior representation learning methods across species and settings. Jennifer J. Sun, Markus Marks, Andrew Ulmer, Dipam Chakraborty, Brian Geuther, Edward Hayes, Heng Jia, Sebastian Oleszko, Zachary Partridge, Milan Peelman, Alice Robie, Catherine E. Schretter, Keith Sheppard, Param Uttarwar, Julian Morgan Wagner, Erik Werner, Joseph Parker, Pietro Perona, Yisong Yue, Kristin Branson, Ann Kennedy |
ICML | 7 |