Demo Data from SIGIR 2026 / reviewers in the wild / expert
Jiacheng Bao
dblp:364/5281
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · unresolved
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Generative modeling · 100% |
Topics — the 4 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Generative modeling › diffusion model
conditional generation |
0.8 | 1 | 2024 | OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024 |
Machine learning › Generative modeling › diffusion model
controlnet |
0.8 | 1 | 2024 | OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024 |
Machine learning › Generative modeling
diffusion model |
0.8 | 1 | 2024 | OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024 |
Machine learning › Generative modeling › diffusion model › human motion generation
text-to-motion generation |
0.8 | 1 | 2024 | OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024 |
Methods — techniques the papers use, named apart from their topics
mixture of controllers · 0.8cross-attention · 0.8CLIP embedding · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | OMG: Towards Open-vocabulary Motion Generation via Mixture of ControllersabstractWe have recently seen tremendous progress in realistic text-to-motion generation. Yet, the existing methods of-ten fail or produce implausible motions with unseen text inputs, which limits the applications. In this paper, we present OMG, a novel framework, which enables compelling motion generation from zero-shot open-vocabulary text prompts. Our key idea is to carefully tailor the pretrain-then-finetune paradigm into the text-to-motion generation. At the pre-training stage, our model improves the gener-ation ability by learning the rich out-of-domain inherent motion traits. To this end, we scale up a large unconditional diffusion model up to 1B parameters, so as to utilize the massive unlabeled motion data up to over 20M motion instances. At the subsequent fine-tuning stage, we intro-duce motion ControlNet, which incorporates text prompts as conditioning information, through a trainable copy of the pre-trained model and the proposed novel Mixture-of-Controllers (MoC) block. MoC block adaptively rec-ognizes various ranges of the sub-motions with a cross-attention mechanism and processes them separately with the text-token-specific experts. Such a design effectively aligns the CLIP token embeddings of text prompts to var-ious ranges of compact and expressive motion features. Ex-tensive experiments demonstrate that our OMG achieves significant improvements over the state-of-the-art meth-ods on zero-shot text-to-motion generation. Project page: https://tr3e.github.io/omg-page. Jiacheng Bao, Ruichi Zhang, Sihan Ren, Yuecheng Xu, Sibei Yang, Xin Chen 0040, Jingyi Yu 0001, Lan Xu 0003 |
CVPR | 2 |