Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Jiacheng Bao

dblp:364/5281 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · unresolved

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Generative modeling · 100%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling › diffusion model
conditional generation
0.812024
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024
Machine learning › Generative modeling › diffusion model
controlnet
0.812024
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024
Machine learning › Generative modeling
diffusion model
0.812024
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024
Machine learning › Generative modeling › diffusion model › human motion generation
text-to-motion generation
0.812024
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers · CVPR 2024

Methods — techniques the papers use, named apart from their topics

mixture of controllers · 0.8cross-attention · 0.8CLIP embedding · 0.8
YearPublicationVenuePosition
2024 OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers
abstract
We have recently seen tremendous progress in realistic text-to-motion generation. Yet, the existing methods of-ten fail or produce implausible motions with unseen text inputs, which limits the applications. In this paper, we present OMG, a novel framework, which enables compelling motion generation from zero-shot open-vocabulary text prompts. Our key idea is to carefully tailor the pretrain-then-finetune paradigm into the text-to-motion generation. At the pre-training stage, our model improves the gener-ation ability by learning the rich out-of-domain inherent motion traits. To this end, we scale up a large unconditional diffusion model up to 1B parameters, so as to utilize the massive unlabeled motion data up to over 20M motion instances. At the subsequent fine-tuning stage, we intro-duce motion ControlNet, which incorporates text prompts as conditioning information, through a trainable copy of the pre-trained model and the proposed novel Mixture-of-Controllers (MoC) block. MoC block adaptively rec-ognizes various ranges of the sub-motions with a cross-attention mechanism and processes them separately with the text-token-specific experts. Such a design effectively aligns the CLIP token embeddings of text prompts to var-ious ranges of compact and expressive motion features. Ex-tensive experiments demonstrate that our OMG achieves significant improvements over the state-of-the-art meth-ods on zero-shot text-to-motion generation. Project page: https://tr3e.github.io/omg-page.
Jiacheng Bao, Ruichi Zhang, Sihan Ren, Yuecheng Xu, Sibei Yang, Xin Chen 0040, Jingyi Yu 0001, Lan Xu 0003
CVPR2