Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Seoyoung Lee 0001

dblp:16/2117-1 · DBLP profile ↗
← Back
4ranked-venue papers
1as first author
4since 2021 · last 2024
—ORCID · unresolved

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 1 first-author · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
3D vision · 100%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › 3D vision › neural rendering
3d gaussian splatting
0.812024
Expressive Gaussian Human Avatars from Monocular RGB Video · NeurIPS 2024
Computer vision › 3D vision › 3d human reconstruction
human avatar reconstruction
0.812024
Expressive Gaussian Human Avatars from Monocular RGB Video · NeurIPS 2024
Computer vision › 3D vision › 3d human reconstruction › human avatar reconstruction
monocular human avatar
0.812024
Expressive Gaussian Human Avatars from Monocular RGB Video · NeurIPS 2024
Computer vision › 3D vision › 3d human reconstruction
parametric body model
0.212024
Expressive Gaussian Human Avatars from Monocular RGB Video · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

per-pixel confidence prediction · 0.8adaptive density control · 0.8SMPL-X fitting · 0.8
YearPublicationVenuePosition
2024 Expressive Gaussian Human Avatars from Monocular RGB Video
abstract
Nuanced expressiveness, especially through detailed hand and facial expressions, is pivotal for enhancing the realism and vitality of digital human representations. In this work, we aim to learn expressive human avatars from a monocular RGB video; a setting that introduces new challenges in capturing and animating fine-grained details. To this end, we introduce EVA, a drivable human model that can recover fine details based on 3D Gaussians and an expressive parametric human model, SMPL-X. Focused on enhancing expressiveness, our work makes three key contributions. First, we highlight the importance of aligning the SMPL-X model with the video frames for effective avatar learning. Recognizing the limitations of current methods for estimating SMPL-X parameters from in-the-wild videos, we introduce a reconstruction module that significantly improves the image-model alignment. Second, we propose a context-aware adaptive density control strategy, which is adaptively adjusting the gradient thresholds to accommodate the varied granularity across body parts. Third, we develop a feedback mechanism that predicts per-pixel confidence to better guide the optimization of 3D Gaussians. Extensive experiments on two benchmarks demonstrate the superiority of our approach both quantitatively and qualitatively, especially on the fine-grained hand and facial details. We make our code available at the project website: https://evahuman.github.io.
Hezhen Hu, Zhiwen Fan, Yihan Xi, Seoyoung Lee 0001, Georgios Pavlakos, Zhangyang Wang
NeurIPS5
2024 PoseDiff: Pose-conditioned Multimodal Diffusion Model for Unbounded Scene Synthesis from Sparse Inputs
abstract
Novel view synthesis has been heavily driven by NeRF-based models, but these models often hold limitations with the requirement of dense coverage of input views and expensive computations. NeRF models designed for scenarios with a few sparse input views face difficulty in being generalizable to complex or unbounded scenes, where multiple scene content can be at any distance from a multi-directional camera, and thus generate unnatural and low quality images with blurry or floating artifacts. To accommodate the lack of dense information in sparse view scenarios and the computational burden of NeRF-based models in novel view synthesis, our approach adopts diffusion models. In this paper, we present PoseDiff, which combines the fast and plausible generation ability of diffusion models and 3D-aware view consistency of pose parameters from NeRF-based models. Specifically, PoseDiff is a multimodal pose-conditioned diffusion model applicable for novel view synthesis of unbounded scenes as well as bounded or forward-facing scenes with sparse views. PoseDiff renders plausible novel views for given pose parameters while maintaining high-frequency geometric details in significantly less time than conventional NeRF-based methods.
Seoyoung Lee 0001, Joonseok Lee
WACV1
2022 Learning to Wear: Details-Preserved Virtual Try-on via Disentangling Clothes and Wearer
Seoyoung Lee 0001, Joonseok Lee
BMVC2
2022 Towards Efficient Neural Scene Graphs by Learning Consistency Fields
Yeji Song, Chaerin Kong, Seoyoung Lee 0001, Nojun Kwak, Joonseok Lee
BMVC3