Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Hyeonyu Kim

dblp:323/4624 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2023
—ORCID · unresolved

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Generative modeling · 100%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling › cross-modal generation
audio-to-image generation
0.712023
Generating Realistic Images from In-the-wild Sounds · ICCV 2023
Machine learning › Generative modeling
cross-modal generation
0.712023
Generating Realistic Images from In-the-wild Sounds · ICCV 2023
Machine learning › Generative modeling
diffusion model
0.712023
Generating Realistic Images from In-the-wild Sounds · ICCV 2023
Machine learning › Generative modeling › diffusion model
text-to-image generation
0.712023
Generating Realistic Images from In-the-wild Sounds · ICCV 2023

Methods — techniques the papers use, named apart from their topics

sentence attention · 0.7diffusion model · 0.7audio captioning · 0.7audio attention · 0.7CLIPScore · 0.7AudioCLIP · 0.7
YearPublicationVenuePosition
2023 Generating Realistic Images from In-the-wild Sounds
abstract
Representing wild sounds as images is an important but challenging task due to the lack of paired datasets between sound and images and the significant differences in the characteristics of these two modalities. Previous studies have focused on generating images from sound in limited categories or music. In this paper, we propose a novel approach to generate images from in-the-wild sounds. First, we convert sound into text using audio captioning. Second, we propose audio attention and sentence attention to represent the rich characteristics of sound and visualize the sound. Lastly, we propose a direct sound optimization with CLIPscore and AudioCLIP and generate images with a diffusion-based model. In experiments, it shows that our model is able to generate high quality images from wild sounds and outperforms baselines in both quantitative and qualitative evaluations on wild audio datasets.
Taegyeong Lee, Jeonghun Kang, Hyeonyu Kim, Taehwan Kim 0013
ICCV3