Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Mohammed M. Alghamdi

dblp:329/4913 · DBLP profile ↗
← Back
1ranked-venue papers
1as first author
1since 2021 · last 2022
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Generative modeling · 87% Language models and text generation · 13%
Computer graphics and multimedia
1 paper
Visual content generation and editing · 100%

Topics — the 3 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling › image generation
GAN-based image generation
0.612022
Talking Head from Speech Audio using a Pre-trained Image Generator · ACM Multimedia 2022
Machine learning › Generative modeling › generative adversarial network › StyleGAN
StyleGAN latent space manipulation
0.612022
Talking Head from Speech Audio using a Pre-trained Image Generator · ACM Multimedia 2022
Visual content generation and editing
talking head generation
0.612022
Talking Head from Speech Audio using a Pre-trained Image Generator · ACM Multimedia 2022

Methods — techniques the papers use, named apart from their topics

recurrent neural network · 1.1latent space trajectory modeling · 1.1generator fine-tuning · 1.1convolutional neural network · 1.1
YearPublicationVenuePosition
2022 Talking Head from Speech Audio using a Pre-trained Image Generator
abstract
We propose a novel method for generating high-resolution videos of talking-heads from speech audio and a single 'identity' image. Our method is based on a convolutional neural network model that incorporates a pre-trained StyleGAN generator. We model each frame as a point in the latent space of StyleGAN so that a video corresponds to a trajectory through the latent space. Training the network is in two stages. The first stage is to model trajectories in the latent space conditioned on speech utterances. To do this, we use an existing encoder to invert the generator, mapping from each video frame into the latent space. We train a recurrent neural network to map from speech utterances to displacements in the latent space of the image generator. These displacements are relative to the back-projection into the latent space of an identity image chosen from the individuals depicted in the training dataset. In the second stage, we improve the visual quality of the generated videos by tuning the image generator on a single image or a short video of any chosen identity. We evaluate our model on standard measures (PSNR, SSIM, FID and LMD) and show that it significantly outperforms recent state-of-the-art methods on one of two commonly used datasets and gives comparable performance on the other. Finally, we report on ablation experiments that validate the components of the model. The code and videos from experiments can be found at https://mohammedalghamdi.github.io/talking-heads-acm-mm/
Mohammed M. Alghamdi, He Wang 0002, Andrew J. Bulpitt, David C. Hogg
ACM Multimedia1