Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Naveen Reddy Desanur

dblp:377/6794 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Vision and language · 100%

Topics — the 2 heaviest of 2, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › Vision and language › caption generation
image and video captioning
0.812024
MICap: A Unified Model for Identity-Aware Movie Descriptions · CVPR 2024
Computer vision › Vision and language › image captioning
image caption evaluation
0.812024
MICap: A Unified Model for Identity-Aware Movie Descriptions · CVPR 2024

Methods — techniques the papers use, named apart from their topics

scene graph · 0.8fill-in-the-blanks · 0.8autoregressive decoder · 0.8
YearPublicationVenuePosition
2024 MICap: A Unified Model for Identity-Aware Movie Descriptions
abstract
Characters are an important aspect of any storyline and identifying and including them in descriptions is necessary for story understanding. While previous work has largely ignored identity and generated captions with some-one (anonymized names), recent work formulates id-aware captioning as a fill-in-the-blanks (FITB) task, where, given a caption with blanks, the goal is to predict person id labels. However, to predict captions with ids, a two-stage approach is required: first predict captions with someone, then fill in identities. In this work, we present a new single stage approach that can seamlessly switch between id-aware caption generation or FITB when given a caption with blanks. Our model, Movie-Identity Captioner (MI-Cap), uses a shared auto-regressive decoder that benefits from training with FITB and full-caption generation ob-jectives, while the encoder can benefit from or disregard captions with blanks as input. Another challenge with id-aware captioning is the lack of a metric to capture subtle differences between person ids. To this end, we introduce iSPICE, a caption evaluation metric that focuses on identity tuples created through intermediate scene graphs. We eval-uate MICap on Large-Scale Movie Description Challenge (LSMDC), where we show a 4.2% improvement in FITB accuracy, and a 1-2% bump in classic captioning metrics.
Haran Raajesh, Naveen Reddy Desanur, Zeeshan Khan, Makarand Tapaswi
CVPR2