Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.

Umar Riaz Muhammad

dblp:191/2703 · DBLP profile ↗
← Back
5ranked-venue papers
3as first author
0since 2021 · last 2020
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 4 · 2 first-authorArtificial intelligence and machine learning · 3 · 3 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Reinforcement learning · 100%
Computer graphics and multimedia
2 papers
Visual content generation and editing · 40% Rendering · 30% Multimedia analysis and retrieval · 30%
Human-computer interaction and pervasive computing
1 paper
Games and playful interaction · 100%

Topics — the 4 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Visual content generation and editing
sketch generation
0.412020
Pixelor: a competitive sketching AI agent. so you think you can sketch? · ACM Trans. Graph. 2020
Machine learning › Reinforcement learning
goal-driven learning
0.412019
Goal-Driven Sequential Data Abstraction · ICCV 2019
Rendering › non-photorealistic rendering
sketch abstraction
0.312018
Learning Deep Sketch Abstraction · CVPR 2018
Multimedia analysis and retrieval › image analysis
sketch analysis
0.312018
Learning Deep Sketch Abstraction · CVPR 2018

Methods — techniques the papers use, named apart from their topics

wasserstein autoencoder · 1.3sequence-to-sequence learning · 1.3optimal transport loss · 1.3neural sorting · 1.3reinforcement learning · 0.4deep learning · 0.3
YearPublicationVenuePosition
2020 Pixelor: a competitive sketching AI agent. so you think you can sketch?
abstract
We present the first competitive drawing agent Pixelor that exhibits humanlevel performance at a Pictionary-like sketching game, where the participant whose sketch is recognized first is a winner. Our AI agent can autonomously sketch a given visual concept, and achieve a recognizable rendition as quickly or faster than a human competitor. The key to victory for the agent's goal is to learn the optimal stroke sequencing strategies that generate the most recognizable and distinguishable strokes first. Training Pixelor is done in two steps. First, we infer the stroke order that maximizes early recognizability of human training sketches. Second, this order is used to supervise the training of a sequence-to-sequence stroke generator. Our key technical contributions are a tractable search of the exponential space of orderings using neural sorting; and an improved Seq2Seq Wasserstein (S2S-WAE) generator that uses an optimal-transport loss to accommodate the multi-modal nature of the optimal stroke distribution. Our analysis shows that Pixelor is better than the human players of the Quick, Draw! game, under both AI and human judging of early recognition. To analyze the impact of human competitors' strategies, we conducted a further human study with participants being given unlimited thinking time and training in early recognizability by feedback from an AI judge. The study shows that humans do gradually improve their strategies with training, but overall Pixelor still matches human performance. The code and the dataset are available at http://sketchx.ai/pixelor.
Ayan Kumar Bhunia, Ayan Das 0003, Umar Riaz Muhammad, Yongxin Yang, Timothy M. Hospedales, Tao Xiang 0002, Yulia Gryaditskaya, Yi-Zhe Song
ACM Trans. Graph.3
2019 Goal-Driven Sequential Data Abstraction
abstract
Automatic data abstraction is an important capability for both benchmarking machine intelligence and supporting summarization applications. In the former one asks whether a machine can `understand' enough about the meaning of input data to produce a meaningful but more compact abstraction. In the latter this capability is exploited for saving space or human time by summarizing the essence of input data. In this paper we study a general reinforcement learning based framework for learning to abstract sequential data in a goal-driven way. The ability to define different abstraction goals uniquely allows different aspects of the input data to be preserved according to the ultimate purpose of the abstraction. Our reinforcement learning objective does not require human-defined examples of ideal abstraction. Importantly our model processes the input sequence holistically without being constrained by the original input order. Our framework is also domain agnostic -- we demonstrate applications to sketch, video and text data and achieve promising results in all domains.
Umar Riaz Muhammad, Yongxin Yang, Timothy M. Hospedales, Tao Xiang 0002, Yi-Zhe Song
ICCV1
2018 Learning Deep Sketch Abstraction
Umar Riaz Muhammad, Yongxin Yang, Yi-Zhe Song, Tao Xiang 0002, Timothy M. Hospedales
CVPR1
2018 Hair detection, segmentation, and hairstyle classification in the wild
Umar Riaz Muhammad, Michele Svanera, Riccardo Leonardi, Sergio Benini
Image Vis. Comput.1
2016 Figaro, hair detection and segmentation in the wild
abstract
Hair is one of the elements that mostly characterize people appearance. Being able to detect hair in images can be useful in many applications, such as face recognition, gender classification, and video surveillance. To this purpose we propose a novel multi-class image database for hair detection in the wild, called Figaro. We tackle the problem of hair detection without relying on a-priori information related to head shape and location. Without using any human-body part classifier, we first classify image patches into hair vs. non-hair by relying on Histogram of Gradients (HOG) and Linear Ternary Pattern (LTP) texture features in a random forest scheme. Then we obtain results at pixel level by refining classified patches by a graph-based multiple segmentation method. Achieved segmentation accuracy (85%) is comparable to state-of-the-art on less challenging databases.
Michele Svanera, Umar Riaz Muhammad, Riccardo Leonardi, Sergio Benini
ICIP2