Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Marcos Nunes-Ueno

dblp:374/8748 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2024
0009-0006-0863-3904ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Human-computer interaction and ubiquitous computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Human-computer interaction and pervasive computing
1 paper
Interaction techniques and input · 50% Immersive interaction · 50%
Artificial intelligence
1 paper
3D vision · 100%

Topics — the 2 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Interaction techniques and input › input sensing › gesture recognition
micro-gesture recognition
0.812024
STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input · CHI 2024
Computer vision › 3D vision › motion capture
skeleton tracking
0.212024
STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input · CHI 2024

Methods — techniques the papers use, named apart from their topics

machine learning · 1.5
YearPublicationVenuePosition
2024 STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input
abstract
AR/VR devices have started to adopt hand tracking, in lieu of controllers, to support user interaction. However, today’s hand input rely primarily on one gesture: pinch. Moreover, current mappings of hand motion to use cases like VR locomotion and content scrolling involve more complex and larger arm motions than joystick or trackpad usage. STMG increases the gesture space by recognizing additional small thumb-based microgestures from skeletal tracking running on a headset. We take a machine learning approach and achieve a 95.1% recognition accuracy across seven thumb gestures performed on the index finger surface: four directional thumb swipes (left, right, forward, backward), thumb tap, and fingertip pinch start and pinch end. We detail the components to our machine learning pipeline and highlight our design decisions and lessons learned in producing a well generalized model. We then demonstrate how these microgestures simplify and reduce arm motions for hand-based locomotion and scrolling interactions.
Kenrick Kin, Chengde Wan, Ken Koh, Andrei Marin, Necati Cihan Camgöz, Yujun Cai, Fedor Kovalev, Moshe Ben-Zacharia, Shannon Hoople, Marcos Nunes-Ueno, Mariel Sanchez-Rodriguez, Ayush Bhargava, Robert Wang 0002, Eric Sauser, Shugao Ma
CHI11