Demo Data from SIGIR 2026 / reviewers in the wild / expert
Mingwu Song
dblp:32/952
· DBLP profile ↗
3ranked-venue papers
0as first author
2since 2021 · last 2022
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 since 2021Human-computer interaction and ubiquitous computing · 2 · 2 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Human-computer interaction and pervasive computing
1 paper |
Wearable and physiological sensing · 87% Immersive interaction · 13% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Wearable and physiological sensing
eye-head coordination |
0.6 | 1 | 2022 | Real-time Gaze Tracking with Head-eye Coordination for Head-mounted Displays · ISMAR 2022 |
Wearable and physiological sensing
eye tracking |
0.6 | 1 | 2022 | Real-time Gaze Tracking with Head-eye Coordination for Head-mounted Displays · ISMAR 2022 |
Immersive interaction › head-mounted display
augmented reality head-mounted display |
0.2 | 1 | 2022 | Real-time Gaze Tracking with Head-eye Coordination for Head-mounted Displays · ISMAR 2022 |
Methods — techniques the papers use, named apart from their topics
multi-modal network · 0.6dataset construction · 0.6
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2022 | Improved Word-level Lipreading with Temporal Shrinkage Network and NetVLADabstractIn most word-level lipreading architectures of recent years, temporal feature extraction module tend to employ Multi-scale Temporal Convolution Network (MS-TCN). In our experiments, we have noticed it is hard for MS-TCN to deal with noise information that may contain in image sequences. In order to solve the problems, we propose a lipreading architecture based on temporal shrinkage network and NetVLAD. We first propose Temporal Shrinkage Unit according to Residual Shrinkage Network and then replace temporal convolution unit with it. The improved network which named Multi-scale Temporal Shrinkage Network (MS-TSN) could focus more on relevant information. Following with MS-TSN that deals with noise frames, NetVLAD is proposed to integrate local information into global feature. Compared with Global Average Pooling, NetVLAD could extract key features by clustering. Our experiments on Lipreading in the Wild (LRW) show that the architecture we propose achieves an accuracy of 89.41%, attaining new state-of-the-art in word-level lipreading. In addition, we build a new Mandarin Chinese lipreading dataset named MCLR-100 and verify our proposed architecture on it. Tao Luo 0010, Yakun Zhang 0002, Mingwu Song, Liang Xie 0012, Ye Yan 0001, Erwei Yin |
ICMI | 4 |
| 2022 | Real-time Gaze Tracking with Head-eye Coordination for Head-mounted DisplaysabstractHigh-accuracy, low-latency gaze tracking is becoming one of the indispensable features in augmented reality (AR) head-mounted devices (HMDs). Researchers have proposed different approaches to predict gaze positions from eye images. However, since only the eye modality is focused, these appearance-based algorithms are still struggle to trade off the accuracy and running speed in HMDs. In this paper, we propose a lightweight multi-modal network (HE-Tracker) to regress gaze positions. By fusing head-movement features with eye features, HE-Tracker achieves comparable accuracy (3.655° in all subjects) and $27 \times$ speedup (48 fps in the specialized AR HMD) compared to the state-of-the-art gaze tracking algorithm. We further demonstrate that when applying our head-eye coordination strategy to other baseline models, all these models achieve at least 6.36% performance improvement without a pronounced effect on running speed. Moreover, we construct HE-Gaze, the first multi-modal dataset with eye images and head-movement data for near-eye gaze tracking. This dataset is currently made of 757,360 frames and 15 persons, providing an opportunity to foster research in multi-modal gaze tracking approaches. Our dataset is available at DOWNLOAD LINK1. Lingling Chen, Yingxi Li, Xiaowei Bai, Yongqiang Hu, Mingwu Song, Liang Xie 0012, Ye Yan 0001, Erwei Yin |
ISMAR | 6 |
| 2006 | Detection of LSB Steganography based on Image SmoothnessabstractThe detection of LSB steganography is a question of common interest in the research of steganalysis techniques. In this paper, the distribution of the difference between the current pixel value and its neighborhood average pixel value is statistically modeled, and then the variance of this statistical distribution is defined as a measurement of image smoothness. Based on the analysis of the effects on the image smoothness brought by message embedding and LSB plane flipping, a new steganalytic technique capable of reliable detection of spatial LSB steganography is proposed. The algorithm can exactly estimate the amount of hidden messages and detect the existence of hidden messages embedded in the image simultaneously. Experimental results show that the proposed algorithm is effective Tao Zhang 0031, Yan Zhang 0010, Xijian Ping, Mingwu Song |
ICME | 4 |