Demo Data from SIGIR 2026 / reviewers in the wild / expert
Haoyuan Guo
dblp:264/6693
· DBLP profile ↗
9ranked-venue papers
2as first author
7since 2021 · last 2025
0009-0009-2994-3823ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 6 · 1 first-author · 6 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 since 2021Computer networks · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 first-author
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
5 papers |
Vision and language · 38% Generative modeling · 19% Language models and text generation · 15% | |
| Computer networks
1 paper |
Physical-layer communications · 77% Internet of things and sensor networks · 12% Edge and fog computing · 12% |
Topics — the 17 heaviest of 18, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Generative modeling › autoregressive model
autoregressive image generation |
0.9 | 1 | 2025 | Parallelized Autoregressive Visual Generation · CVPR 2025 |
Machine learning › Efficient and distributed learning
inference acceleration |
0.9 | 1 | 2025 | Parallelized Autoregressive Visual Generation · CVPR 2025 |
Natural language and speech › Language models and text generation › decoding › decoding strategy
parallel decoding |
0.9 | 1 | 2025 | Parallelized Autoregressive Visual Generation · CVPR 2025 |
Physical-layer communications
channel modeling |
0.9 | 1 | 2025 | Demo: Immersive Digital Twin Networks for Industrial Internet of Things · MobiCom 2025 |
Physical-layer communications › radio propagation
ray-tracing |
0.9 | 1 | 2025 | Demo: Immersive Digital Twin Networks for Industrial Internet of Things · MobiCom 2025 |
Machine learning › Representation and self-supervised learning › contrastive learning
contrastive alignment |
0.8 | 1 | 2024 | Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment · NeurIPS 2024 |
Computer vision › Vision and language
multimodal data generation |
0.8 | 1 | 2024 | World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering · EMNLP 2024 |
Computer vision › Vision and language
vision-language model |
0.8 | 1 | 2024 | Unveiling the Tapestry of Consistency in Large Vision-Language Models · NeurIPS 2024 |
Computer vision › Vision and language › vision-language model
vision-language model alignment |
0.8 | 1 | 2024 | Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment · NeurIPS 2024 |
Computer vision › Image recognition and object detection › object recognition
object verification |
0.4 | 1 | 2020 | A Novel Symmetry Driven Siamese Network for THz Concealed Object Verification · IEEE Trans. Image Process. 2020 |
Machine learning › Generative modeling
image generation |
0.3 | 1 | 2025 | Parallelized Autoregressive Visual Generation · CVPR 2025 |
Machine learning › Generative modeling
video generation |
0.3 | 1 | 2025 | Parallelized Autoregressive Visual Generation · CVPR 2025 |
Edge and fog computing › digital twin
digital twin network |
0.3 | 1 | 2025 | Demo: Immersive Digital Twin Networks for Industrial Internet of Things · MobiCom 2025 |
Internet of things and sensor networks
industrial iot |
0.3 | 1 | 2025 | Demo: Immersive Digital Twin Networks for Industrial Internet of Things · MobiCom 2025 |
Natural language and speech › Language models and text generation › text generation › neural text generation
autoregressive text generation |
0.2 | 1 | 2024 | Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment · NeurIPS 2024 |
Computer vision › Vision and language
caption generation |
0.2 | 1 | 2024 | Unveiling the Tapestry of Consistency in Large Vision-Language Models · NeurIPS 2024 |
Computer vision › Vision and language › vision-language dataset
vision-language model training data |
0.2 | 1 | 2024 | World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and Filtering · EMNLP 2024 |
Methods — techniques the papers use, named apart from their topics
token dependency analysis · 0.9sparse ray tracing · 0.9autoregressive modeling · 0.9adaptive sampling · 0.9AI-based channel prediction · 0.9gaussian mixture model · 0.9contrastive loss · 0.9trigger-based diagnostic refinement · 0.8token reweighting · 0.8self-instructed compositional captioning · 0.8contrastive learning · 0.8consistency filtering · 0.8benchmark construction · 0.8siamese network · 0.4
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Parallelized Autoregressive Visual GenerationabstractAutoregressive models have emerged as a powerful approach for visual generation but suffer from slow inference speed due to their sequential token-by-token prediction process. In this paper, we propose a simple yet effective approach for parallelized autoregressive visual generation that improves generation efficiency while preserving the advantages of autoregressive modeling. Our key insight is that parallel generation depends on visual token dependencies—tokens with weak dependencies can be generated in parallel, while strongly dependent adjacent tokens are difficult to generate together, as their independent sampling may lead to inconsistencies. Based on this observation, we develop a parallel generation strategy that generates distant tokens with weak dependencies in parallel while maintaining sequential generation for strongly dependent local tokens. Our approach can be seamlessly integrated into standard autoregressive models without modifying the architecture or tokenizer. Experiments on ImageNet and UCF-101 demonstrate that our method achieves a 3.6× speedup with comparable quality and up to 9.5× speedup with minimal quality degradation across both image and video generation tasks. We hope this work will inspire future research in efficient visual generation and unified autoregressive modeling. Project page: https://yuqingwang1029.github.io/PAR-project. Shuhuai Ren, Zhijie Lin 0001, Yujin Han, Haoyuan Guo, Zhenheng Yang, Difan Zou, Jiashi Feng, Xihui Liu |
CVPR | 5 |
| 2025 | Demo: Immersive Digital Twin Networks for Industrial Internet of ThingsabstractWith the rapid advancement of the Industrial Internet of Things (IIoT), Digital Twin Networks (DTNs) have emerged as critical enablers for industrial network optimization. However, current full-space industrial DTNs face persistent challenges: neglect of propagation-impacting industrial factors, computational inefficiency, and poor generalization in Artificial Intelligence (AI)-based prediction method. This demo establishes an immersive IIoT-DTNs framework for real logistics scenarios, where cargo stacking rates are considered as the primary industrial dynamic factor. Hence, the 3D scenes reflecting varying stacking rates are generated for Ray Tracing (RT)-based channel modeling. The proposed Adaptive Sampling-based Sparse RT Calculation (AdaSpRT) method strategically selects critical propagation areas for RT calculation, replacing random sampling. Then, AI-based channel prediction can be trained and fine-tuned with the RT data for remaining sample prediction. Evaluations across two distinct environments, high-density shelving vs. open layout, demonstrate 22.0% and 12.4% efficiency improvements over conventional RT while maintaining Mean Absolute Errors (MAE) of 3.44 dB and 1.56 dB respectively. Rui Ban, Zhigang Zhong, Zuoyong Nan, Xinmiao Chen, Haoyuan Guo, Jialin Wang 0001 |
MobiCom | 6 |
| 2025 | UVE: Are MLLMs Unified Evaluators for AI-Generated Videos?abstractWith the rapid growth of video generative models (VGMs), it is essential to develop reliable and comprehensive automatic metrics for AI-generated videos (AIGVs). Existing methods either use off-the-shelf models optimized for other tasks or rely on human assessment data to train specialized evaluators. These approaches are constrained to specific evaluation aspects and are difficult to scale with the increasing demands for finer-grained and more comprehensive evaluations. To address this issue, this work investigates the feasibility of using multimodal large language models (MLLMs) as a unified evaluator for AIGVs, leveraging their strong visual perception and language understanding capabilities. To evaluate the performance of automatic metrics in unified AIGV evaluation, we introduce a benchmark called UVE-Bench. UVE-Bench collects videos generated by state-of-the-art VGMs and provides pairwise human preference annotations across 15 evaluation aspects. Using UVE-Bench, we extensively evaluate 18 MLLMs. Our empirical results suggest that while advanced MLLMs (e.g., Qwen2VL-72B and InternVL2.5-78B) still lag behind human evaluators, they demonstrate promising ability in unified AIGV evaluation, significantly surpassing existing specialized evaluation methods. Additionally, we conduct an in-depth analysis of key design choices that impact the performance of MLLM-driven evaluators, offering valuable insights for future research on AIGV evaluation. Yuanxin Liu, Shuhuai Ren, Jiacong Wang, Haoyuan Guo |
NeurIPS | 5 |
| 2024 | World to Code: Multi-modal Data Generation via Self-Instructed Compositional Captioning and FilteringabstractRecent advances in Vision-Language Models (VLMs) and the scarcity of high-quality multimodal alignment data have inspired numerous researches on synthetic VLM data generation.The conventional norm in VLM data construction uses a mixture of specialists in caption and OCR, or stronger VLM APIs and expensive human annotation.In this paper, we present World to Code (W2C), a meticulously curated multi-modal data construction pipeline that organizes the final generation output into a Python code format.The pipeline leverages the VLM itself to extract cross-modal information via different prompts and filter the generated outputs again via a consistency filtering strategy.Experiments have demonstrated the high quality of W2C by improving various existing visual question answering and visual grounding benchmarks across different VLMs.Further analysis also demonstrates that the new code parsing ability of VLMs presents better crossmodal equivalence than the commonly used detail caption ability.Our code is available at https://github.com/foundation-multimodal- models/World2Code. Jiacong Wang, Bohong Wu, Haiyong Jiang, Haoyuan Guo, Jun Xiao 0005 |
EMNLP | 6 |
| 2024 | Unveiling the Tapestry of Consistency in Large Vision-Language ModelsabstractLarge vision-language models (LVLMs) have recently achieved rapid progress, exhibiting great perception and reasoning abilities concerning visual information. However, when faced with prompts in different sizes of solution spaces, LVLMs fail to always give consistent answers regarding the same knowledge point. This inconsistency of answers between different solution spaces is prevalent in LVLMs and erodes trust. To this end, we provide a multi-modal benchmark ConBench, to intuitively analyze how LVLMs perform when the solution space of a prompt revolves around a knowledge point. Based on the ConBench tool, we are the first to reveal the tapestry and get the following findings: (1) In the discriminate realm, the larger the solution space of the prompt, the lower the accuracy of the answers.
(2) Establish the relationship between the discriminative and generative realms: the accuracy of the discriminative question type exhibits a strong positive correlation with its Consistency with the caption. (3) Compared to open-source models, closed-source models exhibit a pronounced bias advantage in terms of Consistency. Eventually, we ameliorate the consistency of LVLMs by trigger-based diagnostic refinement, indirectly improving the performance of their caption. We hope this paper will accelerate the research community in better evaluating their models and encourage future advancements in the consistency domain. Yuan Zhang 0020, Tao Huang 0020, Chun-Kai Fan, Hongyuan Dong, Jiawen Li 0006, Jiacong Wang, Kuan Cheng, Shanghang Zhang, Haoyuan Guo |
NeurIPS | 10 |
| 2024 | Seeing the Image: Prioritizing Visual Correlation by Contrastive AlignmentabstractExisting image-text modality alignment in Vision Language Models (VLMs) treats each text token equally in an autoregressive manner. Despite being simple and effective, this method results in sub-optimal cross-modal alignment by over-emphasizing the text tokens that are less correlated with or even contradictory with the input images. In this paper, we advocate for distinct contributions for each text token based on its visual correlation. Specifically, we present by contrasting image inputs, the difference in prediction logits on each text token provides strong guidance of visual correlation. We therefore introduce Contrastive Alignment (CAL), a simple yet effective re-weighting strategy that prioritizes training visually correlated tokens. Our experimental results demonstrate that CAL consistently improves different types of VLMs across different resolutions and model sizes on various benchmark datasets. Importantly, our method incurs minimal additional computational overhead, rendering it highly efficient compared to alternative data scaling strategies. Bohong Wu, Jiacong Wang, Chunyuan Li, Haoyuan Guo |
NeurIPS | 6 |
| 2021 | A CenterNet++ model for ship detection in SAR images
Haoyuan Guo, Xi Yang 0011, Nannan Wang 0001, Xinbo Gao 0001 |
Pattern Recognit. | 1 |
| 2020 | A Rotational Libra R-CNN Method for Ship DetectionabstractRecently, ship detection methods based on deep learning have attracted significant attention due to their superior accuracy over traditional methods. However, there still exist two problems affecting its robustness in practical application. 1) The size of ships in one image varies greatly, i.e., different sizes; 2) Numerous ships gather in limited field-of-view, i.e., dense distribution. To address these problems, we propose a rotational Libra R-convolutional neural network (CNN) method. Our idea is to balance the three levels of neural networks for predicting the location of ships with rotational angle information, which refers to the feature level, sample level, and objective level. First, to extract a discriminative feature and improve its robustness against the impact of different sizes of ships, the concept of balanced feature pyramid is introduced. Second, to generate reliable proposals for feature pyramid and efficiently mine hard negative samples, we employ intersection over union (IoU)-balanced sampling. Finally, to eliminate the redundant background and detect densely distributed ships, we bring in a rotational region detection branch with balanced L1 loss. In general, we develop the balanced learning with rotational region detection to achieve consistent improvement on accuracy and visualization. Experimental results on DOTA data set show that the proposed method achieves the state-of-the-art accuracy. Haoyuan Guo, Xi Yang 0011, Nannan Wang 0001, Bin Song 0001, Xinbo Gao 0001 |
IEEE Trans. Geosci. Remote. Sens. | 1 |
| 2020 | A Novel Symmetry Driven Siamese Network for THz Concealed Object VerificationabstractSecurity inspection aims to improve the high detection rate as well as reduce the false alarm rate. However, it still suffers from two challenges affecting its robustness. 1) Existing security inspection methods are mostly designed for natural images, which cannot reflect the uniqueness and imaging principle of THz images. 2) Existing methods is sensitive to noise interference and pose variations. This work revisits these challenges and presents a novel symmetry driven Siamese network (SDSN) for THz concealed object verification. Our idea is to employ a specially designed network architecture for THz concealed object verification. First, to reflect the uniqueness and the special property of THz images, Siamese network with Contrastive loss is used for feature extraction along with symmetrical prior information consideration, which can learn symmetrical metrics from the same person. Second, to alleviate the impact of noise interference and pose variations, the adaptive identity normalization (A-IDN) is proposed to normalize the symmetrical metrics each person. Finally, to enhance the generalization of network, an adaptive selective threshold based on Gaussian mixture model (AST-GMM) is designed, which serves as a classifier for the final classification results. Extensive experiments show that SDSN significantly improves the accuracy. Specially, SDSN outperforms the state-of-the-art methods without symmetrical prior information on THz security dataset. Xi Yang 0011, Haoyuan Guo, Nannan Wang 0001, Bin Song 0001, Xinbo Gao 0001 |
IEEE Trans. Image Process. | 2 |