Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Qi Lyu

dblp:165/3049 · DBLP profile ↗
← Back
11ranked-venue papers
8as first author
9since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 9 · 7 first-author · 8 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 2 first-author · 2 since 2021Databases, data management, data science and information retrieval · 2 · 1 first-author · 2 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 1 first-author · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
6 papers
Representation and self-supervised learning · 36% Vision and language · 10% Planning, search and constraint satisfaction · 10%
Computer graphics and multimedia
1 paper
Audio and music processing · 100%

Topics — the 16 heaviest of 17, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Representation and self-supervised learning › causal representation learning
identifiability
1.732022
Provable Subspace Identification Under Post-Nonlinear Mixtures · NeurIPS 2022
On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis · ICML 2022
Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective · ICLR 2022
Machine learning › Learning paradigms
continual learning
1.012026
CRISP: Contrastive Residual Injection and Semantic Prompting for Continual Video Instance Segmentation · IEEE Trans. Image Process. 2026
Knowledge, reasoning and agents › Planning, search and constraint satisfaction
hierarchical planning
1.012026
SeqWalker: Sequential-Horizon Vision-and-Language Navigation with Hierarchical Planning · AAAI 2026
Computer vision › Segmentation and scene understanding
instance segmentation
1.012026
CRISP: Contrastive Residual Injection and Semantic Prompting for Continual Video Instance Segmentation · IEEE Trans. Image Process. 2026
Computer vision › Video understanding and tracking
video instance segmentation
1.012026
CRISP: Contrastive Residual Injection and Semantic Prompting for Continual Video Instance Segmentation · IEEE Trans. Image Process. 2026
Computer vision › Vision and language
vision-and-language navigation
1.012026
SeqWalker: Sequential-Horizon Vision-and-Language Navigation with Hierarchical Planning · AAAI 2026
Machine learning › Learning theory › statistical learning theory
finite-sample analysis
0.612022
Provable Subspace Identification Under Post-Nonlinear Mixtures · NeurIPS 2022
Machine learning › Representation and self-supervised learning
multi-view learning
0.612022
Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective · ICLR 2022
Machine learning › Representation and self-supervised learning › blind source separation › independent component analysis
nonlinear ICA
0.612022
On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis · ICML 2022
Machine learning › Representation and self-supervised learning
subspace identification
0.612022
Provable Subspace Identification Under Post-Nonlinear Mixtures · NeurIPS 2022
Machine learning › Generative modeling
music generation
0.212015
Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation · IJCAI 2015
Machine learning › Deep learning architectures and training
recurrent neural network
0.212015
Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation · IJCAI 2015
Machine learning › Deep learning architectures and training
sequence modeling
0.212015
Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation · IJCAI 2015
Audio and music processing
music information retrieval
0.212015
Polyphonic Music Modelling with LSTM-RTRBM · ACM Multimedia 2015
Audio and music processing › music analysis
polyphonic music modeling
0.212015
Polyphonic Music Modelling with LSTM-RTRBM · ACM Multimedia 2015
Machine learning › Representation and self-supervised learning
contrastive learning
0.212022
On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis · ICML 2022

Methods — techniques the papers use, named apart from their topics

contrastive learning · 1.6semantic prompting · 1.0residual injection · 1.0low-level planner · 1.0high-level planner · 1.0exploration-verification · 1.0statistical generalization analysis · 0.6numerical differentiation · 0.6identifiability analysis · 0.6block coordinate descent · 0.6restricted boltzmann machine · 0.2long short-term memory · 0.2
YearPublicationVenuePosition
2026 SeqWalker: Sequential-Horizon Vision-and-Language Navigation with Hierarchical Planning
abstract
Sequential-Horizon Vision-and-Language Navigation (SH-VLN) presents a challenging scenario where agents should sequentially execute multi-task trajectory navigation guided by complex, long-horizon natural language instructions. Current vision-and-language navigation models exhibit significant performance degradation with such instructions, as information overload impairs the agent's ability to attend to observationally relevant details. To address this problem, we propose SeqWalker, a novel navigation model built on a hierarchical planning framework. Our SeqWalker features: (1) A High-Level Planner that dynamically selects global instructions into contextually relevant sub-instructions based on the agent's current visual observations, thus reducing cognitive load; (2) A Low-Level Planner incorporating an Exploration-Verification strategy that leverages the inherent logical structure of instructions for trajectory error correction. To evaluate SH-VLN performance, we also extend the IVLN dataset and establish a new benchmark. Extensive experiments are performed to demonstrate the effectiveness and superiority of SeqWalker.
Zebin Han, Baichen Liu, Qi Lyu, Zhenduo Shang, Jiahua Dong 0001, Lianqing Liu, Zhi Han
AAAI4
2026 CRISP: Contrastive Residual Injection and Semantic Prompting for Continual Video Instance Segmentation
abstract
Continual video instance segmentation (CVIS) requires the plasticity to absorb new categories while maintaining the stability to retain previously learned knowledge. Crucially, the model must also preserve temporal consistency of instances across video frames. In this work, we introduce Contrastive Residual Injection and Semantic Prompting (CRISP), a framework tailored to address instance-wise, category-wise, and task-wise confusion in CVIS. For instance-wise learning, we model instance tracking and construct instance correlation loss, which emphasizes the correlation with the prior query space while strengthening the specificity of the current task query. For category-wise learning, we build an adaptive residual semantic prompt (ARSP) learning framework, which constructs a learnable semantic residual prompt pool generated by category text and uses an adjustive query-prompt matching mechanism to build a mapping relationship between the query of the current task and the semantic residual prompt. Meanwhile, a semantic consistency loss based on the contrastive learning is introduced to maintain semantic coherence between object queries and residual prompts during incremental training. For task-wise learning, to ensure the correlation at the inter-task level within the query space, we introduce a concise yet powerful initialization strategy for incremental prompts. Extensive experiments on YouTube-VIS-2019 and YouTube-VIS-2021 datasets demonstrate that CRISP significantly outperforms existing continual segmentation methods in the long-term continual video instance segmentation task, avoiding catastrophic forgetting and effectively improving segmentation and classification performance. The code is available at https://github.com/LyuQi127/CRISP.
Baichen Liu, Qi Lyu, Jiahua Dong 0001, Lianqing Liu, Zhi Han
IEEE Trans. Image Process.2
2025 Explainable Artificial Intelligence for Business and Economics: Methods, Applications and Challenges
abstract
ABSTRACT In recent years, artificial intelligence (AI) has made significant strides in research and shown great potential in various application fields, including business and economics (B&E). However, AI models are often black boxes, making them difficult to understand and explain. This challenge can be addressed using eXplainable Artificial Intelligence (XAI), which helps humans understand the factors driving AI decisions, thereby increasing transparency and confidence in the results. This paper aims to provide a comprehensive understanding of the state‐of‐the‐art research on XAI in B&E by conducting an extensive literature review. It introduces a novel approach to categorising XAI techniques from three different perspectives: samples, features and modelling method. Additionally, the paper identifies key challenges and corresponding opportunities in the field. We hope that this work will promote the adoption of AI in B&E, inspire interdisciplinary collaboration, foster innovation and growth and ensure transparency and explainability.
Qi Lyu, Shaomin Wu
Expert Syst. J. Knowl. Eng.1
2023 H-MIS: A Hierarchical Multi-Identifier System Based on Blockchain
abstract
With its wide range of applications, the Internet shows a future trend towards abundant and diverse data resources with multiple types of identifiers (multi-identifiers). However, the legacy Domain Name System (DNS) in the current TCP/IP network architecture has failed to manage these identifiers due to the centralized security issue. While some decentralized DNS alternatives have been proposed, they also face scalability issues. In this paper, we propose a blockchain-based Hierarchical Multi-Identifier System, named H-MIS, as a DNS alternative. Specially, it realizes optimal decentralization and scalability by introducing the Zero-Knowledge rollup (ZK-rollup) solution to synchronize the upper and lower on-chain identifier data, as well as off-chain associated resource data. Finally, we implement H-MIS on Ethereum and evaluate its performance. The experimental results indicate that compared to the original MIS and Ethereum Name Service (ENS), H-MIS has advantages in such aspects as efficiency, data consumption, and Gas fees.
Qi Lyu, Hui Li 0022, Xinnan Lin, Han Wang 0022, Hanxu Hou, Yuguo Yin, Qianbin Chen, Selwyn Deng, Jieren Cheng
IEEE Big Data1
2023 Finite-Sample Analysis of Deep CCA-Based Unsupervised Post-Nonlinear Multimodal Learning
abstract
Canonical correlation analysis (CCA) has been essential in unsupervised multimodal/multiview latent representation learning and data fusion. Classic CCA extracts shared information from multiple modalities of data using linear transformations. In recent years, deep neural networks-based nonlinear feature extractors were combined with CCA to come up with new variants, namely the ``DeepCCA'' line of work. These approaches were shown to have enhanced performance in many applications. However, theoretical supports of DeepCCA are often lacking. To address this challenge, the recent work of Lyu and Fu (2020) showed that, under a reasonable postnonlinear generative model, a carefully designed DeepCCA criterion provably removes unknown distortions in data generation and identifies the shared information across modalities. Nonetheless, a critical assumption used by Lyu and Fu (2020) for identifiability analysis was that unlimited data is available, which is unrealistic. This brief paper puts forth a finite-sample analysis of the DeepCCA method by Lyu and Fu (2020). The main result is that the finite-sample version of the method can still estimate the shared information with a guaranteed accuracy when the number of samples is sufficiently large. Our analytical approach is a nontrivial integration of statistical learning, numerical differentiation, and robust system identification, which may be of interest beyond the scope of DeepCCA and benefit other unsupervised learning paradigms.
Qi Lyu, Xiao Fu 0001
IEEE Trans. Neural Networks Learn. Syst.1
2022 Optimizing Parallel Proof of Vote Consensus Based on Mimic Security in Consortium Blockchains
abstract
Some Byzantine fault tolerant (BFT) consensus algorithm in consortium blockchains have lots of message broadcast to encroach bandwidth, which greatly affect the efficiency of consensus execution. Although reducing the number of global consensus nodes can help, it is also at the cost of reduced security. Based on the idea of Mimic Defense, this paper proposes a consensus framework for BFT consensus and takes the Parallel Proof of Vote (PPoV) algorithm as an example to design a randomized node sharding and role partitioning scheme to improve security of the consensus process without affecting efficiency much. In addition, the multimode adjudication group composed of the shard leaders can replace the single leader to complete voting statistics to improve the reliability of consensus results. Through theoretical analysis, it is known that the BFT consensus framework based on mimic security, taking PPoV as an example, has a strong defense effect against eclipse attacks and selfish mining. A simulation experiment is also designed to prove that through efficient iteration and dynamic threshold design, the adjudication group greatly improves the reliability of the results and the robustness of the algorithm.
Zhenwei Xiao, Hui Li 0022, Han Wang 0022, Qiongwei Ye, Shusheng Zou, Ping Lu 0008, Qi Lyu
IEEE Big Data8
2022 Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective
Qi Lyu, Xiao Fu 0001, Songtao Lu
ICLR1
2022 On Finite-Sample Identifiability of Contrastive Learning-Based Nonlinear Independent Component Analysis
abstract
Nonlinear independent component analysis (nICA) aims at recovering statistically independent latent components that are mixed by unknown nonlinear functions. Central to nICA is the identifiability of the latent components, which had been elusive until very recently. Specifically, Hyvärinen et al. have shown that the nonlinearly mixed latent components are identifiable (up to often inconsequential ambiguities) under a generalized contrastive learning (GCL) formulation, given that the latent components are independent conditioned on a certain auxiliary variable. The GCL-based identifiability of nICA is elegant, and establishes interesting connections between nICA and popular unsupervised/self-supervised learning paradigms in representation learning, causal learning, and factor disentanglement. However, existing identifiability analyses of nICA all build upon an unlimited sample assumption and the use of ideal universal function learners—which creates a non-negligible gap between theory and practice. Closing the gap is a nontrivial challenge, as there is a lack of established “textbook” routine for finite sample analysis of such unsupervised problems. This work puts forth a finite-sample identifiability analysis of GCL-based nICA. Our analytical framework judiciously combines the properties of the GCL loss function, statistical generalization analysis, and numerical differentiation. Our framework also takes the learning function’s approximation error into consideration, and reveals an intuitive trade-off between the complexity and expressiveness of the employed function learner. Numerical experiments are used to validate the theorems.
Qi Lyu, Xiao Fu 0001
ICML1
2022 Provable Subspace Identification Under Post-Nonlinear Mixtures
abstract
Unsupervised mixture learning (UML) aims at identifying linearly or nonlinearly mixed latent components in a blind manner. UML is known to be challenging: Even learning linear mixtures requires highly nontrivial analytical tools, e.g., independent component analysis or nonnegative matrix factorization. In this work, the post-nonlinear (PNL) mixture model---where {\it unknown} element-wise nonlinear functions are imposed onto a linear mixture---is revisited. The PNL model is widely employed in different fields ranging from brain signal classification, speech separation, remote sensing, to causal discovery. To identify and remove the unknown nonlinear functions, existing works often assume different properties on the latent components (e.g., statistical independence or probability-simplex structures). This work shows that under a carefully designed UML criterion, the existence of a nontrivial {\it null space} associated with the underlying mixing system suffices to guarantee identification/removal of the unknown nonlinearity. Compared to prior works, our finding largely relaxes the conditions of attaining PNL identifiability, and thus may benefit applications where no strong structural information on the latent components is known. A finite-sample analysis is offered to characterize the performance of the proposed approach under realistic settings. To implement the proposed learning criterion, a block coordinate descent algorithm is proposed. A series of numerical experiments corroborate our theoretical claims.
Qi Lyu, Xiao Fu 0001
NeurIPS1
2015 Modelling High-Dimensional Sequences with LSTM-RTRBM: Application to Polyphonic Music Generation
Qi Lyu, Zhiyong Wu 0001, Jun Zhu 0001, Helen M. Meng
IJCAI1
2015 Polyphonic Music Modelling with LSTM-RTRBM
abstract
Recent interest in music information retrieval and related technologies is exploding. However, very few of the existing techniques take advantage of the recent advancements in neural networks. The challenges of developing effective browsing, searching and organization techniques for the growing bodies of music collections call for more powerful statistical models. In this paper, we present LSTM-RTRBM, a new neural network model for the problem of creating accurate yet flexible models of polyphonic music. Our model integrates the ability of Long Short-Term Memory (LSTM) in memorizing and retrieving useful history information, together with the advantage of Restricted Boltzmann Machine (RBM) in high dimensional data modelling. Our approach greatly improves the performance of polyphonic music sequence modelling, achieving the state-of-the-art results on multiple datasets.
Qi Lyu, Zhiyong Wu 0001, Jun Zhu 0001
ACM Multimedia1