Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Haiping Ma

dblp:83/8129 · DBLP profile ↗
← Back
83ranked-venue papers
37as first author
51since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 57 · 27 first-author · 35 since 2021Databases, data management, data science and information retrieval · 35 · 11 first-author · 22 since 2021Graphics, computer vision, multimedia, augmented reality and games · 12 · 6 first-author · 11 since 2021Applied, interdisciplinary, general and emerging computing · 7 · 2 first-author · 5 since 2021Computer networks · 1Human-computer interaction and ubiquitous computing · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
21 papers
Trustworthy machine learning · 25% Knowledge representation and reasoning · 18% Efficient and distributed learning · 16%
Interdisciplinary, comprehensive, and emerging computing
16 papers
Computing education · 88% Computational social science and digital humanities · 7% Computational science and engineering · 5%
Human-computer interaction and pervasive computing
11 papers
Learning and educational technologies · 94% Usability and user experience research · 5% Ubiquitous computing and smart environments · 0%
Databases, data mining, and information retrieval
9 papers
Recommender systems · 79% Data mining · 21%
Theoretical computer science
1 paper
Mathematical optimization · 100%

Topics — the 30 heaviest of 69, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computing education › student modeling
cognitive diagnosis
5.262026
Counterfactual Debiasing Heterogeneous Ability-Induced Exercise Indices Estimation for Cognitive Diagnosis · IEEE Trans. Knowl. Data Eng. 2026
Debiased Cognitive Diagnosis: A Contrastive Counterfactual Modeling Method via Variational Autoencoder · AAAI 2026
Reconciling Efficiency and Effectiveness of Exercise Retreival: An Uncertainty Reduction Hashing Approach for Computerized Adaptive Testing · SIGIR 2025
Computing education › educational assessment
computerized adaptive testing
4.252026
Survey of Computerized Adaptive Testing: A Machine Learning Perspective · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Reconciling Efficiency and Effectiveness of Exercise Retreival: An Uncertainty Reduction Hashing Approach for Computerized Adaptive Testing · SIGIR 2025
Diffusion-Inspired Cold Start with Sufficient Prior in Computerized Adaptive Testing · KDD (1) 2025
Learning and educational technologies › student knowledge modeling
knowledge tracing
2.542024
HD-KT: Advancing Robust Knowledge Tracing via Anomalous Learning Interaction Detection · WWW 2024
RIGL: A Unified Reciprocal Approach for Tracing the Independent and Group Learning Processes · KDD 2024
Reconciling Cognitive Modeling with Knowledge Forgetting: A Continuous Time-aware Neural Network Approach · IJCAI 2022
Computing education › student modeling
knowledge tracing
2.542025
Learning Patterns-Guided Data Generation for Knowledge Tracing · KDD (2) 2025
Evolutionary Neural Architecture Search for Transformer in Knowledge Tracing · NeurIPS 2023
Federated Deep Knowledge Tracing · WSDM 2021
Knowledge, reasoning and agents › Knowledge representation and reasoning › diagnosis
cognitive diagnosis
2.332024
DisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis · NeurIPS 2024
DGCD: An Adaptive Denoising GNN for Group-level Cognitive Diagnosis · IJCAI 2024
Enhancing Cognitive Diagnosis Using Un-interacted Exercises: A Collaboration-Aware Mixed Sampling Approach · AAAI 2024
Machine learning › Trustworthy machine learning › debiasing
causal debiasing
2.022026
Counterfactual Debiasing Heterogeneous Ability-Induced Exercise Indices Estimation for Cognitive Diagnosis · IEEE Trans. Knowl. Data Eng. 2026
Debiased Cognitive Diagnosis: A Contrastive Counterfactual Modeling Method via Variational Autoencoder · AAAI 2026
Computing education › educational assessment › computerized adaptive testing
question selection
1.922026
Survey of Computerized Adaptive Testing: A Machine Learning Perspective · IEEE Trans. Pattern Anal. Mach. Intell. 2026
Explicit and Implicit Examinee-Question Relation Exploiting for Efficient Computerized Adaptive Testing · AAAI 2025
Learning and educational technologies › student modeling
cognitive diagnosis
1.722025
Rethinking Learner Modeling: A Feedback-Centric Cognitive Disentanglement Perspective · KDD (2) 2025
AD4CD: Causal-Guided Anomaly Detection for Enhancing Cognitive Diagnosis · AAAI 2025
Machine learning › Efficient and distributed learning › automated machine learning
neural architecture search
1.722026
Breaking Robustness Barriers in Cognitive Diagnosis: A One-Shot Neural Architecture Search Perspective · KDD (1) 2026
Evolutionary Neural Architecture Search for Transformer in Knowledge Tracing · NeurIPS 2023
Machine learning › Trustworthy machine learning
interpretability
1.622025
Endowing Interpretability for Neural Cognitive Diagnosis by Efficient Kolmogorov-Arnold Networks · IJCAI 2025
DISCO: A Hierarchical Disentangled Cognitive Diagnosis Framework for Interpretable Job Recommendation · ICDM 2024
Machine learning › Graph learning
graph neural network
1.522024
DisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis · NeurIPS 2024
DGCD: An Adaptive Denoising GNN for Group-level Cognitive Diagnosis · IJCAI 2024
Machine learning › Generative modeling
diffusion model
1.122025
Diffusion-Inspired Cold Start with Sufficient Prior in Computerized Adaptive Testing · KDD (1) 2025
Learning Patterns-Guided Data Generation for Knowledge Tracing · KDD (2) 2025
Computing education
intelligent education
1.122025
Endowing Interpretability for Neural Cognitive Diagnosis by Efficient Kolmogorov-Arnold Networks · IJCAI 2025
DisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis · NeurIPS 2024
Data mining
anomaly detection
1.122025
AD4CD: Causal-Guided Anomaly Detection for Enhancing Cognitive Diagnosis · AAAI 2025
HD-KT: Advancing Robust Knowledge Tracing via Anomalous Learning Interaction Detection · WWW 2024
Learning and educational technologies
computer-assisted instruction
1.122025
AD4CD: Causal-Guided Anomaly Detection for Enhancing Cognitive Diagnosis · AAAI 2025
Enhancing Cognitive Diagnosis Using Un-interacted Exercises: A Collaboration-Aware Mixed Sampling Approach · AAAI 2024
Machine learning › Trustworthy machine learning
debiasing
1.012026
Debiased Cognitive Diagnosis: A Contrastive Counterfactual Modeling Method via Variational Autoencoder · AAAI 2026
Machine learning › Trustworthy machine learning
fairness
1.012026
Debiased Cognitive Diagnosis: A Contrastive Counterfactual Modeling Method via Variational Autoencoder · AAAI 2026
Machine learning › Efficient and distributed learning › automated machine learning › neural architecture search
one-shot neural architecture search
1.012026
Breaking Robustness Barriers in Cognitive Diagnosis: A One-Shot Neural Architecture Search Perspective · KDD (1) 2026
Learning and educational technologies › educational assessment
computerized adaptive testing
1.012026
PEOAT: Personalization-Guided Evolutionary Question Assembly for One-Shot Adaptive Testing · AAAI 2026
Mathematical optimization
combinatorial optimization
1.012026
PEOAT: Personalization-Guided Evolutionary Question Assembly for One-Shot Adaptive Testing · AAAI 2026
Mathematical optimization › multi-objective optimization
evolutionary algorithm
1.012026
PEOAT: Personalization-Guided Evolutionary Question Assembly for One-Shot Adaptive Testing · AAAI 2026
Knowledge, reasoning and agents › Knowledge representation and reasoning › causal reasoning
causal graph
0.912025
AD4CD: Causal-Guided Anomaly Detection for Enhancing Cognitive Diagnosis · AAAI 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning
causal reasoning
0.912025
AD4CD: Causal-Guided Anomaly Detection for Enhancing Cognitive Diagnosis · AAAI 2025
Machine learning › Transfer learning and domain adaptation
cross-domain transfer
0.912025
Diffusion-Inspired Cold Start with Sufficient Prior in Computerized Adaptive Testing · KDD (1) 2025
Computational social science and digital humanities
social media analysis
0.912025
Spatial-Temporal Analysis of Collective Emotional Resonance in China During Global Health Crisis · WWW 2025
Computational science and engineering › scientific data analysis
spatio-temporal analysis
0.912025
Spatial-Temporal Analysis of Collective Emotional Resonance in China During Global Health Crisis · WWW 2025
Recommender systems › large-scale recommendation › multi-stage recommender systems
candidate generation
0.912025
Explicit and Implicit Examinee-Question Relation Exploiting for Efficient Computerized Adaptive Testing · AAAI 2025
Recommender systems › sequential recommendation
learning path recommendation
0.912025
LIGHT: Enhancing Learning Path Recommendation via Knowledge Topology-Aware Sequence Optimization · SIGIR 2025
Learning and educational technologies
student modeling
0.912025
Rethinking Learner Modeling: A Feedback-Centric Cognitive Disentanglement Perspective · KDD (2) 2025
Machine learning › Graph learning › graph representation learning
disentangled graph learning
0.812024
DisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

contrastive learning · 4.4causal inference · 3.5reinforcement learning · 3.2transformer · 3.1graph neural network · 2.6disentangled representation learning · 2.5pseudo-labeling · 2.4variational autoencoder · 2.0schema-preserving crossover · 2.0multi-strategy sampling · 2.0gating mechanism · 2.0evolutionary algorithm · 2.0diversity-aware selection · 2.0counterfactual sampling · 2.0response time modeling · 1.7reconstruction loss · 1.7item response theory · 1.5psychometrics · 1.0
YearPublicationVenuePosition
2026 Debiased Cognitive Diagnosis: A Contrastive Counterfactual Modeling Method via Variational Autoencoder
abstract
Cognitive diagnosis (CD), inferring student knowledge mastery based on historical response records, is crucial for personalized educational services such as adaptive practice and learning path planning. Existing CD models were built based on the assumption that student's response data is integral, overlooking the nonrandom missingness of data caused by student answering exercises selectively. This missingness generally leads to biased and incomplete observations, where confounders, such as selection bias and exposure bias, significantly undermine the accuracy of student knowledge modeling. To address missingness, we propose a Debiased Cognitive Diagnosis (DBCD) framework through the perspective of counterfactual modeling to remove exogenous confounders from the response data. Specifically, the proposed DBCD achieves debiasing for CD by applying the idea of contrastive learning to constrain the model's prediction distributions on both factual and counterfactual data. For a student, the factual data is his/her original response records, while the counterfactual data is generated by sampling the same number of exercises from all exercises of each concept through a similarity-based counterfactual sampling strategy. Considering the difficulty of directly removing the exogenous confounders for student, we devise a β-Variational Autoencoder to model their exogenous confounders within the latent representations of knowledge proficiency by leveraging exercise priors and student response patterns. Then, the learned representations are further combined with the vanilla student's ability embedding via a gating mechanism-based fusion for final diagnosis prediction of the model. Extensive experiments on real-world educational datasets demonstrate that the proposed DBCD effectively mitigates confounders and even outperforms existing methods, thereby validating the feasibility and effectiveness of the DBCD framework.
Shangshang Yang, Xuewen Duan, Xiaoshan Yu 0002, Ziwen Wang 0006, Haiping Ma, Xingyi Zhang 0001
AAAI5
2026 PEOAT: Personalization-Guided Evolutionary Question Assembly for One-Shot Adaptive Testing
abstract
With the rapid advancement of intelligent education, Computerized Adaptive Testing (CAT) has attracted increasing attention by integrating educational psychology with deep learning technologies. Unlike traditional paper-and-pencil testing, CAT aims to efficiently and accurately assess ex- aminee abilities by adaptively selecting the most suitable items during the assessment process. However, its real-time and sequential nature presents limitations in practical scenarios, particularly in large-scale assessments where interaction costs are high, or in sensitive domains such as psychological evaluations where minimizing noise and interfer- ence is essential. These challenges constrain the applicability of conventional CAT methods in time-sensitive or resource- constrained environments. To this end, we first introduce a novel task called one-shot adaptive testing (OAT), which aims to select a fixed set of optimal items for each test-taker in a one-time selection. Meanwhile, we propose PEOAT, a Personalization-guided Evolutionary question assembly framework for One-hot Adaptive Testing from the perspec- tive of combinatorial optimization. Specifically, we began by designing a personalization-aware initialization strategy that integrates differences between examinee ability and ex- ercise difficulty, using multi-strategy sampling to construct a diverse and informative initial population. Building on this, we proposed a cognitive-enhanced evolutionary framework incorporating schema-preserving crossover and cognitively guided mutation to enable efficient exploration through infor- mative signals. To maintain diversity without compromising fitness, we further introduced a diversity-aware environmen- tal selection mechanism. The effectiveness of PEOAT is val- idated through extensive experiments on two datasets, com- plemented by case studies that uncovered valuable insights.
Xiaoshan Yu 0002, Shangshang Yang, Ziwen Wang 0006, Haiping Ma, Xingyi Zhang 0001
AAAI5
2026 Breaking Robustness Barriers in Cognitive Diagnosis: A One-Shot Neural Architecture Search Perspective
Ziwen Wang 0006, Shangshang Yang, Xiaoshan Yu 0001, Haiping Ma, Xingyi Zhang 0001
KDD (1)4
2026 Temporal-spatial-frequency fusion based graph transformer for assessing treatment of methamphetamine use disorder
Haiping Ma, Junhan Jia, Baogen Jin, Zheheng Jiang
Expert Syst. Appl.1
2026 DRUM: Distributionally robust optimization for LLM-based user model in interactive recommendation
Huiting Liu 0001, Yao Quan, Haiping Ma, Xindong Wu 0001
Inf. Process. Manag.4
2026 Survey of Computerized Adaptive Testing: A Machine Learning Perspective
abstract
Computerized Adaptive Testing (CAT) offers an efficient and personalized method for assessing examinee proficiency by dynamically adjusting test questions based on individual performance. Compared to traditional, non-personalized testing methods, CAT requires fewer questions and provides more accurate assessments. As a result, CAT has been widely adopted across various fields, including education, healthcare, sports, sociology, and the evaluation of AI models. While traditional methods rely on psychometrics and statistics, the increasing complexity of large-scale testing has spurred the integration of machine learning techniques. This paper aims to provide a machine learning-focused survey on CAT, presenting a fresh perspective on this adaptive testing paradigm. We delve into measurement models, question selection algorithm, bank construction, and test control within CAT, exploring how machine learning can optimize these components. Through an analysis of current methods, strengths, limitations, and challenges, we strive to develop robust, fair, and efficient CAT systems. By bridging psychometric-driven CAT research with machine learning, this survey advocates for a more inclusive and interdisciplinary approach to the future of adaptive testing.
Yan Zhuang 0001, Qi Liu 0003, Haoyang Bi, Zhenya Huang, Weizhe Huang, Jiatong Li 0002, Junhao Yu, Zirui Liu 0010, Zirui Hu, Yuting Hong, Zachary A. Pardos, Haiping Ma, Mengxiao Zhu 0001, Shijin Wang 0001, Enhong Chen
IEEE Trans. Pattern Anal. Mach. Intell.12
2026 3D temporal-spatial convolutional LSTM network for assessing drug addiction treatment
Haiping Ma, Jiyuan Huang, Chenxu Shen, Qingming Liu
Pattern Recognit.1
2026 Causal Multi-Interest Fusion for Distribution-Robust Sequential Recommendation
abstract
Sequential recommendation predicts the next item based on user behavior patterns. However, due to the influence of unobserved confounders, there are often significant differences between the distributions of training and testing data, resulting in Out-Of-Distribution (OOD) problems that severely degrade recommendation performance. Existing causality-based sequential recommendation methods typically model the unobserved confounders as confounders and assume that they are fully observable, and use causal intervention to remove confounding. However, in reality, the unobserved confounders is complex and unobservable. In this case, the model may learn spurious correlations, which impair its generalization ability to OOD data. To address this, we propose Causal Multi-Interest Fusion for Distribution-Robust Sequential Recommendation (CURE). Specifically, we use stable long-term and periodic interests, unaffected by confounders, as mediators, and apply front-door adjustment to remove the influence of unobserved confounders. Based on front-door adjustment theory, we derive the formula for the target causal effect and employ a multi-interest modeling method to obtain comprehensive representations for each mediator, fully uncovering the causal pathways. Furthermore, we design four modules to implement the key components of the target causal effect formula. During model optimization, to address the lack of explicit interest labels, we leverage large language models (LLMs) to generate fine-grained interest labels, providing high-quality supervision signals for model training. Experiments conducted across four real-world datasets demonstrate that CURE effectively alleviates OOD issues and significantly improves sequential recommendation performance. We will release the code once accepted.
Huiting Liu 0001, Yilong Huang, Wangshu Gong, Haiping Ma, Xindong Wu 0001
IEEE Trans. Big Data4
2026 Reconciling Cognitive Modeling with Knowledge Forgetting: A Continuous Time-aware General Neural Network Framework
abstract
Cognitive modeling, as an emerging technology in the field of computer-aided education, aims to explore students’ knowledge levels and learning abilities to achieve various intelligent educational applications. Although some existing work focuses on addressing the problem of student forgetting, it is still a less explored area how to naturally integrate the forgetting effect caused by the time interval between answering exercises into student knowledge state modeling. Additionally, traditional cognitive modeling methods mostly assume that students answer exercises one by one, which often does not align with real answering behavior and cannot be directly extended to diverse learning scenarios. Therefore, in this article, we propose a Continuous Time-based Neural Cognitive (CT-NC) framework and several implemented models (CT-NCM and two extensions) to effectively integrate the dynamic and continuous characteristics of knowledge forgetting into student learning process modeling, making it more natural. Specifically, we adopt a specially designed learning event encoding method to adjust the neural Hawkes process to capture the relationship between knowledge learning and forgetting over continuous time. Furthermore, we propose a customizable learning function to jointly model the changes in different knowledge states and their interaction with each practice moment. In the end, we demonstrate an extension CT-NCM+ that can adapt well to diverse learning scenarios, indicating that CT-NCM can solve real-world problems by flexibly adjusting its structure. Extensive experimental results on real datasets clearly demonstrate that CT-NCM and CT-NCM+ outperform the current state-of-the-art KT methods in student performance prediction, while our work points out a realistic research direction for KT and demonstrates its interpretability in knowledge learning visualization.
Ziwen Wang 0006, Haiping Ma, Hengshu Zhu, Shangshang Yang, Xiaoshan Yu 0002, Shuhuan Liu, Haifeng Zhang 0003, Xingyi Zhang 0001
ACM Trans. Intell. Syst. Technol.3
2026 Counterfactual Debiasing Heterogeneous Ability-Induced Exercise Indices Estimation for Cognitive Diagnosis
abstract
Cognitive Diagnosis is a critical task in computer-assisted education, aimed at assessing students' mastery of knowledge concepts and analyzing exercise indices. In fact, this direction has received a lot of research attention in the past few decades. However, the inherent heterogeneity in students' abilities introduces significant challenges to accurate exercise indices estimation, resulting biases that lead to inaccurate diagnostics within student groups and undermining the generalizability of exercise indices across diverse groups. To address these challenges, we propose a Counterfactual Adaptive-Debiasing Framework (CADF) for Cognitive Diagnosis, which employs a causal graph to model the intricate relationships among key variables influencing student performance and knowledge mastery. Specifically, by introducing exercise adjustment factors, we capture both the intrinsic attributes of exercises and their dynamic adaptability to individual students. Then, to disentangle the direct and indirect effects of these factors, we adopt a counterfactual inference approach to answer the critical question:How would the diagnostic feedback from a cognitive diagnosis model change if it were only directly influenced by exercise adjustment factors?This allows CADF to retain the beneficial indirect effects while neutralizing the direct effects that introduce bias, thereby achieving debiased exercise indices estimation. Finally, Extensive experiments on three real-world datasets demonstrate that CADF significantly reduces bias in exercise indices estimation and enhances the accuracy of diagnostic feedback.
Haiping Ma, Tianle Li, Changqian Wang, Siyu Song, Limiao Zhang, Xingyi Zhang 0001
IEEE Trans. Knowl. Data Eng.1
2025 AD4CD: Causal-Guided Anomaly Detection for Enhancing Cognitive Diagnosis
abstract
Cognitive diagnosis is a key task in computer-aided education, aimed at assessing a students' proficiency in specific knowledge concepts based on their responses to exercises. However, existing cognitive diagnosis models often overlook anomalies in students and exercises. For instance, some students might incorrectly response exercises despite having a strong grasp of the knowledge concept, or they might response correctly despite a lack of understanding. Such subtle anomalies can adversely affect the diagnostic results of the models. To address these anomalies, we conduct a qualitative analysis of how anomalous student states and exercise properties impact response outcomes using causal diagrams. We propose a framework named Anomaly Detection for Cognitive Diagnosis (AD4CD) to enhance the ability of Learning-to-Detect-Anomalous. AD4CD approaches the problem from a causal perspective, analyzing confounding paths that affect the true causal relationship between student ability and response outcomes, and designing an anomaly detection mechanism suitable for cognitive diagnostic models. Specifically, we first account for anomalous student behaviors and exercise properties and introduce response times from both students and exercises as modeling factors. By quantifying the response time distributions in high-dimensional features, we identify anomalies within skewed distributions, including both left-tail and right-tail anomalies. Using the detected anomaly scores, we comprehensively model the students' anomalous behaviors and exercise anomalies. Additionally, we reconstruct unbiased true abilities under natural conditions and use reconstruction loss as an anomaly score to assist in modeling guessing and slipping features. Lastly, AD4CD leverages a general cognitive diagnosis model as its backbone, optimizing the guessing and slipping features to provide unbiased and accurate feedback. Extensive experimental results demonstrate that AD4CD effectively captures anomalous data in the diagnostic process across three real-world datasets, enhancing the accuracy of the diagnostic results.
Haiping Ma, Changqian Wang, Siyu Song
AAAI1
2025 Explicit and Implicit Examinee-Question Relation Exploiting for Efficient Computerized Adaptive Testing
abstract
Computerized adaptive testing(CAT) is a crucial task in computer-aided education, which aims to adaptively select suitable question to diagnose examinees' ability status. Existing CAT approaches enhance selection performance by exploring examinee-question(E-Q) relation. These approaches either exclusively utilize explicit E-Q relation. For instance, policy-based approaches determine question selection based on predefined criteria. While effective in adapting to changes in question banks, these methods often entail significant computational costs in searching for suitable questions. Conversely, some studies focus solely on implicit E-Q relation. For example, learning-based approaches train agents to efficiently select questions by learning from large-scale datasets. However, they may struggle with newly introduced questions. Additionally, most of these existing question selectors are based on greedy strategies, which potentially overlooks promising quuestions. To bridge the above two types of approaches, we propose a novel framework named Relation Exploiting-based CAT(RECAT) by exploring and exploiting the implicit and explicit examinee-question relation. Specifically, we first define an examinee true ability-oriented selection objective to select more suitable questions. Then, to learn the implicit E-Q relation, we design a question selector, which explores the examinee ability and generates best-fitting questions for specific examinee ability from two aspects, including generation consistency and knowledge matching. The former aims to maximize the likelihood estimation of the implicit E-Q relation learning process, while the latter is employed to fit the distribution of real questions. To fully exploit explicit E-Q relation, we generate a high-quality candidate set for the given examinee's ability using implicit E-Q relation, which streamlines the search process, minimizing selection latency. We demonstrate the effectiveness and efficiency of our framework through comprehensive experiments on real-world datasets.
Changqian Wang, Shangshang Yang, Siyu Song, Ziwen Wang 0006, Haiping Ma, Xingyi Zhang 0001
AAAI5
2025 Endowing Interpretability for Neural Cognitive Diagnosis by Efficient Kolmogorov-Arnold Networks
abstract
Cognitive diagnosis is crucial for intelligent education because of its ability to reveal students' proficiency in knowledge concepts. Although neural network-based neural cognitive diagnosis models (CDMs) have exhibited significantly better performance than traditional models, neural cognitive diagnosis is criticized for the poor model interpretability due to the multi-layer perceptron(MLP) employed, even with the monotonicity assumption. Therefore, this paper proposes to empower the interpretability of neural cognitive diagnosis models through efficient Kolmogorov-Arnold networks (KANs), named KAN2CD, where KANs are used to enhance interpretability in two manners. Specifically, in the first manner, KANs are directly used to replace the used MLPs in existing neural CDMs; while in the second manner, the student embedding, exercise embedding, and concept embedding are directly processed by several KANs, and then their outputs are further combined and learned in a unified KAN to get final predictions. Besides, the implementation of original KANs is modified without affecting the interpretability to overcome the problem of training KANs slowly. Extensive experiments show KAN2CD outperforms traditional CDMs and slightly surpasses existing neural CDMs, and its learned structures ensure interpretability on par with traditional CDMs and better than neural CDMs. The datasets, associated code, and more experimental results are available at https://github.com/null233QAQ/KAN2CD.
Shangshang Yang, Linrui Qin, Xiaoshan Yu 0002, Ziwen Wang 0006, Xueming Yan, Haiping Ma, Ye Tian 0009
IJCAI6
2025 Rethinking Learner Modeling: A Feedback-Centric Cognitive Disentanglement Perspective
abstract
With the rise of web-based technologies, online tutoring platforms have emerged to provide personalized learning services by modeling learners' engagement behaviors, improving both convenience and efficiency in academic progress. Cognitive diagnosis has been always recognized a essential learner modeling task in personalized education, which aims to infer learners' mastery in specific knowledge concepts by mining and analyzing their practice behavior. However, most existing studies fail to explicitly disentangling the multiple interdependent factors that influence learner's response feedback during the problem-solving process, both in web-based environments and real-world contexts. To address this issue, we propose DISCD, a feedback-centric DIS entangled Cognitive Diagnosis framework for enhancing effective and interpretable learner modeling. Specifically, we first introduce a feedback-centric disentangled encoder grounded in variational inference to effectively characterize learners' cognitive traits by modeling their practice responses. To achieve this, we fully leverage the interaction matrix and the exercise-concept correlation matrix to extract implicit signals in the disentanglement process, employing three dedicated sub-encoders to efficiently and comprehensively capture these attributes. Next, we develop a multi-level cognitive coordination module to systematically model the disentangled cognitive factors, ensuring their seamless integration into the diagnosis decoding process. Finally, we design a cognitive interaction decoder to reconstruct and refine learners' engagement trajectories in exercises. Extensive experiments on four educational datasets validate the effectiveness of the proposed DISCD model in learner modeling for cognitive diagnosis.
Xiaoshan Yu 0002, Shangshang Yang, Ziwen Wang 0006, Chuan Qin 0002, Haiping Ma, Xingyi Zhang 0001
KDD (2)6
2025 Diffusion-Inspired Cold Start with Sufficient Prior in Computerized Adaptive Testing
abstract
Computerized Adaptive Testing (CAT) aims to select the most appropriate questions based on the examinee's ability and is widely used in online education. However, existing CAT systems often lack initial understanding of the examinee's ability, requiring random probing questions. This can lead to poorly matched questions, extending the test duration and negatively impacting the examinee's mindset, a phenomenon referred to as the Cold Start with Insufficient Prior (CSIP) task. This issue occurs because CAT systems do not effectively utilize the abundant prior information about the examinee available from other courses on online platforms. These response records, due to the commonality of cognitive states across different knowledge domains, can provide valuable prior information for the target domain. However, no prior work has explored solutions for the CSIP task. In response to this gap, we propose Diffusion Cognitive States TransfeR Framework (DCSR), a novel domain transfer framework based on Diffusion Models (DMs) to address the CSIP task. Specifically, we construct a cognitive state transition bridge between domains, guided by the common cognitive states of examinees, encouraging the model to reconstruct the initial ability state in the target domain. To enrich the expressive power of the generated data, we analyze the causal relationships in the generation process from a causal perspective. Redundant and extraneous cognitive states can lead to limited transfer and negative transfer effects. Therefore, we designed three decoupling strategies to control confounding variables, thereby blocking backdoor paths that hinder causal discovery. Given that excessive uncertainty can affect the applicability of generated results to the CAT system, we propose consistency constraint and task-oriented constraint to control the randomness of the generated results and their relevance to the CAT task, respectively. Our DCSR can seamlessly apply the generated initial ability states in the target domain to existing question selection algorithms, thus improving the cold start performance of the CAT sys- tem. Extensive experiments conducted on five real-world datasets demonstrate that DCSR significantly outperforms existing baseline methods in addressing the CSIP task.
Haiping Ma, Aoqing Xia, Changqian Wang, Xingyi Zhang 0001
KDD (1)1
2025 Learning Patterns-Guided Data Generation for Knowledge Tracing
abstract
Knowledge tracing (KT), which is instrumental in monitoring and forecasting students' knowledge states throughout their learning trajectory in online learning environments, has over the past decade garnered widespread attention due to its pivotal role in facilitating personalized education. Existing KT approaches were mainly invented from the model-centric perspective to overcome the sequence modeling difficulty while not exploiting the potential information of sparsity, thereby limiting their performance. To make full use of the information in the dataset, this paper proposes a data-centric knowledge tracing paradigm, termed LPDG, aiming to generate interaction data between students and exercises by revealing students' Learning Patterns and facilitating the Generation of ideal training Data. Specifically, we propose a learning patterns-guided exercise sequence regenerator, which incorporates Transformer and a tailor-made pattern enhancer, thereby aiding in the extraction of valuable information for generating high-quality training data. Moreover, we devise a learning patterns-guided pseudo-label generator, which leverages the diffusion process to construct pseudo-labels for the regenerated sequences. Afterwards, the fully generated ideal data is incorporated into the training data, and we integrate this framework with various model-centric approaches in KT. Finally, experimental results across datasets clearly demonstrate the efficacy of our proposed LPDG framework.
Haiping Ma, Ziwen Wang 0006, Changqian Wang, Xiaoshan Yu 0002, Shangshang Yang, Xingyi Zhang 0001
KDD (2)1
2025 LIGHT: Enhancing Learning Path Recommendation via Knowledge Topology-Aware Sequence Optimization
abstract
Learning path recommendation (LPR) aims to provide individualized and effective learning item routes by modeling learners' learning histories and goals, which has been widely considered a essential task in the field of personalized education. Indeed, considerable research efforts have been dedicated to this direction in recent years, focusing on step-based and sequence-based modeling approaches. However, most of existing studies overlook the complementarity between explicit and implicit relationships among knowledge concepts, while failing to harmonize static knowledge structures with dynamic path generation. To this end, in this paper, we propose LIGHT, a knowLedge topology-aware sequence optImization model for enhancing learninG patH recommendaTion. Specifically, we first construct a composite concept graph that incorporates explicit prerequisite relationships and implicit collaborative relationships, achieved by mining interaction statistics and collaborative signals from learners' learning processes. Next, we design a complementary contrastive fusion module to fully capture the interplay between the two relational views of concepts through graph structure learning and contrastive constraints, which enhances the effectiveness of the learned representations. Following this, we introduce a knowledge topology-aware modeling module that integrates structural semantics clustering with candidate path sampling. Finally, we develop a bidirectional sensing path optimization network to deeply model and optimize the sampled paths from a sequential perspective, thereby enhancing modeling efficiency while preserving structural semantics. Extensive experiments on three real-world educational datasets clearly demonstrate the effectiveness of the proposed LIGHT model in the LPR task.
Xiaoshan Yu 0002, Shangshang Yang, Ziwen Wang 0006, Siyu Song, Haiping Ma, Zhiguang Cao, Xingyi Zhang 0001
SIGIR5
2025 Reconciling Efficiency and Effectiveness of Exercise Retreival: An Uncertainty Reduction Hashing Approach for Computerized Adaptive Testing
abstract
With the rapid development of intelligent education, Computerized Adaptive Testing(CAT) has garnered significant attention for its ability to tailor exercises to individual examinees. The adaptability of CAT is primarily achieved through the alternating optimization of two core components: the cognitive diagnosis model and the exercise selection module. However, existing CAT approaches, despite their remarkable achievements, often come at the expense of high time costs. Statistical-based approaches incur increased time overhead due to complex computations, while data-driven approaches further exacerbate time inefficiency because of the iterative processes in reinforcement learning, making it challenging to balance evaluation effectiveness and time efficiency. To this end, in this paper, we propose HashCAT, an efficient CAT approach based on learning to hash, aiming to balance efficiency and evaluation effectiveness. Our approach comprises two stages: the hash representation generation and the exercise selection. In the first stage, we design an information alignment module and a novel cognitive diagnosis function to model the interaction between examinees and exercises, generating hash representations with clear physical significance. In the second stage, we propose an uncertainty reduction-based algorithm that utilize information entropy to quantify the uncertainty in student ability estimation and selects exercises that most effectively reduce this uncertainty. Experimental results on four real-world datasets demonstrate that the proposed method significantly improves question selection efficiency while maintaining competitive evaluation performance. The code exists anonymously in https://github.com/sherklock/Intelligent-Education/tree/main/HashCAT-main.
Haiping Ma, Weiyuan Zhou, Xiaoshan Yu 0002, Changqian Wang, Shangshang Yang, Limiao Zhang, Xingyi Zhang 0001
SIGIR1
2025 Spatial-Temporal Analysis of Collective Emotional Resonance in China During Global Health Crisis
abstract
The 21st century has already witnessed so many outbreaks with pandemic potential, including SARS (2002), H1N1 (2009), MERS (2012), Ebola (2014), Zika virus (2015), and the COVID-19 pandemic (2019). Using 60 million geotagged Sina Weibo tweets covering over 20 million active accounts, we investigate the collective emotional dynamics on social media in the most recent global pandemic, i.e., COVID-19. This research features two highlights: (1) It focuses on the Chinese population located in the initial epicenter of the pandemic. (2) It examines the initial year after the pandemic outbreak, a critical period where emotions were most intense due to the uncertainty and rapid developments related to the crisis. Using cross-disciplinary methods, we reveal a positive connection between online emotional resonance and geographic proximity, demonstrating a direct mapping between virtual network distances and physical spatial embedding. We propose a percolation-based index to measure the nationwide emotional resonance level with which we illustrate the significant economic impact of the global health issue. Finally, we identify a leader-follower pattern in emotional resonance fluctuations based on time-lag emotion correlations, revealing that less active regions play a crucial role in leading and responding to emotional changes. In the face of long COVID and emerging global health crises, our analysis elucidates how collective emotional resonance evolves, providing potential directions for online opinion interventions during global shocks.
Limiao Zhang, Xinyang Qi, Haiping Ma, Jie Gao 0012, Xingyi Zhang 0001, Yanqing Hu, Yaochu Jin
WWW3
2025 Retinex-inspired underwater image enhancement with information entropy smoothing and non-uniform illumination priors
Haiping Ma, Jiyuan Huang, Chenxu Shen, Zheheng Jiang
Pattern Recognit.1
2025 An Evolutionary Multiobjective Neural Architecture Search Approach to Advancing Cognitive Diagnosis in Intelligent Education
abstract
As a pivotal technique in intelligent education systems, cognitive diagnosis (CD) serves to reveal students’ knowledge proficiency for better tackling subsequent tasks. Unfortunately, due to pursuing high model interpretability, existing manually designed models for CD often hold simplistic architectures, which cannot cope with intricate data in modern education platforms. Furthermore, the bias of human design limits the emergence of novel and effective CD models (CDMs). To develop interpretable and more effective models, thus this article proposes an evolutionary multiobjective neural architecture search (NAS) approach for CD. Specifically, we first adopt a comprehensive search space for the NAS task of CD: all candidate models can be encompassed by a general model that deals with three distinct types of inputs. Then, an innovative model interpretability objective is devised to formulate the architecture search task as a bi-objective optimization problem (BOP). To solve the BOP, we employ a multiobjective genetic programming (MOGP) as the search strategy to explore the search space. To make the employed MOGP search well, all architectures are first encoded by trees for easy optimization, and we devise a genetic operation and a population initialization strategy to expedite its convergence. Finally, the proposed approach is actually an MOGP-based NAS approach for CD. Extensive experiments show that CDMs searched by the proposed approach exhibit significantly better performance than existing models and hold as good interpretability as handcrafted models. Besides, the effectiveness of the proposed MOGP search strategy, the devised objective, and tailored strategies are validated.
Shangshang Yang, Haiping Ma, Ying Bi 0001, Ye Tian 0009, Limiao Zhang, Yaochu Jin, Xingyi Zhang 0001
IEEE Trans. Evol. Comput.2
2024 Enhancing Cognitive Diagnosis Using Un-interacted Exercises: A Collaboration-Aware Mixed Sampling Approach
abstract
Cognitive diagnosis is a crucial task in computer-aided education, aimed at evaluating students' proficiency levels across various knowledge concepts through exercises. Current models, however, primarily rely on students' answered exercises, neglecting the complex and rich information contained in un-interacted exercises. While recent research has attempted to leverage the data within un-interacted exercises linked to interacted knowledge concepts, aiming to address the long-tail issue, these studies fail to fully explore the informative, un-interacted exercises related to broader knowledge concepts. This oversight results in diminished performance when these models are applied to comprehensive datasets. In response to this gap, we present the Collaborative-aware Mixed Exercise Sampling (CMES) framework, which can effectively exploit the information present in un-interacted exercises linked to un-interacted knowledge concepts. Specifically, we introduce a novel universal sampling module where the training samples comprise not merely raw data slices, but enhanced samples generated by combining weight-enhanced attention mixture techniques. Given the necessity of real response labels in cognitive diagnosis, we also propose a ranking-based pseudo feedback module to regulate students' responses on generated exercises. The versatility of the CMES framework bolsters existing models and improves their adaptability. Finally, we demonstrate the effectiveness and interpretability of our framework through comprehensive experiments on real-world datasets.
Haiping Ma, Changqian Wang, Hengshu Zhu, Shangshang Yang, Xingyi Zhang 0001
AAAI1
2024 DISCO: A Hierarchical Disentangled Cognitive Diagnosis Framework for Interpretable Job Recommendation
abstract
The rapid development of online recruitment platforms has created unprecedented opportunities for job seekers while concurrently posing the significant challenge of quickly and accurately pinpointing positions that align with their skills and preferences. Job recommendation systems have significantly alleviated the extensive search burden for job seekers by optimizing user engagement metrics, such as clicks and applications, thus achieving notable success. In recent years, a substantial amount of research has been devoted to developing effective job recommendation models, primarily focusing on text-matching based and behavior modeling based methods. While these approaches have realized impressive outcomes, it is imperative to note that research on the explainability of recruitment recommendations remains profoundly unexplored. To this end, in this paper, we propose DISCO, a hierarchical Disentanglement based Cognitive diagnosis framework, aimed at flexibly accommodating the underlying representation learning model for effective and interpretable job recommendations. Specifically, we first design a hierarchical representation disentangling module to explicitly mine the hierarchical skill-related factors implied in hidden representations of job seekers and jobs. Subsequently, we propose level-aware association modeling to enhance information communication and robust representation learning both inter- and intra-level, which consists of the inter-level knowledge influence module and the level-wise contrastive learning. Finally, we devise an interaction diagnosis module incorporating a neural diagnosis function for effectively modeling the multi-level recruitment interaction process between job seekers and jobs, which introduces the cognitive measurement theory. Extensive experiments on two real-world recruitment recommendation datasets and an educational recommendation dataset clearly demonstrate the effectiveness and interpretability of our proposed DISCO framework. Our codes are available at https://github.com/LabyrinthineLeo/DISCO.
Xiaoshan Yu 0002, Chuan Qin 0002, Qi Zhang 0053, Chen Zhu 0003, Haiping Ma, Xingyi Zhang 0001, Hengshu Zhu
ICDM5
2024 DGCD: An Adaptive Denoising GNN for Group-level Cognitive Diagnosis
Haiping Ma, Siyu Song, Chuan Qin 0002, Xiaoshan Yu 0002, Limiao Zhang, Xingyi Zhang 0001, Hengshu Zhu
IJCAI1
2024 RIGL: A Unified Reciprocal Approach for Tracing the Independent and Group Learning Processes
abstract
In the realm of education, both independent learning and group learning are esteemed as the most classic paradigms. The former allows learners to self-direct their studies, while the latter is typically characterized by teacher-directed scenarios. Recent studies in the field of intelligent education have leveraged deep temporal models to trace the learning process, capturing the dynamics of students' knowledge states, and have achieved remarkable performance. However, existing approaches have primarily focused on modeling the independent learning process, with the group learning paradigm receiving less attention. Moreover, the reciprocal effect between the two learning processes, especially their combined potential to foster holistic student development, remains inadequately explored. To this end, in this paper, we propose RIGL, a unified Reciprocal model to trace knowledge states at both the individual and group levels, drawing from the Independent and Group Learning processes. Specifically, we first introduce a time frame-aware reciprocal embedding module to concurrently model both student and group response interactions across various time frames. Subsequently, we employ reciprocal enhanced learning modeling to fully exploit the comprehensive and complementary information between the two behaviors. Furthermore, we design a relation-guided temporal attentive network, comprised of dynamic graph modeling coupled with a temporal self-attention mechanism. It is used to delve into the dynamic influence of individual and group interactions throughout the learning processes, which is crafted to explore the dynamic intricacies of both individual and group interactions during the learning sequences. Conclusively, we introduce a bias-aware contrastive learning module to bolster the stability of the model's training. Extensive experiments on four real-world educational datasets clearly demonstrate the effectiveness of the proposed RIGL model. Our codes are available at https://github.com/LabyrinthineLeo/RIGL.
Xiaoshan Yu 0002, Chuan Qin 0002, Dazhong Shen, Shangshang Yang, Haiping Ma, Hengshu Zhu, Xingyi Zhang 0001
KDD5
2024 DisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis
abstract
Existing graph learning-based cognitive diagnosis (CD) methods have made relatively good results, but their student, exercise, and concept representations are learned and exchanged in an implicit unified graph, which makes the interaction-agnostic exercise and concept representations be learned poorly, failing to provide high robustness against noise in students' interactions. Besides, lower-order exercise latent representations obtained in shallow layers are not well explored when learning the student representation. To tackle the issues, this paper suggests a meta multigraph-assisted disentangled graph learning framework for CD (DisenGCD), which learns three types of representations on three disentangled graphs: student-exercise-concept interaction, exercise-concept relation, and concept dependency graphs, respectively. Specifically, the latter two graphs are first disentangled from the interaction graph. Then, the student representation is learned from the interaction graph by a devised meta multigraph learning module; multiple learnable propagation paths in this module enable current student latent representation to access lower-order exercise latent representations, which can lead to more effective nad robust student representations learned; the exercise and concept representations are learned on the relation and dependency graphs by graph attention modules. Finally, a novel diagnostic function is devised to handle three disentangled representations for prediction. Experiments show better performance and robustness of DisenGCD than state-of-the-art CD methods and demonstrate the effectiveness of the disentangled learning framework and meta multigraph module.The source code is available at https://github.com/BIMK/Intelligent-Education/tree/main/DisenGCD.
Shangshang Yang, Ziwen Wang 0006, Xiaoshan Yu 0002, Haiping Ma, Xingyi Zhang 0001
NeurIPS6
2024 HD-KT: Advancing Robust Knowledge Tracing via Anomalous Learning Interaction Detection
Haiping Ma, Chuan Qin 0002, Xiaoshan Yu 0002, Shangshang Yang, Xingyi Zhang 0001, Hengshu Zhu
WWW1
2024 Weighted multi-error information entropy based you only look once network for underwater object detection
Haiping Ma, Shengyi Sun, Minrui Fei, Huiyu Zhou 0001
Eng. Appl. Artif. Intell.1
2024 Temporal-Spatial Conversion Based Sequential Convolutional LSTM Architecture for Detecting Drug Addiction
abstract
Drug addiction (DA) is a long-term and relapsing brain disorder with limited effective treatments. Electroencephalography (EEG) is a highly promising tool for investigating DA. This letter proposes an effective sequential convolutional long short-term memory (LSTM) network based on temporal-spatial conversion for DA detection from EEG signals. First, the multi-channel EEG time series are converted into a few EEG topomaps composed of RGB colors, to reduce the temporal-spatial redundancy of EEG signals. Then these EEG topomaps are input to the convolutional module to extract the spatial features of brain activity under DA condition. Next, considering the EEG temporal correlation, an LSTM module is introduced to adaptively capture significant sequential information like time series. Meanwhile, a contrastive loss function is defined for reinforcing the temporal-spatial features, to improve DA detection. Experiments on the DA dataset show that the proposed network is simple and universal, and can achieve better detection performance compared to several existing approaches.
Haiping Ma, Jiuyi Yao, Jiyuan Huang, Zheheng Jiang
IEEE Signal Process. Lett.1
2024 Model-Agnostic Adaptive Testing for Intelligent Education Systems via Meta-learned Gradient Embeddings
abstract
The field of education has undergone a significant revolution with the advent of intelligent systems and technology, which aim to personalize the learning experience, catering to the unique needs and abilities of individual learners. In this pursuit, a fundamental challenge is designing proper test for assessing the students’ cognitive status on knowledge and skills accurately and efficiently. One promising approach, referred to as Computerized Adaptive Testing (CAT), is to administrate computer-automated tests that alternately select the next item for each examinee and estimate their cognitive states given their responses to the selected items. Nevertheless, existing CAT systems suffer from inflexibility in item selection and ineffectiveness in cognitive state estimation, respectively. In this article, we propose a Model-Agnostic adaptive testing framework via Meta-leaned Gradient Embeddings, MAMGE for short, improving both item selection and cognitive state estimation simultaneously. For item selection, we design a Gradient Embedding-based Item Selector (GEIS) which incorporates the concept of gradient embeddings to represent items and selects the best ones that are both informative and representative. For cognitive state estimation, we propose a Meta-learned Cognitive State Estimator (MCSE) to automatically control the estimation process by learning to learn a proper initialization and dynamically inferred updates. Both MCSE and GEIS are inherently model-agnostic, and the two modules have an ingenious connection via meta-learned gradient embeddings. Finally, extensive experiments evaluate the effectiveness and flexibility of MAMGE.
Haoyang Bi, Qi Liu 0003, Han Wu 0002, Weidong He, Zhenya Huang, Yu Yin 0002, Haiping Ma, Yu Su 0002, Shijin Wang 0001, Enhong Chen
ACM Trans. Intell. Syst. Technol.7
2024 RDGT: Enhancing Group Cognitive Diagnosis With Relation-Guided Dual-Side Graph Transformer
abstract
Cognitive diagnosis has been widely recognized as a crucial task in the field of computational education, which is capable of learning the knowledge profiles of students and predicting their future exercise performance. Indeed, considerable research efforts have been made in this direction over the past decades. However, most of the existing studies only focus on individual-level diagnostic modeling, while the group-level cognitive diagnosis still lacks an in-depth exploration, which is more compatible with realistic collaborative learning environments. To this end, in this paper, we propose aRelation-guidedDual-sideGraphTransformer (RDGT) model for achieving effective group-level cognitive diagnosis. Specifically, we first construct the dual-side relation graphs (i.e., student-side and exercise-side) from the group-student-exercise heterogeneous interaction data for explicitly modeling associations between students and exercises, respectively. In particular, the edge weight between two nodes is defined based on the similarity of corresponding student-exercise interactions. Then, we introduce two relation-guided graph transformers to learn the representations of students and exercises by integrating the whole graph information, including both nodes and edge weights. Meanwhile, the inter-group information has been incorporated into the student-side relation graph to further enhance the representations of students. Along this line, we design a cognitive diagnosis module for learning the groups' proficiency in specific knowledge concepts, which includes an attention-based aggregation strategy to obtain the final group representation and a hybrid loss for optimizing the performance prediction of both group and student. Finally, extensive experiments on 5 real-world datasets clearly demonstrate the effectiveness of our model as well as some interesting findings (e.g., the representative groups and potential collaborations among students).
Xiaoshan Yu 0002, Chuan Qin 0002, Dazhong Shen, Haiping Ma, Le Zhang 0010, Xingyi Zhang 0001, Hengshu Zhu, Hui Xiong 0001
IEEE Trans. Knowl. Data Eng.4
2024 Multigranularity Surrogate Modeling for Evolutionary Multiobjective Optimization With Expensive Constraints
abstract
Multiobjective optimization problems (MOPs) with expensive constraints pose stiff challenges to existing surrogate-assisted evolutionary algorithms (SAEAs) in a very limited computational cost, due to the fact that the number of expensive constraints for an MOP is often large. For existing SAEAs, they always approximate constraint functions in a single granularity, namely, approximating the constraint violation (CV, coarse-grained) or each constraint (fine-grained). However, the landscape of CV is often too complex to be accurately approximated by a surrogate model. Although the modeling of each constraint function may be simpler than that of CV, approximating all the constraint functions independently may result in tremendous cumulative errors and high computational costs. To address this issue, in this article, we develop a multigranularity surrogate modeling framework for evolutionary algorithms (EAs), where the approximation granularity of constraint surrogates is adaptively determined by the position of the population in the fitness landscape. Moreover, a dedicated model management strategy is also developed to reduce the impact resulting from the errors introduced by constraint surrogates and prevent the population from trapping into local optima. To evaluate the performance of the proposed framework, an implementation called K-MGSAEA is proposed, and the experimental results on a large number of test problems show that the proposed framework is superior to seven state-of-the-art competitors.
Hao Jiang 0023, Ye Tian 0009, Haiping Ma, Xingyi Zhang 0001
IEEE Trans. Neural Networks Learn. Syst.4
2023 Homogeneous Cohort-Aware Group Cognitive Diagnosis: A Multi-grained Modeling Perspective
abstract
Cognitive Diagnosis has been widely investigated as a fundamental task in the field of education, aiming at effectively assessing the students' knowledge proficiency level by mining their exercise records. Recently, group-level cognitive diagnosis is also attracting attention, which measures the group-level knowledge proficiency on specific concepts by modeling the response behaviors of all students within the classes. However, existing work tends to explore group characteristics with a coarse-grained perspective while ignoring the inter-individual variability within groups, which is prone to unstable diagnosis results. To this end, in this paper, we propose a novel Homogeneous cohort-aware Group Cognitive Diagnosis model, namely HomoGCD, to effectively model the group's knowledge proficiency level from a multi-grained modeling perspective. Specifically, we first design a homogeneous cohort mining module to explore subgroups of students with similar ability status within a class by modeling their routine exercising performance. Then, we construct the mined cohorts into fine-grained organizations for exploring stable and uniformly distributed features of groups. Subsequently, we develop a multi-grained modeling module to comprehensively learn the cohort and group ability status, which jointly trains both interactions with the exercises. In particular, an extensible diagnosis module is introduced to support the incorporation of different diagnosis functions. Finally, extensive experiments on two real-world datasets clearly demonstrate the generality and effectiveness of our HomoGCD in group as well as cohort~assessments.
Shuhuan Liu, Xiaoshan Yu 0002, Haiping Ma, Ziwen Wang 0006, Chuan Qin 0002, Xingyi Zhang 0001
CIKM3
2023 ReliCD: A Reliable Cognitive Diagnosis Framework with Confidence Awareness
abstract
During the past few decades, cognitive diagnostics modeling has attracted increasing attention in computational education communities, which is capable of quantifying the learning status and knowledge mastery levels of students. Indeed, the recent advances in neural networks have greatly enhanced the performance of traditional cognitive diagnosis models through learning the deep representations of students and exercises. Nevertheless, existing approaches often suffer from the issue of overconfidence in predicting students’ mastery levels, which is primarily caused by the unavoidable noise and sparsity in realistic student-exercise interaction data, severely hindering the educational application of diagnostic feedback. To address this, in this paper, we propose a novel Reliable Cognitive Diagnosis (ReliCD) framework, which can quantify the confidence of the diagnosis feedback and is flexible for different cognitive diagnostic functions. Specifically, we first propose a Bayesian method to explicitly estimate the state uncertainty of different knowledge concepts for students, which enables the confidence quantification of diagnostic feedback. In particular, to account for potential differences, we suggest modeling individual prior distributions for the latent variables of different ability concepts using a pre-trained model. Additionally, we introduce a logical hypothesis for ranking confidence levels. Along this line, we design a novel calibration loss to optimize the confidence parameters by modeling the process of student performance prediction. Finally, extensive experiments on four real-world datasets clearly demonstrate the effectiveness of our ReliCD framework.
Chuan Qin 0002, Dazhong Shen, Haiping Ma, Le Zhang 0010, Xingyi Zhang 0001, Hengshu Zhu
ICDM4
2023 Evolutionary Neural Architecture Search for Transformer in Knowledge Tracing
abstract
Knowledge tracing (KT) aims to trace students' knowledge states by predicting whether students answer correctly on exercises. Despite the excellent performance of existing Transformer-based KT approaches, they are criticized for the manually selected input features for fusion and the defect of single global context modelling to directly capture students' forgetting behavior in KT, when the related records are distant from the current record in terms of time. To address the issues, this paper first considers adding convolution operations to the Transformer to enhance its local context modelling ability used for students' forgetting behavior, then proposes an evolutionary neural architecture search approach to automate the input feature selection and automatically determine where to apply which operation for achieving the balancing of the local/global context modelling. In the search space, the original global path containing the attention module in Transformer is replaced with the sum of a global path and a local path that could contain different convolutions, and the selection of input features is also considered. To search the best architecture, we employ an effective evolutionary algorithm to explore the search space and also suggest a search space reduction strategy to accelerate the convergence of the algorithm. Experimental results on the two largest and most challenging education datasets demonstrate the effectiveness of the architecture found by the proposed approach.
Shangshang Yang, Xiaoshan Yu 0002, Ye Tian 0009, Xueming Yan, Haiping Ma, Xingyi Zhang 0001
NeurIPS5
2023 A Probabilistic Framework for Temporal Cognitive Diagnosis in Online Learning Systems
Jiayu Liu 0001, Fei Wang 0063, Haiping Ma, Zhenya Huang, Qi Liu 0003, Enhong Chen, Yu Su 0002
J. Comput. Sci. Technol.3
2023 Non-Uniform Illumination Underwater Image Enhancement via Minimum Weighted Error Entropy Loss
abstract
An effective enhanced unsupervised network based on minimum weighted error entropy (MWEE) loss is proposed for underwater image enhancement, which is one of the most challenging issues in computer vision. First, by the inspiration of Retinex theory, an underwater image is decomposed into non-uniform illumination and reflectance with shot noise. Then non-uniform illumination is modeled as an independent and piecewise identical (IPI) distribution, and shot noise in reflectance is seen as a single non-Gaussian distribution. Next, taking advantage of these two distributions, the MWEE criterion and its special case as training losses are embedded into a generative adversarial network (GAN) for piecewise uniformization of illumination and reflectance denoising. Experiments on underwater image enhancement datasets show the network enhanced by the proposed method obtains superior performance, and exhibits higher naturalness and better visual quality than several existing approaches.
Haiping Ma, Shengyi Sun, Senggang Ye, Zheheng Jiang
IEEE Signal Process. Lett.1
2023 A Search Space Reduction-Based Progressive Evolutionary Algorithm for Influence Maximization in Social Networks
abstract
Influence maximization (IM) problem, which selects a subset of nodes from a social network to maximize the influence spread, appeals to numerous scholars. Since the IM problem is NP-hard, it is still an arduous task to achieve good results in terms of influence spread and running time at the same time. This article proposes a novel search space reduction strategy-based progressive evolutionary algorithm (SSR-PEA) for solving IM problems effectively and efficiently. In SSR-PEA, a novel search space reduction strategy (SSR) in the light of the power-law distribution of the social network is designed to reduce the computational overheads, which eliminates a great deal of less influential nodes in a sensible way. After that, we propose a progressive evolutionary framework based on SSR, where the$k$-element individual is optimized on the basis of the ($k$-1)-element individual to speed up the optimal solution search process. Experimental results on ten real-world networks demonstrate that the proposed algorithm SSR-PEA can achieve 98% of the influence spread achieved by cost-effective lazy forward (CELF) on average, and its running time is two or even three orders of magnitude shorter. Thus, SSR-PEA strikes a better balance between effectiveness and efficiency.
Lei Zhang 0060, Kaicong Ma, Haipeng Yang, Cheng Zhang 0010, Haiping Ma, Qi Liu 0003
IEEE Trans. Comput. Soc. Syst.5
2022 Fully Adaptive Framework: Neural Computerized Adaptive Testing for Online Education
abstract
Computerized Adaptive Testing (CAT) refers to an efficient and personalized test mode in online education, aiming to accurately measure student proficiency level on the required subject/domain. The key component of CAT is the "adaptive" question selection algorithm, which automatically selects the best suited question for student based on his/her current estimated proficiency, reducing test length. Existing algorithms rely on some manually designed and pre-fixed informativeness/uncertainty metrics of question for selections, which is labor-intensive and not sufficient for capturing complex relations between students and questions. In this paper, we propose a fully adaptive framework named Neural Computerized Adaptive Testing (NCAT), which formally redefines CAT as a reinforcement learning problem and directly learns selection algorithm from real-world data. Specifically, a bilevel optimization is defined and simplified under CAT's application scenarios to make the algorithm learnable. Furthermore, to address the CAT task effectively, we tackle it as an equivalent reinforcement learning problem and propose an attentive neural policy to model complex non-linear interactions. Extensive experiments on real-world datasets demonstrate the effectiveness and robustness of NCAT compared with several state-of-the-art methods.
Yan Zhuang 0001, Qi Liu 0003, Zhenya Huang, Zhi Li 0057, Shuanghong Shen, Haiping Ma
AAAI6
2022 Knowledge-Sensed Cognitive Diagnosis for Intelligent Education Platforms
abstract
Cognitive diagnosis is a fundamental issue of intelligent education platforms, whose goal is to reveal the mastery of students on knowledge concepts. Recently, certain efforts have been made to improve the diagnosis precision, by designing deep neural networks-based diagnostic functions or incorporating more rich context features to enhance the representation of students and exercises. However, how to interpretably infer the student's mastery over non-interactive knowledge concepts (i.e., knowledge concepts not related to his/her exercising records) still remains challenging, especially when not giving relations between knowledge concepts. To this end, we propose a Knowledge-Sensed Cognitive Diagnosis (KSCD) framework, aiming at learning intrinsic relations among knowledge concepts from student response logs and incorporating them for inferring students' mastery over all knowledge concepts in an end-to-end manner. Specifically, we firstly project students, exercises and knowledge concepts into embedding representation matrices, where the intrinsic relations among knowledge concepts are reflected in the knowledge embedding representation matrix. Then, the knowledge-sensed student knowledge mastery vector and exercise factor vectors are obtained by the multiply product of their embedding representations and the knowledge embedding representation matrix, which make the student's mastery of non-interactive knowledge concepts be interpretably inferred. Finally, we can utilize classical student-exercise interaction functions to predict student's exercising performance and jointly train the model. In additional, we also design a new function to better model the student-exercise interactions. Extensive experimental results on two real-world datasets clearly show the significant performance gain of our KSCD framework, especially in predicting students' mastery over non-interactive knowledge concepts, by comparing to state-of-the-art cognitive diagnosis models (CDMs).
Haiping Ma, Manwei Li, Le Wu 0001, Haifeng Zhang 0003, Yunbo Cao, Xingyi Zhang 0001, Xuemin Zhao
CIKM1
2022 A Prerequisite Attention Model for Knowledge Proficiency Diagnosis of Students
abstract
With the rapid development of intelligent education platforms, how to enhance the performance of diagnosing students' knowledge proficiency has become an important issue, e.g., by incorporating the prerequisite relation of knowledge concepts. Unfortunately, the differentiated influence from different predecessor concepts to successor concepts is still underexplored in existing approaches. To this end, we propose a Prerequisite Attention model for Knowledge Proficiency diagnosis of students (PAKP) to learn the attentive weights of precursor concepts on successor concepts and model it for inferring the knowledge proficiency. Specifically, given the student response records and knowledge prerequisite graph, we design an embedding layer to output the representations of students, exercises, and concepts. Influence coefficient among concepts is calculated via an efficient attention mechanism in a fusion layer. Finally, the performance of each student is predicted based on the mined student and exercise factors. Extensive experiments on real-data sets demonstrate that PAKP exhibits great efficiency and interpretability advantages without accuracy loss.
Haiping Ma, Shangshang Yang, Qi Liu 0003, Haifeng Zhang 0003, Xingyi Zhang 0001, Yunbo Cao, Xuemin Zhao
CIKM1
2022 Reconciling Cognitive Modeling with Knowledge Forgetting: A Continuous Time-aware Neural Network Approach
abstract
As an emerging technology of computer-aided education, cognitive modeling aims at discovering the knowledge proficiency or learning ability of students, which can enable a wide range of intelligent educational applications. While considerable efforts have been made in this direction, a long-standing research challenge is how to naturally integrate the forgetting mechanism into the learning process of knowledge concepts. To this end, in this paper, we propose a novel Continuous Time based Neural Cognitive Modeling(CT-NCM) approach to integrate the dynamism and continuity of knowledge forgetting into students' learning process modeling in a realistic manner. To be specific, we first adapt the neural Hawkes process with a specially-designed learning event encoding method to model the relationship between knowledge learning and forgetting with continuous time. Then, we propose a learning function with extendable settings to jointly model the change of different knowledge states and their interactions with the exercises at each moment. In this way, CT-NCM can simultaneously predict the future knowledge state and exercise performance of students. Finally, we conduct extensive experiments on five real-world datasets with various benchmark methods. The experimental results clearly validate the effectiveness of CT-NCM and show its interpretability in terms of knowledge learning visualization.
Haiping Ma, Hengshu Zhu, Haifeng Zhang 0003, Xingyi Zhang 0001, Lei Zhang 0060
IJCAI1
2022 SWIPENET: Object detection in noisy underwater scenes
abstract
Deep learning based object detection methods have achieved promising performance in controlled environments. However, these methods lack sufficient capabilities to handle underwater object detection due to these challenges: (1) images in the underwater datasets and real applications are blurry whilst accompanying severe noise that confuses the detectors and (2) objects in real applications are usually small. In this paper, we propose a Sample-WeIghted hyPEr Network (SWIPENET), and a novel training paradigm named Curriculum Multi-Class Adaboost (CMA), to address these two problems at the same time. Firstly, the backbone of SWIPENET produces multiple high resolution and semantic-rich Hyper Feature Maps, which significantly improve small object detection. Secondly, inspired by the human education process that drives the learning from easy to hard concepts, we propose the noise-robust CMA training paradigm that learns the clean data first and then move on to learns the diverse noisy data. Experiments on four underwater object detection datasets show that the proposed SWIPENET+CMA framework achieves better or competitive accuracy in object detection against several state-of-the-art approaches.
Long Chen 0019, Feixiang Zhou, Shengke Wang, Junyu Dong, Ning Li 0012, Haiping Ma, Xin Wang 0068, Huiyu Zhou 0001
Pattern Recognit.6
2022 Multi-system genetic algorithm for complex system optimization
Haiping Ma, Yu Shan, Jinglin Wang, Zhile Yang, Dan Simon
Soft Comput.1
2022 CoEA: A Cooperative-Competitive Evolutionary Algorithm for Bidirectional Recommendations
abstract
In recent decades, recommender systems have been well studied and widely applied. However, most recommenders unilaterally optimize the results from the buying customers’ views without considering expectations of other participants, e.g., merchants. Unfortunately, the expectations of customers and merchants in recommendation are different or even conflicted. Especially for popular group-trading markets, customers and merchants are competing in trading, i.e., customers want to meet their preferences or obtain gains with personal favorite items, while merchants want to recommend wholesale items with setting group-trading terms or conditions. In addition, some practical constraints are not fully considered by prior systems. In this article, we propose a cooperative–competitive evolutionary algorithm (i.e., CoEA) for the bidirectional recommendations in group-trading markets. Specifically, we, respectively, formalize two subproblems with designed objectives for two-sided participants in markets, and integrate the cooperative–competitive optimizations into one framework. Second, CoEA designs abinary encoding matrixfor individual representation to integrate the two subproblems. Furthermore, by assembling game evolution process, CoEA designs cooperative–competitive evolution operators, i.e., thecooperative crossoverandcompetitive mutation, which guide the solutions to equilibrium by, respectively, bridging communication between two populations of subproblems and optimizing distinctive objective in each population. Finally, we construct two real applications involving bidirectional recommendations, i.e., the group buying and P2P lending, and conduct extensive experiments with the real-world datasets. By comparing CoEA with several representative recommendation algorithms and evolutionary algorithms, the experimental results clearly demonstrate the effectiveness of CoEA.
Hongke Zhao, Xinpeng Wu, Chuang Zhao 0002, Lei Zhang 0060, Haiping Ma, Fan Cheng 0001
IEEE Trans. Evol. Comput.5
2021 Privileged Graph Distillation for Cold Start Recommendation
abstract
The cold start problem in recommender systems is a long-standing challenge, which requires recommending to new users (items) based on attributes without any historical interaction records. In these recommendation systems, warm users (items) have privileged collaborative signals of interaction records compared to cold start users (items), and these Collaborative Filtering (CF) signals are shown to have competing performance for recommendation. Many researchers proposed to learn the correlation between collaborative signal embedding space and the attribute embedding space to improve the cold start recommendation, in which user and item categorical attributes are available in many online platforms. However, the cold start recommendation is still limited by two embedding spaces modeling and simple assumptions of space transformation. As user-item interaction behaviors and user (item) attributes naturally form a heterogeneous graph structure, in this paper, we propose a privileged graph distillation model (PGD). The teacher model is composed of a heterogeneous graph structure for warm users and items with privileged CF links. The student model is composed of an entity-attribute graph without CF links. Specifically, the teacher model can learn better embeddings of each entity by injecting complex higher-order relationships from the constructed heterogeneous graph. The student model can learn the distilled output with privileged CF embeddings from the teacher embeddings. Our proposed model is generally applicable to different cold start scenarios with new user, new item, or new user-new item. Finally, extensive experimental results on the real-world datasets clearly show the effectiveness of our proposed model on different types of cold start problems, with average 6.6%, 5.6%, and 17.1% improvement over state-of-the-art baselines on three datasets, respectively.
Shuai Wang 0020, Kun Zhang 0015, Le Wu 0001, Haiping Ma, Richang Hong, Meng Wang 0001
SIGIR4
2021 Federated Deep Knowledge Tracing
abstract
Knowledge tracing is a fundamental task in intelligent education for tracking the knowledge states of students on necessary concepts. In recent years, Deep Knowledge Tracing (DKT) utilizes recurrent neural networks to model student learning sequences. This approach has achieved significant success and has been widely used in many educational applications. However, in practical scenarios, it tends to suffer from the following critical problems due to data isolation: 1) Data scarcity. Educational data, which is usually distributed across different silos (e.g., schools), is difficult to gather. 2) Different data quality. Students in different silos have different learning schedules, which results in unbalanced learning records, meaning that it is necessary to evaluate the learning data quality independently for different silos. 3) Data incomparability. It is difficult to compare the knowledge states of students with different learning processes from different silos. Inspired by federated learning, in this paper, we propose a novel Federated Deep Knowledge Tracing (FDKT) framework to collectively train high-quality DKT models for multiple silos. In this framework, each client takes charge of training a distributed DKT model and evaluating data quality by leveraging its own local data, while a center server is responsible for aggregating models and updating the parameters for all the clients. In particular, in the client part, we evaluate data quality incorporating different education measurement theories, and we construct two quality-oriented implementations based on FDKT, i.e., FDKTCTT and FDKTIRT-where the means of data quality evaluation follow Classical Test Theory and Item Response Theory, respectively. Moreover, in the server part, we adopt hierarchical model interpolation to uptake local effects for model personalization. Extensive experiments on real-world datasets demonstrate the effectiveness and superiority of the FDKT framework.
Zhenya Huang, Qi Liu 0003, Defu Lian, Hao Wang 0076, Enhong Chen, Haiping Ma, Shijin Wang 0001
WSDM7
2021 A multi-stage evolutionary algorithm for multi-objective optimization with complex constraints
Haiping Ma, Haoyu Wei, Ye Tian 0009, Ran Cheng 0004, Xingyi Zhang 0001
Inf. Sci.1
2021 Balancing topology structure and node attribute in evolutionary multi-objective community detection for attributed networks
Haiping Ma, Zhenjie Liu, Xingyi Zhang 0001, Lei Zhang 0060, Hao Jiang 0023
Knowl. Based Syst.1
2021 A local-to-global scheme-based multi-objective evolutionary algorithm for overlapping community detection on large-scale complex networks
Haiping Ma, Haipeng Yang, Kefei Zhou, Lei Zhang 0060, Xingyi Zhang 0001
Neural Comput. Appl.1
2021 A Multipopulation Evolutionary Algorithm for Solving Large-Scale Multimodal Multiobjective Optimization Problems
abstract
Multimodal multiobjective optimization problems (MMOPs) widely exist in real-world applications, which have multiple equivalent Pareto-optimal solutions that are similar in the objective space but totally different in the decision space. While some evolutionary algorithms (EAs) have been developed to find the equivalent Pareto-optimal solutions in recent years, they are ineffective to handle large-scale MMOPs having a large number of variables. This article thus proposes an EA for solving large-scale MMOPs with sparse Pareto-optimal solutions, i.e., most variables in the optimal solutions are 0. The proposed algorithm explores different regions of the decision space via multiple subpopulations and guides the search behavior of the subpopulations via adaptively updated guiding vectors. The guiding vector for each subpopulation not only provides efficient convergence in the huge search space but also differentiates its search direction from others to handle the multimodality. While most existing EAs solve MMOPs with 2-7 decision variables, the proposed algorithm is shown to be effective for benchmark MMOPs with up to 500 decision variables. Moreover, the proposed algorithm also produces a better result than state-of-the-art methods for the neural architecture search.
Ye Tian 0009, Ruchen Liu, Xingyi Zhang 0001, Haiping Ma, Kay Chen Tan, Yaochu Jin
IEEE Trans. Evol. Comput.4
2020 An Overlapping Community Detection Based Multi-Objective Evolutionary Algorithm for Diversified Social Influence Maximization
abstract
Influence maximization refers to selecting a group of nodes from a social network, which obtains the largest influence spread under a cascade model. However, most of the existing works only focused on the influence and ignored the diversity of influenced crowd. Thus, scholars have raised the issue of diversified social influence maximization recently, using the category information of nodes to design diversity indicator and introducing a trade-off parameter to balance the two objectives influence and diversity as one single objective for optimization. In fact, the category information of nodes in the network is usually difficult to be collected, thus the definition of diversity based on nodes' categories is not very general and accurate. In addition, it is very difficult to set the trade-off parameter, especially when there is no prior knowledge in real applications. To this end, we employ overlapping community structure information to design the diversity of nodes without any node's additional (e.g. category) information. Due to the two objectives of influence and diversity may be conflicting, a multi-objective evolutionary algorithm named MOEA-DIM is proposed to optimize the two objectives simultaneously, which does not need to set the tradeoff parameter between the two objectives. In MOEA-DIM, a network reduction strategy based on overlapping community structure is suggested to greatly reduce the search space. In addition, a population initialization strategy based on random walk is designed to accelerate the convergence of the algorithm. Experiments on six real-world datasets show that the proposed algorithm MOEA-DIM has promising performance in terms of both effectiveness and efficiency.
Lei Zhang 0060, Fengiiao Sun, Fan Cheng 0001, Haiping Ma, Xiaoyan Sun 0002
CEC4
2020 Quality meets Diversity: A Model-Agnostic Framework for Computerized Adaptive Testing
abstract
Computerized Adaptive Testing (CAT) is emerging as a promising testing application in many scenarios, such as education, game and recruitment, which targets at diagnosing the knowledge mastery levels of examinees on required concepts. It shows the advantage of tailoring a personalized testing procedure for each examinee, which selects questions step by step, depending on her performance. While there are many efforts on developing CAT systems, existing solutions generally follow an inflexible model-specific fashion. That is, they need to observe a specific cognitive model which can estimate examinee's knowledge levels and design the selection strategy according to the model estimation. In this paper, we study a novel model-agnostic CAT problem, where we aim to propose a flexible framework that can adapt to different cognitive models. Meanwhile, this work also figures out CAT solution with addressing the problem of how to generate both high-quality and diverse questions simultaneously, which can give a comprehensive knowledge diagnosis for each examinee. Inspired by Active Learning, we propose a novel framework, namely Model-Agnostic Adaptive Testing (MAAT) for CAT solution, where we design three sophisticated modules including Quality Module, Diversity Module and Importance Module. Specifically, at one CAT selection step, Quality Module first quantifies the informativeness of questions and generates candidate subset with the highest quality. Then, Diversity Module selects one question at each step that maximizes the concept coverage. Additionally, we propose Importance Module to estimate the importance of concepts that optimizes the CAT selection. Under MAAT, we prove that the goal of maximizing both quality and diversity is NP-hard, but we provide efficient algorithms by exploiting the inherent submodular property. Extensive experimental results on two real-world datasets clearly demonstrate that our MAAT can support CAT with guaranteeing both quality and diversity perspectives.
Haoyang Bi, Haiping Ma, Zhenya Huang, Yu Yin 0002, Qi Liu 0003, Enhong Chen, Yu Su 0002, Shijin Wang 0001
ICDM2
2020 Structure-based Knowledge Tracing: An Influence Propagation View
abstract
Knowledge Tracing (KT) is a fundamental but challenging task in online education that traces learners' evolving knowledge states. Much attention has been drawn to this area and several works such as Bayesian Knowledge Tracing and Deep Knowledge Tracing are proposed. Recent works have explored the value of relations among concepts and proposed to introduce knowledge structure into KT task. However, the propagated influence among concepts, which has been shown to be a key factor in human learning by the educational theories, is still under-explored. In this paper, we propose a new framework called Structure-based Knowledge Tracing (SKT), which exploits the multiple relations in knowledge structure to model the influence propagation among concepts. In the SKT framework, we not only consider the temporal effect on the exercising sequence but also take the spatial effect on the knowledge structure into account. We take advantages of two novel formulations in modeling the influence propagation on the knowledge structure with multiple relations. For undirected relations such as similarity relations, the synchronization propagation method is adopted, where the influence propagates bidirectionally between neighbor concepts. For directed relations such as prerequisite relations, the partial propagation method is applied, where the influence can only unidirectionally propagate from a predecessor to a successor. Meanwhile, we employ the gated functions to update the states of concepts temporally and spatially. Extensive experiments demonstrate the effectiveness and interpretability of SKT.
Shiwei Tong, Qi Liu 0003, Wei Huang 0002, Zhenya Huang, Enhong Chen, Chuanren Liu, Haiping Ma, Shijin Wang 0001
ICDM7
2020 Convolutional Knowledge Tracing: Modeling Individualization in Student Learning Process
abstract
With the development of online education systems, a growing number of research works are focusing on Knowledge Tracing (KT), which aims to assess students' changing knowledge state and help them learn knowledge concepts more efficiently. However, only given student learning interactions, most of existing KT methods neglect the individualization of students, i.e., the prior knowledge and learning rates differ from student to student. To this end, in this paper, we propose a novel Convolutional Knowledge Tracing (CKT) method to model individualization in KT. Specifically, for individualized prior knowledge, we measure it from students' historical learning interactions. For individualized learning rates, we design hierarchical convolutional layers to extract them based on continuous learning interactions of students. Extensive experiments demonstrate that CKT could obtain better knowledge tracing results through modeling individualization in learning process. Moreover, CKT can learn meaningful exercise embeddings automatically.
Shuanghong Shen, Qi Liu 0003, Enhong Chen, Han Wu 0002, Zhenya Huang, Yu Su 0002, Haiping Ma, Shijin Wang 0001
SIGIR8
2020 Leveraging proficiency and preference for online Karaoke recommendation
Hao Guo 0016, Guangyi Lv, Le Wu 0001, Yong Ge 0001, Enhong Chen, Haiping Ma
Frontiers Comput. Sci.7
2020 A Multipopulation-Based Multiobjective Evolutionary Algorithm
abstract
Multipopulation is an effective optimization component often embedded into evolutionary algorithms to solve optimization problems. In this paper, a new multipopulation-based multiobjective genetic algorithm (MOGA) is proposed, which uses a unique cross-subpopulation migration process inspired by biological processes to share information between subpopulations. Then, a Markov model of the proposed multipopulation MOGA is derived, the first of its kind, which provides an exact mathematical model for each possible population occurring simultaneously with multiple objectives. Simulation results of two multiobjective test problems with multiple subpopulations justify the derived Markov model, and show that the proposed multipopulation method can improve the optimization ability of the MOGA. Also, the proposed multipopulation method is applied to other multiobjective evolutionary algorithms (MOEAs) for evaluating its performance against the IEEE Congress on Evolutionary Computation multiobjective benchmarks. The experimental results show that a single-population MOEA can be extended to a multipopulation version, while obtaining better optimization performance.
Haiping Ma, Minrui Fei, Zheheng Jiang, Ling Li 0010, Huiyu Zhou 0001, Danny Crookes
IEEE Trans. Cybern.1
2020 Learning or Forgetting? A Dynamic Approach for Tracking the Knowledge Proficiency of Students
abstract
The rapid development of the technologies for online learning provides students with extensive resources for self-learning and brings new opportunities for data-driven research on educational management. An important issue of online learning is to diagnose the knowledge proficiency (i.e., the mastery level of a certain knowledge concept) of each student. Considering that it is a common case that students inevitably learn and forget knowledge from time to time, it is necessary to track the change of their knowledge proficiency during the learning process. Existing approaches either relied on static scenarios or ignored the interpretability of diagnosis results. To address these problems, in this article, we present a focused study on diagnosing the knowledge proficiency of students, where the goal is to track and explain their evolutions simultaneously. Specifically, we first devise an explanatory probabilistic matrix factorization model, Knowledge Proficiency Tracing (KPT), by leveraging educational priors. KPT model first associates each exercise with a knowledge vector in which each element represents a specific knowledge concept with the help of Q -matrix. Correspondingly, at each time, each student can be represented as a proficiency vector in the same knowledge space. Then, our KPT model jointly applies two classical educational theories (i.e., learning curve and forgetting curve ) to capture the change of students’ proficiency level on concepts over time. Furthermore, for improving the predictive performance, we develop an improved version of KPT, named Exercise-correlated Knowledge Proficiency Tracing (EKPT), by considering the connectivity among exercises with the same knowledge concepts. Finally, we apply our KPT and EKPT models to three important diagnostic tasks, including knowledge estimation, score prediction, and diagnosis result visualization. Extensive experiments on four real-world datasets demonstrate that both of our models could track the knowledge proficiency of students effectively and interpretatively.
Zhenya Huang, Qi Liu 0003, Yuying Chen, Le Wu 0001, Keli Xiao, Enhong Chen, Haiping Ma
ACM Trans. Inf. Syst.7
2019 DIRT: Deep Learning Enhanced Item Response Theory for Cognitive Diagnosis
abstract
Cognitive diagnosis is the cornerstone of modern educational techniques. One of the most classic cognitive diagnosis methods is Item Response Theory (IRT), which provides interpretable parameters for analyzing student performance. However, traditional IRT only exploits student response results and has difficulties in fully utilizing the semantics of question texts, which significantly restricts its application. To this end, in this paper, we propose a simple yet surprisingly effective framework to enhance the semantic exploiting process, which we termed Deep Item Response Theory (DIRT). In DIRT, we first use a proficiency vector to represent student proficiency on knowledge concepts and represent question texts and knowledge concepts by dense embedding. Then, we use deep learning to enhance the process of diagnosing parameters of student and question by exploiting question texts and the relationship between question texts and knowledge concepts. Finally, with the diagnosed parameters, we adopt the item response function to predict student performance. Extensive experimental results on real-world data clearly demonstrate the effectiveness and the interpretability of DIRT framework.
Qi Liu 0003, Enhong Chen, Zai Huang, Zhenya Huang, Yiying Chen, Haiping Ma
CIKM7
2019 Exploiting Cognitive Structure for Adaptive Learning
abstract
Adaptive learning, also known as adaptive teaching, relies on learning path recommendation, which sequentially recommends personalized learning items (e.g., lectures, exercises) to satisfy the unique needs of each learner. Although it is well known that modeling the cognitive structure including knowledge level of learners and knowledge structure (e.g., the prerequisite relations) of learning items is important for learning path recommendation, existing methods for adaptive learning often separately focus on either knowledge levels of learners or knowledge structure of learning items. To fully exploit the multifaceted cognitive structure for learning path recommendation, we propose a Cognitive Structure Enhanced framework for Adaptive Learning, named CSEAL. By viewing path recommendation as a Markov Decision Process and applying an actor-critic algorithm, CSEAL can sequentially identify the right learning items to different learners. Specifically, we first utilize a recurrent neural network to trace the evolving knowledge levels of learners at each learning step. Then, we design a navigation algorithm on the knowledge structure to ensure the logicality of learning paths, which reduces the search space in the decision process. Finally, the actor-critic algorithm is used to determine what to learn next and whose parameters are dynamically updated along the learning path. Extensive experiments on real-world data demonstrate the effectiveness and robustness of CSEAL.
Qi Liu 0003, Shiwei Tong, Chuanren Liu, Hongke Zhao, Enhong Chen, Haiping Ma, Shijin Wang 0001
KDD6
2019 Context-Aware Mouse Behavior Recognition Using Hidden Markov Models
abstract
Automated recognition of mouse behaviors is crucial in studying psychiatric and neurologic diseases. To achieve this objective, it is very important to analyze the temporal dynamics of mouse behaviors. In particular, the change between mouse neighboring actions is swift in a short period. In this paper, we develop and implement a novel hidden Markov model (HMM) algorithm to describe the temporal characteristics of mouse behaviors. In particular, we here propose a hybrid deep learning architecture, where the first unsupervised layer relies on an advanced spatial-temporal segment Fisher vector encoding both visual and contextual features. Subsequent supervised layers based on our segment aggregate network are trained to estimate the state-dependent observation probabilities of the HMM. The proposed architecture shows the ability to discriminate between visually similar behaviors and results in high recognition rates with the strength of processing imbalanced mouse behavior datasets. Finally, we evaluate our approach using JHuang's and our own datasets, and the results show that our method outperforms other state-of-the-art approaches.
Zheheng Jiang, Danny Crookes, Brian Desmond Green, Haiping Ma, Ling Li 0010, Shengping Zhang, Dacheng Tao, Huiyu Zhou 0001
IEEE Trans. Image Process.5
2018 A Novel Binary Jaya Optimization for Economic/Emission Unit Commitment
abstract
Economic unit commitment is a mix-integer large scale optimization problem calling for powerful and efficient tools. On the other hand, environmental impact related to the power generation is attracting increasing attentions due to the global warming trend and urgent calls for sustainable energy development. In this paper, the dual objectives of economic and emission unit commitment is converted into a single objective problem. For solving this, a novel binary Jaya optimization is proposed and integrated with lambda iteration method. The proposed binary Jaya method is inspired by the Jaya evolution and generates binary bits from a v-shape transfer function. Numerical study demonstrates the significant improvement of the binary Jaya in regarding the convergence speed for solving unit commitment problem. The solution distributions of the both objectives also show the effective of the proposed methods.
Zhile Yang, Yuanjun Guo, Qun Niu, Haiping Ma, Yimin Zhou 0001, Li Zhang 0073
CEC4
2018 Compact real-valued teaching-learning based optimization with the applications to neural network training
Zhile Yang, Kang Li 0002, Yuanjun Guo, Haiping Ma
Knowl. Based Syst.4
2017 An Ad CTR Prediction Method Based on Feature Learning of Deep and Shallow Layers
abstract
In online advertising, Click-Through Rate (CTR) prediction is a crucial task, as it may benefit the ranking and pricing of online ads. To the best of our knowledge, most of the existing CTR prediction methods are shallow layer models (e.g., Logistic Regression and Factorization Machines) or deep layer models (e.g., Neural Networks). Unfortunately, the shallow layer models cannot capture or utilize high-order nonlinear features in ad data. On the other side, the deep layer models cannot satisfy the necessity of updating CTR models online efficiently due to their high computational complexity. To address the shortcomings above, in this paper, we propose a novel hybrid method based on feature learning of both Deep and Shallow Layers (DSL). In DSL, we utilize Deep Neural Network as a deep layer model trained offline to learn high-order nonlinear features and use Factorization Machines as a shallow layer model for CTR prediction. Furthermore, we also develop an online learning implementation based on DSL, i.e., onlineDSL. Extensive experiments on large-scale real-world datasets clearly validate the effectiveness of our DSL method and onlineDSL algorithm compared with several state-of-the-art baselines.
Zai Huang, Zhen Pan, Qi Liu 0003, Bai Long, Haiping Ma, Enhong Chen
CIKM5
2017 A non-cooperative non-zero-sum game-based dependability assessment of heterogeneous WSNs with malware diffusion
Shigen Shen, Haiping Ma, En Fan, Keli Hu, Shui Yu 0001, Jianhua Liu 0004, Qiying Cao
J. Netw. Comput. Appl.2
2017 Conceptual and numerical comparisons of swarm intelligence optimization algorithms
Haiping Ma, Sengang Ye, Dan Simon, Minrui Fei
Soft Comput.1
2017 Interactive Markov Models of Optimization Search Strategies
abstract
This paper introduces a Markov model for evolutionary algorithms (EAs) that is based on interactions among individuals in the population. This interactive Markov model has the potential to provide tractable models for optimization problems of realistic size. We propose two simple discrete optimization search strategies with population-proportion-based selection and a modified mutation operator. The probability of selection is linearly proportional to the number of individuals at each point of the search space. The mutation operator randomly modifies an entire individual rather than a single decision variable. We exactly model these optimization search strategies with interactive Markov models. We present simulation results to confirm the interactive Markov model theory. We show that genetic algorithms and biogeography-based optimization perform better with the addition of population-proportion-based selection on a set of real-world benchmarks. We note that many other EAs, both new and old, might be able to be improved with this addition, or modeled with this method.
Haiping Ma, Dan Simon, Minrui Fei
IEEE Trans. Syst. Man Cybern. Syst.1
2016 Sparse Factorization Machines for Click-through Rate Prediction
abstract
With the rapid development of E-commerce, recent years have witnessed the booming of online advertising industry, which raises extensive concerns of both academic and business circles. Among all the issues, the task of Click-through rates (CTR) prediction plays a central role, as it may influence the ranking and pricing of online ads. To deal with this task, the Factorization Machines (FM) model is designed for better revealing proper combinations of basic features. However, the sparsity of ads transaction data, i.e., a large proportion of zero elements, may severely disturb the performance of FM models. To address this problem, in this paper, we propose a novel Sparse Factorization Machines (SFM) model, in which the Laplace distribution is introduced instead of traditional Gaussian distribution to model the parameters, as Laplace distribution could better fit the sparse data with higher ratio of zero elements. Along this line, it will be beneficial to select the most important features or conjunctions with the proposed SFM model. Furthermore, we develop a distributed implementation of our SFM model on Spark platform to support the prediction task on mass dataset in practice. Comprehensive experiments on two large-scale real-world datasets clearly validate both the effectiveness and efficiency of our SFM model compared with several state-of-the-art baselines, which also proves our assumption that Laplace distribution could be more suitable to describe the online ads transaction data.
Zhen Pan, Enhong Chen, Qi Liu 0003, Tong Xu 0001, Haiping Ma, Hongjie Lin
ICDM5
2016 Statistical Mechanics Approximation of Biogeography-Based Optimization
abstract
Biogeography-based optimization (BBO) is an evolutionary algorithm inspired by biogeography, which is the study of the migration of species between habitats. This paper derives a mathematical description of the dynamics of BBO based on ideas from statistical mechanics. Rather than trying to exactly predict the evolution of the population, statistical mechanics methods describe the evolution of statistical properties of the population fitness. This paper uses the one-max problem, which has only one optimum and whose fitness function is the number of 1s in a binary string, to derive equations that predict the statistical properties of BBO each generation in terms of those of the previous generation. These equations reveal the effect of migration and mutation on the population fitness dynamics of BBO. The results obtained in this paper are similar to those for the simple genetic algorithm with selection and mutation. The paper also derives equations for the population fitness dynamics of general separable functions, and we find that the results obtained for separable functions are the same as those for the one-max problem. The statistical mechanics theory of BBO is shown to be in good agreement with simulation.
Haiping Ma, Dan Simon, Minrui Fei
Evol. Comput.1
2016 Biogeography-based optimization for identifying promising compounds in chemical process
Haiping Ma, Minrui Fei, Zhile Yang
Neurocomputing1
2015 Mining User's Location Intention from Mobile Search Log
Xin Li 0064, Lin Li 0001, Qi Liu 0003, Enhong Chen, Haiping Ma
KSEM6
2015 Ensemble multi-objective biogeography-based optimization with application to automated warehouse scheduling
Haiping Ma, Shufei Su, Dan Simon, Minrui Fei
Eng. Appl. Artif. Intell.1
2014 Hybrid biogeography-based evolutionary algorithms
Haiping Ma, Dan Simon, Minrui Fei, Xinzhan Shu, Zixiang Chen
Eng. Appl. Artif. Intell.1
2013 On the equivalences and differences of evolutionary algorithms
Haiping Ma, Dan Simon, Minrui Fei, Zixiang Chen
Eng. Appl. Artif. Intell.1
2013 Variations of biogeography-based optimization and Markov analysis
Haiping Ma, Dan Simon, Minrui Fei, Zhikun Xie
Inf. Sci.1
2012 Biogeography-based optimization with ensemble of migration models for global numerical optimization
abstract
Biogeography-based optimization (BBO) is a new evolutionary algorithm inspired by biogeography. BBO has demonstrated good performance on various benchmark functions and real-world optimization problems. However, the performance of BBO is sensitive to the migration model which provides the most important control parameters, immigration rate and emigration rate. According to no free lunch theorem, it is impossible for BBO with a single migration model to obtain always good performance. In this paper, BBO with an ensemble of migration models (BBO-EMM) is introduced and is realized using in three parallel populations. The performance is tested on a set of 25 benchmark functions of CEC 2005 and compared with variant versions of BBO with a single migration model with respect to optimization ability and running time. Results show that the proposed BBO-EMM is better than other BBO algorithms for the problems that we studied in this paper.
Haiping Ma, Minrui Fei, Zhiguo Ding 0002
IEEE Congress on Evolutionary Computation1
2012 A habit mining approach for discovering similar mobile users
abstract
Discovering similar users with respect to their habits plays an important role in a wide range of applications, such as collaborative filtering for recommendation, user segmentation for market analysis, etc. Recently, the progressing ability to sense user contexts of smart mobile devices makes it possible to discover mobile users with similar habits by mining their habits from their mobile devices. However, though some researchers have proposed effective methods for mining user habits such as behavior pattern mining, how to leverage the mined results for discovering similar users remains less explored. To this end, we propose a novel approach for conquering the sparseness of behavior pattern space and thus make it possible to discover similar mobile users with respect to their habits by leveraging behavior pattern mining. To be specific, first, we normalize the raw context log of each user by transforming the location-based context data and user interaction records to more general representations. Second, we take advantage of a constraint-based Bayesian Matrix Factorization model for extracting the latent common habits among behavior patterns and then transforming behavior pattern vectors to the vectors of mined common habits which are in a much more dense space. The experiments conducted on real data sets show that our approach outperforms three baselines in terms of the effectiveness of discovering similar mobile users with respect to their habits.
Haiping Ma, Huanhuan Cao, Qiang Yang 0001, Enhong Chen, Jilei Tian
WWW1
2012 Capturing correlations of multiple labels: A generative probabilistic model for multi-label learning
Haiping Ma, Enhong Chen, Linli Xu 0002, Hui Xiong 0001
Neurocomputing1
2011 Blended biogeography-based optimization for constrained optimization
Haiping Ma, Dan Simon
Eng. Appl. Artif. Intell.1
2011 Analysis of migration models of biogeography-based optimization using Markov theory
Haiping Ma, Dan Simon
Eng. Appl. Artif. Intell.1
2011 Exploiting probabilistic topic models to improve text categorization under class imbalance
Enhong Chen, Yanggang Lin, Hui Xiong 0001, Qiming Luo, Haiping Ma
Inf. Process. Manag.5
2010 Biogeography-based optimization with blended migration for constrained optimization problems
abstract
Biogeography-based optimization (BBO) is a new evolutionary algorithm based on the science of biogeography. We propose two extensions to BBO. First, we propose blended migration. Second, we modify BBO to solve constrained optimization problems. The constrained BBO algorithm is compared with solutions based on a genetic algorithm (GA) and particle swarm optimization (PSO). Numerical results indicate that BBO generally performs better than GA and PSO in handling constrained single-objective optimization problems.
Haiping Ma, Dan Simon
GECCO1
2010 An analysis of the equilibrium of migration models for biogeography-based optimization
Haiping Ma
Inf. Sci.1