Feng Xie 0002

dblp:11/4605-2 · DBLP profile ↗
← Back
31ranked-venue papers
8as first author
25since 2021 · last 2026
0000-0001-7229-3955ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 28 · 8 first-author · 23 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 4 since 2021Computer networks · 1Databases, data management, data science and information retrieval · 1 · 1 since 2021Human-computer interaction and ubiquitous computing · 1 · 1 since 2021
YearPublicationVenuePosition
2026 Causal Discovery by Multi-Level Wavelet Mapping Correlation Based Statistical Dependence Measurement
abstract
This article proposes a new method for causal discovery based on a novel dependence measurement criterion, namely, Multi-level Wavelet Mapping Correlation (MWMC). MWMC captures nonlinear dependencies between variables by measuring their correlations across multiple levels of wavelet mappings. From a theoretical perspective, we show that the empirical estimate of MWMC converges exponentially fast to its population quantity. Under the null hypothesis of independence, we further design a permutation-based independence testing procedure, termed the Wavelet Independence Test (WIT), built upon MWMC. We prove that WIT not only effectively controls the Type I error rate (false positives), but also guarantees that the Type II error rate (false negatives) is upper bounded by \(\mathcal{O}(n^{-1})\) , where \( n \) denotes the sample size, even with a finite number of permutations. Building on these theoretical guarantees, we derive a causal discovery method by integrating MWMC-based WIT into standard causal discovery pipelines. Extensive experiments on (conditional) independence testing and causal discovery using both synthetic and real-world datasets with varying sample sizes demonstrate that our approach consistently outperforms existing independence testing and causal discovery methods in terms of reduced Type II error rates and statistically validated performance improvements. Impact Statement —Causal discovery is a fundamental task in knowledge discovery, aiming to uncover the underlying data-generating mechanisms in order to support more accurate and interpretable predictions. Statistical independence tests and conditional independence (CI) tests have long served as core tools in this area. To improve the reliability of independence testing, we propose a novel test, WIT, which achieves lower Type II error rates in 19 out of 25 distinct experimental scenarios involving diverse data distributions, compared to 15 out of 25 for the strongest existing baseline. We further apply WIT to CI testing and causal discovery, and extensive empirical results show that it consistently improves the performance of multiple causal discovery algorithms across a range of experimental settings.
Yixin Ren, Hao Zhang 0079, Yewei Xia, Feng Xie 0002, Jihong Guan, Shuigeng Zhou
ACM Trans. Knowl. Discov. Data4
2025 Rank Constraints of High-Order Cumulants for Learning Linear Non-Gaussian Latent Polytree
abstract
We study the problem of learning the causal structure of a latent tree model only from the observational data. Prior works often assume either a sufficient number of measured variables or the observed variables can only be the child of latent variables (known as measurement assumption). However, they may yield incorrect or uninformative results when some observed variables also cause the latent variable, or when the number of measured variables is less than two. In this paper, we focus on the linear non-Gaussian latent polytree model, where the observed and latent variables can exhibit arbitrary causal dependence and the number of child variables for each latent variable may be only one. By leveraging the non-Gaussianity within the causal model, we introduce rank constraints of high-order cumulants. These constraints align with trek separation within the causal graph and enable the identification of exogenous variables for the relative set. Such properties have intriguing possibilities for identifying the entire latent polytree structure, including not only the number of latent variables but also causal directions. Consequently, we develop an identification algorithm to learn latent polytree by only using the rank constraints of high-order cumulants, and we verify its effectiveness in simulation experiments.
Ruichu Cai, Zhengming Chen 0002, Feng Xie 0002, Zhifeng Hao 0004
CSCWD4
2025 Identification of Latent Confounders via Investigating the Tensor Ranks of the Nonlinear Observations
abstract
We study the problem of learning discrete latent variable causal structures from mixed-type observational data. Traditional methods, such as those based on the tensor rank condition, are designed to identify discrete latent structure models and provide robust identification bounds for discrete causal models. However, when observed variables—specifically, those representing the children of latent variables—are collected at various levels with continuous data types, the tensor rank condition is not applicable, limiting further causal structure learning for latent variables. In this paper, we consider a more general case where observed variables can be either continuous or discrete, and further allow for scenarios where multiple latent parents cause the same set of observed variables. We show that, under the completeness condition, it is possible to discretize the data in a way that satisfies the full-rank assumption required by the tensor rank condition. This enables the identifiability of discrete latent structure models within mixed-type observational data. Moreover, we introduce the two-sufficient measurement condition, a more general structural assumption under which the tensor rank condition holds and the underlying latent causal structure is identifiable by a proposed two-stage identification algorithm. Extensive experiments on both simulated and real-world data validate the effectiveness of our method.
Zhengming Chen 0002, Yewei Xia, Feng Xie 0002, Jie Qiao, Zhifeng Hao 0004, Ruichu Cai, Kun Zhang 0001
ICML3
2025 Data-Driven Selection of Instrumental Variables for Additive Nonlinear, Constant Effects Models
abstract
We consider the problem of selecting instrumental variables from observational data, a fundamental challenge in causal inference. Existing methods mostly focus on additive linear, constant effects models, limiting their applicability in complex real-world scenarios. In this paper, we tackle a more general and challenging setting: the additive non-linear, constant effects model. We first propose a novel testable condition, termed the Cross Auxiliary-based independent Test (CAT) condition, for selecting the valid IV set. We show that this condition is both necessary and sufficient for identifying valid instrumental variable sets within such a model under milder assumptions. Building on this condition, we develop a practical algorithm for selecting the set of valid instrumental variables. Extensive experiments on both synthetic and two real-world datasets demonstrate the effectiveness and robustness of our proposed approach, highlighting its potential for broader applications in causal analysis.
Xichen Guo, Feng Xie 0002, Yan Zeng 0002, Hao Zhang 0079, Zhi Geng
ICML2
2025 Local Identifying Causal Relations in the Presence of Latent Variables
abstract
We tackle the problem of identifying whether a variable is the cause of a specified target using observational data. State-of-the-art causal learning algorithms that handle latent variables typically rely on identifying the global causal structure, often represented as a partial ancestral graph (PAG), to infer causal relationships. Although effective, these approaches are often redundant and computationally expensive when the focus is limited to a specific causal relationship. In this work, we introduce novel local characterizations that are necessary and sufficient for various types of causal relationships between two variables, enabling us to bypass the need for global structure learning. Leveraging these local insights, we develop efficient and fully localized algorithms that accurately identify causal relationships from observational data. We theoretically demonstrate the soundness and completeness of our approach. Extensive experiments on benchmark networks and real-world datasets further validate the effectiveness and efficiency of our method.
Feng Xie 0002, Hao Zhang 0079, Zhi Geng
ICML3
2025 Causal Attribution Analysis for Continuous Outcomes
abstract
Previous studies have extensively addressed the attribution problem for binary outcome variables. However, in many practical scenarios, the outcome variable is continuous, and simply binarizing it may result in information loss or biased conclusions. To address this issue, we propose a series of posterior causal estimands for retrospectively evaluating multiple correlated causes from a continuous outcome. These estimands include posterior intervention effects, posterior total causal effects, and posterior natural direct effects. Under assumptions of sequential ignorability, monotonicity, and perfect positive rank, we show that the posterior causal estimands of interest are identifiable and present the corresponding identification equations. We also provide a simple but effective estimation procedure and establish asymptotic properties of the proposed estimators. An artificial hypertension example and a real developmental toxicity dataset are employed to illustrate our method.
Shanshan Luo, Yixuan Yu 0006, Feng Xie 0002, Zhi Geng
ICML4
2025 Identifying Causal Mechanism Shifts Under Additive Models with Arbitrary Noise
abstract
In many real-world scenarios, the goal is to identify variables whose causal mechanisms change across related datasets. For example, detecting abnormal root nodes in manufacturing, and identifying key genes that influence cancer by analyzing differences in gene regulatory mechanisms between healthy individuals and cancer patients. This can be done by recovering the causal structure for each dataset independently and then comparing them to identify differences, but the performance is often suboptimal. Typically, existing methods directly identify causal mechanism shifts based on linear additive noise models (ANMs) or by imposing restrictive assumptions on the noise distribution. In this paper, we introduce CMSI, a novel and more general algorithm based on nonlinear ANMs that identifies variables with shifting causal mechanisms under arbitrary noise distributions. Evaluated on various synthetic datasets, CMSI consistently outperforms existing baselines in terms of F1 score. Additionally, we demonstrate CMSI's applicability on gene expression datasets of ovarian cancer patients at different disease stages.
Yewei Xia, Xueliang Cui, Hao Zhang 0079, Yixin Ren, Feng Xie 0002, Jihong Guan, Ruxin Wang 0001, Shuigeng Zhou
IJCAI5
2025 Local Learning for Covariate Selection in Nonparametric Causal Effect Estimation with Latent Variables
abstract
Estimating causal effects from nonexperimental data is a fundamental problem in many fields of science. A key component of this task is selecting an appropriate set of covariates for confounding adjustment to avoid bias. Most existing methods for covariate selection often assume the absence of latent variables and rely on learning the global causal structure among variables. However, identifying the global structure can be unnecessary and inefficient, especially when our primary interest lies in estimating the effect of a treatment variable on an outcome variable. To address this limitation, we propose a novel local learning approach for covariate selection in nonparametric causal effect estimation, which accounts for the presence of latent variables. Our approach leverages testable independence and dependence relationships among observed variables to identify a valid adjustment set for a target causal relationship, ensuring both soundness and completeness under standard assumptions. We validate the effectiveness of our algorithm through extensive experiments on both synthetic and real-world data.
Xichen Guo, Feng Xie 0002, Yan Zeng 0002, Hao Zhang 0079, Zhi Geng
NeurIPS3
2025 Regression-based conditional independence test with adaptive kernels
Yixin Ren, Juncai Zhang, Yewei Xia, Ruxin Wang 0001, Feng Xie 0002, Jihong Guan, Hao Zhang 0079, Shuigeng Zhou
Artif. Intell.5
2025 Testing Conditional Independence Between Latent Variables by Independence Residuals
abstract
Conditional independence (CI) testing is an important problem, especially in causal discovery. Most testing methods assume that all variables are fully observable and then test the CI among the observed data. Such an assumption is often untenable beyond applications dealing with, e.g., psychological analysis about the mental health status and medical diagnosing (researchers need to consider the existence of latent variables in these scenarios); and typically adopted latent CI test schemes mainly suffer from robust or efficient issues. Accordingly, this article investigates the problem of testing CI between latent variables. To this end, we offer an auxiliary regression-based CI (AReCI) test by taking the measured variable as the surrogate variable of the latent variables to conduct the regression over the latent variables under the linear causal models, in which each latent variable has some certain measured variables. Specifically, given a pair of latent variables$L_X$and$L_Y$, and a corresponding latent variable set$\mathcal{L}_{O}$,$L_X \CI L_Y | \mathcal{L}_{O}$holds if and only if$A_{\{L_X\}}-\omega_1^\intercal A^{\prime}_{\{\mathcal{L}_{O}\}}$and$A_{\{L_Y\}}-\omega_2^\intercal A^{\prime\prime}_{\{\mathcal{L}_{O}\}}$are statistically independent, where$A^{\prime}$and$A^{\prime\prime}$are the two disjoint subset of the measured variable for the corresponding latent variables,$A^{\prime}_{\{\mathcal{L}_{O}\}} \cap A^{\prime\prime}_{\{\mathcal{L}_{O}\}} =\emptyset$, and$\omega_1$is a parameter vector characterized from the cross covariance between$A_{\{L_X\}}$and$A^{\prime}_{\{\mathcal{L}_{O}\}}$, and$\omega_{2}$is a parameter vector characterized from the cross covariance between$A_{\{L_Y\}}$and$A^{\prime\prime}_{\{\mathcal{L}_{O}\}}$. We theoretically show that the AReCI test is capable of addressing both Gaussian and non-Gaussian data. In addition, we find that the well-known partial correlation test can be seen as a special case of the AReCI test. Finally, we devise a causal discovery method by using the AReCI test as the CI test. The experimental results on synthetic and real-world data illustrate the effectiveness of our method.
Zhengming Chen 0002, Jie Qiao, Feng Xie 0002, Ruichu Cai, Zhifeng Hao 0004, Keli Zhang
IEEE Trans. Neural Networks Learn. Syst.3
2024 Structural Estimation of Partially Observed Linear Non-Gaussian Acyclic Model: A Practical Approach with Identifiability
abstract
Conventional causal discovery approaches, which seek to uncover causal relationships among measured variables, are typically fragile to the presence of latent variables. While various methods have been developed to address this confounding issue, they often rely on strong assumptions about the underlying causal structure. In this paper, we consider a general scenario where measured and latent variables collectively form a partially observed causally sufficient linear system and latent variables may be anywhere in the causal structure. We theoretically show that with the aid of high-order statistics, the causal graph is (almost) fully identifiable if, roughly speaking, each latent set has a sufficient number of pure children, which can be either latent or measured. Naturally, LiNGAM, a model without latent variables, is encompassed as a special case. Based on the identification theorem, we develop a principled algorithm to identify the causal graph by testing for statistical independence involving only measured variables in specific manners. Experimental results show that our method effectively recovers the causal structure, even when latent variables are influenced by measured variables.
Songyao Jin, Feng Xie 0002, Guangyi Chen 0002, Biwei Huang, Zhengming Chen 0002, Xinshuai Dong, Kun Zhang 0001
ICLR2
2024 Automating the Selection of Proxy Variables of Unmeasured Confounders
abstract
Recently, interest has grown in the use of proxy variables of unobserved confounding for inferring the causal effect in the presence of unmeasured confounders from observational data. One difficulty inhibiting the practical use is finding valid proxy variables of unobserved confounding to a target causal effect of interest. These proxy variables are typically justified by background knowledge. In this paper, we investigate the estimation of causal effects among multiple treatments and a single outcome, all of which are affected by unmeasured confounders, within a linear causal model, without prior knowledge of the validity of proxy variables. To be more specific, we first extend the existing proxy variable estimator, originally addressing a single unmeasured confounder, to accommodate scenarios where multiple unmeasured confounders exist between the treatments and the outcome. Subsequently, we present two different sets of precise identifiability conditions for selecting valid proxy variables of unmeasured confounders, based on the second-order statistics and higher-order statistics of the data, respectively. Moreover, we propose two data-driven methods for the selection of proxy variables and for the unbiased estimation of causal effects. Theoretical analysis demonstrates the correctness of our proposed algorithms. Experimental results on both synthetic and real-world data show the effectiveness of the proposed approach.
Feng Xie 0002, Zhengming Chen 0002, Shanshan Luo, Wang Miao, Ruichu Cai, Zhi Geng
ICML1
2024 Policy Learning for Balancing Short-Term and Long-Term Rewards
abstract
Empirical researchers and decision-makers spanning various domains frequently seek profound insights into the long-term impacts of interventions. While the significance of long-term outcomes is undeniable, an overemphasis on them may inadvertently overshadow short-term gains. Motivated by this, this paper formalizes a new framework for learning the optimal policy that effectively balances both long-term and short-term rewards, where some long-term outcomes are allowed to be missing. In particular, we first present the identifiability of both rewards under mild assumptions. Next, we deduce the semiparametric efficiency bounds, along with the consistency and asymptotic normality of their estimators. We also reveal that short-term outcomes, if associated, contribute to improving the estimator of the long-term reward. Based on the proposed estimators, we develop a principled policy learning approach and further derive the convergence rates of regret and estimation errors associated with the learned policy. Extensive experiments are conducted to validate the effectiveness of the proposed method, demonstrating its practical applicability.
Peng Wu 0012, Ziyu Shen, Feng Xie 0002, Zhongyao Wang, Yan Zeng 0002
ICML3
2024 Local Causal Structure Learning in the Presence of Latent Variables
abstract
Discovering causal relationships from observational data, particularly in the presence of latent variables, poses a challenging problem. While current local structure learning methods have proven effective and efficient when the focus lies solely on the local relationships of a target variable, they operate under the assumption of causal sufficiency. This assumption implies that all the common causes of the measured variables are observed, leaving no room for latent variables. Such a premise can be easily violated in various real-world applications, resulting in inaccurate structures that may adversely impact downstream tasks. In light of this, our paper delves into the primary investigation of locally identifying potential parents and children of a target from observational data that may include latent variables. Specifically, we harness the causal information from m-separation and V-structures to derive theoretical consistency results, effectively bridging the gap between global and local structure learning. Together with the newly developed stop rules, we present a principled method for determining whether a variable is a direct cause or effect of a target. Further, we theoretically demonstrate the correctness of our approach under the standard causal Markov and faithfulness conditions, with infinite samples. Experimental results on both synthetic and real-world data validate the effectiveness and efficiency of our approach.
Feng Xie 0002, Peng Wu 0012, Yan Zeng 0002, Zhi Geng
ICML1
2024 Learning Discrete Latent Variable Structures with Tensor Rank Conditions
abstract
Unobserved discrete data are ubiquitous in many scientific disciplines, and how to learn the causal structure of these latent variables is crucial for uncovering data patterns. Most studies focus on the linear latent variable model or impose strict constraints on latent structures, which fail to address cases in discrete data involving non-linear relationships or complex latent structures. To achieve this, we explore a tensor rank condition on contingency tables for an observed variable set $\mathbf{X}_p$, showing that the rank is determined by the minimum support of a specific conditional set (not necessary in $\mathbf{X}_p$) that d-separates all variables in $\mathbf{X}_p$. By this, one can locate the latent variable through probing the rank on different observed variables set, and further identify the latent causal structure under some structure assumptions. We present the corresponding identification algorithm and conduct simulated experiments to verify the effectiveness of our method. In general, our results elegantly extend the identification boundary for causal discovery with discrete latent variables and expand the application scope of causal discovery with latent variables.
Zhengming Chen 0002, Ruichu Cai, Feng Xie 0002, Jie Qiao, Anpeng Wu, Zijian Li 0001, Zhifeng Hao 0004, Kun Zhang 0001
NeurIPS3
2024 Identification and Estimation of the Bi-Directional MR with Some Invalid Instruments
abstract
We consider the challenging problem of estimating causal effects from purely observational data in the bi-directional Mendelian randomization (MR), where some invalid instruments, as well as unmeasured confounding, usually exist. To address this problem, most existing methods attempt to find proper valid instrumental variables (IVs) for the target causal effect by expert knowledge or by assuming that the causal model is a one-directional MR model. As such, in this paper, we first theoretically investigate the identification of the bi-directional MR from observational data. In particular, we provide necessary and sufficient conditions under which valid IV sets are correctly identified such that the bi-directional MR model is identifiable, including the causal directions of a pair of phenotypes (i.e., the treatment and outcome). Moreover, based on the identification theory, we develop a cluster fusion-like method to discover valid IV sets and estimate the causal effects of interest. We theoretically demonstrate the correctness of the proposed algorithm. Experimental results show the effectiveness of our method for estimating causal effects in both one-directional and bi-directional MR models.
Feng Xie 0002, Yan Zeng 0002, Zhi Geng
NeurIPS1
2024 Generalized Independent Noise Condition for Estimating Causal Structure with Latent Variables
abstract
We investigate the challenging task of learning causal structure in the presence of latent variables, including locating latent variables, determining their quantity, and identifying causal relationships among both latent and observed variables. To address this, we propose a Generalized Independent Noise (GIN) condition for linear non-Gaussian acyclic causal models that incorporate latent variables, which establishes the independence between a linear combination of certain measured variables and some other measured variables. Specifically, for two observed random vectors $\bf{Y}$ and $\bf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are statistically independent, where $\omega$ is a non-zero parameter vector determined by the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. We then give necessary and sufficient graphical criteria of the GIN condition in linear non-Gaussian acyclic causal models. From a graphical perspective, roughly speaking, GIN implies the existence of a set $\mathcal{S}$ such that $\mathcal{S}$ is causally earlier (w.r.t. the causal ordering) than $\mathbf{Y}$, and that every active (collider-free) path between $\mathbf{Y}$ and $\mathbf{Z}$ must contain a node from $\mathcal{S}$. Interestingly, we find that the independent noise condition (i.e., if there is no confounder, causes are independent of the residual derived from regressing the effect on the causes) can be seen as a special case of GIN. With such a connection between GIN and latent causal structures, we further leverage the proposed GIN condition, together with a well-designed search procedure, to efficiently estimate Linear, Non-Gaussian Latent Hierarchical Models (LiNGLaHs), where latent confounders may also be causally related and may even follow a hierarchical structure. We show that the underlying causal structure of a LiNGLaH is identifiable in light of GIN conditions under mild assumptions. Experimental results on both synthetic and three real-world data sets show the effectiveness of the proposed approach.
Feng Xie 0002, Biwei Huang, Zhengming Chen 0002, Ruichu Cai, Clark Glymour, Zhi Geng, Kun Zhang 0001
J. Mach. Learn. Res.1
2023 Some General Identification Results for Linear Latent Hierarchical Causal Structure
abstract
We study the problem of learning hierarchical causal structure among latent variables from measured variables. While some existing methods are able to recover the latent hierarchical causal structure, they mostly suffer from restricted assumptions, including the tree-structured graph constraint, no ``triangle" structure, and non-Gaussian assumptions. In this paper, we relax these restrictions above and consider a more general and challenging scenario where the beyond tree-structured graph, the ``triangle" structure, and the arbitrary noise distribution are allowed. We investigate the identifiability of the latent hierarchical causal structure and show that by using second-order statistics, the latent hierarchical structure can be identified up to the Markov equivalence classes over latent variables. Moreover, some directions in the Markov equivalence classes of latent variables can be further identified using partially non-Gaussian data. Based on the theoretical results above, we design an effective algorithm for learning the latent hierarchical causal structure. The experimental results on synthetic data verify the effectiveness of the proposed method.
Zhengming Chen 0002, Feng Xie 0002, Jie Qiao, Zhifeng Hao 0004, Ruichu Cai
IJCAI2
2023 Identification of Nonlinear Latent Hierarchical Models
abstract
Identifying latent variables and causal structures from observational data is essential to many real-world applications involving biological data, medical data, and unstructured data such as images and languages. However, this task can be highly challenging, especially when observed variables are generated by causally related latent variables and the relationships are nonlinear. In this work, we investigate the identification problem for nonlinear latent hierarchical causal models in which observed variables are generated by a set of causally related latent variables, and some latent variables may not have observed children. We show that the identifiability of causal structures and latent variables (up to invertible transformations) can be achieved under mild assumptions: on causal structures, we allow for multiple paths between any pair of variables in the graph, which relaxes latent tree assumptions in prior work; on structural functions, we permit general nonlinearity and multi-dimensional continuous variables, alleviating existing work's parametric assumptions. Specifically, we first develop an identification criterion in the form of novel identifiability guarantees for an elementary latent variable model. Leveraging this criterion, we show that both causal structures and latent variables of the hierarchical model can be identified asymptotically by explicitly constructing an estimation procedure. To the best of our knowledge, our work is the first to establish identifiability guarantees for both causal structures and latent variables in nonlinear latent hierarchical models.
Biwei Huang, Feng Xie 0002, Eric P. Xing, Yuejie Chi, Kun Zhang 0001
NeurIPS3
2023 Causal discovery of 1-factor measurement models in linear latent variable models with arbitrary noise distributions
Feng Xie 0002, Yan Zeng 0002, Zhengming Chen 0002, Yangbo He, Zhi Geng, Kun Zhang 0001
Neurocomputing1
2023 Nonlinear Causal Discovery for High-Dimensional Deterministic Data
abstract
Nonlinear causal discovery with high-dimensional data where each variable is multidimensional plays a significant role in many scientific disciplines, such as social network analysis. Previous work majorly focuses on exploiting asymmetry in the causal and anticausal directions between two high-dimensional variables (a cause-effect pair). Although there exist some works that concentrate on the causal order identification between multiple variables, i.e., more than two high-dimensional variables, they do not validate the consistency of methods through theoretical analysis on multiple-variable data. In particular, based on the asymmetry for the cause-effect pair, if model assumptions for any pair of the data are violated, the asymmetry condition will not hold, resulting in the deduction of incorrect order identification. Thus, in this article, we propose a causal functional model, namely high-dimensional deterministic model (HDDM), to identify the causal orderings among multiple high-dimensional variables. We derive two candidates' selection rules to alleviate the inconvenient effects resulted from the violated-assumption pairs. The corresponding theoretical justification is provided as well. With these theoretical results, we develop a method to infer causal orderings for nonlinear multiple-variable data. Simulations on synthetic data and real-world data are conducted to verify the efficacy of our proposed method. Since we focus on deterministic relations in our method, we also verify the robustness of the noises in simulations.
Yan Zeng 0002, Zhifeng Hao 0004, Ruichu Cai, Feng Xie 0002, Libo Huang 0001, Shohei Shimizu
IEEE Trans. Neural Networks Learn. Syst.4
2022 Identification of Linear Latent Variable Model with Arbitrary Distribution
abstract
An important problem across multiple disciplines is to infer and understand meaningful latent variables. One strategy commonly used is to model the measured variables in terms of the latent variables under suitable assumptions on the connectivity from the latents to the measured (known as measurement model). Furthermore, it might be even more interesting to discover the causal relations among the latent variables (known as structural model). Recently, some methods have been proposed to estimate the structural model by assuming that the noise terms in the measured and latent variables are non-Gaussian. However, they are not suitable when some of the noise terms become Gaussian. To bridge this gap, we investigate the problem of identification of the structural model with arbitrary noise distributions. We provide necessary and sufficient condition under which the structural model is identifiable: it is identifiable iff for each pair of adjacent latent variables Lx, Ly, (1) at least one of Lx and Ly has non-Gaussian noise, or (2) at least one of them has a non-Gaussian ancestor and is not d-separated from the non-Gaussian component of this ancestor by the common causes of Lx and Ly. This identifiability result relaxes the non-Gaussianity requirements to only a (hopefully small) subset of variables, and accordingly elegantly extends the application scope of the structural model. Based on the above identifiability result, we further propose a practical algorithm to learn the structural model. We verify the correctness of the identifiability result and the effectiveness of the proposed method through empirical studies.
Zhengming Chen 0002, Feng Xie 0002, Jie Qiao, Zhifeng Hao 0004, Kun Zhang 0001, Ruichu Cai
AAAI2
2022 Identification of Linear Non-Gaussian Latent Hierarchical Structure
abstract
Traditional causal discovery methods mainly focus on estimating causal relations among measured variables, but in many real-world problems, such as questionnaire-based psychometric studies, measured variables are generated by latent variables that are causally related. Accordingly, this paper investigates the problem of discovering the hidden causal variables and estimating the causal structure, including both the causal relations among latent variables and those between latent and measured variables. We relax the frequently-used measurement assumption and allow the children of latent variables to be latent as well, and hence deal with a specific type of latent hierarchical causal structure. In particular, we define a minimal latent hierarchical structure and show that for linear non-Gaussian models with the minimal latent hierarchical structure, the whole structure is identifiable from only the measured variables. Moreover, we develop a principled method to identify the structure by testing for Generalized Independent Noise (GIN) conditions in specific ways. Experimental results on both synthetic and real-world data show the effectiveness of the proposed approach.
Feng Xie 0002, Biwei Huang, Zhengming Chen 0002, Yangbo He, Zhi Geng, Kun Zhang 0001
ICML1
2022 Latent Hierarchical Causal Structure Discovery with Rank Constraints
abstract
Most causal discovery procedures assume that there are no latent confounders in the system, which is often violated in real-world problems. In this paper, we consider a challenging scenario for causal structure identification, where some variables are latent and they may form a hierarchical graph structure to generate the measured variables; the children of latent variables may still be latent and only leaf nodes are measured, and moreover, there can be multiple paths between every pair of variables (i.e., it is beyond tree structure). We propose an estimation procedure that can efficiently locate latent variables, determine their cardinalities, and identify the latent hierarchical structure, by leveraging rank deficiency constraints over the measured variables. We show that the proposed algorithm can find the correct Markov equivalence class of the whole graph asymptotically under proper restrictions on the graph structure and with linear causal relations.
Biwei Huang, Charles Jia Han Low, Feng Xie 0002, Clark Glymour, Kun Zhang 0001
NeurIPS3
2021 Causal Discovery with Multi-Domain LiNGAM for Latent Factors
abstract
Discovering causal structures among latent factors from observed data is a particularly challenging problem. Despite some efforts for this problem, existing methods focus on the single-domain data only. In this paper, we propose Multi-Domain Linear Non-Gaussian Acyclic Models for LAtent Factors (MD-LiNA), where the causal structure among latent factors of interest is shared for all domains, and we provide its identification results. The model enriches the causal representation for multi-domain data. We propose an integrated two-phase algorithm to estimate the model. In particular, we first locate the latent factors and estimate the factor loading matrix. Then to uncover the causal structure among shared latent factors of interest, we derive a score function based on the characterization of independence relations between external influences and the dependence relations between multi-domain latent factors and latent factors of interest. We show that the proposed method provides locally consistent estimators. Experimental results on both synthetic and real-world data demonstrate the efficacy and robustness of our approach.
Yan Zeng 0002, Shohei Shimizu, Ruichu Cai, Feng Xie 0002, Michio Yamamoto, Zhifeng Hao 0004
IJCAI4
2020 Generalized Independent Noise Condition for Estimating Latent Variable Causal Graphs
abstract
Causal discovery aims to recover causal structures or models underlying the observed data. Despite its success in certain domains, most existing methods focus on causal relations between observed variables, while in many scenarios the observed ones may not be the underlying causal variables (e.g., image pixels), but are generated by latent causal variables or confounders that are causally related. To this end, in this paper, we consider Linear, Non-Gaussian Latent variable Models (LiNGLaMs), in which latent confounders are also causally related, and propose a Generalized Independent Noise (GIN) condition to estimate such latent variable graphs. Specifically, for two observed random vectors $\mathbf{Y}$ and $\mathbf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are statistically independent, where $\omega$ is a parameter vector characterized from the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. From the graphical view, roughly speaking, GIN implies that causally earlier latent common causes of variables in $\mathbf{Y}$ d-separate $\mathbf{Y}$ from $\mathbf{Z}$. Interestingly, we find that the independent noise condition, i.e., if there is no confounder, causes are independent from the error of regressing the effect on the causes, can be seen as a special case of GIN. Moreover, we show that GIN helps locate latent variables and identify their causal structure, including causal directions. We further develop a recursive learning algorithm to achieve these goals. Experimental results on synthetic and real-world data demonstrate the effectiveness of our method.
Feng Xie 0002, Ruichu Cai, Biwei Huang, Clark Glymour, Zhifeng Hao 0004, Kun Zhang 0001
NeurIPS1
2020 Mining hidden non-redundant causal relationships in online social networks
Wei Chen 0103, Ruichu Cai, Zhifeng Hao 0004, Chang Yuan, Feng Xie 0002
Neural Comput. Appl.5
2020 A causal discovery algorithm based on the prior selection of leaf nodes
Yan Zeng 0002, Zhifeng Hao 0004, Ruichu Cai, Feng Xie 0002, Liang Ou, Ruihui Huang
Neural Networks4
2020 An Efficient Entropy-Based Causal Discovery Method for Linear Structural Equation Models With IID Noise Variables
abstract
The discovery of causal relationships from the observational data is an important task. To identify the unique causal structure belonging to a Markov equivalence class, a number of algorithms, such as the linear non-Gaussian acyclic model (LiNGAM), have been proposed. However, two challenges remain to be met: 1) these algorithms fail to work on the data which follow linear structural equation model with Gaussian noise and 2) they misjudge the causal direction when the data contain additional measurement errors. In this paper, we propose an entropy-based two-phase iterative algorithm for arbitrary distribution data with additional measurement errors under some mild assumptions. In the first phase of the algorithm, based on the property that entropy can measure the amount of information behind the data with arbitrary distribution, we design a general approach for the identification of exogenous variable on both Gaussian and non-Gaussian data, and we give the corresponding theoretical derivation. In the second phase, to eliminate the effects of measurement errors, we revise the value of the exogenous variable by removing its measurement error and further use the revised value to remove its effect on the remaining variables. Experimental results on real-world causal structures are presented to demonstrate the effectiveness and stability of our method. We also apply the proposed algorithm on the mobile-base-station data with measurement errors, and the results further prove the effectiveness of our algorithm.
Feng Xie 0002, Ruichu Cai, Yan Zeng 0002, Jiantao Gao, Zhifeng Hao 0004
IEEE Trans. Neural Networks Learn. Syst.1
2019 Triad Constraints for Learning Causal Structure of Latent Variables
abstract
Learning causal structure from observational data has attracted much attention, and it is notoriously challenging to find the underlying structure in the presence of confounders (hidden direct common causes of two variables). In this paper, by properly leveraging the non-Gaussianity of the data, we propose to estimate the structure over latent variables with the so-called Triad constraints: we design a form of "pseudo-residual" from three variables, and show that when causal relations are linear and noise terms are non-Gaussian, the causal direction between the latent variables for the three observed variables is identifiable by checking a certain kind of independence relationship. In other words, the Triad constraints help us to locate latent confounders and determine the causal direction between them. This goes far beyond the Tetrad constraints and reveals more information about the underlying structure from non-Gaussian data. Finally, based on the Triad constraints, we develop a two-step algorithm to learn the causal structure corresponding to measurement models. Experimental results on both synthetic and real data demonstrate the effectiveness and reliability of our method.
Ruichu Cai, Feng Xie 0002, Clark Glymour, Zhifeng Hao 0004, Kun Zhang 0001
NeurIPS2
2017 An efficient kurtosis-based causal discovery method for linear non-Gaussian acyclic data
abstract
Understanding the causality behind the observational data is of great importance to a lot of real world applications, e.g., the improvement of Quality of Service. Non-Gaussianity has been exploited in numerous causal discovery methods for observational linear acyclic data. Transforming non-Gaussianity into indirect metrics is a conventional solution employed by existing methods, although this usually results in unreliable estimations or locally optimal solutions. In this work, we employs the excess kurtosis, a direct measure of non-Gaussianity, to establish a causal discovery method for linear non-Gaussian acyclic data. Firstly, we theoretically prove that an exogenous variable has the largest excess kurtosis when disturbance variables follow independent and identically distributions. Secondly, based on this property of exogenous variables, we propose an efficient exogenous variable identification algorithm, and develop a causal discovery method. Extensive experiment results verify the effectiveness and efficiency of the proposed approach.
Ruichu Cai, Feng Xie 0002, Wei Chen 0103, Zhifeng Hao 0004
IWQoS2