Dong Wen 0001

dblp:92/8453-1 · DBLP profile ↗
in reviewer pool ← Back
56ranked-venue papers in the field
8as first author
45since 2021 · last 2027
0000-0002-0903-1503ORCID · verified

Domains — venue-derived; a paper can count in several

Database Systems & Data Management · 46 (8 first)Data Mining & Knowledge Discovery · 5Information Retrieval & Web Search · 4Other / Interdisciplinary · 1
YearPublicationVenuePosition
2027 PTIL: Partitioned Tree-Cover Interval Labeling for Restricted-Domain Reachability Queries
abstract
Reachability queries are a core operation in graph analytics. Existing labeling methods assume a global query space and construct uniform labels for all vertices. In practice, however, many systems issue queries over semantically structured endpoint domains such as V_s × V_t, where only a subset of vertices serve as meaningful sources or targets. This mismatch makes global labeling redundant and inefficient. We propose Partitioned Tree-Cover Interval Labeling (PTIL), a restricted-domain reachability indexing framework that extends classical Tree-Cover Labeling. PTIL timestamps only target vertices and stores compact disjoint intervals at sources, reducing each query to a single membership test while avoiding unnecessary global labels. By partitioning targets into groups, PTIL provides an explicit and predictable space–time trade-off: finer grouping yields lower latency at the cost of larger index size. PTIL also supports dynamic updates to endpoint domains. We further develop two instantiations: PTIL-g, a grouped scheme for scalable domain-aligned indexing, and PTIL-p, which additionally leverages query distributions for further prioritization when available. Experiments on real and synthetic graphs show that PTIL-g achieves order-of-magnitude lower query latency than state-of-the-art baselines, while PTIL-p provides additional gains under skewed workloads, with near-linear and predictable space–time behavior.
Huangleshuai He, Zhengyi Yang 0001, Yifu Tang, Dong Wen 0001, Tianming Zhang
EDBT5
2026 Accelerating K-Core Computation in Temporal Graphs
Zhuo Ma 0005, Dong Wen 0001, Hanchen Wang 0001, Wentao Li 0001, Wenjie Zhang 0001, Lu Qin 0001
EDBT2
2026 Exploring Sequential Dynamics on Temporal Graphs via Composite Filtering
abstract
Real-world temporal graphs are largely driven by sequential dynamics, and edge repetitions are rare. This characteristic has spotlighted a key limitation of existing temporal graph neural networks (T-GNNs): on such graphs, state-of-the-art T-GNNs often achieve less than 70% MRR on link prediction. Two factors drive this shortfall: (1) Memory modules and neighbor co-occurrence encodings in existing T-GNNs often fail since they rely on memorizing exact neighbor identities and on the co-occurrence assumption. (2) Existing T-GNNs are sensitive to abrupt events, which are common in sequential settings that can exceed ten million updates, thereby compromising generalization. To tackle the challenges of sequential dynamics, we propose SeqFilter, a simple yet robust neural network that functions as a composite filter for link prediction on temporal graphs. SeqFilter comprises two modules: a node rhythm memory and a frequency-selective structure encoder. The node rhythm memory shifts the focus from who interacts to when, modeling absolute timestamps with recency awareness to capture each node's interaction rhythm. To model temporal structures in complex sequential dynamics, we propose a frequency-selective structure encoder that amplifies or suppresses specific frequencies in the neighbor spectrum, enabling the effective modeling of local structure correlations. Theoretically, this encoder functions as a cascade of three learnable filters that approximate the optimal linear denoiser, helping capture the underlying structural patterns. Last, SeqFilter fuses the outputs of two modules to generate high-quality node embeddings. Extensive experiments across eight sequential dynamic datasets show that SeqFilter outperforms 11 baselines by an average improvement of 15.82% in MRR while achieving an order of magnitude speedup compared to the frequency-enhanced baseline.
Yuanyuan Xu 0002, Danni Wu, Xuemin Lin 0001, Dong Wen 0001, Wenjie Zhang 0001, Lei Chen 0002, Ying Zhang 0001
WWW4
2026 Efficient Temporal Subgraph Management: A New Interval Index
Dian Ouyang, Dong Wen 0001, Wenjie Zhang 0001, Xuemin Lin 0001
Proc. VLDB Endow.3
2026 Structural Clustering for Bipartite Graphs
abstract
Bipartite graphs are widely used in many real-world applications, where discovering clusters is crucial for understanding their underlying structure. However, most existing clustering methods for bipartite graphs enforce the assignment ofallvertices to clusters, often neglecting the important roles of outliers and hubs. To address this limitation, we plan to extend the structural clustering model from unipartite to bipartite graphs. This extension is non-trivial due to the lack of common neighbors in bipartite graphs, which renders traditional similarity measures less effective. Recognizing that similarity is key to structural clustering, we resort to butterflies—the fundamental building blocks of bipartite graphs—to define a more effective similarity measure. Building on this, we further propose a novel structural clustering model, SBC, tailored for bipartite graphs. To enable clustering under this model, we develop efficient online and index-based methods, along with a dynamic maintenance method to accommodate graph updates over time. Extensive experiments on real-world bipartite graphs demonstrate that: (1) The SBC model greatly enhances clustering quality, achieving higher modularity while effectively identifying outliers and hubs. (2) Our proposed clustering methods are highly scalable, enabling the processing of graphs with up to 12.2 million edges within 2 seconds
Mingyu Yang 0004, Wentao Li 0001, Wei Wang 0011, Dong Wen 0001, Min Gao 0001, Lu Qin 0001
IEEE Trans. Knowl. Data Eng.4
2026 Efficiently querying connected components in large temporal graphs via scalable and maintainable indices
Yuyang Xia, Haoxuan Xie, Yixiang Fang, Wensheng Luo 0002, Chenhao Ma 0001, Dong Wen 0001
VLDB J.6
2026 On Querying Historical Connectivity in Large-scale Temporal Graphs
Lantian Xu 0002, Dong Wen 0001, Lu Qin 0001, Wenjie Zhang 0001, Xubo Wang, Xuemin Lin 0001
VLDB J.2
2026 On querying minimum spanning tree in temporal graphs
Yuanhang Yu, Dong Wen 0001, Lu Qin 0001, Dawei Cheng, Ying Zhang 0001, Wenjie Zhang 0001, Xuemin Lin 0001
VLDB J.2
2025 Temporal Katz Centrality Estimation with Temporal Graph Neural Networks
Heqi Zhang, Tianming Zhang, Zhengyi Yang 0001, Weiyuan Wang, Mingchen Ju, Dong Wen 0001, Bin Cao 0004
ADMA (4)6
2025 Accelerating Shortest Path Counting on Road Networks
abstract
Counting the number of shortest paths between two query vertices on road networks has a wide range of applications and has recently drawn significant research attention. The state-of-the-art solution builds a tree-based index using the concept of tree decomposition. However, its performance deteriorates when the tree decomposition results in an unbalanced tree and may not perform well when the query vertices are close to each other. This paper aims to improve the efficiency of shortest path counting. We propose a novel indexing scheme that combines hub labeling with a balanced tree hierarchy. This approach significantly reduces the number of visited labels compared to the state-of-the-art solution. Furthermore, we introduce several optimizations to enhance the efficiency of index construction and minimize its size. Extensive experiments conducted on real-world road networks demonstrate that our method achieves up to 4.1 times higher query efficiency and reduces the index size by a factor of 2.35 compared to the state-of-the-art solution.
Kaiyu Chen, Dong Wen 0001, Zhengyi Yang 0001, Wentao Li 0001, Ying Zhang 0001
ICDE3
2025 An Overview of Path Queries on Graphs
abstract
Graphs are powerful tools for modeling entities and their relationships. Among the fundamental operations on graphs, path queries play a vital role in identifying paths between pairs of vertices. These queries underpin a broad range of applications by enabling efficient navigation and insightful analysis of graph-structured data. Path queries can be categorized based on the types of paths they return, with each category addressing specific application needs. In this tutorial, we focus on four major categories of path queries: plain shortest path queries, constrained shortest path queries, shortest path summary queries, and non-shortest path queries. We begin by introducing the basic concepts and practical applications of path queries. We then provide an in-depth exploration of the four categories listed above. Finally, we conclude with a discussion of the future research directions in this area.
Wentao Li 0001, Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001
ICDE2
2025 Efficient Route and Area Matching Query in Dynamic Road Networks
abstract
Nowadays, ride-sharing is developing rapidly because of its economic and environmental advantages. Recent studies investigate the benefits of introducing meeting points during task assignments, allowing riders to be picked up or dropped off near their requested locations. In this paper, we study the route and area matching (ROAM) problem in dynamic road networks. ROAM query aims to find a detour path from source to destination visiting an area, meanwhile satisfying a detour budget. Existing method excludes unmatched queries in a compacted sketch graph, but the Dijkstra-based routing process is still time-consuming. Moreover, maintaining the sketch graph in frequently changing road networks is challenging because it requires computing from scratch. To overcome the limitations, we propose a simple yet effective framework named meeting point search (MPS). A novel index structure named GS-Tree is constructed to integrate spatial information for selecting meeting points and graph shortcuts for routing queries. GSTree has structural stability and can be efficiently maintained in dynamic networks. Theoretical analysis and experimental studies demonstrate the superiority of our methods. The optimal MPS with GS-Tree averagely outperforms the existing methods by two orders of magnitude.
Dian Ouyang, Dong Wen 0001, Xuemin Lin 0001
ICDE4
2025 Preserving K-Connectivity in Dynamic Graphs
abstract
Edge connectivity is a crucial concept in graph theory, which often serves as a fundamental metric for analyzing and improving the robustness, efficiency, and reliability of various types of networks. A graph is k-connected if it is still connected after removing arbitrarily fewer than$k$edges. Sparse certificate is the lossless compression of a graph in terms of k-connectivity with a bounded size, which enables processing connectivity-driven queries in a more efficient way. Existing studies mainly focus on computing a sparse certificate in static graphs. Motivated by the prevalence of highly dynamic graphs, we aim to propose algorithms to maintain a sparse certificate when an edge is in-serted or deleted. We propose efficient algorithms to significantly improve the theoretical running time for both edge insertion and edge deletion compared with the baseline. We also propose a novel strategy for the search process in edge deletion. The strategy improves the efficiency compared with other potential methods with a theoretical guarantee. Extensive performance studies have been conducted on fourteen real-world datasets. The results demonstrate the significant advantages of our algorithms.
Gengda Zhao, Dong Wen 0001, Xiaoyang Wang 0002, Kai Wang 0037, Xuemin Lin 0001
ICDE2
2025 Locally Balancing Signed Graphs
abstract
Signed graphs capture both positive and negative relationships between entities, with balance being a fundamental concept. In these graphs, a vertex is considered balanced if all cycles it belongs to contain an even number of negative edges. On the other hand, unbalanced vertices often experience cognitive dissonance and emotional disturbance, motivating efforts to modify the graph to achieve balance for these vertices. Yet, most existing research emphasizes global balance, focusing on lengthy cycles that represent distant interactions. In contrast, this paper shifts the focus to local balance, where a vertex is deemed balanced when the triangles (length-three cycles) it participates in are positive, reflecting more immediate relationships. Building on this, we introduce the Locally Balancing Signed Graph (LBS) problem, which aims to maximize the number of locally balanced vertices through graph modification. Despite the NP-hard nature of the LBS problem and the absence of properties such as monotonicity and submodularity, our novel greedy method effectively addresses these challenges. We further enhance our method with dynamic computation and pruning techniques. Extensive experiments show the efficacy of our greedy method in solving the LBS problem and underscore the substantial runtime reductions achieved through our optimization techniques.
Wentao Li 0001, Min Gao 0001, Dong Wen 0001, Maolin Cai, Wei Wang 0011
KDD (1)4
2025 Weight-Constrained Simple Path Enumeration in Weighted Graph
abstract
Path enumeration is a fundamental problem and has been extensively studied in the literature. Given two query vertices and a weight threshold, the problem aims to identify all simple paths with weight not exceeding the threshold. Existing studies on path enumeration include DFS-based solutions and join-based solutions, where the join-based solutions only work for unweighted graphs. In this paper, we are the first to propose a join-based framework for weighted graphs. By observing the characteristics of DFS, we design a series of novel data structures and operations based on the join-based framework. In this way, our final solution combines the advantages of both join and DFS. We conduct experiments on several real large graphs. For weighted graphs, our method is much more efficient than existing algorithms. For unweighted graphs, our method is still competitive compared with the state-of-the-art solution which only works for unweighted graphs.
Dian Ouyang, Dong Wen 0001, Jianye Yang 0001, Wentao Li 0001, Xuemin Lin 0001
KDD (1)2
2025 A Survey on Efficient Graph Reachability Queries
Huangleshuai He, Zhengyi Yang 0001, Dong Wen 0001, Wenqian Zhang 0006, Michael Yu, Wenke Yang 0001, Wenjie Zhang 0001
PAKDD (6)3
2025 Counting the Number of Hop-Constrained Simple S-T Paths in Large Graphs
Bocheng Han, Weizhang Jiang, John Shepherd 0001, Dong Wen 0001, Zhengyi Yang 0001
WISE (2)7
2025 Covering K-Cliques in Billion-Scale Graphs
abstract
The k-clique structure in graphs has been investigated in various real-world applications, such as community detection in complex networks, functional module discovery in biological networks, and link spam detection in web graphs. Despite extensive research on k-clique enumeration, the large number of k-cliques in many graphs poses a challenge for practical application and computation. To address this, we explore the k-clique τ-cover problem, a generalization of the vertex cover problem. The problem aims to find a small set of vertices that can effectively represent all k-cliques in the graph. We prove the NP-hardness of finding the minimum k-clique cover. We propose a hierarchical solution that computes a small cover without enumerating k-cliques. Extensive experiments on real-world graphs verify the efficiency and effectiveness of our solution.
Kaiyu Chen, Dong Wen 0001, Hanchen Wang 0001, Zhengyi Yang 0001, Wenjie Zhang 0001, Xuemin Lin 0001
WWW2
2025 Minimum Spanning Tree Maintenance in Dynamic Graphs
abstract
Minimum Spanning Tree (MST) is a fundamental structure in graph analytics and can be applied in various applications. The problem of maintaining MSTs in dynamic graphs is significant, as many real-world graphs are frequently updated. Existing studies on MST maintenance primarily focus on theoretical analysis and lack practical efficiency. In this paper, we propose a novel algorithm to maintain MST in dynamic graphs, which achieves high practical efficiency. In addition to the tree structure, our main idea is to maintain a replacement edge for each tree edge. In this way, the tree structure can be immediately updated when a tree edge is deleted. We propose algorithms to maintain the replacement edge for each tree edge by sharing the computation cost in the updating process. Our performance studies on large datasets demonstrate considerable improvements over state-of-the-art solutions.
Lantian Xu 0002, Dong Wen 0001, Lu Qin 0001, Rong-Hua Li 0001, Ying Zhang 0001, Xuemin Lin 0001
Proc. ACM Manag. Data2
2025 Accelerating Core Decomposition in Billion-Scale Hypergraphs
abstract
Hypergraphs provide a versatile framework for modeling complex relationships beyond pairwise interactions, finding applications in various domains. k -core decomposition is a fundamental task in hypergraph analysis that decomposes hypergraphs into cohesive substructures. Existing studies capture the cohesion in hypergraphs based on the vertex neighborhood size. However, such decomposition poses unique challenges, including the efficiency of core value updates, redundant computation, and high memory consumption. We observe that the state-of-the-art algorithms do not fully address the above challenges and are unable to scale to large hypergraphs. In this paper, we propose an efficient approach for hypergraph k -core decomposition. Novel concepts and strategies are developed to compute the core value of each vertex and reduce redundant computation of vertices. Experimental results on real-world and synthetic hypergraphs demonstrate that our approach significantly outperforms the state-of-the-art algorithm by 7 times on average while reducing the average memory usage by 36 times. Moreover, while existing algorithms fail on tens of millions hyperedges, our approach efficiently handles billion-scale hypergraphs in only a single thread.
Wenqian Zhang 0006, Zhengyi Yang 0001, Dong Wen 0001, Wentao Li 0001, Wenjie Zhang 0001, Xuemin Lin 0001
Proc. ACM Manag. Data3
2025 Querying historical K-cores in large temporal graphs
Yuanhang Yu, Dong Wen 0001, Michael Yu, Lu Qin 0001, Ying Zhang 0001, Wenjie Zhang 0001, Xuemin Lin 0001
VLDB J.2
2024 Hierarchical Structure Construction on Hypergraphs
abstract
Exploring the hierarchical structure of graphs presents notable advantages for graph analysis, revealing insights ranging from individual vertex behavior to community distribution and overall graph stability. This paper studies hierarchical structures within hypergraphs, where a hyperedge can connect multiple vertices. We observed that directly extending hierarchical frameworks from pairwise graphs to hypergraphs overlooks high-order interactions and can result in either high computational complexity or sparse hierarchy structure. To address this challenge, we introduce a dual-layer hypergraph hierarchy consisting of a primary hierarchy and a secondary hierarchy, enabling the construction of a refined hypergraph hierarchy in linear time. The dual-layer hierarchy establishes a global hierarchy based on vertex cohesion, utilizing vertex-induced subhypergraphs, and a local hierarchy based on hyperedge containment, employing edge-induced subhypergraphs. The combination of global and local hierarchy mitigates the homogeneity and sparsity issues inherent in single-layer hierarchies, allowing more effective modeling of high-order interactions. Furthermore, we propose an efficient hierarchical construction algorithm by leveraging a novel hyperedge-based disjoint set to identify connected subhypergraphs. Additionally, to optimize the local hierarchy further and prevent the emergence of excessively redundant levels, we introduce a compact local hierarchy by defining a restricted subgraph metric to eliminate redundancy caused by large-sized hyperedges. Empirical studies on real-world hypergraphs demonstrate the effectiveness of our approach.
Wenjie Zhang 0001, Zhengyi Yang 0001, Dong Wen 0001, Xiaoyang Wang 0002, Dongxiao Yu, Xuemin Lin 0001
CIKM4
2024 On Compressing Historical Cliques in Temporal Graphs
Kaiyu Chen, Dong Wen 0001, Wentao Li 0001, Zhengyi Yang 0001, Wenjie Zhang 0001
DASFAA (1)2
2024 Querying Numeric-Constrained Shortest Distances on Road Networks
abstract
In real-world road networks, edges possess additional numeric attributes, such as width and toll, in addition to length. Incorporating these additional attributes enhances the functionality of shortest-distance services. To this end, current research on shortest-distance computation requires that the numeric attributes of edges on a path exceed a lower bound$l$(within the interval [l,oo]). However, it often overlooks the benefits of setting an upper bound$r$(within the interval [l, r]). To bridge this gap, we introduce the numeric-constrained shortest-distance query problem, which enforces interval constraints [l, r] on the numeric attributes of edges on a path. There are two intuitive solutions: the Online-Search method, which excludes edges that violate the constraints during the search, leading to inefficient query responses, and the Full-Index method, which creates an index for each necessary interval constraint [l, r], resulting in excessive space consumption due to numerous potential intervals. Our novel index-based method, which uses the tree decomposition technique and exploits interval-distance relationships, aims to mitigate these issues. As confirmed by our experimental results, our method greatly improves query speed - over 20 times faster than Online-Search- and consumes less space than Full-Index.
Mingyu Yang 0004, Wentao Li 0001, Wei Wang 0011, Dong Wen 0001, Lu Qin 0001
ICDE4
2024 GQ*: Towards Generalizable Deep Q-Learning for Steiner Tree in Graphs
abstract
Finding the optimal Steiner Tree in graphs has been a critical combinatorial optimization challenge that finds widespread applications in network design. Despite its importance, finding the optimal Steiner Tree remains computationally expensive, especially for large graphs due to its NP-hard nature. Traditional approaches often suffer from high time complexity or poor approximation ratio. Machine learning approaches often leverage local graph structure information instead of global graph structure information, and often suffer from the generalization ability issues in practice. In this paper, we propose a novel reinforcement learning based framework to solve STP, in which we reformulate the classical Q-value computation to capture both global graph structure and deterministic information to search for the Steiner tree. Experiments on both synthetic and real-world datasets demonstrate that our framework exhibits better generalization ability compared to the existing machine learning methods, where our framework can be trained on the small graphs and generalize well to larger graphs and the graphs from different distributions.
Wei Huang 0040, Hanchen Wang 0001, Dong Wen 0001, Xuefeng Chen 0001, Wenjie Zhang 0001, Ying Zhang 0001
ICDM3
2024 On Querying Historical Connectivity in Temporal Graphs
abstract
We study the historical connectivity query in temporal graphs where edges continuously arrive. Given an arbitrary time window, and two query vertices, the problem aims to identify if two vertices are connected by a path in the snapshot of the window. The state-of-the-art method designs an index based on the two-hop cover, and updating the index is costly when new edges arrive. In this paper, we propose a new framework and design a novel forest-based index for historical connectivity queries. The index enables us to answer queries by searching if two vertices are connected in the forest. We update the index by modifying a forest structure. Our techniques also work for connectivity query processing in a sliding window of temporal graphs. Extensive experiments have been conducted to show the considerable advantages of our approach compared with the state-of-the-art methods in both historical connectivity queries and sliding-window connectivity queries.
Jingyi Song, Dong Wen 0001, Lantian Xu 0002, Lu Qin 0001, Wenjie Zhang 0001, Xuemin Lin 0001
Proc. ACM Manag. Data2
2024 Constant-time Connectivity Querying in Dynamic Graphs
abstract
Connectivity query processing is a fundamental problem in graph processing. Given an undirected graph and two query vertices, the problem aims to identify whether they are connected via a path. Given frequent edge updates in real graph applications, in this paper, we study connectivity query processing in fully dynamic graphs, where edges are frequently inserted or deleted. A recent solution, called D-tree, maintains a spanning tree for each connected component and applies several heuristics to reduce the depth of the tree. To improve the efficiency, we propose a new spanning-tree-based solution by maintaining a disjoint-set tree simultaneously. By combining the advantages of two trees, we achieve the constant query time complexity and also significantly improve the theoretical running time in both edge insertion and edge deletion. Our performance studies on real large datasets show considerable improvement of our algorithms.
Lantian Xu 0002, Dong Wen 0001, Lu Qin 0001, Rong-Hua Li 0001, Ying Zhang 0001, Xuemin Lin 0001
Proc. ACM Manag. Data2
2024 Querying Structural Diversity in Streaming Graphs
abstract
Structural diversity of a vertex refers to the diversity of connections within its neighborhood and has been applied in various fields such as viral marketing and user engagement. The paper studies querying the structural diversity of a vertex for any query time windows in streaming graphs. Existing studies are limited to static graphs which fail to capture vertices' structural diversities in snapshots evolving over time. We design an elegant index structure to significantly reduce the index size compared to the basic approach. We propose an optimized incremental algorithm to update the index for continuous edge arrivals. Extensive experiments on real-world streaming graphs demonstrate the effectiveness of our framework.
Kaiyu Chen, Dong Wen 0001, Wenjie Zhang 0001, Ying Zhang 0001, Xiaoyang Wang 0002, Xuemin Lin 0001
Proc. VLDB Endow.2
2024 AeonG: An Efficient Built-in Temporal Support in Graph Databases
abstract
Real-world graphs are often dynamic and evolve over time. It is crucial for storing and querying a graph's evolution in graph databases. However, existing works either suffer from high storage overhead or lack efficient temporal query support, or both. In this paper, we propose AeonG, a new graph database with built-in temporal support. AeonG is based on a novel temporal graph model. To fit this model, we design a storage engine and a query engine. Our storage engine is hybrid, with one current storage to manage the most recent versions of graph objects, and another historical storage to manage the previous versions of graph objects. This separation makes the performance degradation of querying the most recent graph object versions as slight as possible. To reduce the historical storage overhead, we propose a novel anchor+delta strategy, in which we periodically create a complete version (namely anchor) of a graph object, and maintain every change (namely delta) between two adjacent anchors of the same object. To boost temporal query processing, we propose an anchor-based version retrieval technique in the query engine to skip unnecessary historical version traversals. Extensive experiments are conducted on both real and synthetic datasets. The results show that AeonG achieves up to 5.73× lower storage consumption and 2.57× lower temporal query latency against state-of-the-art approaches, while introducing only 9.74% performance degradation for supporting temporal features.
Jiamin Hou, Zhanhao Zhao, Zhouyu Wang, Wei Lu 0015, Guodong Jin, Dong Wen 0001, Xiaoyong Du 0001
Proc. VLDB Endow.6
2024 Efficient Maximal Frequent Group Enumeration in Temporal Bipartite Graphs
abstract
Cohesive subgraph mining is a fundamental problem in bipartite graph analysis. In reality, relationships between two types of entities often occur at some specific timestamps, which can be modeled as a temporal bipartite graph. However, the temporal information is widely neglected by previous studies. Moreover, directly extending the existing models may fail to find some critical groups in temporal bipartite graphs, which appear in a unilateral (i.e., one-layer) form. To fill the gap, in this paper, we propose a novel model, called maximal λ -frequency group (MFG). Given a temporal bipartite graph 𝒢 = (U, V, ℰ ), a vertex set V S ⊆ V is an MFG if i ) there are no less than λ timestamps, at each of which V S can form a ( τ U , τ V )-biclique with some vertices in U at the corresponding snapshot, and ii ) it is maximal. To solve the problem, a filter-and-verification (FilterV) method is proposed based on the Bron-Kerbosch framework, incorporating novel filtering techniques to reduce the search space and array-based strategy to accelerate the frequency and maximality verification. Nevertheless, the cost of frequency verification in each valid candidate set computation and maximality check could limit the scalability of FilterV to larger graphs. Therefore, we further develop a novel verification-free (VFree) approach by leveraging the advanced dynamic counting structure proposed. Theoretically, we prove that VFree can reduce the cost of each valid candidate set computation in FilterV by a factor of O (| V |). Furthermore, VFree can avoid the explicit maximality verification because of the developed search paradigm. Finally, comprehensive experiments on 15 real-world graphs are conducted to demonstrate the efficiency and effectiveness of the proposed techniques and model.
Renjie Sun, Xiaoyang Wang 0002, Dong Wen 0001, Ying Zhang 0001, Lu Qin 0001, Xuemin Lin 0001
Proc. VLDB Endow.4
2023 Efficient and Effective Path Compression in Large Graphs
abstract
A path in a graph is a walk from one vertex to the other via edges. Many tasks for graph analytics may produce numerous paths, which record critical intermediate information or results. On the platform of Alibaba Cloud, a transaction (e.g., user purchase and money transfer) usually involves network communication via multiple servers. The server communication history is recorded as a path, where each vertex is an IP address. It is of significance to record such paths in Alibaba Cloud for daily maintenance tasks, such as anomaly server detection and network routing optimization. Motivated by the considerable data scale of IP paths, this paper proposes a compression method Overlap-Free Frequent Subpath (OFFS) to reduce the overall size. Meanwhile, the compressed paths should allow retrievals of any individual path, which is required by applications in our scenarios. We build a lookup table to match a series of frequent common subpaths to supernodes. Each path is shortened by replacing subpaths with corresponding supernodes in the table. We adopt a bottom-up framework to construct the lookup table in given iterations. Several optimizations are proposed to improve the compression ratio and speed. We conduct extensive experiments to show our effectiveness and efficiency based on several real datasets from Alibaba Cloud.
Yilun Huang 0001, Dong Wen 0001, Longbin Lai, Zhengping Qian, Lu Qin 0001, Ying Zhang 0001
ICDE2
2023 Distributed Near-Maximum Independent Set Maintenance over Large-scale Dynamic Graphs
abstract
Computing the maximum independent set (MIS) in a graph is a fundamental NP-hard problem, which is widely adopted in many real-world applications. Extensive works have been done on computing an approximate MIS. While the highly dynamic property of real-world graphs calls for efficient MIS maintenance solutions, existing works for dynamic MIS computation in the literature mainly focus on the single-machine scenario. The assumption that a single machine can access the whole graph makes them difficult to be straightforwardly applied for large-scale graphs in distributed environment. Motivated by this, in this paper, we study the problem of maintaining approximate MIS over large-scale dynamic graphs in distributed environments. We propose a new vertex centric algorithm OIMIS. Compared with existing solutions, OIMIS avoids the strong order dependency in distributed computation, which makes it easy to handle dynamic graph updates. OIMIS computes and maintains MIS with high effectiveness and efficiency. In terms of high effectiveness, OIMIS maintains consistent MIS results with the state-of-the-art distributed algorithm to compute MIS in static graphs. In terms of high efficiency, each vertex in OIMIS only updates MIS status according to its neighbor attributes. Novel optimization techniques are also designed to reduce communication and computation cost. We conduct extensive experiments to prove the effectiveness and efficiency of our distributed algorithms.
Xubo Wang, Dong Wen 0001, Wenjie Zhang 0001, Ying Zhang 0001, Lu Qin 0001
ICDE2
2023 Expanding Reverse Nearest Neighbors
abstract
In a graph, the reverse nearest neighbors (RNN) of vertex f refer to the set of vertices that consider f as their nearest neighbor. When f represents a facility like a subway station, its RNN comprises potential users who prefer the nearest facility. In practice, there may be underutilized facilities with small RNN sizes, and relocating these facilities to expand their service can be costly or infeasible. A more cost-effective approach involves selectively upgrading some edges (e.g., reducing their weights) to expand the RNN sizes of underutilized facilities. This motivates our research on the Expanding Reverse Nearest Neighbors (ERNN) problem, which aims to maximize the RNN size of a target facility by upgrading a limited number of edges. Solving the ERNN problem allows underutilized facilities to serve more users and alleviate the burden on other facilities. Despite numerous potential applications, ERNN is hard to solve: It can be proven to be NP-hard and APX-hard, and it exhibits non-monotonic and non-submodular properties. To overcome these challenges, we propose novel greedy algorithms that improve efficiency by minimizing the number of edges that need to be processed and the cost of processing each edge. Experimental results demonstrate that the proposed algorithms achieve orders of magnitude speedup compared to the standard greedy algorithm while greatly expanding the RNN.
Wentao Li 0001, Maolin Cai, Min Gao 0001, Dong Wen 0001, Lu Qin 0001, Wei Wang 0011
Proc. VLDB Endow.4
2023 ScaleG: A Distributed Disk-Based System for Vertex-Centric Graph Processing
abstract
Designing distributed graph systems has drawn a lot of research interests due to the strong expressiveness of the graph model and rapidly increasing graph volume. Most of them require the graph data and all intermediate messages to reside in main memory, which may sacrifice the scalability. Even though several disk-based systems have been studied to remedy such issue, several challenges still exist in achieving both high computational efficiency and low network communication under the limitation of memory usage. In this paper, we design a novel disk-based distributed graph system, called ScaleG. The system provides a series of user-friendly programming interfaces. Unlike previous systems, the programmer in ScaleG does not need to concern any logic regarding the communication between vertices like sending messages and combining messages. In addition to a simple and clear programming model, we propose several techniques to reduce both disk I/Os in each machine and message I/Os via the network. We manage all messages in memory and bound all messages by the number of vertices. We also carefully design the data structure to support partial computation and automatic vertex activation. We conduct extensive experiments on six big graphs to show the high efficiency of our system.
Xubo Wang, Dong Wen 0001, Lu Qin 0001, Lijun Chang, Ying Zhang 0001, Wenjie Zhang 0001
IEEE Trans. Knowl. Data Eng.2
2023 When hierarchy meets 2-hop-labeling: efficient shortest distance and path queries on road networks
Dian Ouyang, Dong Wen 0001, Lu Qin 0001, Lijun Chang, Xuemin Lin 0001, Ying Zhang 0001
VLDB J.2
2022 Manipulating Structural Graph Clustering
abstract
Structural graph clustering (SCAN) is a popular clustering technique. Using the concept of$\epsilon$-neighborhood, SCAN defines the core vertices that uniquely determine the clusters of a graph. Most existing studies assume that the graph processed by SCAN contains no controlled edges. Few studies, however, have focused on manipulating SCAN by injecting edges. Manipulation of SCAN can be used to assess its robustness and lay the groundwork for developing robust clustering algorithms. To fill this gap and considering the importance of the$\epsilon$-neighborhood for SCAN, we propose a problem, denoted as MN, for manipulating SCAN. The MN problem aims to maximize the$\epsilon$-neighborhood of the target vertex by inserting some edges. On the theoretical side, we prove that the MN problem is both NP-hard and APX-hard, and also is non-submodular and non-monotonic. On the algorithmic side, we design an algorithm by focusing on how to select vertices to join$\epsilon -$neighborhood and thus avoid enumerating edges to report a solution. As a result, our algorithm bypasses the non-monotonicity nature of the MN problem. Extensive experiments on real-world graphs show that our algorithm can effectively solve the proposed MN problem.
Wentao Li 0001, Min Gao 0001, Dong Wen 0001, Cai Ke, Lu Qin 0001
ICDE3
2022 ScaleG: A Distributed Disk-based System for Vertex-centric Graph Processing (Extended Abstract)
abstract
Designing disk-based distributed graph systems has drawn a lot of research due to the strong expressiveness of the graph model and rapidly increasing graph volume. However, several challenges still exist in achieving both high computational efficiency and low network communication under the limitation of memory. In this paper, we design a novel distributed disk-based graph processing system, ScaleG, with a series of user-friendly programming interfaces. We propose several techniques to reduce both disk I/Os in each machine and message I/Os via the network. We manage all messages in memory and bound the volume of all messages by the number of vertices. We also carefully design the data structure to support partial computation and automatic vertex activation. We conduct extensive experiments on real-world big graphs to show the high efficiency of our system.
Xubo Wang, Dong Wen 0001, Lu Qin 0001, Lijun Chang, Wenjie Zhang 0001
ICDE2
2022 GPU-accelerated Proximity Graph Approximate Nearest Neighbor Search and Construction
abstract
The approximate nearest neighbor (ANN) search in high-dimensional space offers a wide spectrum of applications across many domains such as database, machine learning, multimedia and computer vision. A variety of ANN search algorithms have been proposed in the literature. In recent years, proximity graph-based approaches have attracted considerable attention from both industry and academic settings due to the superior search performance in terms of speed and accuracy. A recent work utilizes a graphics processing unit (GPU) to accelerate the ANN search on proximity graphs. Though significantly reducing the distance computation time by taking advantage of the massive parallelism of GPUs, the algorithm suffers from the high expenses of data structure operations. In this paper, we propose a novel GPU -accelerated algorithm that designs a novel GPU-friendly search framework on proximity graphs to fully exploit the massively parallel processing power of GPUs at key steps of the search. Also, we propose GPU-accelerated proximity graph construction algorithms which can build high-quality representative proximity graphs with efficient parallel implementations. Extensive experiments on benchmark high-dimensional datasets demonstrate the outstanding performance of our proposed algorithms in both ANN search and proximity graph construction.
Yuanhang Yu, Dong Wen 0001, Ying Zhang 0001, Lu Qin 0001, Wenjie Zhang 0001, Xuemin Lin 0001
ICDE2
2022 Reachability Labeling for Distributed Graphs
abstract
Real-world graphs are typically distributed across multiple data centers. When performing reachability queries on these distributed graphs, reachability labeling methods ensure fast query processing by using lightweight indexes. One of the best-known labeling methods is TOL; however, TOL is a serial algorithm and cannot handle distributed graphs. The main goal of this paper is to design new labeling methods that can work in parallel while producing the same index as TOL. To this end, we investigate the limitation of TOL and thus propose a filtering-and-refinement framework for index creation. This framework first obtains a super-set of each vertex's label sets and then eliminates the invalid elements. Based on this framework, we design distributed labeling algorithms and then use batch processing to improve efficiency. Experimental results on real-world graphs show that the proposed algorithms can index distributed graphs efficiently.
Wentao Li 0001, Lu Qin 0001, Ying Zhang 0001, Dong Wen 0001, Li-Zhen Cui 0001, Xuemin Lin 0001
ICDE5
2022 Efficient Shortest Path Counting on Large Road Networks
abstract
The shortest path distance and related concepts lay the foundations of many real-world applications in road network analysis. The shortest path count has drawn much research attention in academia, not only as a closeness metric accompanying the shorted distance but also serving as a building block of centrality computation. This paper aims to improve the efficiency of counting the shortest paths between two query vertices on a large road network. We propose a novel index solution by organizing all vertices in a tree structure and propose several optimizations to speed up the index construction. We conduct extensive experiments on 14 real-world networks. Compared with the state-of-the-art solution, we achieve much higher efficiency on both query processing and index construction with a more compact index.
Yu-Xuan Qiu, Dong Wen 0001, Lu Qin 0001, Wentao Li 0001, Rong-Hua Li 0001, Ying Zhang 0001
Proc. VLDB Endow.2
2022 Computing K-Cores in Large Uncertain Graphs: An Index-Based Optimal Approach
abstract
Uncertain graph management and analysis have attracted many research attentions. Among them, computing k-cores in uncertain graphs (aka, (k,)-cores) is an important problem and has emerged in many applications. Given an uncertain graph, the (k,)-cores can be derived by iteratively removing the vertex with an -degree of less than k and updating the -degrees of its neighbors. However, the results heavily depend on the two input parameters k and, and the settings for these parameters are unique to the specific graph structure and the user's subjective requirements. Additionally, computing and updating the -degree for each vertex is costly. To overcome these drawbacks, we have developed an index-based solution for computing (k,)-cores in this paper. The size of the index is well bounded by O(m), where m is the number of edges in the graph. Based on this index, queries can be answered in optimal time. We propose an algorithm for index construction with several different optimizations. We also propose a new algorithm for index construction in external memory, when the uncertain graph cannot be entirely loaded in memory. We conduct extensive experiments on eight real-world datasets to practically evaluate the performance of all the proposed algorithms.
Dong Wen 0001, Bohua Yang, Lu Qin 0001, Ying Zhang 0001, Lijun Chang, Rong-Hua Li 0001
IEEE Trans. Knowl. Data Eng.1
2022 Span-reachability querying in large temporal graphs
Dong Wen 0001, Bohua Yang, Ying Zhang 0001, Lu Qin 0001, Dawei Cheng, Wenjie Zhang 0001
VLDB J.1
2022 General graph generators: experiments, analyses, and improvements
Sheng Xiang 0001, Dong Wen 0001, Dawei Cheng, Ying Zhang 0001, Lu Qin 0001, Zhengping Qian, Xuemin Lin 0001
VLDB J.2
2021 Efficient Matrix Factorization on Heterogeneous CPU-GPU Systems
abstract
Matrix Factorization (MF) has been widely applied in machine learning and data mining. Due to the large computational cost of MF, we aim to improve the efficiency of SGD-based MF computation by utilizing the massive parallel processing power of heterogeneous multiprocessors. The main challenge in parallel SGD algorithms on heterogeneous CPU-GPU systems lies in the strategy to assign tasks. We design a novel strategy to divide the matrix into a set of blocks by considering two aspects. First, we observe that the matrix should be divided nonuniformly, and relatively large blocks should be assigned to GPUs to saturate the computing power of GPUs. In addition to exploiting the characteristics of hardware, the workloads assigned to two types of hardware should be balanced. We design a cost model tailored for our problem to accurately estimate the performance of hardware on different data sizes. Extensive experiments show that our proposed algorithm achieves high efficiency with a high quality of training quality.
Yuanhang Yu, Dong Wen 0001, Ying Zhang 0001, Xiaoyang Wang 0002, Wenjie Zhang 0001, Xuemin Lin 0001
ICDE2
2021 On Querying Historical K-Cores
abstract
Many real-world relationships between entities can be modeled as temporal graphs, where each edge is associated with a timestamp or a time interval representing its occurrence. K -core is a fundamental model used to capture cohesive subgraphs in a simple graph and have drawn much research attention over the last decade. Despite widespread research, none of the existing works support the efficient querying of historical k -cores in temporal graphs. In this paper, given an integer k and a time window, we study the problem of computing all k -cores in the graph snapshot over the time window. We propose an index-based solution and several pruning strategies to reduce the index size. We also design a novel algorithm to construct this index, whose running time is linear to the final index size. Lastly, we conducted extensive experiments on several real-world temporal graphs to show the high effectiveness of our index-based solution.
Michael Yu, Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Wenjie Zhang 0001, Xuemin Lin 0001
Proc. VLDB Endow.2
2020 Efficiently Answering Span-Reachability Queries in Large Temporal Graphs
abstract
Reachability is a fundamental problem in graph analysis. In applications such as social networks and collaboration networks, edges are always associated with timestamps. Most existing works on reachability queries in temporal graphs assume that two vertices are related if they are connected by a path with non-decreasing timestamps (time-respecting) of edges. This assumption fails to capture the relationship between entities involved in the same group or activity with no time-respecting path connecting them. In this paper, we define a new reachability model, called span-reachability, designed to relax the time order dependency and identify the relationship between entities in a given time period. We adopt the idea of two-hop cover and propose an index-based method to answer span-reachability queries. Several optimizations are also given to improve the efficiency of index construction and query processing. We conduct extensive experiments on 17 real-world datasets to show the efficiency of our proposed solution.
Dong Wen 0001, Yilun Huang 0001, Ying Zhang 0001, Lu Qin 0001, Wenjie Zhang 0001, Xuemin Lin 0001
ICDE1
2020 Progressive Top-K Nearest Neighbors Search in Large Road Networks
abstract
Computing top-k nearest neighbors (kNN) is a fundamental problem in road networks. Existing solutions either need a complicated parameter configuration in index construction or incur high costs when scanning an unbounded number of vertices in query processing. In this paper, we propose a novel parameter-free index-based solution for the kNN query based on the concept of tree decomposition in large road networks. Based on our index structure, we propose an efficient and progressive algorithm that returns each result in a bounded delay. We also optimize the index structure, which improves the efficiency of both index construction and index maintenance in large road networks. We conduct extensive experiments to show the efficiency of our proposed algorithms and the effectiveness of our optimization techniques in real-world road networks from ten regions.
Dian Ouyang, Dong Wen 0001, Lu Qin 0001, Lijun Chang, Ying Zhang 0001, Xuemin Lin 0001
SIGMOD Conference2
2019 Enumerating k-Vertex Connected Components in Large Graphs
abstract
In social network analysis, structural cohesion (or vertex connectivity) is a fundamental metric in measuring the cohesion of social groups. Given an undirected graph, a k-vertex connected component (k-VCC) is a maximal connected subgraph whose structural cohesion is at least k. A k-VCC has many outstanding structural properties, such as high cohesiveness, high robustness, and subgraph overlapping. In this paper, given a graph G and an integer k, we study the problem of computing all k-VCCs in G. The general idea for this problem is to recursively partition the graph into overlapped subgraphs. We prove the upper bound of the number of partitions, which implies the polynomial running time algorithm for the k-VCC enumeration. However, the basic solution is costly in computing the vertex cut. To improve the algorithmic efficiency, we observe that the key is reducing the number of local connectivity testings. We propose two effective optimization strategies, namely neighbor sweep and group sweep, to significantly reduce the number of local connectivity testings. We conduct extensive performance studies using ten large real datasets to demonstrate the efficiency of our proposed algorithms. The experimental results demonstrate that our approach can achieve a speedup of up to two orders of magnitude compared to the state-of-the-art algorithm.
Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Lijun Chang, Ling Chen 0006
ICDE1
2019 Index-Based Optimal Algorithm for Computing K-Cores in Large Uncertain Graphs
abstract
Uncertainty in graph data occurs for a variety of reasons, such as noise and measurement errors. Recently, uncertain graph management and analysis have attracted many research attentions. Among them, computing k-cores in uncertain graphs (aka, (k, η)-cores) is an important problem and has emerged in many applications, for example, community detection, protein-protein interaction network analysis and influence maximization. Given an uncertain graph, the (k, η)-cores can be derived by iteratively removing the vertex with an η-degree of less than k and updating the η-degrees of its neighbors. However, the results heavily depend on the two input parameters k and η, and the settings for these parameters are unique to the specific graph structure and the user's subjective requirements. Additionally, computing and updating the η-degree for each vertex is the most costly component of the algorithm, and that cost is high. To overcome these drawbacks, we have developed an index-based solution for computing (k, η)-cores in this paper. The size of the index is well bounded by O(m), where m is the number of edges in the graph. Based on this index, queries for any k and η can be answered in optimal time. Further, the method is accompanied by several different optimizations to speed up construction of the index. We conduct extensive experiments on eight real-world datasets to practically evaluate the performance of all the proposed algorithms. The results demonstrate that this index-based approach is several orders of magnitude faster at processing queries than the traditional online approaches.?
Bohua Yang, Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Lijun Chang, Rong-Hua Li 0001
ICDE2
2019 Fully Dynamic Depth-First Search in Directed Graphs
abstract
Depth-first search (DFS) is a fundamental and important algorithm in graph analysis. It is the basis of many graph algorithms such as computing strongly connected components, testing planarity, and detecting biconnected components. The result of a DFS is normally shown as a DFS-Tree. Given the frequent updates in many real-world graphs (e.g., social networks and communication networks), we study the problem of DFS-Tree maintenance in dynamic directed graphs. In the literature, most works focus on the DFS-Tree maintenance problem in undirected graphs and directed acyclic graphs. However, their methods cannot easily be applied in the case of general directed graphs. Motivated by this, we propose a framework and corresponding algorithms for both edge insertion and deletion in general directed graphs. We further give several optimizations to speed up the algorithms. We conduct extensive experiments on 12 real-world datasets to show the efficiency of our proposed algorithms.
Bohua Yang, Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Xubo Wang, Xuemin Lin 0001
Proc. VLDB Endow.2
2019 I/O Efficient Core Graph Decomposition: Application to Degeneracy Ordering
abstract
Core decomposition is a fundamental graph problem with a large number of applications. Most existing approaches for core decomposition assume that the graph is kept in memory of a machine. Nevertheless, many real-world graphs are too big to reside in memory. In this paper, we study I/O efficient core decomposition following a semi-external model, which only allows node information to be loaded in memory. We propose a semi-external algorithm and an optimized algorithm for I/O efficient core decomposition. To handle dynamic graph updates, we firstly show that our algorithm can be naturally extended to handle edge deletion. Then, we propose an I/O efficient core maintenance algorithm to handle edge insertion, and an improved algorithm to further reduce I/O and CPU cost. In addition, based on our core decomposition algorithms, we further propose an I/O efficient semi-external algorithm for degeneracy ordering, which is an important graph problem that is highly related to core decomposition. We also consider how to maintain the degeneracy order. We conduct extensive experiments on 12 real large graphs. Our optimal core decomposition algorithm significantly outperforms the existing I/O efficient algorithm in terms of both processing time and memory consumption. They are very scalable to handle web-scale graphs. As an example, we are the first to handle a web graph with 978.5 million nodes and 42.6 billion edges using less than 4.2 GB memory. We also show that our proposed algorithms for degeneracy order computation and maintenance can handle big graphs efficiently with small memory overhead.
Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Xuemin Lin 0001, Jeffrey Xu Yu
IEEE Trans. Knowl. Data Eng.1
2019 Efficient structural graph clustering: an index-based approach
Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Lijun Chang, Xuemin Lin 0001
VLDB J.1
2018 K-Connected Cores Computation in Large Dual Networks
Lingxi Yue, Dong Wen 0001, Li-Zhen Cui 0001, Lu Qin 0001, Yongqing Zheng
DASFAA (1)2
2018 K-Connected Cores Computation in Large Dual Networks
abstract
Computing $$k\text {-}core$$ s is a fundamental and important graph problem, which can be applied in many areas, such as community detection, network visualization, and network topology analysis. Due to the complex relationship between different entities, dual graph widely exists in the applications. A dual graph contains a physical graph and a conceptual graph, both of which have the same vertex set. Given that there exist no previous studies on the $$k\text {-}core$$ in dual graphs, we formulate a k-connected core ( $$k\text {-}CCO$$ ) model in dual graphs. A $$k\text {-}CCO$$ is a $$k\text {-}core$$ in the conceptual graph, and also connected in the physical graph. Given a dual graph and an integer k, we propose a polynomial time algorithm for computing all $$k\text {-}CCO$$ s. We also propose three algorithms for computing all maximum-connected cores ( $$MCCO$$ ), which are the existing $$k\text {-}CCO$$ s such that a $$(k+1)$$ - $$CCO$$ does not exist. We further study a subgraph search problem, which is computing a $$k\text {-}CCO$$ that contains a set of query vertices. We propose an index-based approach to efficiently answer the query for any given parameter k. We conduct extensive experiments on six real-world datasets and four synthetic datasets. The experimental results demonstrate the effectiveness and efficiency of our proposed algorithms.
Li-Zhen Cui 0001, Lingxi Yue, Dong Wen 0001, Lu Qin 0001
Data Sci. Eng.3
2017 Efficient Structural Graph Clustering: An Index-Based Approach
abstract
Graph clustering is a fundamental problem widely experienced across many industries. The structural graph clustering (SCAN) method obtains not only clusters but also hubs and outliers. However, the clustering results closely depend on two sensitive parameters, ϵ and μ, while the optimal parameter setting depends on different graph properties and various user requirements. Moreover, all existing SCAN solutions need to scan at least the whole graph, even if only a small number of vertices belong to clusters. In this paper we propose an index-based method for SCAN. Based on our index, we cluster the graph for any ϵ and μ in O (Σ c ϵℂ | E C |) time, where ℂ is the result set of all clusters and | E C | is the number of edges in a specific cluster C. In other words, the time expended to compute structural clustering depends only on the result size, not on the size of the original graph. Our index's space complexity is bounded by O ( m ), where m is the number of edges in the graph. To handle dynamic graph updates, we propose algorithms and several optimization techniques for maintaining our index. We conduct extensive experiments to practically evaluate the performance of all our proposed algorithms on 10 real-world networks, one of which contains more than 1 billion edges. The experimental results demonstrate that our approaches significantly outperform existing solutions.
Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Lijun Chang, Xuemin Lin 0001
Proc. VLDB Endow.1
2016 I/O efficient Core Graph Decomposition at web scale
abstract
Core decomposition is a fundamental graph problem with a large number of applications. Most existing approaches for core decomposition assume that the graph is kept in memory of a machine. Nevertheless, many real-world graphs are big and may not reside in memory. In the literature, there is only one work for I/O efficient core decomposition that avoids loading the whole graph in memory. However, this approach is not scalable to handle big graphs because it cannot bound the memory size and may load most parts of the graph in memory. In addition, this approach can hardly handle graph updates. In this paper, we study I/O efficient core decomposition following a semi-external model, which only allows node information to be loaded in memory. This model works well in many web-scale graphs. We propose a semi-external algorithm and two optimized algorithms for I/O efficient core decomposition using very simple structures and data access model. To handle dynamic graph updates, we show that our algorithm can be naturally extended to handle edge deletion. We also propose an I/O efficient core maintenance algorithm to handle edge insertion, and an improved algorithm to further reduce I/O and CPU cost by investigating some new graph properties. We conduct extensive experiments on 12 real large graphs. Our optimal algorithm significantly outperform the existing I/O efficient algorithm in terms of both processing time and memory consumption. In many memory-resident graphs, our algorithms for both core decomposition and maintenance can even outperform the in-memory algorithm due to the simple structures and data access model used. Our algorithms are very scalable to handle web-scale graphs. As an example, we are the first to handle a web graph with 978.5 million nodes and 42.6 billion edges using less than 4.2 GB memory.
Dong Wen 0001, Lu Qin 0001, Ying Zhang 0001, Xuemin Lin 0001, Jeffrey Xu Yu
ICDE1