Paolo Boldi

dblp:71/3661 · DBLP profile ↗
← Back
70ranked-venue papers
57as first author
6since 2021 · last 2026
0000-0002-8297-6255ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Theory of computation · 32 · 29 first-author · 4 since 2021Databases, data management, data science and information retrieval · 28 · 19 first-author · 1 since 2021Applied, interdisciplinary, general and emerging computing · 8 · 6 first-author · 1 since 2021Artificial intelligence and machine learning · 6 · 4 first-author · 1 since 2021Systems, architecture and hardware · 4 · 4 first-authorSoftware engineering, systems software and programming languages · 4 · 3 first-authorGraphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-authorComputer networks · 1 · 1 first-author · 1 since 2021Human-computer interaction and ubiquitous computing · 1 · 1 first-author
YearPublicationVenuePosition
2026 Properties and expressivity of linear geometric centralities
abstract
Centrality indices are used to rank the nodes of a graph by importance: this is a common need in many concrete situations (social networks, citation networks, web graphs, for instance) and it was discussed many times in sociology, psychology, mathematics and computer science, giving rise to a whole zoo of definitions of centrality. Although they differ widely in nature, many centrality measures are based on shortest-path distances: such centralities are often referred to as geometric . Geometric centralities can use the shortest-path-length information in many different ways, but most of the existing geometric centralities can be defined as a linear transformation of the distance-count vector (that is, the vector containing, for every index t , the number of nodes at distance t ). In this paper we study this class of centralities, that we call linear (geometric) centralities , in their full generality. In particular, we look at them in the light of the axiomatic approach, and we study their expressivity: we show to what extent linear centralities can be used to distinguish between nodes in a graph, and how many different rankings of nodes can be induced by linear centralities on a given graph. The latter problem (which has a number of possible applications, especially in an adversarial setting) is solved by means of a linear programming formulation, which is based on Farkas’ lemma, and is interesting in its own right.
Paolo Boldi, Flavio Furia, Chiara Prezioso
Theor. Comput. Sci.1
2026 Guest editorial - Fun with algorithms 2024
Paolo Boldi, Giuseppe Prencipe, Tami Tamir
Theor. Comput. Sci.1
2025 Linear Geometric Centralities
Paolo Boldi, Flavio Furia, Chiara Prezioso
WAW1
2024 Engineering Zuffix Arrays
Paolo Boldi, Stefano Marchini, Sebastiano Vigna
SEA1
2023 On Overcoming HPC Challenges of Trillion-Scale Real-World Graph Datasets
abstract
Progress in High-Performance Computing in general, and High-Performance Graph Processing in particular, is highly dependent on the availability of publicly-accessible, relevant, and realistic data sets. To ensure continuation of this progress, we (i) investigate and optimize the process of generating large sequence similarity graphs as an HPC challenge and (ii) demonstrate this process in creating MS-BioGraphs, a new family of publicly available real-world edge-weighted graph datasets with up to 2.5 trillion edges, that is, 6.6 times greater than the largest graph published recently. The largest graph is created by matching (i.e., all-toall similarity aligning) 1.7 billion protein sequences. The MSBioGraphs family includes also seven subgraphs with different sizes and direction types. We describe two main challenges we faced in generating large graph datasets and our solutions, that are, (i) optimizing data structures and algorithms for this multi-step process and (ii) WebGraph parallel compression technique. The datasets are available online on https://blogs.qub.ac.uk/ DIPSA/MS-BioGraphs.
Mohsen Koohi Esfahani, Paolo Boldi, Hans Vandierendonck, Peter Kilpatrick, Sebastiano Vigna
IEEE Big Data2
2021 Fine-Grained Network Analysis for Modern Software Ecosystems
abstract
Modern software development is increasingly dependent on components, libraries, and frameworks coming from third-party vendors or open-source suppliers and made available through a number of platforms (or forges ). This way of writing software puts an emphasis on reuse and on composition, commoditizing the services that modern applications require. On the other hand, bugs and vulnerabilities in a single library living in one such ecosystem can affect, directly or by transitivity, a huge number of other libraries and applications. Currently, only product-level information on library dependencies is used to contain this kind of danger, but this knowledge often reveals itself too imprecise to lead to effective (and possibly automated) handling policies. We will discuss how fine-grained function-level dependencies can greatly improve reliability and reduce the impact of vulnerabilities on the whole software ecosystem.
Paolo Boldi, Georgios Gousios
ACM Trans. Internet Techn.1
2020 Ultra-Large-Scale Repository Analysis via Graph Compression
abstract
We consider the problem of mining the development history—as captured by modern version control systems—of ultra-large-scale software archives (e.g., tens of millions software repositories corresponding). We show that graph compression techniques can be applied to the problem, dramatically reducing the hardware resources needed to mine similarly-sized corpus. As a concrete use case we compress the full Software Heritage archive, consisting of 5 billion unique source code files and 1 billion unique commits, harvested from more than 80 million software projects—encompassing a full mirror of GitHub. The resulting compressed graph fits in less than 100 GB of RAM, corresponding to a hardware cost of less than 300 U.S. dollars. We show that the compressed in-memory representation of the full corpus can be accessed with excellent performances, with edge lookup times close to memory random access. As a sample exploitation experiment we show that the compressed graph can be used to conduct clone detection at this scale, benefiting from main memory access speed.
Paolo Boldi, Antoine Pietri, Sebastiano Vigna, Stefano Zacchiroli
SANER1
2018 Evaluating the impact of topological protein features on the negative examples selection
abstract
BACKGROUND: Supervised machine learning methods when applied to the problem of automated protein-function prediction (AFP) require the availability of both positive examples (i.e., proteins which are known to possess a given protein function) and negative examples (corresponding to proteins not associated with that function). Unfortunately, publicly available proteome and genome data sources such as the Gene Ontology rarely store the functions not possessed by a protein. Thus the negative selection, consisting in identifying informative negative examples, is currently a central and challenging problem in AFP. Several heuristics have been proposed through the years to solve this problem; nevertheless, despite their effectiveness, to the best of our knowledge no previous existing work studied which protein features are more relevant to this task, that is, which protein features help more in discriminating reliable and unreliable negatives. RESULTS: The present work analyses the impact of several features on the selection of negative proteins for the Gene Ontology (GO) terms. The analysis is network-based: it exploits the fact that proteins can be naturally structured in a network, considering the pairwise relationships coming from several sources of data, such as protein-protein and genetic interactions. Overall, the proposed protein features, including local and global graph centrality measures and protein multifunctionality, can be term-aware (i.e., depending on the GO term) and term-unaware (i.e., invariant across the GO terms). We validated the informativeness of each feature utilizing a temporal holdout in three different experiments on yeast, mouse and human proteomes: (i) feature selection to detect which protein features are more helpful for the negative selection; (ii) protein function prediction to verify whether the features considered are also useful to predict GO terms; (iii) negative selection by applying two different negative selection algorithms on proteins represented through the proposed features. CONCLUSIONS: Term-aware features (with some exceptions) resulted more informative for problem (i), together with node betweenness, which is the most relevant among term-unaware features. The node positive neighborhood instead is the most predictive feature for the AFP problem, while experiment (iii) showed that the proposed features allow negative selection algorithms to select effectively negative instances in the temporal holdout setting, with better results when nonlinear combinations of features are also exploited.
Paolo Boldi, Marco Frasca 0001, Dario Malchiodi
BMC Bioinform.1
2018 Correction to: Evaluating the impact of topological protein features on the negative examples selection
abstract
After publication of the original article [1], it was noticed that the dagger symbol indicating equal contribution wasn't added next to the names of all authors.
Paolo Boldi, Marco Frasca 0001, Dario Malchiodi
BMC Bioinform.1
2018 BUbiNG: Massive Crawling for the Masses
abstract
Although web crawlers have been around for twenty years by now, there is virtually no freely available, open-source crawling software that guarantees high throughput, overcomes the limits of single-machine systems, and, at the same time, scales linearly with the amount of resources available. This article aims at filling this gap, through the description of BUbiNG, our next-generation web crawler built upon the authors’ experience with UbiCrawler [9] and on the last ten years of research on the topic. BUbiNG is an open-source Java fully distributed crawler; a single BUbiNG agent, using sizeable hardware, can crawl several thousand pages per second respecting strict politeness constraints, both host- and IP-based. Unlike existing open-source distributed crawlers that rely on batch techniques (like MapReduce), BUbiNG job distribution is based on modern high-speed protocols to achieve very high throughput.
Paolo Boldi, Andrea Marino 0001, Massimo Santini 0001, Sebastiano Vigna
ACM Trans. Web1
2016 A network model characterized by a latent attribute structure with competition
Paolo Boldi, Irene Crimaldi, Corrado Monti
Inf. Sci.1
2016 Using graph distances for named-entity linking
Roi Blanco, Paolo Boldi, Andrea Marino 0001
Sci. Comput. Program.2
2016 Efficient optimally lazy algorithms for minimal-interval semantics
Paolo Boldi, Sebastiano Vigna
Theor. Comput. Sci.1
2015 Minimal and Monotone Minimal Perfect Hash Functions
Paolo Boldi
MFCS (1)1
2015 Local Ranking Problem on the BrowseGraph
abstract
The "Local Ranking Problem" (LRP) is related to the computation of a centrality-like rank on a local graph, where the scores of the nodes could significantly differ from the ones computed on the global graph. Previous work has studied LRP on the hyperlink graph but never on the BrowseGraph, namely a graph where nodes are webpages and edges are browsing transitions. Recently, this graph has received more and more attention in many different tasks such as ranking, prediction and recommendation. However, a web-server has only the browsing traffic performed on its pages (local BrowseGraph) and, as a consequence, the local computation can lead to estimation errors, which hinders the increasing number of applications in the state of the art. Also, although the divergence between the local and global ranks has been measured, the possibility of estimating such divergence using only local knowledge has been mainly overlooked. These aspects are of great interest for online service providers who want to: (i) gauge their ability to correctly assess the importance of their resources only based on their local knowledge, and (ii) take into account real user browsing fluxes that better capture the actual user interest than the static hyperlink network. We study the LRP problem on a BrowseGraph from a large news provider, considering as subgraphs the aggregations of browsing traces of users coming from different domains. We show that the distance between rankings can be accurately predicted based only on structural information of the local graph, being able to achieve an average rank correlation as high as 0.8.
Michele Trevisiol, Luca Maria Aiello, Paolo Boldi, Roi Blanco
SIGIR3
2015 Essential Web Pages Are Easy to Find
abstract
In this paper we address the problem of estimating the index size needed by web search engines to answer as many queries as possible by exploiting the marked difference between query and click frequencies. We provide a possible formal definition for the notion of essential web pages as those that cover a large fraction of distinct queries --- i.e., we look at the problem as a version of MaxCover. Although in general MaxCover is approximable to within a factor of 1-1/e ~0.632 from the optimum, we provide a condition under which the greedy algorithm does find the actual best cover (or remains at a known bounded factor from it). The extra check for optimality (or for bounding the ratio from the optimum) comes at a negligible algorithmic cost. Moreover, in most practical instances of this problem, the algorithm is able to provide solutions that are provably optimal, or close to optimal. We relate this observed phenomenon to some properties of the queries' click graph. Our experimental results confirm that a small number of web pages can respond to a large fraction of the queries (e.g., 0.4% of the pages answers 20% of the queries). Our approach can be used in several related search applications, and has in fact an even more general appeal --- as a first example, our preliminary experimental study confirms that our algorithm has extremely good performances on other (social network based) MaxCover instances.
Ricardo Baeza-Yates, Paolo Boldi, Flavio Chierichetti
WWW2
2014 Cache-Oblivious Peeling of Random Hypergraphs
abstract
The computation of a peeling order in a randomly generated hypergraph is the most time-consuming step in a number of constructions, such as perfect hashing schemes, random r-SAT solvers, error-correcting codes, and approximate set encodings. While there exists a straightforward linear-time algorithm, its poor I/O performance makes it impractical for hypergraphs whose size exceeds the available internal memory. We show how to reduce the computation of a peeling order to a small number of sequential scans and sorts, and analyze its I/O complexity in the cache-oblivious model. The resulting algorithm requires O.sort.n// I/Os and O.n log n/ time to peel a random hypergraph with n edges. We experimentally evaluate the performance of our implementation of this algorithm in a real-world scenario by using the construction of minimal perfect hash functions (MPHF) as our test case: our algorithm builds a MPHF of 7:6 billion keys in less than 21 hours on a single machine. The resulting data structure is both more space-efficient and faster than that obtained with the current state-of-the-art MPHF construction for large-scale key sets.
Djamal Belazzougui, Paolo Boldi, Giuseppe Ottaviano, Rossano Venturini, Sebastiano Vigna
DCC2
2012 Four Degrees of Separation, Really
abstract
We recently measured the average distance of users in the Facebook graph, spurring comments in the scientific community as well as in the general press ("Four Degrees of Separation"). A number of interesting criticisms have been made about the meaningfulness, methods and consequences of the experiment we performed. In this paper we want to discuss some methodological aspects that we deem important to underline in the form of answers to the questions we have read in newspapers, magazines, blogs, or heard from colleagues. We indulge in some reflections on the actual meaning of "average distance" and make a number of side observations showing that, yes, 3.74 "degrees of separation" are really few.
Paolo Boldi, Sebastiano Vigna
ASONAM1
2012 Extending BM25 with multiple query operators
abstract
Traditional probabilistic relevance frameworks for informational retrieval refrain from taking positional information into account, due to the hurdles of developing a sound model while avoiding an explosion in the number of parameters. Nonetheless, the well-known BM25F extension of the successful Okapi ranking function can be seen as an embryonic attempt in that direction. In this paper, we proceed along the same line, defining the notion of virtual region: a virtual region is a part of the document that, like a BM25F-field, can provide a (larger or smaller, depending on a tunable weighting parameter) evidence of relevance of the document; differently from BM25F fields, though, virtual regions are generated implicitly by applying suitable (usually, but not necessarily, positional-aware) operators to the query. This technique fits nicely in the eliteness model behind BM25 and provides a principled explanation to BM25F; it specializes to BM25(F) for some trivial operators, but has a much more general appeal. Our experiments (both on standard collections, such as TREC, and on Web-like repertoires) show that the use of virtual regions is beneficial for retrieval effectiveness.
Roi Blanco, Paolo Boldi
SIGIR2
2012 Special Issue on Fun with Algorithms
Paolo Boldi, Luisa Gargano
Theory Comput. Syst.1
2012 Injecting Uncertainty in Graphs for Identity Obfuscation
abstract
Data collected nowadays by social-networking applications create fascinating opportunities for building novel services, as well as expanding our understanding about social structures and their dynamics. Unfortunately, publishing social-network graphs is considered an ill-advised practice due to privacy concerns. To alleviate this problem, several anonymization methods have been proposed, aiming at reducing the risk of a privacy breach on the published data, while still allowing to analyze them and draw relevant conclusions. In this paper we introduce a new anonymization approach that is based on injecting uncertainty in social graphs and publishing the resulting uncertain graphs . While existing approaches obfuscate graph data by adding or removing edges entirely, we propose using a finer-grained perturbation that adds or removes edges partially : this way we can achieve the same desired level of obfuscation with smaller changes in the data, thus maintaining higher utility. Our experiments on real-world networks confirm that at the same level of identity obfuscation our method provides higher usefulness than existing randomized methods that publish standard graphs.
Paolo Boldi, Francesco Bonchi, Aristides Gionis, Tamir Tassa
Proc. VLDB Endow.1
2011 Layered label propagation: a multiresolution coordinate-free ordering for compressing social networks
abstract
We continue the line of research on graph compression started with WebGraph, but we move our focus to the compression of social networks in a proper sense (e.g., LiveJournal): the approaches that have been used for a long time to compress web graphs rely on a specific ordering of the nodes (lexicographical URL ordering) whose extension to general social networks is not trivial. In this paper, we propose a solution that mixes clusterings and orders, and devise a new algorithm, called Layered Label Propagation, that builds on previous work on scalable clustering and can be used to reorder very large graphs (billions of nodes). Our implementation uses task decomposition to perform aggressively on multi-core architecture, making it possible to reorder graphs of more than 600 millions nodes in a few hours.
Paolo Boldi, Marco Rosa, Massimo Santini 0001, Sebastiano Vigna
WWW1
2011 HyperANF: approximating the neighbourhood function of very large graphs on a budget
abstract
The neighbourhood function NG(t) of a graph G gives, for each t ∈ N, the number of pairs of nodes x, y such that y is reachable from x in less that t hops. The neighbourhood function provides a wealth of information about the graph [10] (e.g., it easily allows one to compute its diameter), but it is very expensive to compute it exactly. Recently, the ANF algorithm [10] (approximate neighbourhood function) has been proposed with the purpose of approximating NG(t) on large graphs. We describe a breakthrough improvement over ANF in terms of speed and scalability. Our algorithm, called HyperANF, uses the new HyperLogLog counters [5] and combines them efficiently through broadword programming [8]; our implementation uses talk decomposition to exploit multi-core parallelism. With HyperANF, for the first time we can compute in a few hours the neighbourhood function of graphs with billions of nodes with a small error and good confidence using a standard workstation.
Paolo Boldi, Marco Rosa, Sebastiano Vigna
WWW1
2011 E=I+T: The internal extent formula for compacted tries
Paolo Boldi, Sebastiano Vigna
Inf. Process. Lett.1
2011 Query reformulation mining: models, patterns, and applications
Paolo Boldi, Francesco Bonchi, Carlos Castillo 0001, Sebastiano Vigna
Inf. Retr.1
2010 Fast Prefix Search in Little Space, with Applications
Djamal Belazzougui, Paolo Boldi, Rasmus Pagh, Sebastiano Vigna
ESA (1)2
2010 Dynamic Z-Fast Tries
Djamal Belazzougui, Paolo Boldi, Sebastiano Vigna
SPIRE2
2010 Efficient algorithms for large-scale local triangle counting
abstract
In this article, we study the problem of approximate local triangle counting in large graphs. Namely, given a large graph G =( V,E ) we want to estimate as accurately as possible the number of triangles incident to every node v ∈ V in the graph. We consider the question both for undirected and directed graphs. The problem of computing the global number of triangles in a graph has been considered before, but to our knowledge this is the first contribution that addresses the problem of approximate local triangle counting with a focus on the efficiency issues arising in massive graphs and that also considers the directed case. The distribution of the local number of triangles and the related local clustering coefficient can be used in many interesting applications. For example, we show that the measures we compute can help detect the presence of spamming activity in large-scale Web graphs, as well as to provide useful features for content quality assessment in social networks. For computing the local number of triangles (undirected and directed), we propose two approximation algorithms, which are based on the idea of min-wise independent permutations [Broder et al. 1998]. Our algorithms operate in a semi-streaming fashion, using O (| V |) space in main memory and performing O (log | V |) sequential scans over the edges of the graph. The first algorithm we describe in this article also uses O (| E |) space of external memory during computation, while the second algorithm uses only main memory. We present the theoretical analysis as well as experimental results on large graphs, demonstrating the practical efficiency of our approach.
Luca Becchetti, Paolo Boldi, Carlos Castillo 0001, Aristides Gionis
ACM Trans. Knowl. Discov. Data2
2009 Theory and Practise of Monotone Minimal Perfect Hashing
abstract
Minimal perfect hash functions have been shown to be useful to compress data in several data management tasks. In particular, order-preserving minimal perfect hash functions [12] have been used to retrieve the position of a key in a given list of keys: however, the ability to preserve any given order leads to an unavoidable Ω(n log n) lower bound on the number of bits required to store the function. Recently, it was observed [1] that very frequently the keys to be hashed are sorted in their intrinsic (i.e., lexicographical) order. This is typically the case of dictionaries of search engines, list of URLs of web graphs, etc. We refer to this restricted version of the problem as monotone minimal perfect hashing. We analyse experimentally the data structures proposed in [1], and along our way we propose some new methods that, albeit asymptotically equivalent or worse, perform very well in practise, and provide a balance between access speed, ease of construction, and space usage.
Djamal Belazzougui, Paolo Boldi, Rasmus Pagh, Sebastiano Vigna
ALENEX2
2009 Voting in social networks
abstract
A voting system is a set of rules that a community adopts to take collective decisions. In this paper we study voting systems for a particular kind of community: electronically mediated social networks. In particular, we focus on delegative democracy (a.k.a. proxy voting) that has recently received increased interest for its ability to combine the benefits of direct and representative systems, and that seems also perfectly suited for electronically mediated social networks. In such a context, we consider a voting system in which users can only express their preference for one among the people they are explicitly connected with, and this preference can be propagated transitively, using an attenuation factor. We present this system and we study its properties. We also take into consideration the problem of missing votes, which is particularly relevant in online networks, as some recent case shows. Our experiments on real-world networks provide interesting insight into the significance and stability of the results obtained with the suggested voting system.
Paolo Boldi, Francesco Bonchi, Carlos Castillo 0001, Sebastiano Vigna
CIKM1
2009 Monotone minimal perfect hashing: searching a sorted table with O(1) accesses
abstract
A minimal perfect hash function maps a set S of n keys into the set {0, 1, …, n − 1} bijectively. Classical results state that minimal perfect hashing is possible in constant time using a structure occupying space close to the lower bound of log e bits per element. Here we consider the problem of monotone minimal perfect hashing, in which the bijection is required to preserve the lexicographical ordering of the keys. A monotone minimal perfect hash function can be seen as a very weak form of index that provides ranking just on the set S (and answers randomly outside of S). Our goal is to minimise the description size of the hash function: we show that, for a set S of n elements out of a universe of 2w elements, O(n log log w) bits are sufficient to hash monotonically with evaluation time O(log w). Alternatively, we can get space O(n log w) bits with O(1) query time. Both of these data structures improve a straightforward construction with O(n log w) space and O(log w) query time. As a consequence, it is possible to search a sorted table with O(1) accesses to the table (using additional O(n log log w) bits). Our results are based on a structure (of independent interest) that represents a trie in a very compact way, but admits errors. As a further application of the same structure, we show how to compute the predecessor (in the sorted order of S) of an arbitrary element, using O(1) accesses in expectation and an index of O(n log w) bits, improving the trivial result of O(nw) bits. This implies an efficient index for searching a blocked memory.
Djamal Belazzougui, Paolo Boldi, Rasmus Pagh, Sebastiano Vigna
SODA2
2009 Permuting Web Graphs
Paolo Boldi, Massimo Santini 0001, Sebastiano Vigna
WAW1
2009 From "Dango" to "Japanese Cakes": Query Reformulation Models and Patterns
abstract
Understanding query reformulation patterns is a key step towards next generation web search engines: it can help improving users' web-search experience by predicting their intent, and thus helping them to locate information more effectively. As a step in this direction, we build an accurate model for classifying user query reformulations into broad classes (generalization, specialization, error correction or parallel move), achieving 92\% accuracy. We apply the model to automatically label two large query logs, creating annotated query-flow graphs. We study the resulting reformulation patterns, finding results consistent with previous studies done on smaller manually annotated datasets, and discovering new interesting patterns, including connections between reformulation types and topical categories. Finally, applying our findings to a third query log that is publicly available for research purposes, we demonstrate that our reformulation classifier leads to improved recommendations in a query recommendation system.
Paolo Boldi, Francesco Bonchi, Carlos Castillo 0001, Sebastiano Vigna
Web Intelligence1
2009 Pictures from Mongolia. Extracting the Top Elements from a Partially Ordered Set
Paolo Boldi, Flavio Chierichetti, Sebastiano Vigna
Theory Comput. Syst.1
2009 PageRank: Functional dependencies
abstract
research-article Share on PageRank: Functional dependencies Authors: Paolo Boldi Università degli Studi di Milano, Milano, MI, Italy Università degli Studi di Milano, Milano, MI, ItalyView Profile , Massimo Santini Università degli Studi di Milano, Milano, MI, Italy Università degli Studi di Milano, Milano, MI, ItalyView Profile , Sebastiano Vigna Università degli Studi di Milano, Milano, MI, Italy Università degli Studi di Milano, Milano, MI, ItalyView Profile Authors Info & Claims ACM Transactions on Information SystemsVolume 27Issue 4Article No.: 19pp 1–23https://doi.org/10.1145/1629096.1629097Published:30 November 2009Publication History 71citation1,468DownloadsMetricsTotal Citations71Total Downloads1,468Last 12 Months42Last 6 weeks2 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access
Paolo Boldi, Massimo Santini 0001, Sebastiano Vigna
ACM Trans. Inf. Syst.1
2008 The query-flow graph: model and applications
abstract
Query logs record the queries and the actions of the users of engines, and as such they contain valuable information about the interests, the preferences, and the behavior of the users, as well as their implicit feedback to engine results. Mining the wealth of information available in the query logs has many important applications including query-log analysis, user profiling and personalization, advertising, query recommendation, and more.In this paper we introduce the query-flow graph, a graph representation of the interesting knowledge about latent querying behavior. Intuitively, in the query-flow graph a directed edge from query qi to query qj means that the two queries are likely to be part of the same search mission. Any path over the query-flow graph may be seen as a searching behavior, whose likelihood is given by the strength of the edges along the path.The query-flow graph is an outcome of query-log mining and, at the same time, a useful tool for it. We propose a methodology that builds such a graph by mining time and textual information as well as aggregating queries from different users. Using this approach we build a real-world query-flow graph from a large-scale query log and we demonstrate its utility in concrete applications, namely, finding logical sessions, and query recommendation. We believe, however, that the usefulness of the query-flow graph goes beyond these two applications.
Paolo Boldi, Francesco Bonchi, Carlos Castillo 0001, Debora Donato, Aristides Gionis, Sebastiano Vigna
CIKM1
2008 Efficient semi-streaming algorithms for local triangle counting in massive graphs
abstract
In this paper we study the problem of local triangle counting in large graphs. Namely, given a large graph G = (V;E) we want to estimate as accurately as possible the number of triangles incident to every node υ ∈ V in the graph. The problem of computing the global number of triangles in a graph has been considered before, but to our knowledge this is the first paper that addresses the problem of local triangle counting with a focus on the efficiency issues arising in massive graphs. The distribution of the local number of triangles and the related local clustering coefficient can be used in many interesting applications. For example, we show that the measures we compute can help to detect the presence of spamming activity in large-scale Web graphs, as well as to provide useful features to assess content quality in social networks.
Luca Becchetti, Paolo Boldi, Carlos Castillo 0001, Aristides Gionis
KDD2
2008 The number of convex permutominoes
Paolo Boldi, Violetta Lonati, Roberto Radicioni, Massimo Santini 0001
Inf. Comput.1
2007 The Number of Convex Permutominoes
Paolo Boldi, Violetta Lonati, Roberto Radicioni, Massimo Santini 0001
LATA1
2006 Generalizing PageRank: damping functions for link-based ranking algorithms
abstract
This paper introduces a family of link-based ranking algorithms that propagate page importance through links. In these algorithms there is a damping function that decreases with distance, so a direct link implies more endorsement than a link through a long path. PageRank is the most widely known ranking function of this family.The main objective of this paper is to determine whether this family of ranking techniques has some interest per se, and how different choices for the damping function impact on rank quality and on convergence speed. Even though our results suggest that PageRank can be approximated with other simpler forms of rankings that may be computed more efficiently, our focus is of more speculative nature, in that it aims at separating the kernel of PageRank, that is, link-based importance propagation, from the way propagation decays over paths.We focus on three damping functions, having linear, exponential, and hyperbolic decay on the lengths of the paths. The exponential decay corresponds to PageRank, and the other functions are new. Our presentation includes algorithms, analysis, comparisons and experiments that study their behavior under different parameters in real Web graph data.Among other results, we show how to calculate a linear approximation that induces a page ordering that is almost identical to PageRank's using a fixed small number of iterations; comparisons were performed using Kendall's τ on large domain datasets.
Ricardo Baeza-Yates, Paolo Boldi, Carlos Castillo 0001
SIGIR2
2006 Efficient Lazy Algorithms for Minimal-Interval Semantics
Paolo Boldi, Sebastiano Vigna
SPIRE1
2006 Traps and Pitfalls of Topic-Biased PageRank
Paolo Boldi, Roberto Posenato, Massimo Santini 0001, Sebastiano Vigna
WAW1
2005 Compressed Perfect Embedded Skip Lists for Quick Inverted-Index Lookups
Paolo Boldi, Sebastiano Vigna
SPIRE1
2005 PageRank as a function of the damping factor
abstract
PageRank is defined as the stationary state of a Markov chain. The chain is obtained by perturbing the transition matrix induced by a web graph with a damping factor α that spreads uniformly part of the rank. The choice of α is eminently empirical, and in most cases the original suggestion α = 0.85 by Brin and Page is still used. Recently, however, the behaviour of PageRank with respect to changes in α was discovered to be useful in link-spam detection[21]. Moreover, an analytical justification of the value chosen for α is still missing. In this paper, we give the first mathematical analysis of PageRank when α changes. In particular, we show that, contrarily to popular belief, for real-world graphs values of α close to 1 do not give a more meaningful ranking. Then, we give closed-form formulae for PageRank derivatives of any order, and an extension of the Power Method that approximates them with convergence O (tk αt) for the k-th derivative. Finally, we show a tight connection between iterated computation and analytical behaviour by proving that the k-th iteration of the Power Method gives exactly the PageRank value obtained using a Maclaurin polynomial of degree k. The latter result paves the way towards the application of analytical methods to the study of PageRank.
Paolo Boldi, Massimo Santini 0001, Sebastiano Vigna
WWW1
2005 Mutable strings in Java: design, implementation and lightweight text-search algorithms
Paolo Boldi, Sebastiano Vigna
Sci. Comput. Program.1
2004 The WebGraph Framework II: Codes For The World-Wide Web
abstract
This paper describes the Web graph framework that provides simple methods to manage very large graphs, specially tailored around Web graphs. A fundamental observation about compression of the web graph was made in the construction of the LINK database. Web graph contains a fully-documented implementation of various instantaneous codes, and of parameterisable compression algorithms that achieve the best compression rates and introducing a new technique called intervalisation. Web graph also contains algorithms for accessing a compressed graph.
Paolo Boldi, Sebastiano Vigna
Data Compression Conference1
2004 Do Your Worst to Make the Best: Paradoxical Effects in PageRank Incremental Computations
Paolo Boldi, Massimo Santini 0001, Sebastiano Vigna
WAW1
2004 The webgraph framework I: compression techniques
abstract
Studying web graphs is often difficult due to their large size. Recently,several proposals have been published about various techniques that allow tostore a web graph in memory in a limited space, exploiting the inner redundancies of the web. The WebGraph framework is a suite of codes, algorithms and tools that aims at making it easy to manipulate large web graphs. This papers presents the compression techniques used in WebGraph, which are centred around referentiation and intervalisation (which in turn are dual to each other). WebGraph can compress the WebBase graph (118 Mnodes, 1 Glinks)in as little as 3.08 bits per link, and its transposed version in as littleas 2.89 bits per link.
Paolo Boldi, Sebastiano Vigna
WWW1
2004 UbiCrawler: a scalable fully distributed Web crawler
abstract
Abstract We report our experience in implementing UbiCrawler, a scalable distributed Web crawler, using the Java programming language. The main features of UbiCrawler are platform independence, linear scalability, graceful degradation in the presence of faults, a very effective assignment function (based on consistent hashing) for partitioning the domain to crawl, and more in general the complete decentralization of every task. The necessity of handling very large sets of data has highlighted some limitations of the Java APIs, which prompted the authors to partially reimplement them. Copyright © 2004 John Wiley & Sons, Ltd.
Paolo Boldi, Bruno Codenotti, Massimo Santini 0001, Sebastiano Vigna
Softw. Pract. Exp.1
2003 Lower bounds for sense of direction in regular graphs
Paolo Boldi, Sebastiano Vigna
Distributed Comput.1
2002 Holographic Trees
Paolo Boldi, Sebastiano Vigna
LATIN1
2002 Universal dynamic synchronous self-stabilization
Paolo Boldi, Sebastiano Vigna
Distributed Comput.1
2002 Universal Homogeneous Graph-Like Structures And Domains
abstract
We present explicit constructions of universal homogeneous objects in categories of domains with stable embedding–projection pairs as arrows. These results make use of a representation of such domains through graph-like structures and apply a generalization of Rado’s result on the existence of the universal homogeneous countable graph. In particular, we build universal homogeneous objects in the categories of coherence spaces and qualitative domains, introduced by Girard (Girard 1987; Girard 1986), and two categories of hypercoherences recently studied by Ehrhard (Ehrhard 1993). Our constructions rely on basic numerical notions. We also show that a suitable random construction of Rado’s graph and its generalizations produces with probability 1 the universal homogeneous structures presented here.
Paolo Boldi, Felice Cardone, Manfred Droste
Math. Struct. Comput. Sci.1
2002 Measuring with jugs
Paolo Boldi, Massimo Santini 0001, Sebastiano Vigna
Theor. Comput. Sci.1
2001 An Effective Characterization of Computability in Anonymous Networks
Paolo Boldi, Sebastiano Vigna
DISC1
2000 Lower bounds for (weak) sense of direction
Paolo Boldi, Sebastiano Vigna
SIROCCO1
2000 More Lower Bounds for Weak Sense of Direction: The Case of Regular Graphs
Paolo Boldi, Sebastiano Vigna
DISC1
2000 Coverings that preserve sense of direction
Paolo Boldi, Sebastiano Vigna
Inf. Process. Lett.1
2000 The Turing closure of an Archimedean field
Paolo Boldi, Sebastiano Vigna
Theor. Comput. Sci.1
1999 Computing Anonymously with Arbitrary Knowledge
abstract
We provide characterizations of the relations that can be computed with arbitrary knowledge on networks where all processors use the same algorithm and start from the same state (in particular, we do not assume that a bound on the network size is known).Three activation models are considered (synchronous, asynchronous, interleaved).Perniission to make digital or hard copies of all or part of this work for ~~ersuna~ or ciassroom use is granted without fee probided that copies arc not m&c or distributed for prolit or commercial adcmtagc and that topics bear this notice and the full citation on the first page.TO copy otherwise.
Paolo Boldi, Sebastiano Vigna
PODC1
1999 Complexity of Deciding Sense of Direction
abstract
In this paper we prove that deciding whether a distributed system (represented as a colored digraph with n nodes) has weak sense of direction is in AC 1 (using n 6 processors). Moreover, we show that deciding sense of direction is in P. Our algorithms can also be used to decide in AC 1 whether a colored graph is a Cayley color graph.
Paolo Boldi, Sebastiano Vigna
SIAM J. Comput.1
1999 Equality is a Jump
Paolo Boldi, Sebastiano Vigna
Theor. Comput. Sci.1
1998 The Turing Closure of an Archimedean Field
Paolo Boldi, Sebastiano Vigna
MCU (2)1
1998 delta-Uniform BSS Machines
Paolo Boldi, Sebastiano Vigna
J. Complex.1
1997 Computing Vector Functions on Anonymous Networks
abstract
No abstract available.
Paolo Boldi, Sebastiano Vigna
PODC1
1997 Computing Vector Functions on Anonymous Networks
Paolo Boldi, Sebastiano Vigna
SIROCCO1
1997 Minimal Sense of Direction and Decision Problems for Cayley Graphs
Paolo Boldi, Sebastiano Vigna
Inf. Process. Lett.1
1996 Good Fibrations and Other Construction Which Preserve Sense of Direction
Paolo Boldi, Sebastiano Vigna
SIROCCO1
1996 Maximal Chains and Antichains in Strongly Noetherian Semiorders
abstract
In the field of abstract measurement theory, semiorders have assumed an especially important role as a natural setting for expressing the comparative relations among the magnitudes of measurands. If we assume in addition that our measuring scale is bounded below, which happens in many important cases, we get an interesting class of semiorders, the strongly noetherian ones. In this work, we study some combinatorial and order-theoretic properties of strongly noetherian semiorders, with a particular regard to the structure of maximal chains and antichains (called lines and cuts in the present paper). We see that the cuts determine a sort of dynamics in the semiorder, which may be described as a linear order on the cuts themselves; from this linear order one can extract the main properties of the original semiorder, whose elements are represented as closed intervals of cuts. Moreover, “continuity” properties such as K-density and coherence have a natural description in term of simple cut properties; as a corollary, we obtain that K-density is equivalent to N-freeness in strongly noetherian semiorders.
Paolo Boldi
Fundam. Informaticae1
1995 On the Complexity of Deciding Sense of Direction
Paolo Boldi, Sebastiano Vigna
SIROCCO1