EDBT 2026 Demo / reviewers in the wild / expert
Kaushik Chakrabarti
dblp:c/KaushikChakrabarti
· DBLP profile ↗
40ranked-venue papers
15as first author
0since 2021 · last 2018
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 38 · 15 first-authorApplied, interdisciplinary, general and emerging computing · 6Artificial intelligence and machine learning · 3 · 1 first-authorGraphics, computer vision, multimedia, augmented reality and games · 2
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
35 papers |
Information retrieval · 26% Query processing and optimization · 25% Data integration and cleaning · 14% | |
| Artificial intelligence
4 papers |
Information extraction and text analysis · 96% Graph learning · 4% |
Topics — the 30 heaviest of 77, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Query processing and optimization
approximate query processing |
0.6 | 4 | 2018 | Efficient Attribute Recommendation with Probabilistic Guarantee · KDD 2018 Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee · SIGMOD Conference 2016 Approximate query processing using wavelets · VLDB J. 2001 |
Query processing and optimization
top-k query processing |
0.4 | 3 | 2015 | S4: Top-k Spreadsheet-Style Search for Query Discovery · SIGMOD Conference 2015 Interval-based pruning for top-k processing over compressed lists · ICDE 2011 Evaluating Refined Queries in Top-k Retrieval Systems · IEEE Trans. Knowl. Data Eng. 2004 |
Recommender systems › content-based recommendation
attribute-based recommendation |
0.3 | 1 | 2018 | Efficient Attribute Recommendation with Probabilistic Guarantee · KDD 2018 |
Data mining
exploratory data analysis |
0.3 | 1 | 2018 | Efficient Attribute Recommendation with Probabilistic Guarantee · KDD 2018 |
Query processing and optimization › approximate query processing
sampling-based approximate query processing |
0.3 | 1 | 2018 | Efficient Attribute Recommendation with Probabilistic Guarantee · KDD 2018 |
Data integration and cleaning › data curation
entity augmentation |
0.3 | 2 | 2013 | InfoGather+: semantic matching and annotation of numeric and time-varying attributes in web tables · SIGMOD Conference 2013 InfoGather: entity augmentation and attribute discovery by holistic matching with web tables · SIGMOD Conference 2012 |
Query processing and optimization › approximate query processing
approximate aggregation |
0.2 | 1 | 2016 | Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee · SIGMOD Conference 2016 |
Query processing and optimization › aggregate query processing
group-by query |
0.2 | 1 | 2016 | Sample + Seek: Approximating Aggregates with Distribution Precision Guarantee · SIGMOD Conference 2016 |
Information retrieval
query understanding |
0.2 | 1 | 2016 | Automatic Discovery of Attribute Synonyms Using Query Logs and Table Corpora · WWW 2016 |
Information retrieval
search engines |
0.2 | 2 | 2011 | Location-aware type ahead search on spatial databases: semantics and efficiency · SIGMOD Conference 2011 Query portals: dynamically generating portals for entity-oriented web queries · SIGMOD Conference 2010 |
Natural language and speech › Information extraction and text analysis
named entity recognition |
0.2 | 2 | 2012 | Targeted disambiguation of ad-hoc, homogeneous sets of named entities · WWW 2012 Scalable ad-hoc entity extraction from text collections · Proc. VLDB Endow. 2008 |
Natural language and speech › Information extraction and text analysis
concept expansion |
0.2 | 1 | 2015 | Concept Expansion Using Web Tables · WWW 2015 |
Natural language and speech › Information extraction and text analysis › named entity processing
entity set expansion |
0.2 | 1 | 2015 | Concept Expansion Using Web Tables · WWW 2015 |
Data integration and cleaning › data extraction
table extraction |
0.2 | 1 | 2015 | TEGRA: Table Extraction by Global Record Alignment · SIGMOD Conference 2015 |
Web and social media mining › web mining
web table mining |
0.2 | 1 | 2015 | Concept Expansion Using Web Tables · WWW 2015 |
Information retrieval › distributed information retrieval
federated search |
0.2 | 2 | 2010 | Query portals: dynamically generating portals for entity-oriented web queries · SIGMOD Conference 2010 Exploiting web search engines to search structured databases · WWW 2009 |
Graph data management › keyword search on graphs
keyword search over knowledge graphs |
0.2 | 1 | 2014 | Finding Patterns in a Knowledge Base using Keywords to Compose Table Answers · Proc. VLDB Endow. 2014 |
Knowledge graphs
knowledge graph querying |
0.2 | 1 | 2014 | Finding Patterns in a Knowledge Base using Keywords to Compose Table Answers · Proc. VLDB Endow. 2014 |
Data models and query languages › query interface
query inference from examples |
0.2 | 1 | 2014 | Discovering queries based on example tuples · SIGMOD Conference 2014 |
Data mining › text mining › information extraction
acronym disambiguation |
0.2 | 1 | 2013 | Mining acronym expansions and their meanings using query click log · WWW 2013 |
Natural language and speech › Information extraction and text analysis › entity linking
entity disambiguation |
0.1 | 1 | 2012 | Targeted disambiguation of ad-hoc, homogeneous sets of named entities · WWW 2012 |
Data integration and cleaning › table understanding › table annotation
attribute discovery |
0.1 | 1 | 2012 | InfoGather: entity augmentation and attribute discovery by holistic matching with web tables · SIGMOD Conference 2012 |
Information retrieval
query log analysis |
0.1 | 1 | 2012 | A framework for robust discovery of entity synonyms · KDD 2012 |
Distributed and cloud data management › mapreduce
mapreduce algorithms |
0.1 | 1 | 2011 | Fast personalized PageRank on MapReduce · SIGMOD Conference 2011 |
Spatial and temporal data management › spatial query processing
proximity search |
0.1 | 1 | 2011 | Location-aware type ahead search on spatial databases: semantics and efficiency · SIGMOD Conference 2011 |
Spatial and temporal data management
spatial query processing |
0.1 | 1 | 2011 | Location-aware type ahead search on spatial databases: semantics and efficiency · SIGMOD Conference 2011 |
Information retrieval
type-ahead search |
0.1 | 1 | 2011 | Location-aware type ahead search on spatial databases: semantics and efficiency · SIGMOD Conference 2011 |
Graph algorithms and graph theory
graph processing |
0.1 | 1 | 2011 | Fast personalized PageRank on MapReduce · SIGMOD Conference 2011 |
Graph algorithms and graph theory › centrality › pagerank
personalized pagerank |
0.1 | 1 | 2011 | Fast personalized PageRank on MapReduce · SIGMOD Conference 2011 |
Information retrieval › distributed information retrieval
integrated search |
0.1 | 1 | 2009 | Exploiting web search engines to search structured databases · WWW 2009 |
Methods — techniques the papers use, named apart from their topics
probabilistic ranking · 0.4personalized pagerank · 0.4probabilistic guarantees · 0.3adaptive sampling · 0.3sampling · 0.2optimization · 0.2linear programming · 0.2scoring function · 0.2query discovery algorithms · 0.2path-based indexing · 0.2entity tagging · 0.2context word extraction · 0.2co-click analysis · 0.2mentionrank · 0.1graph-based ranking · 0.1collective inference · 0.1random walk · 0.1monte carlo approximation · 0.1
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2018 | Efficient Attribute Recommendation with Probabilistic GuaranteeabstractWe study how to efficiently solve a primitive data exploration problem: Given two ad-hoc predicates which define two subsets of a relational table, find the top-K attributes whose distributions in the two subsets deviate most from each other. The deviation is measured by $\ell1$ or $\ell2$ distance. The exact approach is to query the full table to calculate the deviation for each attribute and then sort them. It is too expensive for large tables. Researchers have proposed heuristic sampling solutions to avoid accessing the entire table for all attributes. However, these solutions have no theoretical guarantee of correctness and their speedup over the exact approach is limited. In this paper, we develop an adaptive querying solution with probabilistic guarantee of correctness and near-optimal sample complexity. We perform experiments in both synthetic and real-world datasets. Compared to the exact approach implemented with a commercial DBMS, previous sampling solutions achieve up to 2× speedup with erroneous answers. Our solution can produce 25× speedup with near-zero error in the answer. Chi Wang 0001, Kaushik Chakrabarti |
KDD | 2 |
| 2016 | Sample + Seek: Approximating Aggregates with Distribution Precision GuaranteeabstractData volumes are growing exponentially for our decision-support systems making it challenging to ensure interactive response time for ad-hoc queries without increasing cost of hardware. Aggregation queries with Group By that produce an aggregate value for every combination of values in the grouping columns are the most important class of ad-hoc queries. As small errors are usually tolerable for such queries, approximate query processing (AQP) has the potential to answer them over very large datasets much faster. Bolin Ding, Silu Huang, Surajit Chaudhuri, Kaushik Chakrabarti, Chi Wang 0001 |
SIGMOD Conference | 4 |
| 2016 | Automatic Discovery of Attribute Synonyms Using Query Logs and Table CorporaabstractAttribute synonyms are important ingredients for keyword-based search systems. For instance, web search engines recognize queries that seek the value of an entity on a specific attribute (referred to as e+a queries) and provide direct answers for them using a combination of knowledge bases, web tables and documents. However, users often refer to an attribute in their e+a query differently from how it is referred in the web table or text passage. In such cases, search engines may fail to return relevant answers. To address that problem, we propose to automatically discover all the alternate ways of referring to the attributes of a given class of entities (referred to as attribute synonyms) in order to improve search quality. The state-of-the-art approach that relies on attribute name co-occurrence in web tables suffers from low precision. Our main insight is to combine positive evidence of attribute synonymity from query click logs, with negative evidence from web table attribute name co-occurrences. We formalize the problem as an optimization problem on a graph, with the attribute names being the vertices and the positive and negative evidences from query logs and web table schemas as weighted edges. We develop a linear programming based algorithm to solve the problem that has bi-criteria approximation guarantees. Our experiments on real-life datasets show that our approach has significantly higher precision and recall compared with the state-of-the-art. Yeye He, Kaushik Chakrabarti, Tomasz Tylenda |
WWW | 2 |
| 2015 | Holistic entity matching across knowledge graphsabstractEntity matching is the problem of determining if two entities in a data set refer to the same real-world object. In the last decade a growing number of large-scale knowledge bases have been created online. Tools for automatically aligning these sources would make it possible to unify them in a structured knowledge and to answer complex queries. Here we present Holistic Entity Matching (HolisticEM), an algorithm based on Personalized Page Rank for aligning instances in large knowledge bases. It consists of two steps. First, a graph of potential matching pairs is constructed; second, local and global information from the relationship graph is propagated via Personalized Page Rank. We demonstrate that HolisticEM performs competitively and can efficiently handle databases with 110M and 203M entities accurately resolving 1.6M of matching entity pairs. Maria Pershina, Mohamed Yakout, Kaushik Chakrabarti |
IEEE BigData | 3 |
| 2015 | TEGRA: Table Extraction by Global Record AlignmentabstractIt is well known today that pages on the Web contain a large number of content-rich relational tables. Such tables have been systematically extracted in a number of efforts to empower important applications such as table search and schema discovery. However, a significant fraction of relational tables are not embedded in the standard HTML table tags, and are thus difficult to extract. In particular, a large number of relational tables are known to be in a ``list'' form, which contains a list of clearly separated rows that are not separated into columns. Xu Chu 0002, Yeye He, Kaushik Chakrabarti, Kris Ganjam |
SIGMOD Conference | 3 |
| 2015 | S4: Top-k Spreadsheet-Style Search for Query DiscoveryabstractAn enterprise information worker is often aware of a few example tuples that should be present in the output of the query. Query discovery systems have been developed to discover project-join queries that contain the given example tuples in their output. However, they require the output to exactly contain all the example tuples and do not perform any ranking. To address this limitation, we study the problem of efficiently discovering top-k project join queries which approximately contain the given example tuples in their output. We extend our algorithms to incrementally produce results as soon as the user finishes typing/modifying a cell. Our experiments on real-life and synthetic datasets show that our proposed solution is significantly more efficient compared with applying state-of-the-art algorithms. Fotis Psallidas, Bolin Ding, Kaushik Chakrabarti, Surajit Chaudhuri |
SIGMOD Conference | 3 |
| 2015 | Concept Expansion Using Web TablesabstractWe study the following problem: given the name of an ad-hoc concept as well as a few seed entities belonging to the concept, output all entities belonging to it. Since producing the exact set of entities is hard, we focus on returning a ranked list of entities. Previous approaches either use seed entities as the only input, or inherently require negative examples. They suffer from input ambiguity and semantic drift, or are not viable options for ad-hoc tail concepts. In this paper, we propose to leverage the millions of tables on the web for this problem. The core technical challenge is to identify the ``exclusive'' tables for a concept to prevent semantic drift; existing holistic ranking techniques like personalized PageRank are inadequate for this purpose. We develop novel probabilistic ranking methods that can model a new type of table-entity relationship. Experiments with real-life concepts show that our proposed solution is significantly more effective than applying state-of-the-art set expansion or holistic ranking techniques. Chi Wang 0001, Kaushik Chakrabarti, Yeye He, Kris Ganjam, Philip A. Bernstein |
WWW | 2 |
| 2014 | Discovering queries based on example tuplesabstractAn enterprise information worker is often aware of a few example tuples (but not the entire result) that should be present in the output of the query. We study the problem of discovering the minimal project join query that contains the given example tuples in its output. Efficient discovery of such queries is challenging. We propose novel algorithms to solve this problem. Our experiments on real-life datasets show that the proposed solution is significantly more efficient compared with na\"{i}ve adaptations of known techniques. Yanyan Shen, Kaushik Chakrabarti, Surajit Chaudhuri, Bolin Ding, Lev Novik |
SIGMOD Conference | 2 |
| 2014 | Finding Patterns in a Knowledge Base using Keywords to Compose Table AnswersabstractWe aim to provide table answers to keyword queries using a knowledge base. For queries referring to multiple entities, like "Washington cities population" and "Mel Gibson movies", it is better to represent each relevant answer as a table which aggregates a set of entities or joins of entities within the same table scheme or pattern. In this paper, we study how to find highly relevant patterns in a knowledge base for user-given keyword queries to compose table answers. A knowledge base is modeled as a directed graph called knowledge graph, where nodes represent its entities and edges represent the relationships among them. Each node/edge is labeled with type and text. A pattern is an aggregation of subtrees which contain all keywords in the texts and have the same structure and types on node/edges. We propose efficient algorithms to find patterns that are relevant to the query for a class of scoring functions. We show the hardness of the problem in theory, and propose path-based indexes that are affordable in memory. Two query-processing algorithms are proposed: one is fast in practice for small queries (with small numbers of patterns as answers) by utilizing the indexes; and the other one is better in theory, with running time linear in the sizes of indexes and answers, which can handle large queries better. We also conduct extensive experimental study to compare our approaches with a naive adaption of known techniques. Mohan Yang, Bolin Ding, Surajit Chaudhuri, Kaushik Chakrabarti |
Proc. VLDB Endow. | 4 |
| 2013 | Data services for E-tailers leveraging web search engine assetsabstractRetail is increasingly moving online. There are only a few big e-tailers but there is a long tail of small-sized e-tailers. The big e-tailers are able to collect significant data on user activities at their websites. They use these assets to derive insights about their products and to provide superior experiences for their users. On the other hand, small e-tailers do not possess such user data and hence cannot match the rich user experiences offered by big e-tailers. Our key insight is that web search engines possess significant data on user behaviors that can be used to help smaller e-tailers mine the same signals that big e-tailers derive from their proprietary user data assets. These signals can be exposed as data services in the cloud; e-tailers can leverage them to enable similar user experiences as the big e-tailers. We present three such data services in the paper: entity synonym data service, query-to-entity data service and entity tagging data service. The entity synonym service is an in-production data service that is currently available while the other two are data services currently in development at Microsoft. Our experiments on product datasets show (i) these data services have high quality and (ii) they have significant impact on user experiences on e-tailer websites. To the best of our knowledge, this is the first paper to explore the potential of using search engine data assets for e-tailers. Kaushik Chakrabarti, Surajit Chaudhuri, Vivek R. Narasayya, Manoj Syamala |
ICDE | 2 |
| 2013 | InfoGather+: semantic matching and annotation of numeric and time-varying attributes in web tablesabstractUsers often need to gather information about "entities" of interest. Recent efforts try to automate this task by leveraging the vast corpus of HTML tables; this is referred to as "entity augmentation". The accuracy of entity augmentation critically depends on semantic relationships between web tables as well as semantic labels of those tables. Current techniques work well for string-valued and static attributes but perform poorly for numeric and time-varying attributes. Meihui Zhang 0001, Kaushik Chakrabarti |
SIGMOD Conference | 2 |
| 2013 | Mining acronym expansions and their meanings using query click logabstractAcronyms are abbreviations formed from the initial components of words or phrases. Acronym usage is becoming more common in web searches, email, text messages, tweets, blogs and posts. Acronyms are typically ambiguous and often disambiguated by context words. Given either just an acronym as a query or an acronym with a few context words, it is immensely useful for a search engine to know the most likely intended meanings, ranked by their likelihood. To support such online scenarios, we study the offline mining of acronyms and their meanings in this paper. For each acronym, our goal is to discover all distinct meanings and for each meaning, compute the expanded string, its popularity score and a set of context words that indicate this meaning. Existing approaches are inadequate for this purpose. Our main insight is to leverage "co-clicks" in search engine query click log to mine expansions of acronyms. There are several technical challenges such as ensuring 1:1 mapping between expansions and meanings, handling of "tail meanings" and extracting context words. We present a novel, end-to-end solution that addresses the above challenges. We further describe how web search engines can leverage the mined information for prediction of intended meaning for queries containing acronyms. Our experiments show that our approach (i) discovers the meanings of acronyms with high precision and recall, (ii) significantly complements existing meanings in Wikipedia and (iii) accurately predicts intended meaning for online queries with over 90% precision. Bilyana Taneva, Kaushik Chakrabarti, Yeye He |
WWW | 3 |
| 2012 | A framework for robust discovery of entity synonymsabstractEntity synonyms are critical for many applications like information retrieval and named entity recognition in documents. The current trend is to automatically discover entity synonyms using statistical techniques on web data. Prior techniques suffer from several limitations like click log sparsity and inability to distinguish between entities of different concept classes. In this paper, we propose a general framework for robustly discovering entity synonym with two novel similarity functions that overcome the limitations of prior techniques. We develop efficient and scalable techniques leveraging the MapReduce framework to discover synonyms at large scale. To handle long entity names with extraneous tokens, we propose techniques to effectively map long entity names to short queries in query log. Our experiments on real data from different entity domains demonstrate the superior quality of our synonyms as well as the efficiency of our algorithms. The entity synonyms produced by our system is in production in Bing Shopping and Video search, with experiments showing the significance it brings in improving search experience. Kaushik Chakrabarti, Surajit Chaudhuri, Dong Xin |
KDD | 1 |
| 2012 | InfoGather: entity augmentation and attribute discovery by holistic matching with web tablesabstractThe Web contains a vast corpus of HTML tables, specifically entity attribute tables. We present three core operations, namely entity augmentation by attribute name, entity augmentation by example and attribute discovery, that are useful for "information gathering" tasks (e.g., researching for products or stocks). We propose to use web table corpus to perform them automatically. We require the operations to have high precision and coverage, have fast (ideally interactive) response times and be applicable to any arbitrary domain of entities. The naive approach that attempts to directly match the user input with the web tables suffers from poor precision and coverage. Mohamed Yakout, Kris Ganjam, Kaushik Chakrabarti, Surajit Chaudhuri |
SIGMOD Conference | 3 |
| 2012 | Targeted disambiguation of ad-hoc, homogeneous sets of named entitiesabstractIn many entity extraction applications, the entities to be recognized are constrained to be from a list of "target entities". In many cases, these target entities are (i) ad-hoc, i.e., do not exist in a knowledge base and (ii) homogeneous (e.g., all the entities are IT companies). We study the following novel disambiguation problem in this unique setting: given the candidate mentions of all the target entities, determine which ones are true mentions of a target entity. Prior techniques only consider target entities present in a knowledge base and/or having a rich set of attributes. In this paper, we develop novel techniques that require no knowledge about the entities except their names. Our main insight is to leverage the homogeneity constraint and disambiguate the candidate mentions collectively across all documents. We propose a graph-based model, called MentionRank, for that purpose. Furthermore, if additional knowledge is available for some or all of the entities, our model can leverage it to further improve quality. Our experiments demonstrate the effectiveness of our model. To the best of our knowledge, this is the first work on targeted entity disambiguation for ad-hoc entities. Chi Wang 0001, Kaushik Chakrabarti, Surajit Chaudhuri |
WWW | 2 |
| 2012 | Guest Editor's editorial: ranking in databases
Kaushik Chakrabarti |
Distributed Parallel Databases | 1 |
| 2011 | Interval-based pruning for top-k processing over compressed listsabstractOptimizing execution of top-k queries over record-id ordered, compressed lists is challenging. The threshold family of algorithms cannot be effectively used in such cases. Yet, improving execution of such queries is of great value. For example, top-k keyword search in information retrieval (IR) engines represents an important scenario where such optimization can be directly beneficial. In this paper, we develop novel algorithms to improve execution of such queries over state of the art techniques. Our main insights are pruning based on fine-granularity bounds and traversing the lists based on judiciously chosen “intervals” rather than individual records. We formally study the optimality characteristics of the proposed algorithms. Our algorithms require minimal changes and can be easily integrated into IR engines. Our experiments on real-life datasets show that our algorithm outperform the state of the art techniques by a factor of 3-6 in terms of query execution times. Kaushik Chakrabarti, Surajit Chaudhuri, Venkatesh Ganti |
ICDE | 1 |
| 2011 | Fast personalized PageRank on MapReduceabstractIn this paper, we design a fast MapReduce algorithm for Monte Carlo approximation of personalized PageRank vectors of all the nodes in a graph. The basic idea is very efficiently doing single random walks of a given length starting at each node in the graph. More precisely, we design a MapReduce algorithm, which given a graph G and a length », outputs a single random walk of length » starting at each node in G. We will show that the number of MapReduce iterations used by our algorithm is optimal among a broad family of algorithms for the problem, and its I/O efficiency is much better than the existing candidates. We will then show how we can use this algorithm to very efficiently approximate all the personalized PageRank vectors. Our empirical evaluation on real-life graph data and in production MapReduce environment shows that our algorithm is significantly more efficient than all the existing algorithms in the MapReduce setting. Bahman Bahmani, Kaushik Chakrabarti, Dong Xin |
SIGMOD Conference | 2 |
| 2011 | Location-aware type ahead search on spatial databases: semantics and efficiencyabstractUsers often search spatial databases like yellow page data using keywords to find businesses near their current location. Typing the entire query is cumbersome and prone to errors, especially from mobile phones. We address this problem by introducing type-ahead search functionality on spatial databases. Like keyword search on spatial data, type-ahead search needs to be location-aware, i.e., with every letter being typed, it needs to return spatial objects whose names (or descriptions) are valid completions of the query string typed so far, and which rank highest in terms of proximity to the user's location and other static scores. Existing solutions for type-ahead search cannot be used directly as they are not location-aware. We show that a straight-forward combination of existing techniques for performing type-ahead search with those for performing proximity search perform poorly. We propose a formal model for query processing cost and develop novel techniques that optimize that cost. Our empirical evaluations on real and synthetic datasets demonstrate the effectiveness of our techniques. To the best of our knowledge, this is the first work on location-aware type-ahead search. Senjuti Basu Roy, Kaushik Chakrabarti |
SIGMOD Conference | 2 |
| 2010 | Query portals: dynamically generating portals for entity-oriented web queriesabstractMany web queries seek information about named entities (such as products or people). Web search engines federate such entity-oriented queries to relevant structured databases; the results of those searches are then returned to the user along with web search results. Current federated approaches have two limitations: (i) they often fail to return important results for a broad class of such entity-oriented queries and (ii) the information they return per entity is often inadequate. In this paper, we present the Query Portals system that addresses these limitations. The Query Portals system dynamically generates a portal for an entity-oriented query. It first provides an overview of the relevant entities and further allows users to drill down to gather additional information on these entities. Our architecture uses a judicious combination of pre-processing and query time techniques so that the query portal can be generated efficiently. Sanjay Agrawal 0001, Kaushik Chakrabarti, Surajit Chaudhuri, Venkatesh Ganti, Arnd Christian König, Dong Xin |
SIGMOD Conference | 2 |
| 2009 | Exploiting web search engines to search structured databasesabstractWeb search engines often federate many user queries to relevant structured databases. For example, a product related query might be federated to a product database containing their descriptions and specifications. The relevant structured data items are then returned to the user along with web search results. However, each structured database is searched in isolation. Hence, the search often produces empty or incomplete results as the database may not contain the required information to answer the query. In this paper, we propose a novel integrated search architecture. We establish and exploit the relationships between web search results and the items in structured databases to identify the relevant structured data items for a much wider range of queries.Our architecture leverages existing search engine components to implement this functionality at very low overhead. We demonstrate the quality and efficiency of our techniques through an extensive experimental study. Sanjay Agrawal 0001, Kaushik Chakrabarti, Surajit Chaudhuri, Venkatesh Ganti, Arnd Christian König, Dong Xin |
WWW | 2 |
| 2008 | An efficient filter for approximate membership checkingabstractWe consider the problem of identifying sub-strings of input text strings that approximately match with some member of a potentially large dictionary. This problem arises in several important applications such as extracting named entities from text documents and identifying biological concepts from biomedical literature. In this paper, we develop a filter-verification framework, and propose a novel in-memory filter structure. That is, we first quickly filter out sub-strings that cannot match with any dictionary member, and then verify the remaining sub-strings against the dictionary. Our method does not produce false negatives. We demonstrate the efficiency and effectiveness of our filter over real datasets, and show that it significantly outperforms the previous best-known methods in terms of both filtering power and computation time. Kaushik Chakrabarti, Surajit Chaudhuri, Venkatesh Ganti, Dong Xin |
SIGMOD Conference | 1 |
| 2008 | Scalable ad-hoc entity extraction from text collectionsabstractSupporting entity extraction from large document collections is important for enabling a variety of important data analysis tasks. In this paper, we introduce the "ad-hoc" entity extraction task where entities of interest are constrained to be from a list of entities that is specific to the task. In such scenarios, traditional entity extraction techniques that process all the documents for each ad-hoc entity extraction task can be significantly expensive. In this paper, we propose an efficient approach that leverages the inverted index on the documents to identify the subset of documents relevant to the task and processes only those documents. We demonstrate the efficiency of our techniques on real datasets. Sanjay Agrawal 0001, Kaushik Chakrabarti, Surajit Chaudhuri, Venkatesh Ganti |
Proc. VLDB Endow. | 2 |
| 2006 | Ranking objects based on relationshipsabstractIn many document collections, documents are related to objects such as document authors, products described in the document, or persons referred to in the document. In many applications, the goal is to find these objects that best match a set of keywords. However, the keywords may not necessarily occur in the target objects; they occur only in the documents. For example, in a product review database, a user might search for names of products (say, laptops) using keywords like "lightweight" and "business use" that occur only in the reviews but not in the names of laptops. In order to answer these queries, we need to exploit relationships between documents containing the keywords and the target objects related to those documents. Current keyword query paradigms do not exploit these relationships effectively and hence are inefficient for these queries.In this paper, we consider a class of queries called the "object finder" queries. Our main intuition is to exploit the relationships between searchable documents and related objects and further "aggregate" the document scores from these relationships in order to find the best ranking target objects. Building upon existing keyword search engines such as full text search, we design efficient algorithms that exploit the requirement of only the best k target objects to terminate early. The main challenge here is to push early termination through blocking operators such as group by and aggregation. Our experiments with real datasets and workloads demonstrate the effectiveness of our techniques. Although we present our techniques in the context of keyword search, our techniques apply to other types of ranked searches (e.g., multimedia search) as well. Kaushik Chakrabarti, Venkatesh Ganti, Jiawei Han 0001, Dong Xin |
SIGMOD Conference | 1 |
| 2004 | Automatic Categorization of Query ResultsabstractExploratory ad-hoc queries could return too many answers - a phenomenon commonly referred to as "information overload". In this paper, we propose to automatically categorize the results of SQL queries to address this problem. We dynamically generate a labeled, hierarchical category structure - users can determine whether a category is relevant or not by examining simply its label; she can then explore just the relevant categories and ignore the remaining ones, thereby reducing information overload. We first develop analytical models to estimate information overload faced by a user for a given exploration. Based on those models, we formulate the categorization problem as a cost optimization problem and develop heuristic algorithms to compute the min-cost categorization. Kaushik Chakrabarti, Surajit Chaudhuri, Seung-won Hwang |
SIGMOD Conference | 1 |
| 2004 | Evaluating Refined Queries in Top-k Retrieval SystemsabstractIn many applications, users specify target values for certain attributes/features without requiring exact matches to these values in return. Instead, the result is typically a ranked list of "top k" objects that best match the specified feature values. User subjectivity is an important aspect of such queries, i.e., which objects are relevant to the user and which are not depends on the perception of the user. Due to the subjective nature of top-k queries, the answers returned by the system to an user query often do not satisfy the users need right away, either because the weights and the distance functions associated with the features do not accurately capture the users perception or because the specified target values do not fully capture her information need or both. In such cases, the user would like to refine the query and resubmit it in order to get back a better set of answers. While there has been a lot of research on query refinement models, there is no work that we are aware of on supporting refinement of top-k queries efficiently in a database system. Done naively, each "refined" query can be treated as a "starting" query and evaluated from scratch. We explore alternative approaches that significantly improve the cost of evaluating refined queries by exploiting the observation that the refined queries are not modified drastically from one iteration to another. Our experiments over a real-life multimedia data set show that the proposed techniques save more than 80 percent of the execution cost of refined queries over the naive approach and is more than an order of magnitude faster than a simple sequential scan. Kaushik Chakrabarti, Michael Ortega-Binderberger, Sharad Mehrotra, Kriengkrai Porkaew |
IEEE Trans. Knowl. Data Eng. | 1 |
| 2002 | An Approach to Integrating Query Refinement in SQL
Michael Ortega-Binderberger, Kaushik Chakrabarti, Sharad Mehrotra |
EDBT | 2 |
| 2002 | Locally adaptive dimensionality reduction for indexing large time series databasesabstractSimilarity search in large time series databases has attracted much research interest recently. It is a difficult problem because of the typically high dimensionality of the data. The most promising solutions involve performing dimensionality reduction on the data, then indexing the reduced data with a multidimensional index structure. Many dimensionality reduction techniques have been proposed, including Singular Value Decomposition (SVD), the Discrete Fourier transform (DFT), and the Discrete Wavelet Transform (DWT). In this article, we introduce a new dimensionality reduction technique, which we call Adaptive Piecewise Constant Approximation (APCA). While previous techniques (e.g., SVD, DFT and DWT) choose a common representation for all the items in the database that minimizes the global reconstruction error, APCA approximates each time series by a set of constant value segments of varying lengths such that their individual reconstruction errors are minimal. We show how APCA can be indexed using a multidimensional index structure. We propose two distance measures in the indexed space that exploit the high fidelity of APCA for fast searching: a lower bounding Euclidean distance approximation, and a non-lower-bounding, but very tight, Euclidean distance approximation, and show how they can support fast exact searching and even faster approximate searching on the same index structure. We theoretically and empirically compare APCA to all the other techniques and demonstrate its superiority. Kaushik Chakrabarti, Eamonn J. Keogh, Sharad Mehrotra, Michael J. Pazzani |
ACM Trans. Database Syst. | 1 |
| 2001 | Locally Adaptive Dimensionality Reduction for Indexing Large Time Series DatabasesabstractSimilarity search in large time series databases has attracted much research interest recently. It is a difficult problem because of the typically high dimensionality of the data.. The most promising solutions involve performing dimensionality reduction on the data, then indexing the reduced data with a multidimensional index structure. Many dimensionality reduction techniques have been proposed, including Singular Value Decomposition (SVD), the Discrete Fourier transform (DFT), and the Discrete Wavelet Transform (DWT). In this work we introduce a new dimensionality reduction technique which we call Adaptive Piecewise Constant Approximation (APCA). While previous techniques (e.g., SVD, DFT and DWT) choose a common representation for all the items in the database that minimizes the global reconstruction error, APCA approximates each time series by a set of constant value segments of varying lengths such that their individual reconstruction errors are minimal. We show how APCA can be indexed using a multidimensional index structure. We propose two distance measures in the indexed space that exploit the high fidelity of APCA for fast searching: a lower bounding Euclidean distance approximation, and a non-lower bounding, but very tight Euclidean distance approximation and show how they can support fast exact searching, and even faster approximate searching on the same index structure. We theoretically and empirically compare APCA to all the other techniques and demonstrate its superiority. Eamonn J. Keogh, Kaushik Chakrabarti, Sharad Mehrotra, Michael J. Pazzani |
SIGMOD Conference | 2 |
| 2001 | Dimensionality Reduction for Fast Similarity Search in Large Time Series Databases
Eamonn J. Keogh, Kaushik Chakrabarti, Michael J. Pazzani, Sharad Mehrotra |
Knowl. Inf. Syst. | 2 |
| 2001 | Approximate query processing using wavelets
Kaushik Chakrabarti, Minos N. Garofalakis, Rajeev Rastogi, Kyuseok Shim |
VLDB J. | 1 |
| 2000 | Efficient Query Refinement in Multimedia DatabasesabstractIncreasing application demands are pushing database management systems (DBMSs) towards providing adequate and efficient support for content-based retrieval over multimedia objects (e.g., images, video, audio, time-series, spatial and spatio-temporal data). Recently, several powerful models for multimedia similarity retrieval have been proposed. An important aspect of these models is the notion of query refinement: a technique that allows the users to interactively specify their information need to the system by providing relevance ranking on example objects. Query refinement has several motivations. First, the `starting' query may only partially capture the user's information need. The user may find better examples among the answers returned to the starting query which then become the basis of the `refined' query. Second, multimedia objects are represented as a collection of features. The relative importance of these features in computing the similarity between objects (inter-feature w... Kaushik Chakrabarti, Kriengkrai Porkaew, Sharad Mehrotra |
ICDE | 1 |
| 2000 | Approximate Query Processing Using Wavelets
Kaushik Chakrabarti, Minos N. Garofalakis, Rajeev Rastogi, Kyuseok Shim |
VLDB | 1 |
| 2000 | Local Dimensionality Reduction: A New Approach to Indexing High Dimensional Spaces
Kaushik Chakrabarti, Sharad Mehrotra |
VLDB | 1 |
| 1999 | The Hybrid Tree: An Index Structure for High Dimensional Feature SpacesabstractFeature-based similarity searching is emerging as an important search paradigm in database systems. The technique used is to map the data items as points into a high-dimensional feature space which is indexed using a multidimensional data structure. Similarity searching then corresponds to a range search over the data structure. Although several data structures have been proposed for feature indexing, none of them is known to scale beyond 10-15 dimensional spaces. This paper introduces the hybrid tree-a multidimensional data structure for indexing high-dimensional feature spaces. Unlike other multidimensional data structures, the hybrid tree cannot be classified as either a pure data partitioning (DP) index structure (such as the R-tree, SS-tree or SR-tree) or a pure space partitioning (SP) one (such as the KDB-tree or hB-tree); rather it combines the positive aspects of the two types of index structures into a single data structure to achieve a search performance which is more scalable to high dimensionalities than either of the above techniques. Furthermore, unlike many data structures (e.g. distance-based index structures like the SS-tree and SR-tree), the hybrid tree can support queries based on arbitrary distance functions. Our experiments on "real" high-dimensional large-size feature databases demonstrate that the hybrid tree scales well to high dimensionality and large database sizes. It significantly outperforms both purely DP-based and SP-based index mechanisms as well as linear scans at all dimensionalities for large-sized databases. Kaushik Chakrabarti, Sharad Mehrotra |
ICDE | 1 |
| 1999 | Query refinement for multimedia similarity retrieval in MARSabstractAdvances in image processing, database management, and information retrieval has resulted in content-based multimedia retrieval to emerge as an important area of research. Typical content-based retrieval systems allow users to specify queries by providing examples of objects similar to the ones they wish to retrieve. Due to the sub-jective nature of retrieval, it is unlikely that the answers to the ‘starting query ’ will satisfy the user’s information need. Rather, among answers retrieved, the user may find one or more objects that are closer to what she has in mind compared to the original examples. In the Multimedia Analysis and Retrieval System (MARS), we have explored query refinement techniques to modify the query based on the relevance feedback of the user on the retrieved objects. Query refinement Kriengkrai Porkaew, Kaushik Chakrabarti |
ACM Multimedia (1) | 2 |
| 1999 | Efficient Concurrency Control in Multidimensional Access MethodsabstractThe importance of multidimensional index structures to numerous emerging database applications is well established. However, before these index structures can be supported as access methods (AMs) in a “commercial-strength” database management system (DBMS), efficient techniques to provide transactional access to data via the index structure must be developed. Concurrent accesses to data via index structures introduce the problem of protecting ranges specified in the retrieval from phantom insertions and deletions (the phantom problem). This paper presents a dynamic granular locking approach to phantom protection in Generalized Search Trees(GiSTs), an index structure supporting an extensible set of queries and data types. The granular locking technique offers a high degree of concurrency and has a low lock overhead. Our experiments show that the granular locking technique (1) scales well under various system loads and (2) similar to the B-tree case, provides a significantly more efficient implementation compared to predicate locking for multidimensional AMs as well. Since a wide variety of multidimensional index structures can be implemented using GiST, the developed algorithms provide a general solution to concurrency control in multidimensional AMs. To the best of our knowledge, this paper provides the first such solution based on granular locking. Kaushik Chakrabarti, Sharad Mehrotra |
SIGMOD Conference | 1 |
| 1998 | Dynamic Granular Locking Approach to Phantom Protection in R-TreesabstractOver the last decade (1988-98), the R tree has emerged as one of the most robust multidimensional access methods. However, before the R tree can be integrated as an access method to a commercial strength database management system, efficient techniques to provide transactional access to data via R trees need to be developed. Concurrent access to data through a multidimensional data structure introduces the problem of protecting ranges specified in the retrieval from phantom insertions and deletions (the phantom problem). Existing approaches to phantom protection in B trees (namely, key range locking) cannot be applied to multidimensional data structures since they rely on a total order over the key space on which the B tree is designed. The paper presents a dynamic granular locking approach to phantom protection in R trees. To the best of our knowledge, the paper provides the first solution to the phantom problem in multidimensional access methods based on granular locking. Kaushik Chakrabarti, Sharad Mehrotra |
ICDE | 1 |
| 1998 | Supporting Ranked Boolean Similarity Queries in MARSabstractTo address the emerging needs of applications that require access to and retrieval of multimedia objects, we are developing the Multimedia Analysis and Retrieval System (MARS). In this paper, we concentrate on the retrieval subsystem of MARS and its support for content-based queries over image databases. Content-based retrieval techniques have been extensively studied for textual documents in the area of automatic information retrieval. This paper describes how these techniques can be adapted for ranked retrieval over image databases. Specifically, we discuss the ranking and retrieval algorithms developed in MARS based on the Boolean retrieval model and describe the results of our experiments that demonstrate the effectiveness of the developed model for image retrieval. Michael Ortega-Binderberger, Yong Rui, Kaushik Chakrabarti, Kriengkrai Porkaew, Sharad Mehrotra, Thomas S. Huang |
IEEE Trans. Knowl. Data Eng. | 3 |
| 1997 | Supporting Similarity Queries in MARSabstractTo address the emerging needs of applications that require access to and retrieval of multimedia objects, we are developing the Multimedia Analysis and Retrieval System (MARS) in our group at the University of Illinois [13].In this paper, we concentrate on the retrieval subsystem of MARS and its support for content-based queries over image databases.Content-based retrieval techniques have been extensively studied for textual documents in the area of automatic information retrieval [24, 21.This paper describes how these techniques can be adapted for ranked retried over image databases.Specifically, we discuss the ranking and retrieval algorithms developed in MARS based on the Boolean re-trievaI model and describe the results of our experiments that demonstrate the effectiveness of the developed model for image retrieval. Michael Ortega-Binderberger, Yong Rui, Kaushik Chakrabarti, Sharad Mehrotra, Thomas S. Huang |
ACM Multimedia | 3 |