Kam-Fai Wong

dblp:w/KamFaiWong · DBLP profile ↗
← Back
57ranked-venue papers in the field
5as first author
9since 2021 · last 2026
0000-0002-9427-5659ORCID · verified

Domains — venue-derived; a paper can count in several

Information Retrieval & Web Search · 31 (1 first)Database Systems & Data Management · 18 (1 first)Data Mining & Knowledge Discovery · 3Other / Interdisciplinary · 3 (2 first)Knowledge Engineering, Semantic Web & Information Systems · 2 (1 first)
YearPublicationVenuePosition
2026 Dynamic Soft Contrastive Learning for Spatio-Temporal Forecasting
Hanzhi Deng, Heyuan Wang 0001, Tengjiao Wang 0003, Kam-Fai Wong
DASFAA (4)5
2026 Enhancing Event Causality Extraction With Mention-Level Causal Evidence and Global Causal Graph Reasoning
abstract
Event Causality Extraction (ECE) aims to extract causal event pairs from text. Existing methods overlook the interplay between causal event pairs and their corresponding textual evidence (e.g., causal event mention pairs), and fail to effectively leverage global causal dependency information. To address these issues, we propose a Mention-Level Causal Evidence and Global Causal Graph Reasoning (MLCE-GCGR) framework to enhance ECE. First, we introduce an auxiliary Event Mention Causality Extraction (EMCE) task, which extracts causal event mention pairs, to provide evidence for the main ECE task, and design a Dual-Level Interaction Enhancement (DLIE) strategy to enhance the bidirectional interplay between event-level and mention-level causality. Second, we develop a Global Causal Graph Reasoning (GCGR) module that simulates human-like multi-turn reasoning, aiming to progressively refine the causal graph by capturing global dependencies among event mentions, types, and arguments. Experiments on four benchmark datasets show that our method outperforms state-of-the-art approaches. Moreover, by extracting causal event mention pairs as supporting evidence, our approach improves the interpretability of structured causality extraction.
Ruili Pu, Yang Li 0074, Jun Zhao 0001, Suge Wang, Xiaoli Li 0001, Deyu Li 0001, Jian Liao 0005, Jianxing Zheng, Bin Liang 0004, Kam-Fai Wong
IEEE Trans. Knowl. Data Eng.10
2024 Empowering Large Language Models: Tool Learning for Real-World Interaction
abstract
Since the advent of large language models (LLMs), the field of tool learning has remained very active in solving various tasks in practice, including but not limited to information retrieval. This half-day tutorial provides basic concepts of this field and an overview of recent advancements with several applications. In specific, we start with some foundational components and architecture of tool learning (i.e., cognitive tool and physical tool), and then we categorize existing studies in this field into tool-augmented learning and tool-oriented learning, and introduce various learning methods to empower LLMs this kind of capability. Furthermore, we provide several cases about when, what, and how to use tools in different applications. We end with some open challenges and several potential research directions for future studies. We believe this tutorial is suited for both researchers at different stages (introductory, intermediate, and advanced) and industry practitioners who are interested in LLMs and tool learning.
Hongru Wang 0003, Yujia Qin, Yankai Lin 0001, Jeff Z. Pan, Kam-Fai Wong
SIGIR5
2024 Improving Conversational Recommender System Via Contextual and Time-Aware Modeling With Less Domain-Specific Knowledge
abstract
Conversational Recommender Systems (CRS) has become an emerging research topic seeking to perform recommendations through interactive conversations, which generally consist of generation and recommendation modules. Prior work on CRS tends to incorporate more external and domain-specific knowledge like item reviews to enhance performance. Despite the fact that the collection and annotation of theexternal domain-specificinformation needs much human effort and degenerates the generalizability, too much extra knowledge introduces more difficulty to balance among them. Therefore, we propose to fully discover and extract theinternalknowledge from the context. We capture both entity-level and contextual-level representations to jointly model user preferences for the recommendation, where a time-aware attention is designed to emphasize the recently appeared items in entity-level representations. We further use the pre-trained BART to initialize the generation module to alleviate the data scarcity and enhance the context modeling. In addition to conducting experiments on a popular dataset (ReDial), we also include a multi-domain dataset (OpenDialKG) to show the effectiveness of our model. Experiments on both datasets show that our model achieves better performance on most evaluation metrics with less external knowledge and generalizes well to other domains. Additional analyses on the recommendation and generation tasks demonstrate the effectiveness of our model in different scenarios.
Lingzhi Wang 0001, Shafiq R. Joty, Wei Gao 0001, Xingshan Zeng, Kam-Fai Wong
IEEE Trans. Knowl. Data Eng.5
2024 Acquiring New Knowledge Without Losing Old Ones for Effective Continual Dialogue Policy Learning
abstract
Dialogue policy learning is the core decision-making module of a task-oriented dialogue system. Its primary objective is to assist users to achieve their goals effectively in as few turns as possible. A practical dialogue-policy agent must be able to expand its knowledge to handle new scenarios efficiently without affecting its performance. Nevertheless, when adapting to new tasks, existing dialogue-policy agents often fail to retain their existing (old) knowledge. To overcome this predicament, we propose a novel continual dialogue-policy model which tackles the issues of “not forgetting the old” and “acquiring the new” from three different aspects: (1) For effective old-task preservation, we introduce the forgetting preventor which uses a behavior cloning technique to force the agent to take actions consistent with the replayed experience to retain the policy trained on historic tasks. (2) For new-task acquisition, we introduce the adaption accelerator which employs an invariant risk minimization mechanism to produce a stable policy predictor to avoid spurious corrections in training data. (3) For reducing the storage cost of the replayed experience, we introduce a replay manager which helps regularly clean up the old data. The effectiveness of the proposed model is evaluated both theoretically and experimentally and demonstrated favorable results.
Yunyan Zhang, Yifan Yang 0008, Yefeng Zheng 0001, Kam-Fai Wong
IEEE Trans. Knowl. Data Eng.5
2023 Improving Rumor Detection by Promoting Information Campaigns With Transformer-Based Generative Adversarial Learning
abstract
Rumors can cause devastating consequences to individuals and our society. Analysis shows that the widespread of rumors typically results from deliberate promotion of information with unknown veracity aiming to shape the collective public opinions on the concerned news event. In this paper, we attempt to combat such chaotic phenomenon with a countermeasure by mirroring against how such chaos is created in order to make automatic rumor detection more robust and effective. Our idea is inspired by adversarial learning method originated from Generative Adversarial Networks (GAN). We propose a GAN-style approach, where a generator is designed to produce uncertain or conflicting voices, further polarizing the original conversation threads with the intention of pressurizing the discriminator to learn stronger rumor indicative features from the augmented, more challenging examples. We reveal that feature learning effectiveness is highly relevant to the quality of generated parody, viz., how hard it is to get distinguished from real posts. Given the strong natural language generation performance of transformer, we propose a transformer-based method to improve the generated posts, so that they appear to be closely responsive to the source post and retain the authentic propagation structure and context of information. Different from traditional data-driven approach to rumor detection, our method can capture low-frequency but more salient non-trivial discriminant patterns via adversarial training. Extensive experiments on THREE benchmark datasets demonstrate that our rumor detection methods and the transformer-based model achieve much better results than state-of-the-art methods.
Jing Ma 0004, Jun Li 0112, Wei Gao 0001, Yang Yang 0002, Kam-Fai Wong
IEEE Trans. Knowl. Data Eng.5
2023 Quotation Recommendation for Multi-party Online Conversations Based on Semantic and Topic Fusion
abstract
Quotations are crucial for successful explanations and persuasions in interpersonal communications. However, finding what to quote in a conversation is challenging for humans. This work studies automatic quotation recommendation for online conversations. Unlike the previous works that only consider semantic-level modeling, we adopt topic-level representation to facilitate the recommendation. A hierarchical architecture that is based on a pretrained language model is adopted to model the semantic-level conversation representation, and a neural topic model is employed to learn the topic-level representation. Moreover, the semantic-level conversation modeling is enhanced by a topic-aware attention mechanism, which is adopted to capture the interactive conversation structure from the perspective of word co-occurrence. The joint training of semantic- and topic-based recommendation leads to significantly better performance than the state-of-the-art models on two large-scale datasets. Apart from the novel and advanced recommendation framework, we conduct extensive quantitative experiments to investigate the difficulty of the quotation recommendation task, validate the topic-based recommendation assumption, and explore the stability of the recommendation. Some qualitative experiments and analyses are also included to interpret the quotation and topic distribution for some instances. All the extensive experiments and analyses provide persuasive explanations and interpretations of the module design and the recommendation results.
Lingzhi Wang 0001, Xingshan Zeng, Kam-Fai Wong
ACM Trans. Inf. Syst.3
2022 Successful New-entry Prediction for Multi-Party Online Conversations via Latent Topics and Discourse Modeling
abstract
With the increasing popularity of social media, online interpersonal communication now plays an essential role in people’s everyday information exchange. Whether and how a newcomer can better engage in the community has attracted great interest due to its application in many scenarios. Although some prior works that explore early socialization have obtained salient achievements, they are focusing on sociological surveys based on the small group. To help individuals get through the early socialization period and engage well in online conversations, we study a novel task to foresee whether a newcomer’s message will be responded to by other participants in a multi-party conversation (henceforth Successful New-entry Prediction)1. The task would be an important part of the research in online assistants and social media. To further investigate the key factors indicating such engagement success, we employ an unsupervised neural network, Variational Auto-Encoder (VAE), to examine the topic content and discourse behavior from newcomer’s chatting history and conversation’s ongoing context. Furthermore, two large-scale datasets, from Reddit and Twitter, are collected to support further research on new-entries. Extensive experiments on both Twitter and Reddit datasets show that our model significantly outperforms all the baselines and popular neural models. Additional explainable and visual analyses on new-entry behavior shed light on how to better join in others’ discussions.
Lingzhi Wang 0001, Jing Li 0049, Xingshan Zeng, Kam-Fai Wong
WWW4
2022 Modeling Global and Local Interactions for Online Conversation Recommendation
abstract
The popularity of social media platforms results in a huge volume of online conversations produced every day. To help users better engage in online conversations, this article presents a novel framework to automatically recommend conversations to users based on what they said and how they behaved in their chatting histories. While prior work mostly focuses on post-level recommendation, we aim to explore conversation context and model the interaction patterns therein. Furthermore, to characterize personal interests from interleaving user interactions, we learn (1) global interactions , represented by topic and discourse word clusters to reflect users’ content and pragmatic preferences, and (2) local interactions , encoding replying relations and chronological order of conversation turns to characterize users’ prior behavior. Built on collaborative filtering, our model captures global interactions via discovering word distributions to represent users’ topical interests and discourse behaviors, while local interactions are explored with graph-structured networks exploiting both reply structure and temporal features. Extensive experiments on three datasets from Twitter and Reddit show that our model coupling global and local interactions significantly outperforms the state-of-the-art model. Further analyses show that our model is able to capture meaningful features from global and local interactions, which results in its superior performance in conversation recommendation.
Xingshan Zeng, Jing Li 0049, Lingzhi Wang 0001, Kam-Fai Wong
ACM Trans. Inf. Syst.4
2020 An Attention-based Rumor Detection Model with Tree-structured Recursive Neural Networks
abstract
Rumor spread in social media severely jeopardizes the credibility of online content. Thus, automatic debunking of rumors is of great importance to keep social media a healthy environment. While facing a dubious claim, people often dispute its truthfulness sporadically in their posts containing various cues, which can form useful evidence with long-distance dependencies. In this work, we propose to learn discriminative features from microblog posts by following their non-sequential propagation structure and generate more powerful representations for identifying rumors. For modeling non-sequential structure, we first represent the diffusion of microblog posts with propagation trees, which provide valuable clues on how a claim in the original post is transmitted and developed over time. We then present a bottom-up and a top-down tree-structured models based on Recursive Neural Networks (RvNN) for rumor representation learning and classification, which naturally conform to the message propagation process in microblogs. To enhance the rumor representation learning, we reveal that effective rumor detection is highly related to finding evidential posts, e.g., the posts expressing specific attitude towards the veracity of a claim, as an extension of the previous RvNN-based detection models that treat every post equally. For this reason, we design discriminative attention mechanisms for the RvNN-based models to selectively attend on the subset of evidential posts during the bottom-up/top-down recursive composition. Experimental results on four datasets collected from real-world microblog platforms confirm that (1) our RvNN-based models achieve much better rumor detection and classification performance than state-of-the-art approaches; (2) the attention mechanisms for focusing on evidential posts can further improve the performance of our RvNN-based method; and (3) our approach possesses superior capacity on detecting rumors at a very early stage.
Jing Ma 0004, Wei Gao 0001, Shafiq R. Joty, Kam-Fai Wong
ACM Trans. Intell. Syst. Technol.4
2019 An Environment-Aware Market Strategy for Data Allocation and Dynamic Migration in Cloud Database
abstract
Currently, a cloud database is employed to serve on-line query-intensive applications. It inevitably happens that some cloud data nodes storing hot records are facing high frequent query requests while others are rarely visited or even idle. Therefore, how data are dynamically allocated and migrated at runtime has significant impact on query load distribution and system performance. Existing system adopt centralized approaches, and they face two main challenges: (1) Query load on individual node cannot be always balancing even if the data are fairly distributed; (2) For each node, the dynamic changes of configuration resources cannot be captured during the runtime. To this end, this paper presents an environment-aware market strategy based system, named e-MARS, for reasonable data migration to achieve query load balance in cloud database. In e-MARS, cloud database is modeled as a cloudDB market, while data nodes are regarded as intelligent traders and the query load as commodity. Each trader is aware of its local environmental re-sources, such as computing capacity, disk volume, based on which the trader itself decides how to trade the query load and migrates the corresponding data. In this way the cloudDB market will achieve equilibrium. Experiments are conducted on the real communication data, and e-MARS significantly enhances the efficiency. Compared with HBase Balancer, more than 65% improvement is achieved in terms of query response time.
Tengjiao Wang 0003, Binyang Li, Wei Chen 0021, Jinzhong Niu, Kam-Fai Wong
ICDE7
2019 Detect Rumors on Twitter by Promoting Information Campaigns with Generative Adversarial Learning
abstract
Rumors can cause devastating consequences to individual and/or society. Analysis shows that widespread of rumors typically results from deliberately promoted information campaigns which aim to shape collective opinions on the concerned news events. In this paper, we attempt to fight such chaos with itself to make automatic rumor detection more robust and effective. Our idea is inspired by adversarial learning method originated from Generative Adversarial Networks (GAN). We propose a GAN-style approach, where a generator is designed to produce uncertain or conflicting voices, complicating the original conversational threads in order to pressurize the discriminator to learn stronger rumor indicative representations from the augmented, more challenging examples. Different from traditional data-driven approach to rumor detection, our method can capture low-frequency but stronger non-trivial patterns via such adversarial training. Extensive experiments on two Twitter benchmark datasets demonstrate that our rumor detection method achieves much better results than state-of-the-art methods.
Jing Ma 0004, Wei Gao 0001, Kam-Fai Wong
WWW3
2018 Convolution-based Memory Network for Aspect-based Sentiment Analysis
abstract
Memory networks have shown expressive performance on aspect based sentiment analysis. However, ordinary memory networks only capture word-level information and lack the capacity for modeling complicated expressions which consist of multiple words. Targeting this problem, we propose a novel convolutional memory network which incorporates an attention mechanism. This model sequentially computes the weights of multiple memory units corresponding to multi-words. This model may capture both words and multi-words expressions in sentences for aspect-based sentiment analysis. Experimental results show that the proposed model outperforms the state-of-the-art baselines.
Chuang Fan, Qinghong Gao, Jiachen Du, Lin Gui 0003, Ruifeng Xu 0001, Kam-Fai Wong
SIGIR6
2015 Detect Rumors Using Time Series of Social Context Information on Microblogging Websites
abstract
Automatically identifying rumors from online social media especially microblogging websites is an important research issue. Most of existing work for rumor detection focuses on modeling features related to microblog contents, users and propagation patterns, but ignore the importance of the variation of these social context features during the message propagation over time. In this study, we propose a novel approach to capture the temporal characteristics of these features based on the time series of rumor's lifecycle, for which time series modeling technique is applied to incorporate various social context information. Our experiments using the events in two microblog datasets confirm that the method outperforms state-of-the-art rumor detection approaches by large margins. Moreover, our model demonstrates strong performance on detecting rumors at early stage after their initial broadcast.
Jing Ma 0004, Wei Gao 0001, Zhongyu Wei, Yueming Lu, Kam-Fai Wong
CIKM5
2015 The Role of Physical Location in Our Online Social Networks
Jia Zhu 0003, Gabriel Pui Cheong Fung, Kam-Fai Wong, Binyang Li, Zhixu Li, Haoye Dong
WAIM3
2014 CLUSM: An Unsupervised Model for Microblog Sentiment Analysis Incorporating Link Information
Gaoyan Ou, Wei Chen 0021, Binyang Li, Tengjiao Wang 0003, Dongqing Yang, Kam-Fai Wong
DASFAA (1)6
2013 A link-bridged topic model for cross-domain document classification
Pei Yang 0001, Wei Gao 0001, Qi Tan 0001, Kam-Fai Wong
Inf. Process. Manag.4
2013 Dynamic joint sentiment-topic model
abstract
Social media data are produced continuously by a large and uncontrolled number of users. The dynamic nature of such data requires the sentiment and topic analysis model to be also dynamically updated, capturing the most recent language use of sentiments and topics in text. We propose a dynamic Joint Sentiment-Topic model (dJST) which allows the detection and tracking of views of current and recurrent interests and shifts in topic and sentiment. Both topic and sentiment dynamics are captured by assuming that the current sentiment-topic-specific word distributions are generated according to the word distributions at previous epochs. We study three different ways of accounting for such dependency information: (1) sliding window where the current sentiment-topic word distributions are dependent on the previous sentiment-topic-specific word distributions in the last S epochs; (2) skip model where history sentiment topic word distributions are considered by skipping some epochs in between; and (3) multiscale model where previous long- and short- timescale distributions are taken into consideration. We derive efficient online inference procedures to sequentially update the model with newly arrived data and show the effectiveness of our proposed model on the Mozilla add-on reviews crawled between 2007 and 2011.
Yulan He 0001, Chenghua Lin 0002, Wei Gao 0001, Kam-Fai Wong
ACM Trans. Intell. Syst. Technol.4
2012 Tracking Sentiment and Topic Dynamics from Social Media
Yulan He 0001, Chenghua Lin 0002, Wei Gao 0001, Kam-Fai Wong
ICWSM4
2012 A split-list approach for relevance feedback in information retrieval
Ho Chung Wu, Robert Wing Pong Luk, Kam-Fai Wong, Jian-Yun Nie
Inf. Process. Manag.3
2011 Leveraging web 2.0 data for scalable semi-supervised learning of domain-specific sentiment lexicons
abstract
Since manually constructing domain-specific sentiment lexicons is extremely time consuming and it may not even be feasible for domains where linguistic expertise is not available, research on automatic construction of domain-specific sentiment lexicons has become a hot topic in recent years. The main contribution of this paper is the illustration of a novel semi-supervised learning method which exploits both term-to-term and document-to-term relations hidden in a corpus for the construction of domain-specific sentiment lexicons. More specifically, the proposed two-pass pseudo labeling method combines shallow linguistic parsing and corpus-base statistical learning to make domain-specific sentiment extraction scalable with respect to the sheer volume of opinionated documents archived on the Internet these days. Our experiments show that the proposed method can generate high quality domain-specific sentiment lexicons according to users' evaluation.
Raymond Y. K. Lau, Chun Lam Lai, Peter Bruza, Kam-Fai Wong
CIKM4
2011 Weight-Based Boosting Model for Cross-Domain Relevance Ranking Adaptation
Peng Cai 0001, Wei Gao 0001, Kam-Fai Wong, Aoying Zhou
ECIR3
2011 Relevant knowledge helps in choosing right teacher: active query selection for ranking adaptation
abstract
Learning to adapt in a new setting is a common challenge to our knowledge and capability. New life would be easier if we actively pursued supervision from the right mentor chosen with our relevant but limited prior knowledge. This variant principle of active learning seems intuitively useful to many domain adaptation problems. In this paper, we substantiate its power for advancing automatic ranking adaptation, which is important in web search since it's prohibitive to gather enough labeled data for every search domain for fully training domain-specific rankers. For the cost-effectiveness, it is expected that only those most informative instances in target domain are collected to annotate while we can still utilize the abundant ranking knowledge in source domain. We propose a unified ranking framework to mutually reinforce the active selection of informative target-domain queries and the appropriate weighting of source training data as related prior knowledge. We select to annotate those target queries whose documents' order most disagrees among the members of a committee built on the mixture of source training data and the already selected target data. Then the replenished labeled set is used to adjust the importance of source queries for enhancing their rank transfer. This procedure iterates until labeling budget exhausts. Based on LETOR3.0 and Yahoo! Learning to Rank Challenge data sets, our approach significantly outperforms the random query annotation commonly used in ranking adaptation and the active rank learner on target-domain data only.
Peng Cai 0001, Wei Gao 0001, Aoying Zhou, Kam-Fai Wong
SIGIR4
2011 Learning features through feedback for blog distillation
abstract
The paper is focused on blogosphere research based on the TREC blog distillation task, and aims to explore unbiased and significant features automatically and efficiently. Feedback from faceted feeds is introduced to harvest relevant features and information gain is used to select discriminative features. The evaluation result shows that the selected feedback features can greatly improve the performance and adapt well to the terabyte data.
Dehong Gao, Renxian Zhang, Wenjie Li 0002, Raymond Y. K. Lau, Kam-Fai Wong
SIGIR5
2011 Extracting common emotions from blogs based on fine-grained sentiment clustering
Shi Feng 0001, Daling Wang, Ge Yu 0001, Wei Gao 0001, Kam-Fai Wong
Knowl. Inf. Syst.5
2010 Summarizing and Extracting Online Public Opinion from Blog Search Results
Shi Feng 0001, Daling Wang, Ge Yu 0001, Binyang Li, Kam-Fai Wong
DASFAA (1)5
2010 Learning to rank only using training data from related domain
abstract
Like traditional supervised and semi-supervised algorithms, learning to rank for information retrieval requires document annotations provided by domain experts. It is costly to annotate training data for different search domains and tasks. We propose to exploit training data annotated for a related domain to learn to rank retrieved documents in the target domain, in which no labeled data is available. We present a simple yet effective approach based on instance-weighting scheme. Our method first estimates the importance of each related-domain document relative to the target domain. Then heuristics are studied to transform the importance of individual documents to the pairwise weights of document pairs, which can be directly incorporated into the popular ranking algorithms. Due to importance weighting, ranking model trained on related domain is highly adaptable to the data of target domain. Ranking adaptation experiments on LETOR3.0 dataset [27] demonstrate that with a fair amount of related-domain training data, our method significantly outperforms the baseline without weighting, and most of time is not significantly worse than an "ideal" model directly trained on target domain.
Wei Gao 0001, Peng Cai 0001, Kam-Fai Wong, Aoying Zhou
SIGIR3
2010 Exploiting query logs for cross-lingual query suggestions
abstract
Query suggestion aims to suggest relevant queries for a given query, which helps users better specify their information needs. Previous work on query suggestion has been limited to the same language. In this article, we extend it to cross-lingual query suggestion (CLQS): for a query in one language, we suggest similar or relevant queries in other languages. This is very important to the scenarios of cross-language information retrieval (CLIR) and other related cross-lingual applications. Instead of relying on existing query translation technologies for CLQS, we present an effective means to map the input query of one language to queries of the other language in the query log. Important monolingual and cross-lingual information such as word translation relations and word co-occurrence statistics, and so on, are used to estimate the cross-lingual query similarity with a discriminative model. Benchmarks show that the resulting CLQS system significantly outperforms a baseline system that uses dictionary-based query translation. Besides, we evaluate CLQS with French-English and Chinese-English CLIR tasks on TREC-6 and NTCIR-4 collections, respectively. The CLIR experiments using typical retrieval models demonstrate that the CLQS-based approach has significantly higher effectiveness than several traditional query translation methods. We find that when combined with pseudo-relevance feedback, the effectiveness of CLIR using CLQS is enhanced for different pairs of languages.
Wei Gao 0001, Cheng Niu, Jian-Yun Nie, Ming Zhou 0001, Kam-Fai Wong, Hsiao-Wuen Hon
ACM Trans. Inf. Syst.5
2009 Joint Ranking for Multilingual Web Search
Wei Gao 0001, Cheng Niu, Ming Zhou 0001, Kam-Fai Wong
ECIR4
2009 Building a framework for the probability ranking principle by a family of expected weighted rank
abstract
A new principles framework is presented for retrieval evaluation of ranked outputs. It applies decision theory to model relevance decision preferences and shows that the Probability Ranking Principle (PRP) specifies optimal ranking. It has two new components, namely a probabilistic evaluation model and a general measure of retrieval effectiveness. Its probabilities may be interpreted as subjective or objective ones. Its performance measure is the expected weighted rank which is the weighted average rank of a retrieval list. Starting from this measure, the expected forward rank and some existing retrieval effectiveness measures (e.g., top n precision and discounted cumulative gain) are instantiated using suitable weighting schemes after making certain assumptions. The significance of these instantiations is that the ranking prescribed by PRP is shown to be optimal simultaneously for all these existing performance measures. In addition, the optimal expected weighted rank may be used to normalize the expected weighted rank of retrieval systems for (summary) performance comparison (across different topics) between systems. The framework also extends PRP and our evaluation model to handle graded relevance, thereby generalizing the discussed, existing measures (e.g., top n precision) and probabilistic retrieval models for graded relevance.
Edward K. F. Dang, Ho Chung Wu, Robert Wing Pong Luk, Kam-Fai Wong
ACM Trans. Inf. Syst.4
2008 Multiple Materialized View Selection for XPath Query Rewriting
abstract
We study the problem of answering XPATH queries using multiple materialized views. Despite the efforts on answering queries using single materialized view, answering queries using multiple views remains relatively new. We address two important aspects of this problem: multiple-view selection and equivalent multiple-view rewriting. With regards to the first problem, we propose an NFA-based approach (called VFILTER) to filter views that cannot be used to answer a given query. We then present the criterion for multiple view/query answerability. Based on the output of VFILTER, we further propose a heuristic method to identify a minimal view set that can answer a given query. For the problem of multiple-view rewriting, we first refine the materialized fragments of each selected view (like pushing selection), we then join the refined fragments utilizing an encoding scheme. Finally, we extract the result of the query from the materialized fragments of a single view. Experiments show the efficiency of our approach.
Nan Tang 0001, Jeffrey Xu Yu, M. Tamer Özsu, Byron Choi, Kam-Fai Wong
ICDE5
2008 Hierarchical Indexing Approach to Support XPath Queries
abstract
We study new hierarchical indexing approach to process XPath queries. Here, a hierarchical index consists of index entries that are pairs of queries and their (full/partial) answers (called extents). With such an index, XPath queries can be processed to extract the results if they match the queries maintained in those index entries. Existing XML path indexing approaches support either child-axis (/) only, or additional descendant-or-self-axis (//) but only in the query root. Different from them, we propose a novel indexing approach to process a large fragment of XPath queries, which may use /, //, and wildcards (*). The key issues are how to reduce the number of index entries and how to maintain non-overlapping extents among index entries. We show how to compress such index and how to evaluate XPath queries on it. Experiments show the efficiency of our approaches.
Nan Tang 0001, Jeffrey Xu Yu, M. Tamer Özsu, Kam-Fai Wong
ICDE4
2008 Learning Knowledge from Relevant Webpage for Opinion Analysis
abstract
This paper presents an opinion analysis system based on linguistic knowledge which is acquired from small-scale annotated text and raw topic-relevant Web page. Based on the observation on the annotated opinion corpus, some word-, collocation- and sentence-level linguistic features for opinion analysis are discovered. Supervised and unsupervised learning techniques are developed to learn these features from annotated text and raw relevant Web page, respectively. These features are then incorporated into a classifier based on support vector machine (SVM) to identify opinionated sentences and determine their polarities. Evaluations show that the proposed opinion analysis system, namely OA, achieved promising performance, which shows the effectiveness of linguistic knowledge learning from relevant Web page.
Ruifeng Xu 0001, Kam-Fai Wong, Qin Lu 0001, Yunqing Xia, Wenjie Li 0002
Web Intelligence2
2008 Interpreting TF-IDF term weights as making relevance decisions
Ho Chung Wu, Robert Wing Pong Luk, Kam-Fai Wong, Kui-Lam Kwok
ACM Trans. Inf. Syst.3
2007 Cross-lingual query suggestion using query logs of different languages
abstract
Query suggestion aims to suggest relevant queries for a given query, which help users better specify their information needs. Previously, the suggested terms are mostly in the same language of the input query. In this paper, we extend it to cross-lingual query suggestion (CLQS): for a query in one language, we suggest similar or relevant queries in other languages. This is very important to scenarios of cross-language information retrieval (CLIR) and cross-lingual keyword bidding for search engine advertisement. Instead of relying on existing query translation technologies for CLQS, we present an effective means to map the input query of one language to queries of the other language in the query log. Important monolingual and cross-lingual information such as word translation relations and word co-occurrence statistics, etc. are used to estimate the cross-lingual query similarity with a discriminative model. Benchmarks show that the resulting CLQS system significantly out performs a baseline system based on dictionary-based query translation. Besides, the resulting CLQS is tested with French to English CLIR tasks on TREC collections. The results demonstrate higher effectiveness than the traditional query translation methods.
Wei Gao 0001, Cheng Niu, Jian-Yun Nie, Ming Zhou 0001, Kam-Fai Wong, Hsiao-Wuen Hon
SIGIR6
2007 Probability ranking principle via optimal expected rank
abstract
This paper presents a new perspective of the probability ranking principle (PRP) by defining retrieval effectiveness in terms of our novel expected rank measure of a set of documents for a particular query. This perspective is based on preserving decision preferences, and it imposes weaker conditions on PRP than the utility-theoretic perspective of PRP.
Ho Chung Wu, Robert Wing Pong Luk, Kam-Fai Wong
SIGIR3
2007 A retrospective study of a hybrid document-context based retrieval model
Ho Chung Wu, Robert Wing Pong Luk, Kam-Fai Wong, Kui-Lam Kwok
Inf. Process. Manag.3
2006 Probabilistic document-context based relevance feedback with limited relevance judgments
abstract
This paper presents our novel relevance feedback (RF) algorithm that uses the probabilistic document-context based retrieval model with limited relevance judgments for document re-ranking. Probabilities of the document-context based retrieval model are estimated from the top N (=20) documents in the initial retrieval. We use document-context based cosine similarity measure to find similar data for better probability estimation in order to reduce the data scarcity problem and the negative weighting problem. Our RF algorithm is promising because its mean average precision is statistically significantly better than the baseline using TREC-6 and TREC-7 data collections.
Ho Chung Wu, Robert Wing Pong Luk, Kam-Fai Wong, Kui-Lam Kwok
CIKM3
2006 Fast Structural Join with a Location Function
Nan Tang 0001, Jeffrey Xu Yu, Kam-Fai Wong
DASFAA3
2006 An Information Retrieval Approach Based on Discourse Type
D. Y. Wang, Robert Wing Pong Luk, Kam-Fai Wong, Kui-Lam Kwok
NLDB3
2005 Accelerating XML Structural Join by Partitioning
Nan Tang 0001, Jeffrey Xu Yu, Kam-Fai Wong, Kevin Lü 0001, Jianxin Li 0001
DEXA3
2005 A retrospective study of probabilistic context-based retrieval
abstract
We propose a novel probabilistic retrieval model which weights terms according to their contexts in documents. The term weighting function of our model is similar to the language model and the binary independence model. The retrospective experiments (i.e., relevance information is present) illustrate the potential of our probabilistic context-based retrieval where the precision at the top 30 documents is about 43% for TREC-6 data and 52% for TREC-7 data.
Ho Chung Wu, Robert Wing Pong Luk, Kam-Fai Wong, Kui-Lam Kwok, W. J. Li
SIGIR3
2003 Nstar: an interactive tool for local web search
Kam-Fai Wong
Inf. Manag.2
2001 Conceptual Graphs as Schemas for Semi-structured Databases
abstract
As the World Wide Web grows dramatically in recent years, there is increasing interest in semi-structured data on the web. Semi-structured data are usually represented in graph format, many graph schemas have then been proposed to extract schemas from those data graphs. Conceptual graphs, which use incremental conceptual clustering method to extract schemas, have initially been proposed in 2000. In this paper, we revise the original algorithm to generate a conceptual graph by proposing some new operators in the construction process. The results have shown that with the revised algorithm the quality of the conceptual graphs has been improved in terms of query optimization.
Yat Fan Su, Kam-Fai Wong
DASFAA2
2001 A New Conceptual Graph Generated Algorithm for Semi-structured Databases
Kam-Fai Wong, Yat Fan Su, Dongqing Yang, Shiwei Tang
Web Intelligence1
2001 Chinese document indexing based on a new partitioned signature file: Model and evaluation
abstract
Abstract In this article we investigate the use of signature files in Chinese information retrieval system and propose a new partitioning method for Chinese signature file based on the characteristic of Chinese words. Our partitioning method, called Partitioned Signature File for Chinese (PSFC), offers faster search efficiency than the traditional single signature file approach. We devise a general scheme for controlling the trade‐off between the false drop and storage overhead while maintaining the search space reduction in PSFC. An analytical study is presented to support the claims of our method. We also propose two new hashing methods for Chinese signature files so that the signature file will be more suitable for dynamic environment while the retrieval performance is maintained. Furthermore, we have implemented PSFC and the new hashing methods, and we evaluated them using a large‐scale real‐world Chinese document corpus, namely, the TREC‐5 (Text REtrieval Conference) Chinese collection. The experimental results confirm the features of PSFC and demonstrate its superiority over the traditional single signature file method.
Wai Lam, Kam-Fai Wong, Chi-Yin Wong
J. Assoc. Inf. Sci. Technol.2
2001 Toward automatic Chinese temporal information extraction
abstract
Abstract Over the past few years, temporal information processing and temporal database management have increasingly become hot topics. Nevertheless, only a few researchers have investigated these areas in the Chinese language. This lays down the objective of our research: to exploit Chinese language processing techniques for temporal information extraction and concept reasoning. In this article, we first study the mechanism for expressing time in Chinese. On the basis of the study, we then design a general frame structure for maintaining the extracted temporal concepts and propose a system for extracting time‐dependent information from Hong Kong financial news. In the system, temporal knowledge is represented by different types of temporal concepts (TTC) and different temporal relations, including absolute and relative relations, which are used to correlate between action times and reference times. In analyzing a sentence, the algorithm first determines the situation related to the verb. This in turn will identify the type of temporal concept associated with the verb. After that, the relevant temporal information is extracted and the temporal relations are derived. These relations link relevant concept frames together in chronological order, which in turn provide the knowledge to fulfill users' queries, e.g., for question‐answering (i.e., Q&A) applications.
Wenjie Li 0002, Kam-Fai Wong, Chunfa Yuan
J. Assoc. Inf. Sci. Technol.2
2001 Application of aboutness to functional benchmarking in information retrieval
abstract
Experimental approaches are widely employed to benchmark the performance of an information retrieval (IR) system. Measurements in terms of recall and precision are computed as performance indicators. Although they are good at assessing the retrieval effectiveness of an IR system, they fail to explore deeper aspects such as its underlying functionality and explain why the system shows such performance. Recently, inductive (i.e., theoretical) evaluation of IR systems has been proposed to circumvent the controversies of the experimental methods. Several studies have adopted the inductive approach, but they mostly focus on theoretical modeling of IR properties by using some metalogic. In this article, we propose to use inductive evaluation for functional benchmarking of IR models as a complement of the traditional experiment-based performance benchmarking. We define a functional benchmark suite in two stages: the evaluation criteria based on the notion of "aboutness," and the formal evaluation methodology using the criteria. The proposed benchmark has been successfully applied to evaluate various well-known classical and logic-based IR models. The functional benchmarking results allow us to compare and analyze the functionality of the different IR models.
Kam-Fai Wong, Dawei Song 0001, Peter Bruza, Chun Hung Cheng 0001
ACM Trans. Inf. Syst.1
2000 Approximate Graph Schema Extraction for Semi-Structured Data
Qiu Yue Wang, Jeffrey Xu Yu, Kam-Fai Wong
EDBT3
2000 SWAM - a structured WWW access model
Kam-Fai Wong, Chun Hung Cheng 0001, Jaideep Motwani
Inf. Manag.1
2000 Aboutness from a commonsense perspective
abstract
Information retrieval (IR) is driven by a process which decides whether a document is about a query. Recent attempts \nspawned from logic-based information retrieval theory have formalized properties characterizing “aboutness”, \nbut no consensus has yet been reached. The proposed properties are largely determined by the underlying \nframework within which aboutness is defined. In addition, some properties are only sound within the context of a \ngiven IR model, but are not sound from the perspective of the user. For example, a common form of aboutness, \nnamely overlapping aboutness, implies precision degrading properties such as compositional monotonicity. Therefore, \nthe motivating question for this paper is: Independent of any given IR model, and examined within an information- \nbased, abstract framework, what are commonsense properties of aboutness (and its dual, non-aboutness)? \nWe propose a set of properties characterizing aboutness and non-aboutness from a commonsense perspective. \nSpecial attention is paid to the rules prescribing conservative behaviour of aboutness with respect to information \ncomposition. The interaction between aboutness and non-aboutness is modeled via normative rules. The completeness, \nsoundness and consistency of the aboutness proof systems are analyzed and discussed. A case study based on \nmonotonicity shows that many current IR systems are either monotonic or non-monotonic. An interesting class of \nIR models, namely those that are conservatively monotonic, is identified.
Peter Bruza, Dawei Song 0001, Kam-Fai Wong
J. Am. Soc. Inf. Sci.3
1999 Fundamental Properties of Aboutness (poster abstract)
abstract
No abstract available.
Peter Bruza, Dawei Song 0001, Kam-Fai Wong
SIGIR3
1999 MODEC: A Multi-Granularity Mobile Object-Oriented Database Caching Mechanism, Prototype and Performance
Boris Y. L. Chan, Hong Va Leong, Antonio Si, Kam-Fai Wong
Distributed Parallel Databases4
1999 A Study on Word-Based and Integral-Bit Chinese Text Compression Algorithms
abstract
Experimental results show that a word-based arithmetic coding scheme can achieve a higher compression performance for Chinese text. However, an arithmetic coding scheme is a fractional-bit compression algorithm which is known to be time consuming. In this article, we change the direction to study how to cascade the word segmentation model with a faster alternative, the integral-bit compression algorithm. It is shown that the cascaded algorithm is more suitable for practical usage. Among several word-based integral-bit compression algorithms, WLZSSHUF achieves the best compression results. Not only can it achieve a comparable compression ratio with a PPM compressor, COMP-2, it demonstrates a faster compression and decompression speed. In the last part of this article, the relation between the accuracy of the word segmentation model (match ratio) and the performance of the compression algorithm (compression ratio) are analyzed. By varying the match ratio, it was discovered that the growth rate of the compression ratio is content-dependent and close to linear. The results of our study will help the practitioners of information retrieval to design word-based compression algorithms for Chinese. This is particularly useful to multilingual digital libraries in which a massive volume of data is often involved.
Kwok-Shing Cheng, Gilbert H. Young, Kam-Fai Wong
J. Am. Soc. Inf. Sci.3
1995 On the Issues of Expressiveness and Portability of Chiql
Gary C. K. Lam, Vincent Y. Lum, Kam-Fai Wong
DASFAA3
1991 A Superimposed Codeword Indexing Scheme for Handling Sets in Prolog Databases
Kam-Fai Wong, M. Howard Williams
DASFAA1
1989 Comments on "A Comparison of Concatenated and Superimposed Code Word Surrogate Files for Very Large Data/Knowledge Bases"
Kam-Fai Wong
Inf. Process. Lett.1