EDBT 2026 Demo / reviewers in the wild / expert
Kyumin Lee
dblp:22/8024 · also Kyu Min Lee
· DBLP profile ↗
48ranked-venue papers in the field
11as first author
12since 2021 · last 2025
—ORCID · conflict
Domains — venue-derived; a paper can count in several
Information Retrieval & Web Search · 27 (8 first)Data Mining & Knowledge Discovery · 11 (2 first)Big Data, Cloud & Distributed Data Systems · 10 (1 first)
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | LLM Profiling and Fine-Tuning with Limited Neighbor Information for Node Classification on Text-Attributed Graphs
Xinyi Fang, Kyumin Lee, Yichuan Li 0001 |
IEEE Big Data | 2 |
| 2024 | Context-Aware Diffusion-based Sequential RecommendationabstractSequential recommendation aims to recommend the next item that matches a user’s interest, based on the sequence of items he/she interacted with before. Although effective, existing work suffers from the following limitations: (1) Existing diffusion-based recommendation methods have undertaken tailored refinements to the diffusion process without considering the difference between recommendation and other tasks, leading to the ignorance of the user’s personalized preferences; (2) Self-supervised contrastive learning, widely used to mitigate the data sparsity issue in sequential recommendation, typically employs random augmentation to create multiple views of user sequences. However, random augmentation can disrupt the semantic integrity and interest patterns within the sequence, resulting in semantically divergent augmented views that may misrepresent user preferences. To address these challenges, we propose the Context-Aware Diffusion-based Sequential Recommendation (CADSR) model, which leverages context information to generate more semantically consistent positive samples during contrastive learning. This ensures that the model captures both user preferences and their evolution more accurately. Extensive experiments on four public benchmark datasets show that CADSR outperforms 11 state-of-the-art baselines, achieving an average improvement of 10.94% in Recall@10 and 10.54% in NDCG@10 over the best baseline. Source code is available at https://github.com/queenjocey/CADSR. Di You, Kyumin Lee |
IEEE Big Data | 2 |
| 2024 | ID and Graph View Contrastive Learning with Multi-View Attention Fusion for Sequential RecommendationabstractSequential recommendation has become an increasingly prominent subject both in academia and industrial sectors, particularly within the e-commerce domain. Its primary aim is to extract user preference from a user’s historical item list and predict the subsequent items that the user might purchase based on that history. Recent trends show a surge in the application of using contrastive learning and graph-based neural network to extract more expressive representation from user’s historical item list, where graph contains information of relationship between nodes while ID based representation contains more specific information. However, limited work has explored on multi-view contrastive learning, especially, between the ID and graph to further improve quality of user and item representation learning when only interaction data is available without auxiliary information. To fill the gap, in this study, we propose a novel framework called MultiView Contrastive learning for sequential recommendation (MVCrec). This framework is designed to combine information from both sequential/ID and graph views. It incorporates three facets of contrastive learning: one for sequential view, another one for graph view and the other one for cross-view. To leverage the representations derived from the contrastive learning, we propose a multi-view attention fusion module, which integrates both global and local attentions and measures how likely a target user will purchase a target item. Comprehensive experiments demonstrate the superiority of our model over 11 state-of-the-art baselines, as evidenced by its performance on five real-world benchmark datasets. Our model achieves improvements of up to 14.44% in NDCG@10 and up to 9.22% in HitRatio@10 compared to the best baseline. Our code and datasets are available at https://github.com/sword-Lz/MMCrec. Xiaofan Zhou, Kyumin Lee |
IEEE Big Data | 2 |
| 2024 | Alleviating Confounding Effects with Contrastive Learning in Recommendation
Di You, Kyumin Lee |
ECIR (2) | 2 |
| 2024 | Wildlife Product Trading in Online Social Networks: A Case Study on Ivory-Related Product Sales Promotion PostsabstractWildlife trafficking (WLT) has evolved into a pressing global concern, as traffickers increasingly utilize online platforms such as e-commerce websites and social networks to expand their illicit trade. This paper addresses the pivotal challenge of detecting and recognizing promotional behaviors related to the sale of wildlife products within online social networks—a critical step in combating these environmentally detrimental activities. To confront these illicit operations effectively, our research undertakes the following key initiatives: 1. Data Collection and Labeling: We employ a network-based approach to gather a scalable dataset pertaining to wildlife product trading. Through a human-in-the-loop machine learning process, this dataset is meticulously labeled, distinguishing between positive class samples containing wildlife product selling posts and hard-negatives representing regular posts misclassified as potential WLT posts, subsequently rectified by human annotators. 2. Machine Learning Framework Development: We present a robust framework that benchmarks machine learning results on the collected dataset. This framework autonomously identifies suspicious wildlife selling posts and accounts, effectively harnessing the multi-modal nature of online social networks. 3. In-depth Analysis of Trading Behaviors: Our research delves into a comprehensive analysis of trading posts, illuminating the systematic and organized selling behaviors prevalent in the current landscape. By providing detailed insights into the nature of these behaviors, we contribute valuable information for understanding and countering illegal wildlife product trading. Moreover, we emphasize our commitment to openness and collaboration by making our code and dataset openly available, thereby fostering cooperative efforts towards the development of more effective strategies in combating illegal wildlife trafficking. Guanyi Mou, Yun Yue, Kyumin Lee |
ICWSM | 3 |
| 2023 | What Boosts Fake News Dissemination on Social Media? A Causal Inference View
Yichuan Li 0001, Kyumin Lee, Nima Kordzadeh, Ruocheng Guo |
PAKDD (4) | 2 |
| 2022 | Extracting and Visualizing Wildlife Trafficking Events from Wildlife Trafficking ReportsabstractExperts combating wildlife trafficking manually sift through articles about seizures and arrests, which is time consuming and make identifying trends difficult. We apply natural language processing techniques to automatically extract data from reports published by the Eco Activists for Governance and Law Enforcement (EAGLE). We expanded Python spaCy's pre-trained pipeline and added a custom named entity ruler, which identified 15 fully correct and 36 partially correct events in 15 reports against an existing baseline, which did not identify any fully correct events. The extracted wildlife trafficking events were inserted to a database. Then, we created visualizations to display trends over time and across regions to support domain experts. These are accessible on our website, Wildlife Trafficking in Africa. Devin Coughlin, Maylee Gagnon, Victoria Grasso, Guanyi Mou, Kyumin Lee, Renata Konrad, Patricia Raxter, Meredith Gore |
ASONAM | 5 |
| 2022 | Energy-based Domain Adaption with Active Learning for Emerging Misinformation DetectionabstractClassifying whether collected information related to emerging topics and domains is fake/incorrect is not an easy task because we do not have enough labeled data in the domains. Given labeled data from source domains (e.g., gossip and health) and limited labeled data from a newly emerging target domain (e.g., COVID-19 and Ukraine war), simply applying knowledge learned from source domains to the target domain may not work well because of different data distribution. To solve the problem, in this paper, we propose an energy-based domain adaptation with active learning for early misinformation detection. Given three real world news datasets, we evaluate our proposed model against two baselines in both domain adaptation and the whole pipeline. Our model outperforms the baselines, improving at least 5% in the domain adaptation task and 10% in the whole pipeline, showing effectiveness of our proposed approach. Kyumin Lee, Guanyi Mou, Scott Sievert |
IEEE Big Data | 1 |
| 2022 | Multi-Behavior Recommendation with Hyperbolic GeometryabstractEven though users interacted diversely on items (e.g., click, add-to-cart, and buy), traditional recommendations were mostly built using only the user-item interaction data on the target behavior (e.g., buy), making them suffer from the severe data sparsity issue. To alleviate the problem, recent works on multi-behavior recommendation incorporated multiple types of user-item interactions such as click, add-to-cart, and buy. However, the latest approaches are still limited by overlooking early-stage interactions, and have limited expressiveness of Euclidean geometry. To overcome these issues, in this paper, we propose a Multi-behavior Hyperbolic Graph Recommender (MB-HGR) with two novel aspects. First, it uses multiple heterogeneous graphs to learn multiple user behavior types, where each heterogeneous graph represents a user-item interaction type. This will help not only alleviate the serious data sparsity problem, but also allow the model to explicitly weight different behavior types and prevent information loss. Second, it leverages the expressiveness of the hyperbolic geometry over Euclidean geometry, where exponential growth of distances in the hyperbolic geometry matches the exponential growth of nodes in the hierarchical structures and learns better users/items representations. Experimental results on two public benchmark datasets show that on average our proposed model achieves a significant improvement of 28.32% at Recall@10 and 30.14% at NDCG@10 over the best baseline. Di You, Thanh Tran 0005, Kyumin Lee |
IEEE Big Data | 3 |
| 2021 | Multi-Source Domain Adaptation with Weak Supervision for Early Fake News DetectionabstractRecently, the massive and diverse fake news from politics to entertainment and health has amplified the social distrust problem and has become a big challenge for the society and research community. The existing fake news detection methods are mostly designed for either a specific domain or require huge labeled data from various domains. If there is not enough labeled data in a certain domain, existing models may not work well for detecting fake news from that domain. To overcome these limitations we propose a novel framework based on multisource domain adaptation and weak supervision for early fake news detection. The framework transfers sufficient labeled source domains’ knowledge into a target/new domain with limited or even no labeled data by the multi-source domain adaptation, and applies researchers’ prior knowledge about fake news to the target domain by the weak supervision. The weak supervision assigns the weak labels to the unlabeled samples in the target domain through known heuristic rules. Our experimental results show that our approach outperforms 7 state-of-the-art methods in three real-world datasets. In particular, our model achieves, on average, 5.2% higher accuracy than the best baseline. Our model with a more advanced encoder can further boost the performance by 3.7%. The code is available at this clickable link. Yichuan Li 0001, Kyumin Lee, Nima Kordzadeh, Brenton D. Faber, Cameron Fiddes, Elaine Chen, Kai Shu |
IEEE BigData | 2 |
| 2021 | An Effective, Robust and Fairness-aware Hate Speech Detection FrameworkabstractWith the widespread online social networks, hate speeches are spreading faster and causing more damage than ever before. Existing hate speech detection methods have limitations in several aspects, such as handling data insufficiency, estimating model uncertainty, improving robustness against malicious attacks, and handling unintended bias (i.e., fairness). There is an urgent need for accurate, robust, and fair hate speech classification in online social networks. To bridge the gap, we design a data-augmented, fairness addressed, and uncertainty estimated novel framework. As parts of the framework, we propose Bidirectional Quaternion-Quasi-LSTM layers to balance effectiveness and efficiency. To build a generalized model, we combine five datasets collected from three platforms. Experiment results show that our model outperforms eight state-of-the-art methods under both no attack scenario and various attack scenarios, indicating the effectiveness and robustness of our model. We share our code along with combined dataset for better future research1. Guanyi Mou, Kyumin Lee |
IEEE BigData | 2 |
| 2021 | Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text ClassificationabstractData augmentation has shown its effectiveness in resolving the data-hungry problem and improving model's generalization ability. However, the quality of augmented data can be varied, especially compared with the raw/original data. To boost deep learning models' performance given augmented data/samples in text classification tasks, we propose a novel framework, which leverages both meta learning and contrastive learning techniques as parts of our design for reweighting the augmented samples and refining their feature representations based on their quality. As part of the framework, we propose novel weight-dependent enqueue and dequeue algorithms to utilize augmented samples' weight/quality information effectively. Through experiments, we show that our framework can reasonably cooperate with existing deep learning models (e.g., RoBERTa-base and Text-CNN) and augmentation techniques (e.g., Wordnet and Easydata) for specific supervised learning tasks. Experiment results show that our framework achieves an average of 1.6%, up to 4.3% absolute improvement on Text-CNN encoders and an average of 1.4%, up to 4.4% absolute improvement on RoBERTa-base encoders on seven GLUE benchmark datasets compared with the best baseline. We present an indepth analysis of our framework design, revealing the non-trivial contributions of our network components. Our code is publicly available for better reproducibility.1 Guanyi Mou, Yichuan Li 0001, Kyumin Lee |
IEEE BigData | 3 |
| 2020 | SWE2: SubWord Enriched and Significant Word Emphasized Framework for Hate Speech DetectionabstractHate speech detection on online social networks has become one of the emerging hot topics in recent years. With the broad spread and fast propagation speed across online social networks, hate speech makes significant impacts on society by increasing prejudice and hurting people. Therefore, there are aroused attention and concern from both industry and academia. In this paper, we address the hate speech problem and propose a novel hate speech detection framework called SWE2, which only relies on the content of messages and automatically identifies hate speech. In particular, our framework exploits both word-level semantic information and sub-word knowledge. It is intuitively persuasive and also practically performs well under a situation with/without character-level adversarial attack. Experimental results show that our proposed model achieves 0.975 accuracy and 0.953 macro F1, outperforming 7 state-of-the-art baselines under no adversarial attack. Our model robustly and significantly performed well under extreme adversarial attack (manipulation of 50% messages), achieving 0.967 accuracy and 0.934 macro F1. Guanyi Mou, Pengyi Ye, Kyumin Lee |
CIKM | 3 |
| 2020 | Quaternion-Based Self-Attentive Long Short-term User Preference Encoding for RecommendationabstractQuaternion space has brought several benefits over the traditional Euclidean space: Quaternions (i) consist of a real and three imaginary components, encouraging richer representations; (ii) utilize Hamilton product which better encodes the inter-latent interactions across multiple Quaternion components; and (iii) result in a model with smaller degrees of freedom and less prone to overfitting. Unfortunately, most of the current recommender systems rely on real-valued representations in Euclidean space to model either user's long-term or short-term interests. In this paper, we fully utilize Quaternion space to model both user's long-term and short-term preferences. We first propose a QUaternion-based self-Attentive Long term user Encoding (QUALE) to study the user's long-term intents. Then, we propose a QUaternion-based self-Attentive Short term user Encoding (QUASE) to learn the user's short-term interests. To enhance our models' capability, we propose to fuse QUALE and QUASE into one model, namely QUALSE, by using a Quaternion-based gating mechanism. We further develop Quaternion-based Adversarial learning along with the Bayesian Personalized Ranking (QABPR) to improve our model's robustness. Extensive experiments on six real-world datasets show that our fused QUALSE model outperformed 11 state-of-the-art baselines, improving 8.43% at [email protected] and 10.27% at [email protected] on average compared with the best baseline. Thanh Tran 0005, Di You, Kyumin Lee |
CIKM | 3 |
| 2019 | Building a task blacklist for online social platformsabstractRecently, the use of crowdsourcing platforms (e.g., Amazon Mechanical Turk) has boomed because of their flexible and cost-effective nature, which benefits both requestors and workers. However, some requestors misused power of the crowdsourcing platforms by creating malicious tasks, which targeted manipulating search results, leaving fake reviews, etc. Crowdsourced manipulation reduces the quality of online social media, and threatens the social values and security of the cyberspace as a whole. To help solve this problem, we build a classification model which filters out malicious campaigns from a large number of campaigns crawled from several popular crowdsourcing platforms. We then build a task blacklist web service, which provides users with a keyword-based search so that they can understand, moderate and eliminate potential malicious campaigns from the Web. Trang Ha, Quyen Hoang, Kyumin Lee |
ASONAM | 3 |
| 2019 | Detecting Fake News ArticlesabstractFake news has been generated and widely spread although journalists and researchers created fact-checking websites (e.g., Snopes and PolitiFact) and analyzed characteristics of fake news. To fill this gap, in this paper we focus on developing machine learning models based on only text information in news articles toward automatically detecting fake news. In particular, we proposed a framework which extracts 134 features and builds traditional known machine learning models like Random Forest and XGBoost. We also propose a deep learning based model (LSTM with self-attention mechanism) to see which one performs better in the fake news article detection in both political news and celebrity news domains. In the experiments, we compare our models against 7 baselines. The results show that our XGBoost model improved 16.4% and 13.1% over the best baseline in terms of accuracy in both political news articles and celebrity news articles, respectively. Glenna Tremblay-Taylor, Guanyi Mou, Di You, Kyumin Lee |
IEEE BigData | 5 |
| 2019 | Attributed Multi-Relational Attention Network for Fact-checking URL RecommendationabstractTo combat fake news, researchers mostly focused on detecting fake news and journalists built and maintained fact-checking sites (e.g., Snopes.com and Politifact.com). However, fake news dissemination has been greatly promoted via social media sites, and these fact-checking sites have not been fully utilized. To overcome these problems and complement existing methods against fake news, in this paper we propose a deep-learning based fact-checking URL recommender system to mitigate impact of fake news in social media sites such as Twitter and Facebook. In particular, our proposed framework consists of a multi-relational attentive module and a heterogeneous graph attention network to learn complex/semantic relationship between user-URL pairs, user-user pairs, and URL-URL pairs. Extensive experiments on a real-world dataset show that our proposed framework outperforms eight state-of-the-art recommendation models, achieving at least 3$\sim$5.3% improvement. Our source code and dataset are available at \urlhttps://web.cs.wpi.edu/~kmlee/data.html . Di You, Nguyen Vo, Kyumin Lee |
CIKM | 3 |
| 2019 | Adversarial Mahalanobis Distance-based Attentive Song Recommender for Automatic Playlist ContinuationabstractIn this paper, we aim to solve the automatic playlist continuation (APC) problem by modeling complex interactions among users, playlists, and songs using only their interaction data. Prior methods mainly rely on dot product to account for similarities, which is not ideal as dot product is not metric learning, so it does not convey the important inequality property. Based on this observation, we propose three novel deep learning approaches that utilize Mahalanobis distance. Our first approach uses user-playlist-song interactions, and combines Mahalanobis distance scores between (i) a target user and a target song, and (ii) between a target playlist and the target song to account for both the user's preference and the playlist's theme. Our second approach measures song-song similarities by considering Mahalanobis distance scores between the target song and each member song (i.e., existing song) in the target playlist. The contribution of each distance score is measured by our proposed memory metric-based attention mechanism. In the third approach, we fuse the two previous models into a unified model to further enhance their performance. In addition, we adopt and customize Adversarial Personalized Ranking (APR) for our three approaches to further improve their robustness and predictive capabilities. Through extensive experiments, we show that our proposed models outperform eight state-of-the-art models in two large-scale real-world datasets. Thanh Tran 0005, Renee Sweeney, Kyumin Lee |
SIGIR | 3 |
| 2019 | Learning from Fact-checkers: Analysis and Generation of Fact-checking LanguageabstractIn fighting against fake news, many fact-checking systems comprised of human-based fact-checking sites (e.g., snopes.com and politifact.com) and automatic detection systems have been developed in recent years. However, online users still keep sharing fake news even when it has been debunked. It means that early fake news detection may be insufficient and we need another complementary approach to mitigate the spread of misinformation. In this paper, we introduce a novel application of text generation for combating fake news. In particular, we (1) leverage online users named fact-checkers, who cite fact-checking sites as credible evidences to fact-check information in public discourse; (2) analyze linguistic characteristics of fact-checking tweets; and (3) propose and build a deep learning framework to generate responses with fact-checking intention to increase the fact-checkers' engagement in fact-checking activities. Our analysis reveals that the fact-checkers tend to refute misinformation and use formal language (e.g. few swear words and Internet slangs). Our framework successfully generates relevant responses, and outperforms competing models by achieving up to 30% improvements. Our qualitative study also confirms that the superiority of our generated responses compared with responses generated from the existing models. Nguyen Vo, Kyumin Lee |
SIGIR | 2 |
| 2019 | Signed Distance-based Deep Memory RecommenderabstractPersonalized recommendation algorithms learn a user's preference for an item by measuring a distance/similarity between them. However, some of the existing recommendation models (e.g., matrix factorization) assume a linear relationship between the user and item. This approach limits the capacity of recommender systems, since the interactions between users and items in real-world applications are much more complex than the linear relationship. To overcome this limitation, in this paper, we design and propose a deep learning framework called Signed Distance-based Deep Memory Recommender, which captures non-linear relationships between users and items explicitly and implicitly, and work well in both general recommendation task and shopping basket-based recommendation task. Through an extensive empirical study on six real-world datasets in the two recommendation tasks, our proposed approach achieved significant improvement over ten state-of-the-art recommendation models. Thanh Tran 0005, Xinyue Liu 0003, Kyumin Lee, Xiangnan Kong |
WWW | 3 |
| 2018 | Predicting Highly Rated Crowdfunded ProductsabstractOnline crowdfunding platforms have given creators new opportunities to obtain funding. Despite the popularity and success of many projects on the platforms, the quality of crowd-funded products in the market (e.g., Amazon) was not statistically and scientifically evaluated yet. To fill the gap, in this paper, we (i) compare crowdfunded products with traditional products in terms of their ratings in the largest e-commerce market, Amazon; (ii) analyze characteristics of the successful products (received ≥4 star) and unsuccessful products (received <; 4 star); and (iii) build machine learning models in three different stages, which predict whether a crowdfunded product will receive high star ratings or not. Our experimental results show that crowdfunded products, on average, received lower rating than traditional products. Our predictive models effectively identify which product will receive high star-ratings from customers on Amazon. The datasets used in this paper will be available at http://web.cs.wpi.edu/~kmlee/data.html. Vishal Sharma 0005, Kyumin Lee |
ASONAM | 2 |
| 2018 | Regularizing Matrix Factorization with User and Item Embeddings for RecommendationabstractFollowing recent successes in exploiting both latent factor and word embedding models in recommendation, we propose a novel Regularized Multi-Embedding (RME) based recommendation model that simultaneously encapsulates the following ideas via decomposition: (1) which items a user likes, (2) which two users co-like the same items, (3) which two items users often co-liked, and (4) which two items users often co-disliked. In experimental validation, the RME outperforms competing state-of-the-art models in both explicit and implicit feedback datasets, significantly improving [email protected] by 5.9~7.0%, [email protected] by 4.3~5.6%, and [email protected] by 7.9~8.9%. In addition, under the cold-start scenario for users with the lowest number of interactions, against the competing models, the RME outperforms [email protected] by 20.2% and 29.4% in MovieLens-10M and MovieLens-20M datasets, respectively. Our datasets and source code are available at: https://github.com/thanhdtran/RME.git. Thanh Tran 0005, Kyumin Lee, Yiming Liao, Dongwon Lee 0001 |
CIKM | 2 |
| 2018 | The Rise of Guardians: Fact-checking URL Recommendation to Combat Fake NewsabstractA large body of research work and efforts have been focused on detecting fake news and building online fact-check systems in order to debunk fake news as soon as possible. Despite the existence of these systems, fake news is still wildly shared by online users. It indicates that these systems may not be fully utilized. After detecting fake news, what is the next step to stop people from sharing it? How can we improve the utilization of these fact-check systems? To fill this gap, in this paper, we (i) collect and analyze online users called guardians, who correct misinformation and fake news in online discussions by referring fact-checking URLs; and (ii) propose a novel fact-checking URL recommendation model to encourage the guardians to engage more in fact-checking activities. We found that the guardians usually took less than one day to reply to claims in online conversations and took another day to spread verified information to hundreds of millions of followers. Our proposed recommendation model outperformed four state-of-the-art models by 11%~33%. Our source code and dataset are available at http://web.cs.wpi.edu/~kmlee/data/gau.html. Nguyen Vo, Kyumin Lee |
SIGIR | 2 |
| 2017 | Identifying On-time Reward Delivery Projects with Estimating Delivery Duration on KickstarterabstractIn Crowdfunding platforms, people turn their prototype ideas into real products by raising money from the crowd, or invest in someone else's projects. In reward-based crowdfunding platforms such as Kickstarter and Indiegogo, selecting accurate reward delivery duration becomes crucial for creators, backers, and platform providers to keep the trust between the creators and the backers, and the trust between the platform providers and users. According to Kickstarter, 35% backers did not receive rewards on time. Unfortunately, little is known about on-time and late reward delivery projects, and there is no prior work to estimate reward delivery duration. To fill the gap, in this paper, we (i) extract novel features that reveal latent difficulty levels of project rewards; (ii) build predictive models to identify whether a creator will deliver all rewards in a project on time or not; and (iii) build a regression model to estimate accurate reward delivery duration (i.e., how long it will take to produce and deliver all the rewards). Experimental results show that our models achieve good performance -- 82.5% accuracy, 78.1 RMSE, and 0.108 NRMSE at the first 5% of the longest reward delivery duration. Thanh Tran 0005, Kyumin Lee, Nguyen Vo, Hongkyu Choi |
ASONAM | 2 |
| 2017 | Revealing and Detecting Malicious Retweeter GroupsabstractRetweeting/sharing action has enabled information to be cascaded to distant nodes on social network. Unfortunately, malicious users as a group have taken advantage of the retweeting function with coordinated behavior to falsely distort the volume of specific keywords, topics or URLs for promotional purposes (e.g., spreading fake news, and increasing public visibility of products or services). Unfortunately, little is known about their retweeting behavior as a group and how to detect them based on group-based signals. To fill the gap, in this paper, we (i) propose Attractor+ algorithm to extract retweeter groups, members of each of which have similar retweeting behavior; (ii) analyze underlying characteristics of malicious and legitimate retweeter groups; (iii) propose group-based features to catch synchronized and coordinated behavior; and build a predictor to classify if a group is malicious. Experimental results show that our proposed method outperformed existing approaches. Nguyen Vo, Kyumin Lee, Thanh Tran 0005, Hongkyu Choi |
ASONAM | 2 |
| 2017 | MRAttractor: Detecting communities from large-scale graphsabstractDetecting groups of users, who have similar opinions, interests, or social behavior, has become an important task for many applications. A recent study showed that dynamic distance based Attractor, a community detection algorithm, outperformed other community detection algorithms such as Spectral clustering, Louvain and Infomap, achieving higher Normalized Mutual Information (NMI) and Adjusted Rand Index (ARI). However, Attractor often takes long time to detect communities, requiring many iterations. To overcome the drawback and handle large-scale graphs, in this paper we propose MRAttractor, an advanced version of Attractor to be runnable on a MapReduce framework. In particular, we (i) apply a sliding window technique to reduce the running time, keeping the same community detection quality; (ii) design and implement the Attractor algorithm for a MapReduce framework; and (iii) evaluate MRAttractor's performance on synthetic and real-world datasets. Experimental results show that our algorithm significantly reduced running time and was able to handle large-scale graphs. Nguyen Vo, Kyumin Lee, Thanh Tran 0005 |
IEEE BigData | 2 |
| 2017 | Characteristics of On-Time and Late Reward Delivery Projects
Thanh Tran 0005, Kyumin Lee |
ICWSM | 2 |
| 2016 | Detecting malicious campaigns in crowdsourcing platformsabstractCrowdsourcing systems enable new opportunities for requesters with limited funds to accomplish various tasks using human computation. However, the power of human computation is abused by malicious requesters who create malicious campaigns to manipulate information in web systems such as social networking sites, online review sites, and search engines. To mitigate the impact and reach of these malicious campaigns to targeted sites, we propose and evaluate a machine learning based classification approach for detecting malicious campaigns in crowdsourcing platforms as a first line of defense. Specifically, we (i) conduct a comprehensive analysis to understand the characteristics of malicious campaigns and legitimate campaigns in crowdsourcing platforms, (ii) propose various features to distinguish between malicious campaigns and legitimate campaigns, and (iii) evaluate a classification approach against baselines. Our experimental results show that our proposed approaches effectively detect malicious campaigns with low false negative and false positive rates. Hongkyu Choi, Kyumin Lee, Steve Webb |
ASONAM | 2 |
| 2016 | Understanding citizen reactions and Ebola-related information propagation on social mediaabstractIn severe outbreaks such as Ebola, bird flu and SARS, people share news, and their thoughts and responses regarding the outbreaks on social media. Understanding how people perceive the severe outbreaks, what their responses are, and what factors affect these responses become important. In this paper, we conduct a comprehensive study of understanding and mining the spread of Ebola-related information on social media. In particular, we (i) conduct a large-scale data-driven analysis of geotagged social media messages to understand citizen reactions regarding Ebola; (ii) build information propagation models which measure locality of information; and (iii) analyze spatial, temporal and social properties of Ebola-related information. Our work provides new insights into Ebola outbreak by understanding citizen reactions and topic-based information propagation, as well as providing a foundation for analysis and response of future public health crises. Thanh Tran 0005, Kyumin Lee |
ASONAM | 2 |
| 2016 | Uncovering Fake Likers in Online Social NetworksabstractAs the commercial implications of Likes in online social networks multiply, the number of fake Likes also increase rapidly. To maintain a healthy ecosystem, however, it is critically important to prevent and detect such fake Likes. Toward this goal, in this paper, we investigate the problem of detecting the so-called "fake likers" who frequently make fake Likes for illegitimate reasons. To uncover fake Likes in online social networks, we: (1) first collect a substantial number of profiles of both fake and legitimate Likers using linkage and honeypot approaches, (2) analyze the characteristics of both types of Likers, (3) identify effective features exploiting the learned characteristics and apply them in supervised learning models, and (4) thoroughly evaluate their performances against three baseline methods and under two attack models. Our experimental results show that our proposed methods with effective features significantly outperformed baseline methods, with accuracy = 0.871, false positive rate = 0.1, and false negative rate = 0.14. Prudhvi Ratna Badri Satya, Kyumin Lee, Dongwon Lee 0001, Thanh Tran 0005, Jason (Jiasheng) Zhang |
CIKM | 2 |
| 2015 | Organic or Organized?: Exploring URL Sharing BehaviorabstractURL sharing has become one of the most popular activities on many online social media platforms. Shared URLs are an avenue to interesting news articles, memes, photos, as well as low-quality content like spam, promotional ads, and phishing sites. While some URL sharing is organic, other sharing is strategically organized with a common purpose (e.g., aggressively promoting a website). In this paper, we investigate the individual-based and group-based user behavior of URL sharing in social media toward uncovering these organic versus organized user groups. Concretely, we pro- pose a four-phase approach to model, identify, characterize, and classify organic and organized groups who engage in URL sharing. The key motivating insights of this approach are (i) that patterns of individual-based behavioral signals embedded in URL posting activities can uncover groups whose members engage in similar behaviors; and (ii) that group-level behavioral signals can distinguish between organic and organized user groups. Through extensive experiments, we find that levels of organized behavior vary by URL type and that the proposed approach achieves good performance -- an F-measure of 0.836 and Area Under the Curve of 0.921. James Caverlee, Kyumin Lee, Hancheng Ge, Jin-Wook Chung |
CIKM | 3 |
| 2015 | Crowds, Gigs, and Super Sellers: A Measurement Study of a Supply-Driven Crowdsourcing Marketplace
Hancheng Ge, James Caverlee, Kyumin Lee |
ICWSM | 3 |
| 2015 | Uncovering Crowdsourced Manipulation of Online ReviewsabstractOnline reviews are a cornerstone of consumer decision making. However, their authenticity and quality has proven hard to control, especially as polluters target these reviews toward promoting products or in degrading competitors. In a troubling direction, the widespread growth of crowdsourcing platforms like Mechanical Turk has created a large-scale, potentially difficult-to-detect workforce of malicious review writers. Hence, this paper tackles the challenge of uncovering crowdsourced manipulation of online reviews through a three-part effort: (i) First, we propose a novel sampling method for identifying products that have been targeted for manipulation and a seed set of deceptive reviewers who have been enlisted through crowdsourcing platforms. (ii) Second, we augment this base set of deceptive reviewers through a reviewer-reviewer graph clustering approach based on a Markov Random Field where we define individual potentials (of single reviewers) and pair potentials (between two reviewers). (iii) Finally, we embed the results of this probabilistic model into a classification framework for detecting crowd-manipulated reviews. We find that the proposed approach achieves up to 0.96 AUC, outperforming both traditional detection methods and a SimRank-based alternative clustering approach. Amir Fayazi, Kyumin Lee, James Caverlee, Anna Cinzia Squicciarini |
SIGIR | 2 |
| 2015 | Who Will Retweet This? Detecting Strangers from Twitter to Retweet InformationabstractThere has been much effort on studying how social media sites, such as Twitter, help propagate information in different situations, including spreading alerts and SOS messages in an emergency. However, existing work has not addressed how to actively identify and engage the right strangers at the right time on social media to help effectively propagate intended information within a desired time frame. To address this problem, we have developed three models: (1) a feature-based model that leverages people's exhibited social behavior, including the content of their tweets and social interactions, to characterize their willingness and readiness to propagate information on Twitter via the act of retweeting; (2) a wait-time model based on a user's previous retweeting wait times to predict his or her next retweeting time when asked; and (3) a subset selection model that automatically selects a subset of people from a set of available people using probabilities predicted by the feature-based model and maximizes retweeting rate. Based on these three models, we build a recommender system that predicts the likelihood of a stranger to retweet information when asked, within a specific time window, and recommends the top-N qualified strangers to engage with. Our experiments, including live studies in the real world, demonstrate the effectiveness of our work. Kyumin Lee, Jalal Mahmud, Jilin Chen, Michelle X. Zhou, Jeffrey Nichols 0001 |
ACM Trans. Intell. Syst. Technol. | 1 |
| 2014 | The Dark Side of Micro-Task Marketplaces: Characterizing Fiverr and Automatically Detecting Crowdturfing
Kyumin Lee, Steve Webb, Hancheng Ge |
ICWSM | 1 |
| 2013 | Combating Threats to Collective Attention in Social Media: An Evaluation
Kyumin Lee, Krishna Yeswanth Kamath, James Caverlee |
ICWSM | 1 |
| 2013 | Crowdturfers, Campaigns, and Social Media: Tracking and Revealing Crowdsourced Manipulation of Social Media
Kyumin Lee, Prithivi Tamilarasan, James Caverlee |
ICWSM | 1 |
| 2013 | Spatio-temporal dynamics of online memes: a study of geo-tagged tweetsabstractWe conduct a study of the spatio-temporal dynamics of Twitter hashtags through a sample of 2 billion geo-tagged tweets. In our analysis, we (i) examine the impact of location, time, and distance on the adoption of hashtags, which is important for understanding meme diffusion and information propagation; (ii) examine the spatial propagation of hashtags through their focus, entropy, and spread; and (iii) present two methods that leverage the spatio-temporal propagation of hashtags to characterize locations. Based on this study, we find that although hashtags are a global phenomenon, the physical distance between locations is a strong constraint on the adoption of hashtags, both in terms of the hashtags shared between locations and in the timing of when these hashtags are adopted. We find both spatial and temporal locality as most hashtags spread over small geographical areas but at high speeds. We also find that hashtags are mostly a local phenomenon with long-tailed life spans. These (and other) findings have important implications for a variety of systems and applications, including targeted advertising, location-based services, social media search, and content delivery networks. Krishna Yeswanth Kamath, James Caverlee, Kyumin Lee, Zhiyuan Cheng 0001 |
WWW | 3 |
| 2013 | A content-driven framework for geolocating microblog usersabstractHighly dynamic real-time microblog systems have already published petabytes of real-time human sensor data in the form of status updates. However, the lack of user adoption of geo-based features per user or per post signals that the promise of microblog services as location-based sensing systems may have only limited reach and impact. Thus, in this article, we propose and evaluate a probabilistic framework for estimating a microblog user's location based purely on the content of the user's posts. Our framework can overcome the sparsity of geo-enabled features in these services and bring augmented scope and breadth to emerging location-based personalized information services. Three of the key features of the proposed approach are: (i) its reliance purely on publicly available content; (ii) a classification component for automatically identifying words in posts with a strong local geo-scope; and (iii) a lattice-based neighborhood smoothing model for refining a user's location estimate. On average we find that the location estimates converge quickly, placing 51% of users within 100 miles of their actual location. Zhiyuan Cheng 0001, James Caverlee, Kyumin Lee |
ACM Trans. Intell. Syst. Technol. | 3 |
| 2013 | Campaign extraction from social mediaabstractIn this manuscript, we study the problem of detecting coordinated free text campaigns in large-scale social media. These campaigns—ranging from coordinated spam messages to promotional and advertising campaigns to political astro-turfing—are growing in significance and reach with the commensurate rise in massive-scale social systems. Specifically, we propose and evaluate a content-driven framework for effectively linking free text posts with common “talking points” and extracting campaigns from large-scale social media. Three of the salient features of the campaign extraction framework are: (i) first, we investigate graph mining techniques for isolating coherent campaigns from large message-based graphs; (ii) second, we conduct a comprehensive comparative study of text-based message correlation in message and user levels; and (iii) finally, we analyze temporal behaviors of various campaign types. Through an experimental study over millions of Twitter messages we identify five major types of campaigns—namely Spam, Promotion, Template, News, and Celebrity campaigns—and we show how these campaigns may be extracted with high precision and recall. Kyumin Lee, James Caverlee, Zhiyuan Cheng 0001, Daniel Z. Sui |
ACM Trans. Intell. Syst. Technol. | 1 |
| 2011 | Toward traffic-driven location-based web searchabstractThe emergence of location sharing services is rapidly accelerating the convergence of our online and offline activities. In one direction, Foursquare, Google Latitude, Facebook Places, and related services are enriching real-world venues with the social and semantic connections among online users. In analogy to how clickstreams have been successfully incorporated into traditional web ranking based on content and link analysis, we propose to mine traffic patterns revealed through location sharing services to augment traditional location-based search. Concretely, we study location-based traffic patterns revealed through location sharing services and find that these traffic patterns can identify semantically related locations. Based on this observation, we propose and evaluate a traffic-driven location clustering algorithm that can group semantically related locations with high confidence. Through experimental study of 12 million locations from Foursquare, we extend this result through supervised location categorization, wherein traffic patterns can be used to accurately predict the semantic category of uncategorized locations. Based on these results, we show how traffic-driven semantic organization of locations may be naturally incorporated into location-based web search. Zhiyuan Cheng 0001, James Caverlee, Krishna Yeswanth Kamath, Kyumin Lee |
CIKM | 4 |
| 2011 | Content-driven detection of campaigns in social mediaabstractWe study the problem of detecting coordinated free text campaigns in large-scale social media. These campaigns -- ranging from coordinated spam messages to promotional and advertising campaigns to political astro-turfing -- are growing in significance and reach with the commensurate rise of massive-scale social systems. Often linked by common "talking points", there has been little research in detecting these campaigns. Hence, we propose and evaluate a content-driven framework for effectively linking free text posts with common "talking points" and extracting campaigns from large-scale social media. One of the salient aspects of the framework is an investigation of graph mining techniques for isolating coherent campaigns from large message-based graphs. Through an experimental study over millions of Twitter messages we identify five major types of campaigns -- Spam, Promotion, Template, News, and Celebrity campaigns -- and we show how these campaigns may be extracted with high precision and recall. Kyumin Lee, James Caverlee, Zhiyuan Cheng 0001, Daniel Z. Sui |
CIKM | 1 |
| 2011 | Exploring Millions of Footprints in Location Sharing Services
Zhiyuan Cheng 0001, James Caverlee, Kyumin Lee, Daniel Z. Sui |
ICWSM | 3 |
| 2011 | Seven Months with the Devils: A Long-Term Study of Content Polluters on Twitter
Kyumin Lee, Brian Eoff, James Caverlee |
ICWSM | 1 |
| 2010 | You are where you tweet: a content-based approach to geo-locating twitter usersabstractWe propose and evaluate a probabilistic framework for estimating a Twitter user's city-level location based purely on the content of the user's tweets, even in the absence of any other geospatial cues. By augmenting the massive human-powered sensing capabilities of Twitter and related microblogging services with content-derived location information, this framework can overcome the sparsity of geo-enabled features in these services and enable new location-based personalized information services, the targeting of regional advertisements, and so on. Three of the key features of the proposed approach are: (i) its reliance purely on tweet content, meaning no need for user IP information, private login information, or external knowledge bases; (ii) a classification component for automatically identifying words in tweets with a strong local geo-scope; and (iii) a lattice-based neighborhood smoothing model for refining a user's location estimate. The system estimates k possible locations for each user in descending order of confidence. On average we find that the location estimates converge quickly (needing just 100s of tweets), placing 51% of Twitter users within 100 miles of their actual location. Zhiyuan Cheng 0001, James Caverlee, Kyumin Lee |
CIKM | 3 |
| 2010 | Devils, Angels, and Robots: Tempting Destructive Users in Social Media
Kyumin Lee, Brian Eoff, James Caverlee |
ICWSM | 1 |
| 2010 | Uncovering social spammers: social honeypots + machine learningabstractWeb-based social systems enable new community-based opportunities for participants to engage, share, and interact. This community value and related services like search and advertising are threatened by spammers, content polluters, and malware disseminators. In an effort to preserve community value and ensure longterm success, we propose and evaluate a honeypot-based approach for uncovering social spammers in online social systems. Two of the key components of the proposed approach are: (1) The deployment of social honeypots for harvesting deceptive spam profiles from social networking communities; and (2) Statistical analysis of the properties of these spam profiles for creating spam classifiers to actively filter out existing and new spammers. We describe the conceptual framework and design considerations of the proposed approach, and we present concrete observations from the deployment of social honeypots in MySpace and Twitter. We find that the deployed social honeypots identify social spammers with low false positive rates and that the harvested spam data contains signals that are strongly correlated with observable profile features (e.g., content, friend information, posting patterns, etc.). Based on these profile features, we develop machine learning based classifiers for identifying previously unknown spammers with high precision and a low rate of false positives. Kyumin Lee, James Caverlee, Steve Webb |
SIGIR | 1 |
| 2010 | The social honeypot project: protecting online communities from spammersabstractWe present the conceptual framework of the Social Honeypot Project for uncovering social spammers who target online communities and initial empirical results from Twitter and MySpace. Two of the key components of the Social Honeypot Project are: (1) The deployment of social honeypots for harvesting deceptive spam profiles from social networking communities; and (2) Statistical analysis of the properties of these spam profiles for creating spam classifiers to actively filter out existing and new spammers. Kyumin Lee, James Caverlee, Steve Webb |
WWW | 1 |