Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Fred Morstatter

dblp:51/9687 · DBLP profile ↗
← Back
52ranked-venue papers
7as first author
33since 2021 · last 2026
0000-0002-0247-4328ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 33 · 5 first-author · 21 since 2021Databases, data management, data science and information retrieval · 29 · 4 first-author · 13 since 2021Human-computer interaction and ubiquitous computing · 20 · 4 first-author · 10 since 2021Applied, interdisciplinary, general and emerging computing · 12 · 1 first-author · 7 since 2021Graphics, computer vision, multimedia, augmented reality and games · 6 · 1 first-author · 4 since 2021Computer networks · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
8 papers
Trustworthy machine learning · 33% Information extraction and text analysis · 23% Generative modeling · 18%
Databases, data mining, and information retrieval
6 papers
Knowledge graphs · 66% Data mining · 18% Web and social media mining · 14%
Network and information security
1 paper
Security and privacy of machine learning · 100%
Computer graphics and multimedia
2 papers
Visualization and visual analytics · 100%

Topics — the 22 heaviest of 27, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Generative modeling
synthetic data generation
1.012026
On Causal and Anticausal LLM-based Data Synthesis · WSDM 2026
Knowledge graphs › temporal knowledge graph
knowledge graph extrapolation
0.712023
Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning · EMNLP 2023
Knowledge graphs
temporal knowledge graph
0.712023
Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning · EMNLP 2023
Knowledge graphs
knowledge graph construction
0.612022
Assessing Scientific Research Papers with Knowledge Graphs · SIGIR 2022
Data mining › text mining
topic model
0.612022
Keyword Assisted Embedded Topic Model · WSDM 2022
Knowledge, reasoning and agents › Knowledge representation and reasoning › commonsense reasoning
commonsense knowledge base
0.512021
Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources · EMNLP (1) 2021
Natural language and speech › Information extraction and text analysis › event analysis
event prediction
0.512021
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data · ACL/IJCNLP (1) 2021
Machine learning › Trustworthy machine learning
fairness
0.512021
Exacerbating Algorithmic Bias through Fairness Attacks · AAAI 2021
Machine learning › Trustworthy machine learning › robustness › robust fairness
fairness attack
0.512021
Exacerbating Algorithmic Bias through Fairness Attacks · AAAI 2021
Machine learning › Trustworthy machine learning › fairness › social bias
representational harm
0.512021
Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources · EMNLP (1) 2021
Security and privacy of machine learning
poisoning attack
0.512021
Exacerbating Algorithmic Bias through Fairness Attacks · AAAI 2021
Web and social media mining
social media analysis
0.422016
Predicting Online Protest Participation of Social Media Users · AAAI 2016
Navigating information facets on twitter (NIF-T) · KDD 2012
Natural language and speech › Information extraction and text analysis › topic model
topic interpretability
0.312017
In Search of Coherence and Consensus: Measuring the Interpretability of Statistical Topics · J. Mach. Learn. Res. 2017
Natural language and speech › Information extraction and text analysis
topic model
0.312017
In Search of Coherence and Consensus: Measuring the Interpretability of Statistical Topics · J. Mach. Learn. Res. 2017
Natural language and speech › Language models and text generation
in-context learning
0.212023
Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning · EMNLP 2023
Natural language and speech › Information extraction and text analysis › topic model
latent dirichlet allocation
0.212022
Keyword Assisted Embedded Topic Model · WSDM 2022
Knowledge graphs
knowledge graph embedding
0.212022
Assessing Scientific Research Papers with Knowledge Graphs · SIGIR 2022
Visualization and visual analytics
visual analytics
0.212013
Understanding Twitter data with TweetXplorer · KDD 2013
Knowledge, reasoning and agents › Knowledge representation and reasoning
commonsense reasoning
0.112021
Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources · EMNLP (1) 2021
Computational social science and digital humanities
social movement analysis
0.112016
Predicting Online Protest Participation of Social Media Users · AAAI 2016
Web and social media mining › social media analysis
twitter analysis
0.012013
Understanding Twitter data with TweetXplorer · KDD 2013
Information retrieval › search interfaces
faceted search
0.012012
Navigating information facets on twitter (NIF-T) · KDD 2012

Methods — techniques the papers use, named apart from their topics

large language model · 1.3in-context learning · 1.3word embeddings · 1.1probabilistic generative model · 1.1prompting strategies · 1.0influence attack · 1.0fine-tuning · 1.0anchoring attack · 1.0language model · 0.6knowledge graph embedding · 0.6temporal text data · 0.5temporal interaction modeling · 0.5sociological protest participation theory · 0.5question answering · 0.5machine learning · 0.4crowdsourcing · 0.4visualization techniques · 0.3faceted browsing · 0.3
YearPublicationVenuePosition
2026 On Causal and Anticausal LLM-based Data Synthesis
abstract
While Large Language Models (LLMs) have been increasingly used to generate synthetic data for various downstream tasks, researchers overlook the causal direction in the data synthesis process. A natural causal direction should contain two steps: diverse raw data are generated first, and subsequently annotated for downstream tasks. However, most LLM-based methods adopt an anticausal direction: embedding label information in the prompt to force LLMs to generate targeted data. This reversal raises a critical question: How does the direction of data synthesis impact the quality and utility of the synthetic data? In this work, we empirically study the impact of causal and anticausal data synthesis. To do so, we first design simple yet effective prompting strategies to control the causal direction of LLM-based data synthesis. Using GPT-5 as the data generator, we construct synthetic datasets for three distinct machine learning tasks. We then fine-tune BERT-base and LLaMA-3.2-1B models on these datasets and evaluate them against human-curated benchmarks. Our experiments reveal consistent patterns: (1) models trained on anticausal synthetic data suffer larger performance drops across all tasks and model families --- Accuracy declines range from 13.7%-59.1% for BERT and 4.9%-54.3% for LLaMA, and (2) distributional analysis shows that anticausal synthetic datasets deviate further from human data. Our findings provide practical guidance on how to generate better synthetic data and make good use of it.
Bohan Jiang, Pingchuan Ma 0012, Zhuoyu Shi, Fred Morstatter, Adrienne Raglin, Huan Liu 0001
WSDM4
2025 Simulating Hashtag Dynamics with Networked Groups of Generative Agents
Abha Jha, John Priniski, Carolyn Steinle, Fred Morstatter
ASONAM (1)4
2025 Precision Under Fire: Analysis and Predictive Modeling in Counter-Strike: Global Offensive
abstract
Esports analytics has gained traction in recent years, leveraging machine learning (ML) to predict in-game events and enhance strategic decision making. This study develops structured datasets from Counter-Strike: Global Offensive (CS: GO) competitive matches to address two predictive tasks: round result prediction and player death prediction. Using data from professional Dust 2 matches in 2022, we extract key playerand team-level features such as health, spatial positioning, and economy-related metrics. Various ML models, including Logistic Regression, Decision Trees, and XGBoost, are evaluated and benchmarked against random guessing and majority-class baselines. Results show that XGBoost consistently outperforms other models, effectively capturing gameplay dynamics and providing accurate predictions. These findings offer valuable insights for esports strategy optimization, coaching, real-time decision support, and applications in live-game analysis and betting. The dataset and methodology also establish a foundation for future esports research and predictive modeling across other game environments.
Xinyao Xia, Abel Salinas, Fred Morstatter
CoG3
2025 Effect-prompting shifts the narrative framing of networked interactions
John Priniski, Bryce Linford, Darren Cao, Fred Morstatter, P. Jeffrey Brantingham, Hongjing Lu
CogSci4
2025 UniPlane: Unified Plane Detection and Reconstruction from Posed Monocular Videos
abstract
We present UniPlane, a novel approach that unifies plane detection and reconstruction from posed monocular videos. Unlike existing methods that detect planes from local observations and associate them across the video for the final reconstruction, UniPlane unifies both the detection and the reconstruction tasks in a single network, which allows us to directly optimize final reconstruction quality and fully leverage temporal information. Specifically, we build a Transformers-based deep neural network that jointly constructs a 3D feature volume for the environment and estimates a set of per-plane embeddings as queries. UniPlane directly reconstructs the 3D planes by taking dot products between voxel embeddings and the plane embeddings followed by binary thresholding. Extensive experiments on real-world datasets demonstrate that UniPlane outperforms state-of-the-art methods in both plane detection and reconstruction tasks, achieving +4.6 in F-score in geometry as well as consistent improvements in other geometry and segmentation metrics.
Yuzhong Huang, Fred Morstatter
ICASSP2
2025 OrientDream: Streamlining Text-to-3D Generation with Explicit Orientation Control
abstract
In the evolving landscape of text-to-3D technology, Dreamfusion [9] optimizes implicit representations like NeRF using Score Distillation Sampling (SDS) but faces limitations in both fidelity and speed. Specifically, it faces the multi-head Janus issue and exhibits a relatively slow optimization process. We present OrientDream, a camera orientation conditioned framework for efficient, multi-view consistent 3D generation from text prompts. OrientDream achieves this by pre-training a 2D text-to-image diffusion module with camera orientation features and utilizing data from MVImgNet. To shorten training time, we introduced a decoupled back-propagation technique, allowing for multiple updates of implicit parameters per optimization cycle. Our experiments reveal that our method not only produces high-quality NeRF models with consistent multi-view properties but also achieves an optimization speed significantly greater than existing methods, as quantified by comparative metrics.
Yuzhong Huang, Fred Morstatter
ICASSP2
2025 Communication Patterns Predict Team Skill in Multiplayer Online Games
abstract
The present research on team collaboration is typically performed through qualitative interview based studies or social network measurements of connectedness through co-play. In this study, we take the unique approach to build networks from direct messages between players in the massive online game World of Tanks where players self-organize into clans with specific roles assigned from military rankings (from Private to Commander). We explore the relationship between team communication volume and skill level, the impact of communication features on clan rating, and the differences in communication hierarchy between high and low-rated clans. Our findings reveal that higher-rated clans send more pre-battle chat messages, suggesting that effective communication and strategic planning are key to team performance. Evidence shows teams who use voice chat during battle are significantly higher ranked. Finally, we reveal that the highest rated clans have more connected lower-ranked members emphasizing that these teams are ''only as strong as their weakest link.'' This research is guided by the Transactive Memory Systems and Collective Intelligence theories which serve to expand the contribution of this research outside of games to other forms of virtual collaboration.
Alexander J. Bisberg, Sonia Jawaid Shaikh, Yilei Zeng, Fred Morstatter, Emily Chen, Emilio Ferrara, Dmitri Williams
Proc. ACM Hum. Comput. Interact.4
2025 The Pulse of Mood Online: Unveiling Emotional Reactions in a Dynamic Social Media Landscape
abstract
The rich and dynamic information environment of social media provides researchers, policymakers, and entrepreneurs with opportunities to learn about social phenomena in a timely manner. However, using these data to understand social behavior is difficult due to the heterogeneity of topics and events discussed in the highly dynamic online information environment. To address these challenges, we present a method for systematically detecting and measuring emotional reactions to offline events using change point detection on the time series of collective affect and further explaining these reactions using a transformer-based topic model. We demonstrate the utility of the method by successfully detecting major and smaller events on three different datasets, including (1) a Los Angeles Tweet dataset between Jan. and Aug. 2020, in which we revealed the complex psychological impact of the BlackLivesMatter movement and the COVID-19 pandemic, (2) a dataset related to abortion rights discussions in the USA, in which we uncovered the strong emotional reactions to the overturn of Roe v. Wade and state abortion bans, and (3) a dataset about the 2022 French presidential election, in which we discovered the emotional and moral shift from positive before voting to fear and criticism after voting. We further demonstrate the importance of disaggregating data by topics and populations to mitigate potential biases when studying collective emotions. The capability of our method allows for better sensing and monitoring of the population’s reactions during crises using online data.
Siyi Guo, Ashwin Rao, Fred Morstatter, P. Jeffrey Brantingham, Kristina Lerman
ACM Trans. Web4
2024 Policy Learning for Localized Interventions from Observational Data
abstract
A largely unaddressed problem in causal inference is that of learning reliable policies in continuous, high-dimensional treatment variables from observational data. Especially in the presence of strong confounding, it can be infeasible to learn the entire heterogeneous response surface from treatment to outcome. It is also not particularly useful, when there are practical constraints on the size of the interventions altering the observational treatments. Since it tends to be easier to learn the outcome for treatments near existing observations, we propose a new framework for evaluating and optimizing the effect of small, tailored, and localized interventions that nudge the observed treatment assignments. Our doubly robust effect estimator plugs into a policy learner that stays within the interventional scope by optimal transport. Consequently, the error of the total policy effect is restricted to prediction errors nearby the observational distribution, rather than the whole response surface.
Myrl G. Marmarelis, Fred Morstatter, Aram Galstyan, Greg Ver Steeg
AISTATS2
2024 Non-binary Gender Expression in Online Interactions
Rebecca Dorn, Negar Mokhberian, Julie Jiang, Jeremy Abramson, Fred Morstatter, Kristina Lerman
ASONAM (2)5
2024 Online network topology shapes personal narratives and hashtag generation
John Priniski, Bryce Linford, Sai Krishna, Fred Morstatter, P. Jeffrey Brantingham, Hongjing Lu
CogSci4
2024 "Define Your Terms" : Enhancing Efficient Offensive Speech Classification with Definition
abstract
The propagation of offensive content through social media channels has garnered attention of the research community.Multiple works have proposed various semantically related yet subtle distinct categories of offensive speech.In this work, we explore meta-learning approaches to leverage the diversity of offensive speech corpora to enhance their reliable and efficient detection.We propose a joint embedding architecture that incorporates the input's label and definition for classification via Prototypical Network.Our model achieves at least 75% of the maximal F1-score while using less than 10% of the available training data across 4 datasets.Our experimental findings also provide a case study of training strategies valuable to combat resource scarcity.
Huy Nghiem, Umang Gupta, Fred Morstatter
EACL (1)3
2024 The Diffusion of Causal Language in Social Networks
abstract
Causal reasoning plays a central role in human cognition. It facilitates the ability to infer, predict, and manipulate outcomes within the environment, which in turn lays the foundation for a uniquely adaptive decision-making framework that is crucial in navigating complex problem-solving contexts. With the pervasive influence of social media platforms, these online social networks have become critical for disseminating information, shaping public beliefs, and influencing daily life. However, no study has examined the propagation of causal language within social networks. In this work, we analyze the dispersion of messages containing causal language against those without, within the milieu of a large online social network. With the entirety of messages over one complete day on Twitter along with two additional days for validation, and with our validated ensemble method for identifying causal language, our findings reveal that messages with causal language exhibit a more extensive reach than those without. Furthermore, our counterfactual analysis demonstrates that the effect of causal language on information diffusion is truly causal. Moreover, our findings indicate that messages incorporating causal language manifest a higher ability to spread to out-groups compared to those without. These novel insights reveal the unique diffusion pattern of causal language within social networks, and suggest a potential to mitigate the echo chamber effect, while causal language could serve as a bridge for diverse perspectives.
Zhuoyu Shi, Fred Morstatter
ICWSM2
2024 Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks
abstract
Negar Mokhberian, Myrl Marmarelis, Frederic Hopp, Valerio Basile, Fred Morstatter, Kristina Lerman. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.
Negar Mokhberian, Myrl G. Marmarelis, Frederic R. Hopp, Valerio Basile, Fred Morstatter, Kristina Lerman
NAACL-HLT5
2023 Measuring Online Emotional Reactions to Events
abstract
The rich and dynamic information environment of social media provides researchers, policy makers, and entrepreneurs with opportunities to learn about social phenomena in a timely manner. However, using this data to understand social behavior is difficult due heterogeneity of topics and events discussed in the highly dynamic online information environment. To address these challenges, we present a method for systematically detecting and measuring emotional reactions to offline events using change point detection on the time series of collective affect, and further explaining these reactions using a transformer-based topic model. We demonstrate the utility of the method on a corpus of tweets from a large US metropolitan area between January and August, 2020, covering a period of great social change. We demonstrate that our method is able to disaggregate topics to measure population's emotional and moral reactions. This capability allows for better monitoring of population's reactions during crises using online data.
Siyi Guo, Ashwin Rao, Eugene Jang, Yuanfeixue Nan, Fred Morstatter, P. Jeffrey Brantingham, Kristina Lerman
ASONAM6
2023 Retweets Amplify the Echo Chamber Effect
abstract
The growing prominence of social media in public discourse has led to a greater scrutiny of the quality of online information and the role it plays in amplifying political polarization. However, studies of polarization on social media platforms like Twitter have been hampered by the difficulty of collecting data about the social graph, specifically follow links that shape the echo chambers users join as well as what they see in their timelines. As a proxy of the follower graph, researchers use retweets, although it is not clear how this choice affects analysis. Using a sample of the Twitter follower graph and the tweets posted by users within it, we reconstruct the retweet graph and quantify its impact on the measures of echo chambers and exposure. While we find that echo chambers exist in both graphs, they are more pronounced in the retweet graph. We compare the information users see via their follower and retweet networks to show that retweeted accounts share systematically more polarized content. This bias cannot be explained by the activity or polarization within users' own follower graph neighborhoods but by the increased attention they pay to accounts that are ideologically aligned with their own views. Our results suggest that studies relying on the retweet graphs overestimate the echo chamber effects and exposure to polarized information.
Ashwin Rao, Fred Morstatter, Kristina Lerman
ASONAM2
2023 Pandemic Culture Wars: Partisan Differences in the Moral Language of COVID-19 Discussions
abstract
Effective response to pandemics requires coordinated adoption of mitigation measures, like masking and quarantines, to curb a virus’s spread. However, as the COVID-19 pandemic demonstrated, political divisions can hinder consensus on the appropriate response. To better understand these divisions, our study examines a vast collection of COVID-19-related tweets. We focus on five contentious issues: coronavirus origins, lockdowns, masking, education, and vaccines. We describe a weakly supervised method to identify issue-relevant tweets and employ state-of-the-art computational methods to analyze moral language and infer political ideology. We explore how partisanship and moral language shape conversations about these issues. Our findings reveal ideological differences in issue salience and moral language used by different groups. We find that conservatives use more negatively-valenced moral language than liberals and that political elites use moral rhetoric to a greater extent than non-elites across most issues. Examining the evolution and moralization on divisive issues can provide valuable insights into the dynamics of COVID-19 discussions and assist policymakers in better understanding the emergence of ideological divisions.
Ashwin Rao, Siyi Guo, Sze-Yuh Nina Wang, Fred Morstatter, Kristina Lerman
IEEE Big Data4
2023 AutoTriggER: Label-Efficient and Robust Named Entity Recognition with Auxiliary Trigger Extraction
abstract
Dong-Ho Lee, Ravi Kiran Selvam, Sheikh Muhammad Sarwar, Bill Yuchen Lin, Fred Morstatter, Jay Pujara, Elizabeth Boschee, James Allan, Xiang Ren. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. 2023.
Ravi Kiran Selvam, Sheikh Muhammad Sarwar, Bill Y. Lin, Fred Morstatter, Jay Pujara, Elizabeth Boschee, James Allan 0001, Xiang Ren 0001
EACL5
2023 Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning
abstract
Temporal knowledge graph (TKG) forecasting benchmarks challenge models to predict future facts using knowledge of past facts.In this paper, we develop an approach to use in-context learning (ICL) with large language models (LLMs) for TKG forecasting.Our extensive evaluation compares diverse baselines, including both simple heuristics and state-of-the-art (SOTA) supervised models, against pre-trained LLMs across several popular benchmarks and experimental settings.We observe that naive LLMs perform on par with SOTA models, which employ carefully designed architectures and supervised training for the forecasting task, falling within the (-3.6%, +1.5%) Hits@1 margin relative to the median performance.To better understand the strengths of LLMs for forecasting, we explore different approaches for selecting historical facts, constructing prompts, controlling information propagation, and parsing outputs into a probability distribution.A surprising finding from our experiments is that LLM performance endures (±0.4% Hit@1) even when semantic information is removed by mapping entities/relations to arbitrary numbers, suggesting that prior semantic knowledge is unnecessary; rather, LLMs can leverage the symbolic patterns in the context to achieve such a strong performance.Our analysis also reveals that ICL enables LLMs to learn irregular patterns from the historical context, going beyond frequency and recency biases 1 .
Kian Ahrabian, Woojeong Jin 0001, Fred Morstatter, Jay Pujara
EMNLP4
2023 Just Another Day on Twitter: A Complete 24 Hours of Twitter Data
abstract
At the end of October 2022, Elon Musk concluded his acquisition of Twitter. In the weeks and months before that, several questions were publicly discussed that were not only of interest to the platform's future buyers, but also of high relevance to the Computational Social Science research community. For example, how many active users does the platform have? What percentage of accounts on the site are bots? And, what are the dominating topics and sub-topical spheres on the platform? In a globally coordinated effort of 80 scholars to shed light on these questions, and to offer a dataset that will equip other researchers to do the same, we have collected all 375 million tweets published within a 24-hour time period starting on September 21, 2022. To the best of our knowledge, this is the first complete 24-hour Twitter dataset that is available for the research community. With it, the present work aims to accomplish two goals. First, we seek to answer the aforementioned questions and provide descriptive metrics about Twitter that can serve as references for other researchers. Second, we create a baseline dataset for future research that can be used to study the potential impact of the platform's ownership change.
Jürgen Pfeffer, Daniel Matter, Kokil Jaidka, Onur Varol, Afra J. Mashhadi, Jana Lasser, Dennis Assenmacher, Diyi Yang, Cornelia Brantner, Daniel M. Romero, Jahna Otterbacher, Carsten Schwemmer, Kenneth Joseph, David García 0001, Fred Morstatter
ICWSM16
2022 Noise Audits Improve Moral Foundation Classification
abstract
Morality plays an important role in culture, identity, and emotion. Recent advances in natural language processing have shown that it is possible to classify moral values expressed in text at scale. Morality classification relies on human annotators to label the moral expressions in text, which provides training data to achieve state-of-the-art performance. However, these annotations are inherently subjective and some of the instances are hard to classify, resulting in noisy annotations due to error or lack of agreement. The presence of noise in training data harms the classifier's ability to accurately recognize moral foundations from text. We propose two metrics to audit the noise of annotations. The first metric is entropy of instance labels, which is a proxy measure of annotator disagreement about how the instance should be labeled. The second metric is the silhouette coefficient of a label assigned by an annotator to an instance. This metric leverages the idea that instances with the same label should have similar latent representations, and deviations from collective judgments are indicative of errors. Our experiments on three widely used moral foundations datasets show that removing noisy annotations based on the proposed metrics improves classification performance.11Our code can be found at: https://github.com/negar-mokhberian/noise-audits.
Negar Mokhberian, Frederic R. Hopp, Bahareh Harandizadeh, Fred Morstatter, Kristina Lerman
ASONAM4
2022 Samba: Identifying Inappropriate Videos for Young Children on YouTube
abstract
YouTube videos are one of the most effective platforms for disseminating creative material and ideas, and they appeal to a diverse audience. Along with adults and older children, young children are avid consumers of YouTube materials. Children often lack means to evaluate if a given content is appropriate for their age, and parents have very limited options to enforce content restrictions on YouTube. Young children can thus become exposed to inappropriate content, such as violent, scary or disturbing videos on YouTube. Previous studies demonstrated that YouTube videos can be classified into appropriate or inappropriate for young viewers using video metadata, such as video thumbnails, title, comments, etc. Metadata-based approaches achieve high accuracy, but still have significant misclassifications, due to the reliability of input features. In this paper, we propose a fusion model, called Samba, which uses both metadata and video subtitles for content classification. Using subtitles in the model helps better infer the true nature of a video improving classification accuracy. On a large-scale, comprehensive dataset of 70K videos, we show that Samba achieves 95% accuracy, outperforming other state-of-the-art classifiers by at least 7%. We also publicly release our dataset.
Le Binh, Rajat Tandon, Chingis Oinar, Jeffrey Liu, Uma Durairaj, Jiani Guo, Spencer Zahabizadeh, Sanjana Ilango, Jeremy Tang, Fred Morstatter, Simon S. Woo, Jelena Mirkovic
CIKM10
2022 Robust Conversational Agents against Imperceptible Toxicity Triggers
abstract
Ninareh Mehrabi, Ahmad Beirami, Fred Morstatter, Aram Galstyan. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.
Ninareh Mehrabi, Ahmad Beirami, Fred Morstatter, Aram Galstyan
NAACL-HLT3
2022 Assessing Scientific Research Papers with Knowledge Graphs
abstract
In recent decades, the growing scale of scientific research has led to numerous novel findings. Reproducing these findings is the foundation of future research. However, due to the complexity of experiments, manually assessing scientific research is laborious and time-intensive, especially in social and behavioral sciences. Although increasing reproducibility studies have garnered increased attention in the research community, there is still a lack of systematic ways for evaluating scientific research at scale. In this paper, we propose a novel approach towards automatically assessing scientific publications by constructing a knowledge graph (KG) that captures a holistic view of the research contributions. Specifically, during the KG construction, we combine information from two different perspectives: micro-level features that capture knowledge from published articles such as sample sizes, effect sizes, and experimental models, and macro-level features that comprise relationships between entities such as authorship and reference information. We then learn low-dimensional representations using language models and knowledge graph embeddings for entities (nodes in KGs), which are further used for the assessments. A comprehensive set of experiments on two benchmark datasets shows the usefulness of leveraging KGs for scoring scientific research.
Kexuan Sun 0002, Zhiqiang Qiu, Abel Salinas, Yuzhong Huang, Daniel Benjamin, Fred Morstatter, Xiang Ren 0001, Kristina Lerman, Jay Pujara
SIGIR7
2022 Keyword Assisted Embedded Topic Model
abstract
By illuminating latent structures in a corpus of text, topic models are an essential tool for categorizing, summarizing, and exploring large collections of documents. Probabilistic topic models, such as latent Dirichlet allocation (LDA), describe how words in documents are generated via a set of latent distributions called topics. Recently, the Embedded Topic Model (ETM) has extended LDA to utilize the semantic information in word embeddings to derive semantically richer topics. As LDA and its extensions are unsupervised models, they aren't defined to make efficient use of a user's prior knowledge of the domain. To this end, we propose the Keyword Assisted Embedded Topic Model (KeyETM), which equips ETM with the ability to incorporate user knowledge in the form of informative topic-level priors over the vocabulary. Using both quantitative metrics and human responses on a topic intrusion task, we demonstrate that KeyETM produces better topics than other guided, generative models in the literature\footnoteCode for this work can be found at \urlhttps://github.com/bahareharandizade/KeyETM .
Bahareh Harandizadeh, John Priniski, Fred Morstatter
WSDM3
2022 Social Bots and Their Coordination During Online Campaigns: A Survey
abstract
Online social networks (OSNs) are a major component of societal digitalization. OSNs alter how people communicate, make decisions, and form or change their beliefs, attitudes, and behaviors. Thus, they can now impact social groups, financial systems, and political communication at scale. As one type of OSN, social media platforms, such as Facebook, Twitter, and YouTube, serve as outlets for users to convey information to an audience as broad or targeted as the user desires. Over the years, these social media platforms have been infected with automated accounts, or bots, that are capable of hijacking conversations, influencing other users, and manipulating content dissemination. Although benign bots exist to facilitate legitimate activities, we focus on bots designed to perform malicious acts through social media platforms. Bots that mimic the social behaviors of humans are referred to as social bots. Social bots help automate sociotechnical behaviors, such as “liking” tweets, tweeting/retweeting a message, following users, and coordinating with or even competing against other bots. Some advanced social bots exhibit highly sophisticated traits of coordination and communication with complex organizational structures. This article presents a detailed survey of social bots, their types and behaviors, and how they impact social media, identification algorithms, and their coordination strategies in OSNs. The survey also discusses coordination in areas such as biological systems, interorganizational networks, and coordination games. Existing research extensively studied bot detection, but bot coordination is still emerging and requires more in-depth analysis. The survey covers existing techniques and open research issues on the analysis of social bots, their behaviors, and how social network theories can be leveraged to assess coordination during online campaigns.
Tuja Khaund, Baris Kirdemir, Nitin Agarwal 0001, Huan Liu 0001, Fred Morstatter
IEEE Trans. Comput. Soc. Syst.5
2021 Exacerbating Algorithmic Bias through Fairness Attacks
abstract
Algorithmic fairness has attracted significant attention in recent years, with many quantitative measures suggested for characterizing the fairness of different machine learning algorithms. Despite this interest, the robustness of those fairness measures with respect to an intentional adversarial attack has not been properly addressed. Indeed, most adversarial machine learning has focused on the impact of malicious attacks on the accuracy of the system, without any regard to the system's fairness. We propose new types of data poisoning attacks where an adversary intentionally targets the fairness of a system. Specifically, we propose two families of attacks that target fairness measures. In the anchoring attack, we skew the decision boundary by placing poisoned points near specific target points to bias the outcome. In the influence attack on fairness, we aim to maximize the covariance between the sensitive attributes and the decision outcome and affect the fairness of the model. We conduct extensive experiments that indicate the effectiveness of our proposed attacks.
Ninareh Mehrabi, Fred Morstatter, Aram Galstyan
AAAI3
2021 ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data
abstract
Woojeong Jin, Rahul Khanna, Suji Kim, Dong-Ho Lee, Fred Morstatter, Aram Galstyan, Xiang Ren. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Woojeong Jin 0001, Rahul Khanna, Fred Morstatter, Aram Galstyan, Xiang Ren 0001
ACL/IJCNLP (1)5
2021 Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources
abstract
Warning: this paper contains content that may be offensive or upsetting.Commonsense knowledge bases (CSKB) are increasingly used for various natural language processing tasks.Since CSKBs are mostly human-generated and may reflect societal biases, it is important to ensure that such biases are not conflated with the notion of commonsense.Here we focus on two widely used CSKBs, ConceptNet and GenericsKB, and establish the presence of bias in the form of two types of representational harms, overgeneralization of polarized perceptions and representation disparity across different demographic groups in both CSKBs.Next, we find similar representational harms for downstream models that use ConceptNet.Finally, we propose a filtering-based approach for mitigating such harms, and observe that our filtered-based approach can reduce the issues in both resources and models but leads to a performance drop, leaving room for future work to build fairer and stronger commonsense models.
Ninareh Mehrabi, Fred Morstatter, Jay Pujara, Xiang Ren 0001, Aram Galstyan
EMNLP (1)3
2021 Analyzing Race and Citizenship Bias in Wikidata
abstract
Since there are limited full-time contributors to Wikidata, the current information might have a bias. In this paper, we examine the race and citizenship bias in general and in regards to STEM representation for scientists, software developers, and engineers. By comparing Wikidata queries to real-world datasets, we discovered that there is an overrepresentation of white individuals and those with citizenship in Europe and North America; the rest are generally underrepresented. We plan to create and implement a bot using a table-linking software to take missing information from the external datasets and insert it into Wikidata to increase minority race representation.
Zaina Shaik, Filip Ilievski, Fred Morstatter
MASS3
2021 Detecting cryptocurrency pump-and-dump frauds using market and social signals
Huy Nghiem, Goran Muric, Fred Morstatter, Emilio Ferrara
Expert Syst. Appl.3
2021 I'll Play on My Other Account: The Network and Behavioral Differences of Sybils
abstract
This article studies the effects and implications of sybils (secondary accounts created by a person in an online platform) through the game World of Tanks from interdisciplinary, mixed-methods perspectives. Considering sybils allows us to access a "person based'' network, instead of an "account based" network, revealing formerly undetected patterns. We move on to behavioral differences between the "parent" (the initial account) and "child" (those created afterwards) accounts in a sybil relationship. We explore the behavioral patterns of sybils using network, chat, and gameplay data. We find that sybils represent players experimenting with new roles or features without damaging their play record. We find that there are significant behavioral differences between different sybil accounts, and we leverage them to build a machine learning classifier to differentiate sybils. This classifier is able to identify sybil accounts with over 95% accuracy for sybil/non-sybil, 61% for parent/child. This study demonstrates the underexplored but rich potential for sybils to improve research and industry practitioners' understandings of user practices and experiences.
Fred Morstatter, Do Own (Donna) Kim, Natalie Jonckheere, Calvin Liu, Malika Seth, Dmitri Williams
Proc. ACM Hum. Comput. Interact.1
2021 Identifying and Analyzing Cryptocurrency Manipulations in Social Media
abstract
Interest surrounding cryptocurrencies, digital or virtual currencies that are used as a medium for financial transactions, has grown tremendously in the recent years. The anonymity surrounding these currencies makes investors particularly susceptible to fraudity-such as “pump and dump” scams-where the goal is to artificially inflate the perceived worth of a currency, luring victims into investing before the fraudsters can sell their holdings. Because of the speed and relative anonymity offered by social platforms such as Twitter and Telegram, social media has become a preferred platform for scammers who wish to spread false hype about the cryptocurrency they are trying to pump. In this work, we propose and evaluate a computational approach that can automatically identify pump and dump scams as they unfold by combining information across social media platforms. We also develop a multi-modal approach for predicting whether a particular pump attempt will succeed or not. Finally, we analyze the prevalence of bots in cryptocurrency related tweets, and observe a significant increase in bot activity during the pump attempts.
Mehrnoosh Mirtaheri, Sami Abu-El-Haija, Fred Morstatter, Greg Ver Steeg, Aram Galstyan
IEEE Trans. Comput. Soc. Syst.3
2020 Aggressive, Repetitive, Intentional, Visible, and Imbalanced: Refining Representations for Cyberbullying Classification
Caleb Ziems, Ymir Vigfusson, Fred Morstatter
ICWSM3
2019 Debiasing community detection: the importance of lowly connected nodes
abstract
Community detection is an important task in social network analysis, allowing us to identify and understand the communities within the social structures provided by the network. However, many community detection approaches either fail to assign low-degree (or lowly connected) users to communities, or assign them to trivially small communities that prevent them from being included in analysis. In this work we investigate how excluding these users can bias analysis results. We then introduce an approach that is more inclusive for lowly connected users by incorporating them into larger groups. Experiments show that our approach outperforms the existing state-of-the-art in terms of F1 and Jaccard similarity scores while reducing the bias towards low-degree users.
Ninareh Mehrabi, Fred Morstatter, Nanyun Peng 0001, Aram Galstyan
ASONAM2
2019 A Large-Scale Study of ISIS Social Media Strategy: Community Size, Collective Influence, and Behavioral Impact
Majid Alfifi, Parisa Kaghazgaran, James Caverlee, Fred Morstatter
ICWSM4
2019 SAGE: A Hybrid Geopolitical Event Forecasting System
abstract
Forecasting of geopolitical events is a notoriously difficult task, with experts failing to significantly outperform a random baseline across many types of forecasting events. One successful way to increase the performance of forecasting tasks is to turn to crowdsourcing: leveraging many forecasts from non-expert users. Simultaneously, advances in machine learning have led to models that can produce reasonable, although not perfect, forecasts for many tasks. Recent efforts have shown that forecasts can be further improved by ``hybridizing'' human forecasters: pairing them with the machine models in an effort to combine the unique advantages of both. In this demonstration, we present Synergistic Anticipation of Geopolitical Events (SAGE), a platform for human/computer interaction that facilitates human reasoning with machine models.
Fred Morstatter, Aram Galstyan, Gleb Satyukov, Daniel Benjamin, Andrés Abeliuk, Mehrnoosh Mirtaheri, K. S. M. Tozammel Hossain, Pedro A. Szekely, Emilio Ferrara, Akira Matsui, Mark Steyvers, Stephen Bennett, David V. Budescu, Mark Himmelstein, Michael D. Ward, Andreas Beger, Michele Catasta, Rok Sosic, Jure Leskovec, Pavel Atanasov, Regina Joseph, Rajiv Sethi, Ali E. Abbas
IJCAI1
2018 Toward Relational Learning with Misinformation
abstract
Relational learning has been proposed to cope with the interdependency among linked instances in a network, and it is a fundamental tool to categorize social network users for various tasks. However, the emerging widespread of misinformation in social networks, information that is inaccurate or false, poses novel challenges to utilizing social media data. Malicious users may actively manipulate their content and characteristics, which easily lead to a noisy dataset. Hence, it is intricate for traditional relational learning approaches to deliver an accurate predictive model in the presence of misinformation. In this work, we precisely focus on the problem by proposing a joint framework that simultaneously constructs a relational learning model and mitigates the effect of misinformation by restraining anomalous points. Empirical results on real-world social media data prove the superiority of the proposed approach, Relational Learning with Misinformation (RLM), over traditional approaches on modeling social network users.
Liang Wu 0006, Jundong Li, Fred Morstatter, Huan Liu 0001
SDM3
2017 Adaptive Spammer Detection with Sparse Group Modeling
Liang Wu 0006, Xia Ben Hu, Fred Morstatter, Huan Liu 0001
ICWSM3
2017 Detecting Camouflaged Content Polluters
Liang Wu 0006, Xia Ben Hu, Fred Morstatter, Huan Liu 0001
ICWSM3
2017 In Search of Coherence and Consensus: Measuring the Interpretability of Statistical Topics
Fred Morstatter, Huan Liu 0001
J. Mach. Learn. Res.1
2016 Predicting Online Protest Participation of Social Media Users
abstract
Social media has emerged to be a popular platform for people to express their viewpoints on political protests like the Arab Spring. Millions of people use social media to communicate and mobilize their viewpoints on protests. Hence, it is a valuable tool for organizing social movements. However, the mechanisms by which protest affects the population is not known, making it difficult to estimate the number of protestors. In this paper, we are inspired by sociological theories of protest participation and propose a framework to predict from the user's past status messages and interactions whether the next post of the user will be a declaration of protest. Drawing concepts from these theories, we model the interplay between the user's status messages and messages interacting with him over time and predict whether the next post of the user will be a declaration of protest. We evaluate the framework using data from the social media platform Twitter on protests during the recent Nigerian elections and demonstrate that it can effectively predict whether the next post of a user is a declaration of protest.
Suhas Ranganath, Fred Morstatter, Xia Ben Hu, Jiliang Tang, Suhang Wang, Huan Liu 0001
AAAI2
2016 Detecting and mitigating bias in social media
abstract
Social media is an important data source. Every day, billions of posts, likes, and connections are created by people around the globe. By monitoring it we can observe important topics, as well as find new topics of discussion as they emerge. However, within this source of information there are natural forms of bias. Different aspects of the sites lend themselves to bias, such as varying features that restrict users. Additionally, the users themselves can be biased, such as the age-bias found in Twitter users. Finally, the way sites divulge their data can cause bias to those studying information produced on that site. In this forum we will discuss the different types of bias that can occur on social media data as well as different strategies to mitigate that bias.
Fred Morstatter
ASONAM1
2016 A new approach to bot detection: Striking the balance between precision and recall
abstract
The presence of bots has been felt in many aspects of social media. Twitter, one example of social media, has especially felt the impact, with bots accounting for a large portion of its users. These bots have been used for malicious tasks such as spreading false information about political candidates and inflating the perceived popularity of celebrities. Furthermore, these bots can change the results of common analyses performed on social media. It is important that researchers and practitioners have tools in their arsenal to remove them. Approaches exist to remove bots, however they focus on precision to evaluate their model at the cost of recall. This means that while these approaches are almost always correct in the bots they delete, they ultimately delete very few, thus many bots remain. We propose a model which increases the recall in detecting bots, allowing a researcher to delete more bots. We evaluate our model on two real-world social media datasets and show that our detection algorithm removes more bots from a dataset than current approaches.
Fred Morstatter, Liang Wu 0006, Tahora H. Nazer, Kathleen M. Carley, Huan Liu 0001
ASONAM1
2016 Finding requests in social media for disaster relief
abstract
Natural disasters create an uncertain environment in which first responders face the challenge of locating affected people and dispatching aids and resources in a timely manner. In recent years, crowdsourcing systems have been developed to exploit the power of volunteers to facilitate humanitarian logistic efforts. Most of the current systems require volunteers to directly provide input to them and do not have the capability to benefit the large number of disaster-related posts that are published on social media. Hence, many social media posts in the aftermath of disasters remain hidden. Among these hidden posts are those that need immediate attention, such as requests for help. Hence, we have implemented a system that detects requests on Twitter using content and context of tweets.
Tahora H. Nazer, Fred Morstatter, Harsh Dani, Huan Liu 0001
ASONAM2
2016 Leveraging the Implicit Structure within Social Media for Emergent Rumor Detection
abstract
The automatic and early detection of rumors is of paramount importance as the spread of information with questionable veracity can have devastating consequences. This became starkly apparent when, in early 2013, a compromised Associated Press account issued a tweet claiming that there had been an explosion at the White House. This tweet resulted in a significant drop for the Dow Jones Industrial Average. Most existing work in rumor detection leverages conversation statistics and propagation patterns, however, such patterns tend to emerge slowly requiring a conversation to have a significant number of interactions in order to become eligible for classification. In this work, we propose a method for classifying conversations within their formative stages as well as improving accuracy within mature conversations through the discovery of implicit linkages between conversation fragments. In our experiments, we show that current state-of-the-art rumor classification methods can leverage implicit links to significantly improve the ability to properly classify emergent conversations when very little conversation data is available. Adopting this technique allows rumor detection methods to continue to provide a high degree of classification accuracy on emergent conversations with as few as a single tweet. This improvement virtually eliminates the delay of conversation growth inherent in current rumor classification methods while significantly increasing the number of conversations considered viable for classification.
Justin Sampson, Fred Morstatter, Liang Wu 0006, Huan Liu 0001
CIKM2
2016 Paired Restricted Boltzmann Machine for Linked Data
abstract
Restricted Boltzmann Machines (RBMs) are widely adopted unsupervised representation learning methods and have powered many data mining tasks such as collaborative filtering and document representation. Recently, linked data that contains both attribute and link information has become ubiquitous in various domains. For example, social media data is inherently linked via social relations and web data is networked via hyperlinks. It is evident from recent work that link information can enhance a number of real-world applications such as clustering and recommendations. Therefore, link information has the potential to advance RBMs for better representation learning. However, the majority of existing RBMs have been designed for independent and identically distributed data and are unequipped for linked data. In this paper, we aim to design a new type of Restricted Boltzmann Machines that takes advantage of linked data. In particular, we propose a paired Restricted Boltzmann Machine (pRBM), which is able to leverage the attribute and link information of linked data for representation learning. Experimental results on real-world datasets demonstrate the effectiveness of the proposed framework pRBM.
Suhang Wang, Jiliang Tang, Fred Morstatter, Huan Liu 0001
CIKM3
2013 Near real time assessment of social media using geo-temporal network analytics
abstract
When a crisis occurs, there is often little time to evaluate the situation and determine how best to respond. We use rapid ethnographic methods centered on the construction of geo-temporally contextualized social and knowledge networks. By utilizing a combination of Twitter and news media, the consulate attack in Libya were examined in near real time. In this work we outline a procedure to extract key insights from the event as an event unfolds using a suite of tools developed by a team of researchers from two universities.
Kathleen M. Carley, Jürgen Pfeffer, Huan Liu 0001, Fred Morstatter, Rebecca Goolsby
ASONAM4
2013 Is the Sample Good Enough? Comparing Data from Twitter's Streaming API with Twitter's Firehose
Fred Morstatter, Jürgen Pfeffer, Huan Liu 0001, Kathleen M. Carley
ICWSM1
2013 Understanding Twitter data with TweetXplorer
abstract
In the era of big data it is increasingly difficult for an analyst to extract meaningful knowledge from a sea of information. We present TweetXplorer, a system for analysts with little information about an event to gain knowledge through the use of effective visualization techniques. Using tweets collected during Hurricane Sandy as an example, we will lead the reader through a workflow that exhibits the functionality of the system.
Fred Morstatter, Shamanth Kumar, Huan Liu 0001, Ross Maciejewski
KDD1
2012 Navigating information facets on twitter (NIF-T)
abstract
Recent years have seen an exponential increase in the number of users of social media sites. As the number of users of these sites continues to grow at an extraordinary rate, the amount of data produced follows in magnitude. With this deluge of social media data, the need for comprehensive tools to analyze user interactions is ever increasing. In this paper, we present a novel tool, Navigating Information Facets on Twitter (NIF-T), which helps users to explore data generated on social media sites. Using the three dimensions or facets: time, location, and topic as an example of the many possible facets, we enable the users to explore large social media datasets. With the help of a large corpus of tweets collected from the Occupy Wall Street movement on the Twitter platform we show how our system can be used to identify important aspects of the event along these facets.
Shamanth Kumar, Fred Morstatter, Grant Marshall, Huan Liu 0001, Ullas Nambiar
KDD2
2011 Feature Selection Strategy in Text Classification
Gabriel Pui Cheong Fung, Fred Morstatter, Huan Liu 0001
PAKDD (1)2