Ping Liu 0002

dblp:34/188-2 · DBLP profile ↗
← Back
10ranked-venue papers in the field
6as first author
9since 2021 · last 2026
0000-0002-0866-8801ORCID · conflict

Domains — venue-derived; a paper can count in several

Information Retrieval & Web Search · 7 (4 first)Data Mining & Knowledge Discovery · 3 (2 first)
YearPublicationVenuePosition
2026 Policy-Grounded Dynamic Facet Suggestions for Job Search
abstract
Job seekers often initiate search with short, underspecified queries. At LinkedIn, over 80% of job-related queries contain three or fewer keywords, making accurate user intent inference and relevant job retrieval particularly challenging. We present dynamic facet suggestion (DFS), an interactive query-refinement mechanism that facilitates intent disambiguation by surfacing personalized semantic attributes conditioned on the joint user-query context in real time. We propose a policy-grounded, retrieval-augmented ranking framework for facet suggestion, comprising offline taxonomy curation, embedding-based retrieval of top-K candidates, and a distilled small language model (SLM) based candidate scoring. The system is optimized for real-time serving via point-wise single-token scoring and batching/prefix caching. Offline evaluation demonstrates high precision for generated suggestions, and online A/B tests show significant lifts in suggestion engagement and job search outcomes.
Baofen Zheng, Qianqi Shen, Jianqiang Shen, Wenqiong Liu, Chunnan Yao, Ping Liu 0002, Rajat Arora 0002, Kevin Kao, Hsiang Lin, Wanjun Jiang, Yusuke Takebuchi, Jingwei Wu
SIGIR7
2025 Powering Job Search at Scale: LLM-Enhanced Query Understanding in Job Matching Systems
abstract
Query understanding is essential in modern relevance systems, where user queries are often short, ambiguous, and highly context-dependent. Traditional approaches often rely on multiple task-specific Named Entity Recognition models to extract structured facets as seen in job search applications. However, this fragmented architecture is brittle, expensive to maintain, and slow to adapt to evolving taxonomies and language patterns. In this paper, we introduce a unified query understanding framework powered by a Large Language Model (LLM), designed to address these limitations. Our approach jointly models the user query and contextual signals such as profile attributes to generate structured interpretations that drive more accurate and personalized recommendations. The framework improves relevance quality in online A/B testing while significantly reducing system complexity and operational overhead. The results demonstrate that our solution provides a scalable and adaptable foundation for query understanding in dynamic web applications.
Ping Liu 0002, Jianqiang Shen, Qianqi Shen, Chunnan Yao, Kevin Kao, Rajat Arora 0002, Baofen Zheng, Caleb Johnson, Liangjie Hong, Jingwei Wu
CIKM1
2025 A Scalable and Efficient Signal Integration System for Job Matching
abstract
LinkedIn, one of the world's largest platforms for professional networking and job seeking, encounters various modeling challenges in building recommendation systems for its job matching product, including cold-start, filter bubbles, and biases affecting candidate-job matching. To address these, we developed the STAR (Signal integration for Talent And Recruiters) system, leveraging the combined strengths of Large Language Models (LLMs) and Graph Neural Networks (GNNs). LLMs excel at understanding textual data, such as member profiles and job postings, while GNNs capture intricate relationships and mitigate cold-start issues through network effects. STAR integrates diverse signals by uniting LLM and GNN capabilities with industrial-scale paradigms including adaptive sampling and version management. It provides an end-to-end solution for developing and deploying embeddings in large-scale recommender systems. Our key contributions include a robust methodology for building embeddings in industrial applications, a scalable GNN-LLM integration for high-performing recommendations, and practical insights for real-world model deployment.
Ping Liu 0002, Rajat Arora 0002, Benjamin Le, Qianqi Shen, Jianqiang Shen, Chengming Jiang 0001, Nikita Zhiltsov, Priya Bannur, Yidan Zhu, Liming Dong 0005, Haichao Wei, Luke Simon, Liangjie Hong
KDD (2)1
2025 LinkSAGE: Optimizing Job Matching Using Graph Neural Networks
abstract
We present LinkSAGE, an innovative framework that integrates Graph Neural Networks (GNNs) into large-scale personalized job matching systems, designed to address the complex dynamics of LinkedIn's extensive professional network. Our approach capitalizes on a novel job marketplace graph, the largest and most intricate of its kind in industry, with billions of nodes and edges. This graph is not merely extensive but also richly detailed, encompassing member and job nodes along with key attributes, thus creating an expansive and interwoven network. A key innovation in LinkSAGE is its training and serving methodology, which effectively combines inductive graph learning on a heterogeneous, evolving graph with an encoder-decoder GNN model. This methodology decouples the training of the GNN model from that of existing Deep Neural Network (DNN) models, eliminating the need for frequent GNN retraining while maintaining up-to-date graph signals in near real-time, allowing for the effective integration of GNN insights through transfer learning. The subsequent nearline inference system serves the GNN encoder within a real-world setting, significantly reducing online latency and obviating the need for costly real-time GNN infrastructure. Validated across multiple online A/B tests in diverse product scenarios, LinkSAGE demonstrates marked improvements in member engagement, relevance matching, and member retention, confirming its generalizability and practical impact.
Ping Liu 0002, Haichao Wei, Xiaochen Hou, Jianqiang Shen, Shihai He, Qianqi Shen, Zhujun Chen, Fedor Borisyuk, Daniel Hewlett, Liang Wu 0006, Srikant Veeraraghavan, Alex Tsun, Chengming Jiang 0001
KDD (1)1
2024 Learning Links for Adaptable and Explainable Retrieval
abstract
Web-scale search systems typically tackle the scalability challenge with a two-step paradigm: retrieval and ranking. The retrieval step, also known as candidate selection, often involves extracting entities, creating an inverted index, and performing term matching for retrieval. Such traditional methods require manual and time-consuming development of retrieval models. In this paper, we propose a framework for constructing a graph that integrates human knowledge with user activity data analysis. The learned links are utilized for retrieval purposes. The model is easy to explain, debug, and tune. The system implementation is straightforward and can directly leverage existing inverted index systems. We applied this retrieval framework to enhance the job search and recommendation systems on a large professional networking portal, resulting in significant performance improvements.
Jianqiang Shen, Yuchin Juan, Ping Liu 0002, Wen Pu, Qianqi Shen, Liangjie Hong
CIKM3
2024 How Does Empowering Users with Greater System Control Affect News Filter Bubbles?
abstract
While recommendation systems enable users to find articles of interest, they can also create "filter bubbles" by presenting content that reinforces users' pre-existing beliefs. Users are often unaware that the system placed them in a filter bubble and, even when aware, they often lack direct control over it. To address these issues, we first design a political news recommendation system augmented with an enhanced interface that exposes the political and topical interests the system inferred from user behavior. This allows the user to adjust the recommendation system to receive more articles on a particular topic or presenting a particular political stance. We then conduct a user study to compare our system to a traditional interface and found that the transparent approach helped users realize that they were in a filter bubble. Additionally, the enhanced system led to less extreme news for most users but also allowed others to move the system to more extremes. Similarly, while many users moved the system from extreme liberal/conservative to the center, this came at the expense of reducing political diversity of the articles shown. These findings suggest that, while the proposed system increased awareness of the filter bubbles, it had heterogeneous effects on news consumption depending on user preferences.
Ping Liu 0002, Karthik Shivaram, Aron Culotta, Matthew A. Shapiro, Mustafa Bilgic 0001
ICWSM1
2024 LiGNN: Graph Neural Networks at LinkedIn
abstract
In this paper, we present LiGNN, a deployed large-scale Graph Neural Networks (GNNs) Framework. We share our insight on developing and deployment of GNNs at large scale at LinkedIn. We present a set of algorithmic improvements to the quality of GNN representation learning including temporal graph architectures with long term losses, effective cold start solutions via graph densification, ID embeddings and multi-hop neighbor sampling. We explain how we built and sped up by 7x our large-scale training on LinkedIn graphs with adaptive sampling of neighbors, grouping and slicing of training data batches, specialized shared-memory queue and local gradient optimization. We summarize our deployment lessons and learnings gathered from A/B test experiments. The techniques presented in this work have contributed to an approximate relative improvements of 1% of Job application hearing back rate, 2% Ads CTR lift, 0.5% of Feed engaged daily active users, 0.2% session lift and 0.1% weekly active user lift from people recommendation. We believe that this work can provide practical solutions and insights for engineers who are interested in applying Graph neural networks at large scale.
Fedor Borisyuk, Shihai He, Yunbo Ouyang, Morteza Ramezani, Peng Du 0004, Xiaochen Hou, Chengming Jiang 0001, Nitin Pasumarthy, Priya Bannur, Birjodh Singh Tiwana, Ping Liu 0002, Siddharth Dangi, Daqi Sun, Zhoutao Pei, Sirou Zhu, Qianqi Shen, Kuang-Hsuan Lee, David Stein 0002, Baolei Li, Haichao Wei, Amol Ghoting
KDD11
2022 Reducing Cross-Topic Political Homogenization in Content-Based News Recommendation
abstract
Content-based news recommenders learn words that correlate with user engagement and recommend articles accordingly. This can be problematic for users with diverse political preferences by topic — e.g., users that prefer conservative articles on one topic but liberal articles on another. In such instances, recommenders can have a homogenizing effect by recommending articles with the same political lean on both topics, particularly if both topics share salient, politically polarized terms like “far right” or “radical left.” In this paper, we propose attention-based neural network models to reduce this homogenization effect by increasing attention on words that are topic specific while decreasing attention on polarized, topic-general terms. We find that the proposed approach results in more accurate recommendations for simulated users with such diverse preferences.
Karthik Shivaram, Ping Liu 0002, Matthew A. Shapiro, Mustafa Bilgic 0001, Aron Culotta
RecSys2
2021 The Interaction between Political Typology and Filter Bubbles in News Recommendation Algorithms
abstract
Algorithmic personalization of news and social media content aims to improve user experience; however, there is evidence that this filtering can have the unintended side effect of creating homogeneous “filter bubbles,” in which users are over-exposed to ideas that conform with their preexisting perceptions and beliefs. In this paper, we investigate this phenomenon in the context of political news recommendation algorithms, which have important implications for civil discourse.
Ping Liu 0002, Karthik Shivaram, Aron Culotta, Matthew A. Shapiro, Mustafa Bilgic 0001
WWW1
2018 Forecasting the Presence and Intensity of Hostility on Instagram Using Linguistic and Social Features
Ping Liu 0002, Joshua Guberman, Libby Hemphill, Aron Culotta
ICWSM1