Demo Data from VLDB 2026 / reviewers in the wild / expert
Ruijie Xu 0005
dblp:169/1986-5
· DBLP profile ↗
2ranked-venue papers
0as first author
2since 2021 · last 2024
0009-0006-6218-9197ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 2 since 2021Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
2 papers |
Graph learning · 44% Language models and text generation · 25% Vision and language · 25% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computing education · 77% Computational science and engineering · 23% |
Topics — the 6 heaviest of 8, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
large language model |
0.8 | 1 | 2024 | OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI · NeurIPS 2024 |
Computer vision › Vision and language › multimodal evaluation
multimodal reasoning evaluation |
0.8 | 1 | 2024 | OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI · NeurIPS 2024 |
Machine learning › Graph learning › graph neural network › trustworthy graph neural networks
degree bias |
0.7 | 1 | 2023 | Grace: Graph Self-Distillation and Completion to Mitigate Degree-Related Biases · KDD 2023 |
Machine learning › Graph learning › graph neural network
node classification |
0.7 | 1 | 2023 | Grace: Graph Self-Distillation and Completion to Mitigate Degree-Related Biases · KDD 2023 |
Computational science and engineering
AI for science |
0.2 | 1 | 2024 | OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI · NeurIPS 2024 |
Machine learning › Trustworthy machine learning
fairness |
0.2 | 1 | 2023 | Grace: Graph Self-Distillation and Completion to Mitigate Degree-Related Biases · KDD 2023 |
Methods — techniques the papers use, named apart from their topics
process-level evaluation · 1.5benchmark evaluation · 1.5self-distillation · 0.7label propagation · 0.7graph completion · 0.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AIabstractThe evolution of Artificial Intelligence (AI) has been significantly accelerated by advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), gradually showcasing potential cognitive reasoning abilities in problem-solving and scientific discovery (i.e., AI4Science) once exclusive to human intellect. To comprehensively evaluate current models' performance in cognitive reasoning abilities, we introduce OlympicArena, which includes 11,163 bilingual problems across both text-only and interleaved text-image modalities. These challenges encompass a wide range of disciplines spanning seven fields and 62 international Olympic competitions, rigorously examined for data leakage. We argue that the challenges in Olympic competition problems are ideal for evaluating AI's cognitive reasoning due to their complexity and interdisciplinary nature, which are essential for tackling complex scientific challenges and facilitating discoveries. Beyond evaluating performance across various disciplines using answer-only criteria, we conduct detailed experiments and analyses from multiple perspectives. We delve into the models' cognitive reasoning abilities, their performance across different modalities, and their outcomes in process-level evaluations, which are vital for tasks requiring complex reasoning with lengthy solutions. Our extensive evaluations reveal that even advanced models like GPT-4o only achieve a 39.97\% overall accuracy (28.67\% for mathematics and 29.71\% for physics), illustrating current AI limitations in complex reasoning and multimodal integration. Through the OlympicArena, we aim to advance AI towards superintelligence, equipping it to address more complex challenges in science and beyond. We also provide a comprehensive set of resources to support AI research, including a benchmark dataset, an open-source annotation platform, a detailed evaluation tool, and a leaderboard with automatic submission features. Zengzhi Wang, Shijie Xia, Xuefeng Li 0003, Haoyang Zou, Ruijie Xu 0005, Run-Ze Fan, Lyumanshan Ye, Ethan Chern, Yixin Ye, Yikai Zhang 0003, Yuqing Yang 0004, Binjie Wang, Shichao Sun, Yiyuan Li, Steffi Chern, Yiwei Qin, Jiadi Su, Yixiu Liu, Shaoting Zhang 0001, Dahua Lin, Yu Qiao 0001, Pengfei Liu 0003 |
NeurIPS | 6 |
| 2023 | Grace: Graph Self-Distillation and Completion to Mitigate Degree-Related BiasesabstractDue to the universality of graph data, node classification shows its great importance in a wide range of real-world applications. Despite the successes of Graph Neural Networks (GNNs), GNN based methods rely heavily on rich connections and perform poorly on low-degree nodes. Since many real-world graphs follow a long-tailed distribution in node degrees, they suffer from a substantial performance bottleneck as a significant fraction of nodes is of low degree. In this paper, we point out that under-represented self-representations and low neighborhood homophily ratio of low-degree nodes are two main culprits. Based on that, we propose a novel method Grace which improves the node representation by self-distillation, and increases neighborhood homophily ratio of low-degree nodes by graph completion. To avoid error propagation of graph completion, label propagation is further leveraged. Experimental evidence has shown that our method well supports real-world graphs, and is superior in balancing degree-related bias and overall performance on node classification tasks. Hui Xu 0011, Liyao Xiang, Femke Huang, Yuting Weng, Ruijie Xu 0005, Xinbing Wang, Chenghu Zhou |
KDD | 5 |