Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Ryan Sun

dblp:254/3383 · DBLP profile ↗
← Back
2ranked-venue papers
1as first author
1since 2021 · last 2024
0000-0003-1176-1561ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Efficient and distributed learning · 56% Language models and text generation · 44%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Bioinformatics and computational biology · 100%

Topics — the 5 heaviest of 5, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation › decoding
multi-draft speculative decoding
0.812024
SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding · EMNLP 2024
Machine learning › Efficient and distributed learning › inference acceleration
speculative decoding
0.812024
SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding · EMNLP 2024
Bioinformatics and computational biology › gene expression analysis
differential expression analysis
0.412019
Identification of differentially expressed gene sets using the Generalized Berk-Jones statistic · Bioinform. 2019
Bioinformatics and computational biology › functional genomics › functional enrichment analysis
gene set enrichment analysis
0.412019
Identification of differentially expressed gene sets using the Generalized Berk-Jones statistic · Bioinform. 2019
Machine learning › Efficient and distributed learning
inference acceleration
0.212024
SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding · EMNLP 2024

Methods — techniques the papers use, named apart from their topics

recursive rejection sampling · 0.8optimal transport · 0.8linear programming · 0.8generalized higher criticism · 0.4generalized berk-jones statistic · 0.4gene set enrichment analysis · 0.4
YearPublicationVenuePosition
2024 SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding
abstract
Large Language Models (LLMs) have become essential in advancing natural language processing (NLP) tasks, but their sequential token generation limits inference speed.Multi-Draft Speculative Decoding (MDSD) offers a promising solution by using a smaller draft model to generate multiple token sequences, which the target LLM verifies in parallel.However, current heuristic approaches, such as Recursive Rejection Sampling (RRS), suffer from low acceptance rates in subsequent drafts, limiting the advantages of using multiple drafts.Meanwhile, Optimal Transport with Membership Cost (OTM) can theoretically improve acceptance rates, but its computational cost is too high for real-time use.We present SpecHub, a novel, efficient samplingverification method for MDSD that improves acceptance rates with only linear computational overhead.By simplifying the OTM problem into a compact Linear Programming model, SpecHub significantly reduces computational complexity.It further accelerates sampling by leveraging a sparse joint distribution, focusing computation on high-probability token sequences.In extensive experiments, Spechub consistently generates 0.05-0.27and 0.02-0.16more tokens per step than RRS and RRS without replacement.We attach our code at https://github.com/MasterGodzilla/ Speculative_decoding_OT.
Ryan Sun, Tianyi Zhou 0001, Lichao Sun 0001
EMNLP1
2019 Identification of differentially expressed gene sets using the Generalized Berk-Jones statistic
abstract
MOTIVATION: Cancer genomics studies frequently aim to identify genes that are differentially expressed between clinically distinct patient subgroups, generally by testing single genes one at a time. However, the results of any individual transcriptomic study are often not fully reproducible. A particular challenge impeding statistical analysis is the difficulty of distinguishing between differential expression comprising part of the genomic disease etiology and that induced by downstream effects. More robust analytical approaches that are well-powered to detect potentially causative genes, are less prone to discovering spurious associations, and can deliver reproducible findings across different studies are needed. RESULTS: We propose a set-based procedure for testing of differential expression and show that this set-based approach can produce more robust results by aggregating information across multiple, correlated genomic markers. Specifically, we adapt the Generalized Berk-Jones statistic to test for the transcription factors that may contribute to the progression of estrogen receptor positive breast cancer. We demonstrate the ability of our method to produce reproducible findings by applying the same analysis to 21 publicly available datasets, producing a similar list of significant transcription factors across most studies. Our Generalized Berk-Jones approach produces results that show improved consistency over three set-based testing algorithms: Generalized Higher Criticism, Gene Set Analysis and Gene Set Enrichment Analysis. AVAILABILITY AND IMPLEMENTATION: Data are in the MetaGxBreast R package. Code is available at github.com/ryanrsun/gaynor_sun_GBJ_breast_cancer. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
Sheila M. Gaynor, Ryan Sun, Xihong Lin, John Quackenbush
Bioinform.2