Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Paul Jung

dblp:296/0276 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2024
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 2 since 2021Databases, data management, data science and information retrieval · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Learning theory · 50% Efficient and distributed learning · 33% Probabilistic and Bayesian machine learning · 17%

Topics — the 6 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Learning theory › neural network theory › infinite-width limit
gaussian process limit
0.712023
Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility · J. Mach. Learn. Res. 2023
Machine learning › Learning theory › neural network theory
infinite-width limit
0.712023
Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility · J. Mach. Learn. Res. 2023
Machine learning › Probabilistic and Bayesian machine learning › stochastic processes › gaussian process
mixture of gaussian processes
0.712023
Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility · J. Mach. Learn. Res. 2023
Machine learning › Efficient and distributed learning
model compression
0.712023
Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility · J. Mach. Learn. Res. 2023
Machine learning › Learning theory
neural network theory
0.712023
Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility · J. Mach. Learn. Res. 2023
Machine learning › Efficient and distributed learning › model compression
pruning
0.712023
Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility · J. Mach. Learn. Res. 2023

Methods — techniques the papers use, named apart from their topics

mixture of gaussians · 0.7lévy measure · 0.7gaussian process · 0.7
YearPublicationVenuePosition
2024 OncoPrint++: An Enhanced OncoPrint Beyond Data Visualization for Clinical Bioinformatics and Genomics
abstract
It is presented in this article a web-based tool named OncoPrint++. OncoPrint++ is a tool integrated with traditional OncoPrint/heatmap and enhanced functions and features for processing, visualizing and analyzing clinicogenomics data in oncology. OncoPrint++ functions as an all-in-one tool primarily designed for oncology studies, but it could be extended for general clinical bioinformatics and genomics. It will be available to use for free at GitHub/AWS.
Shiquan Wu, Kwangbom Choi, Paul Jung, Jifeng Qian, Paul Hiser, Melih Acar, Edith Szafer Glusman, Leo Wang-Kit Cheung
IEEE Big Data3
2023 Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility
abstract
This article studies the infinite-width limit of deep feedforward neural networks whose weights are dependent, and modelled via a mixture of Gaussian distributions. Each hidden node of the network is assigned a nonnegative random variable that controls the variance of the outgoing weights of that node. We make minimal assumptions on these per-node random variables: they are iid and their sum, in each layer, converges to some finite random variable in the infinite-width limit. Under this model, we show that each layer of the infinite-width neural network can be characterised by two simple quantities: a non-negative scalar parameter and a Lévy measure on the positive reals. If the scalar parameters are strictly positive and the Lévy measures are trivial at all hidden layers, then one recovers the classical Gaussian process (GP) limit, obtained with iid Gaussian weights. More interestingly, if the Lévy measure of at least one layer is non-trivial, we obtain a mixture of Gaussian processes (MoGP) in the large-width limit. The behaviour of the neural network in this regime is very different from the GP regime. One obtains correlated outputs, with non-Gaussian distributions, possibly with heavy tails. Additionally, we show that, in this regime, the weights are compressible, and some nodes have asymptotically non-negligible contributions, therefore representing important hidden features. Many sparsity-promoting neural network models can be recast as special cases of our approach, and we discuss their infinite-width limits; we also present an asymptotic analysis of the pruning error. We illustrate some of the benefits of the MoGP regime over the GP regime in terms of representation learning and compressibility on simulated, MNIST and Fashion MNIST datasets.
Hoil Lee, Fadhel Ayed, Paul Jung, Juho Lee 0001, Hongseok Yang, François Caron
J. Mach. Learn. Res.3