Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Benjamin Ehret

dblp:267/9864 · DBLP profile ↗
← Back
3ranked-venue papers
1as first author
3since 2021 · last 2023
0000-0002-5059-7947ORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 1 first-author · 2 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Deep learning architectures and training · 46% Learning paradigms · 30% Probabilistic and Bayesian machine learning · 23%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Learning paradigms
continual learning
0.722021
Continual learning in recurrent neural networks · ICLR 2021
Posterior Meta-Replay for Continual Learning · NeurIPS 2021
Machine learning › Probabilistic and Bayesian machine learning › deep probabilistic models › bayesian deep learning
bayesian continual learning
0.512021
Posterior Meta-Replay for Continual Learning · NeurIPS 2021
Machine learning › Deep learning architectures and training
hypernetwork
0.512021
Posterior Meta-Replay for Continual Learning · NeurIPS 2021
Machine learning › Deep learning architectures and training
recurrent neural network
0.512021
Continual learning in recurrent neural networks · ICLR 2021

Methods — techniques the papers use, named apart from their topics

variational inference · 0.5probabilistic task-conditioned hypernetworks · 0.5
YearPublicationVenuePosition
2023 How synaptic strength, short-term plasticity, and input synchrony contribute to neuronal spike output
abstract
Neurons integrate from thousands of synapses whose strengths span an order of magnitude. Intriguingly, in mouse neocortex, the few 'strong' synapses are formed between similarly tuned cells, suggesting they determine spiking output. This raises the question of how other computational primitives, including 'background' activity from the many 'weak' synapses, short-term plasticity, and temporal factors contribute to spiking. We used paired recordings and extracellular stimulation experiments to map excitatory postsynaptic potential (EPSP) amplitudes and paired-pulse ratios of synaptic connections formed between pyramidal neurons in layer 2/3 (L2/3) of barrel cortex. While net short-term plasticity was weak, strong synaptic connections were exclusively depressing. Importantly, we found no evidence for clustering of synaptic properties on individual neurons. Instead, EPSPs and paired-pulse ratios of connections converging onto the same cells spanned the full range observed across L2/3, which critically constrains theoretical models of cortical filtering. To investigate how different computational primitives of synaptic information processing interact to shape spiking, we developed a computational model of a pyramidal neuron in the excitatory L2/3 circuitry, which was constrained by our experiments and published in vivo data. We found that strong synapses were substantially depressed during ongoing activation and their ability to evoke correlated spiking primarily depended on their high temporal synchrony and high firing rates observed in vivo. However, despite this depression, their larger EPSP amplitudes strongly amplified information transfer and responsiveness. Thus, our results contribute to a nuanced framework of how cortical neurons exploit synergies between temporal coding, synaptic properties, and noise to transform synaptic inputs into spikes.
Moritz O. Buchholz, Alexandra Gastone Guilabert, Benjamin Ehret, Gregor F. P. Schuhknecht
PLoS Comput. Biol.3
2021 Continual learning in recurrent neural networks
Benjamin Ehret, Christian Henning, Maria R. Cervera, Alexander Meulemans, Johannes von Oswald, Benjamin F. Grewe
ICLR1
2021 Posterior Meta-Replay for Continual Learning
abstract
Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since recursive and one-off Bayesian updates yield the same result. In practice, however, recursive updating often leads to poor trade-off solutions across tasks because approximate inference is necessary for most models of interest. Here, we describe an alternative Bayesian approach where task-conditioned parameter distributions are continually inferred from data. We offer a practical deep learning implementation of our framework based on probabilistic task-conditioned hypernetworks, an approach we term posterior meta-replay. Experiments on standard benchmarks show that our probabilistic hypernetworks compress sequences of posterior parameter distributions with virtually no forgetting. We obtain considerable performance gains compared to existing Bayesian CL methods, and identify task inference as our major limiting factor. This limitation has several causes that are independent of the considered sequential setting, opening up new avenues for progress in CL.
Christian Henning, Maria R. Cervera, Francesco D'Angelo, Johannes von Oswald, Regina Traber, Benjamin Ehret, Seijin Kobayashi, Benjamin F. Grewe, João Sacramento
NeurIPS6