Demo Data from SIGIR 2026 / reviewers in the wild / expert
Hubert J. Banville
dblp:160/4305
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
0000-0002-3362-0244ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
3D vision · 77% Generative modeling · 23% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Bioinformatics and computational biology · 100% |
Topics — the 2 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Bioinformatics and computational biology › neuroscience › neuroinformatics
brain decoding |
0.8 | 1 | 2024 | Brain decoding: toward real-time reconstruction of visual perception · ICLR 2024 |
Machine learning › Generative modeling
image generation |
0.2 | 1 | 2024 | Brain decoding: toward real-time reconstruction of visual perception · ICLR 2024 |
Methods — techniques the papers use, named apart from their topics
regression · 1.5pretrained image embeddings · 1.5magnetoencephalography · 1.5contrastive learning · 1.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Brain decoding: toward real-time reconstruction of visual perceptionabstractIn the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with remarkable fidelity. This neuroimaging technique, however, suffers from a limited temporal resolution ($\approx$0.5\,Hz) and thus fundamentally constrains its real-time usage. Here, we propose an alternative approach based on magnetoencephalography (MEG), a neuroimaging device capable of measuring brain activity with high temporal resolution ($\approx$5,000 Hz). For this, we develop an MEG decoding model trained with both contrastive and regression objectives and consisting of three modules: i) pretrained embeddings obtained from the image, ii) an MEG module trained end-to-end and iii) a pretrained image generator. Our results are threefold: Firstly, our MEG decoder shows a 7X improvement of image-retrieval over classic linear decoders. Second, late brain responses to images are best decoded with DINOv2, a recent foundational image model. Third, image retrievals and generations both suggest that high-level visual features can be decoded from MEG signals, although the same approach applied to 7T fMRI also recovers better low-level features. Overall, these results, while preliminary, provide an important step towards the decoding - in real-time - of the visual processes continuously unfolding within the human brain. Yohann Benchetrit, Hubert J. Banville, Jean-Rémi King |
ICLR | 2 |