Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Leon A. Gatys

dblp:163/2338 · DBLP profile ↗
← Back
8ranked-venue papers
3as first author
0since 2021 · last 2019
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 6 · 3 first-authorGraphics, computer vision, multimedia, augmented reality and games · 4 · 2 first-authorHuman-computer interaction and ubiquitous computing · 1Applied, interdisciplinary, general and emerging computing · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
5 papers
Visual content generation and editing · 70% Image and video processing · 15% Visualization and visual analytics · 15%
Artificial intelligence
5 papers
Trustworthy machine learning · 35% Representation and self-supervised learning · 27% Deep learning architectures and training · 18%
Human-computer interaction and pervasive computing
1 paper
Health and well-being technologies · 77% Ubiquitous computing and smart environments · 23%

Topics — the 13 heaviest of 15, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Visual content generation and editing › style transfer
image style transfer
0.522017
Controlling Perceptual Factors in Neural Style Transfer · CVPR 2017
Image Style Transfer Using Convolutional Neural Networks · CVPR 2016
Visual content generation and editing
texture synthesis
0.522017
What does it take to generate natural textures? · ICLR (Poster) 2017
Texture Synthesis Using Convolutional Neural Networks · NIPS 2015
Machine learning › Deep learning architectures and training
convolutional neural network
0.322018
Image Style Transfer Using Convolutional Neural Networks · CVPR 2016
Diverse Feature Visualizations Reveal Invariances in Early Layers of Deep Neural Networks · ECCV (12) 2018
Machine learning › Trustworthy machine learning › interpretability › visual explanation
feature visualization
0.312018
Diverse Feature Visualizations Reveal Invariances in Early Layers of Deep Neural Networks · ECCV (12) 2018
Machine learning › Trustworthy machine learning
interpretability
0.312018
Diverse Feature Visualizations Reveal Invariances in Early Layers of Deep Neural Networks · ECCV (12) 2018
Machine learning › Representation and self-supervised learning › representation learning › neural network representation learning › deep representation learning
deep feature representation
0.312017
Understanding Low- and High-Level Contributions to Fixation Prediction · ICCV 2017
Computer vision › Image recognition and object detection
object recognition
0.312017
Understanding Low- and High-Level Contributions to Fixation Prediction · ICCV 2017
Visualization and visual analytics › visual saliency
fixation prediction
0.312017
Understanding Low- and High-Level Contributions to Fixation Prediction · ICCV 2017
Visual content generation and editing
image editing
0.312017
Controlling Perceptual Factors in Neural Style Transfer · CVPR 2017
Image and video processing
saliency detection
0.312017
Understanding Low- and High-Level Contributions to Fixation Prediction · ICCV 2017
Machine learning › Representation and self-supervised learning › visual representation › image representation
convolutional neural network features
0.212015
Texture Synthesis Using Convolutional Neural Networks · NIPS 2015
Ubiquitous computing and smart environments › mobile computing
mobile app usage analysis
0.112019
App Usage Predicts Cognitive Ability in Older Adults · CHI 2019
Machine learning › Generative modeling › image generation
texture synthesis
0.112017
What does it take to generate natural textures? · ICLR (Poster) 2017

Methods — techniques the papers use, named apart from their topics

convolutional neural network · 1.5texture synthesis · 0.6readout architecture · 0.6deep neural network features · 0.6gram matrix correlations · 0.4longitudinal usage data collection · 0.4cognitive testing · 0.4ROC analysis · 0.4neural style transfer · 0.3
YearPublicationVenuePosition
2019 App Usage Predicts Cognitive Ability in Older Adults
abstract
We have limited understanding of how older adults use smartphones, how their usage differs from younger users, and the causes for those differences. As a result, researchers and developers may miss promising opportunities to support older adults or offer solutions to unimportant problems. To characterize smartphone usage among older adults, we collected iPhone usage data from 84 healthy older adults over three months. We find that older adults use fewer apps, take longer to complete tasks, and send fewer messages. We use cognitive test results from these same older adults to then show that up to 79% of these differences can be explained by cognitive decline, and that we can predict cognitive test performance from smartphone usage with 83% ROCAUC. While older adults differ from younger adults in app usage behavior, the "cognitively young" older adults use smartphones much like their younger counterparts. Our study suggests that to better support all older adults, researchers and developers should consider the full spectrum of cognitive function.
Mitchell L. Gordon, Leon A. Gatys, Carlos Guestrin, Jeffrey P. Bigham, Andrew Trister, Kayur Patel
CHI2
2019 Deep convolutional models improve predictions of macaque V1 responses to natural images
abstract
Despite great efforts over several decades, our best models of primary visual cortex (V1) still predict spiking activity quite poorly when probed with natural stimuli, highlighting our limited understanding of the nonlinear computations in V1. Recently, two approaches based on deep learning have emerged for modeling these nonlinear computations: transfer learning from artificial neural networks trained on object recognition and data-driven convolutional neural network models trained end-to-end on large populations of neurons. Here, we test the ability of both approaches to predict spiking activity in response to natural images in V1 of awake monkeys. We found that the transfer learning approach performed similarly well to the data-driven approach and both outperformed classical linear-nonlinear and wavelet-based feature representations that build on existing theories of V1. Notably, transfer learning using a pre-trained feature space required substantially less experimental time to achieve the same performance. In conclusion, multi-layer convolutional neural networks (CNNs) set the new state of the art for predicting neural responses to natural images in primate V1 and deep features learned for object recognition are better explanations for V1 computation than all previous filter bank theories. This finding strengthens the necessity of V1 models that are multiple nonlinearities away from the image domain and it supports the idea of explaining early visual cortex based on high-level functional goals.
Santiago A. Cadena, George H. Denfield, Edgar Y. Walker, Leon A. Gatys, Andreas S. Tolias, Matthias Bethge, Alexander S. Ecker
PLoS Comput. Biol.4
2018 Diverse Feature Visualizations Reveal Invariances in Early Layers of Deep Neural Networks
Santiago A. Cadena, Marissa A. Weis, Leon A. Gatys, Matthias Bethge, Alexander S. Ecker
ECCV (12)3
2017 Controlling Perceptual Factors in Neural Style Transfer
abstract
Neural Style Transfer has shown very exciting results enabling new forms of image manipulation. Here we extend the existing method to introduce control over spatial location, colour information and across spatial scale. We demonstrate how this enhances the method by allowing high-resolution controlled stylisation and helps to alleviate common failure cases such as applying ground textures to sky regions. Furthermore, by decomposing style into these perceptual factors we enable the combination of style information from multiple sources to generate new, perceptually appealing styles from existing ones. We also describe how these methods can be used to more efficiently produce large size, high-quality stylisation. Finally we show how the introduced control measures can be applied in recent methods for Fast Neural Style Transfer.
Leon A. Gatys, Alexander S. Ecker, Matthias Bethge, Aaron Hertzmann, Eli Shechtman
CVPR1
2017 Understanding Low- and High-Level Contributions to Fixation Prediction
abstract
Understanding where people look in images is an important problem in computer vision. Despite significant research, it remains unclear to what extent human fixations can be predicted by low-level (contrast) compared to highlevel (presence of objects) image features. Here we address this problem by introducing two novel models that use different feature spaces but the same readout architecture. The first model predicts human fixations based on deep neural network features trained on object recognition. This model sets a new state-of-the art in fixation prediction by achieving top performance in area under the curve metrics on the MIT300 hold-out benchmark (AUC = 88%, sAUC = 77%, NSS = 2.34). The second model uses purely low-level (isotropic contrast) features. This model achieves better performance than all models not using features pretrained on object recognition, making it a strong baseline to assess the utility of high-level features. We then evaluate and visualize which fixations are better explained by lowlevel compared to high-level image features. Surprisingly we find that a substantial proportion of fixations are better explained by the simple low-level model than the stateof- the-art model. Comparing different features within the same powerful readout architecture allows us to better understand the relevance of low- versus high-level features in predicting fixation locations, while simultaneously achieving state-of-the-art saliency prediction.
Matthias Kümmerer, Thomas S. A. Wallis, Leon A. Gatys, Matthias Bethge
ICCV3
2017 What does it take to generate natural textures?
Ivan Ustyuzhaninov, Wieland Brendel, Leon A. Gatys, Matthias Bethge
ICLR (Poster)3
2016 Image Style Transfer Using Convolutional Neural Networks
abstract
Rendering the semantic content of an image in different styles is a difficult image processing task. Arguably, a major limiting factor for previous approaches has been the lack of image representations that explicitly represent semantic information and, thus, allow to separate image content from style. Here we use image representations derived from Convolutional Neural Networks optimised for object recognition, which make high level image information explicit. We introduce A Neural Algorithm of Artistic Style that can separate and recombine the image content and style of natural images. The algorithm allows us to produce new images of high perceptual quality that combine the content of an arbitrary photograph with the appearance of numerous wellknown artworks. Our results provide new insights into the deep image representations learned by Convolutional Neural Networks and demonstrate their potential for high level image synthesis and manipulation.
Leon A. Gatys, Alexander S. Ecker, Matthias Bethge
CVPR1
2015 Texture Synthesis Using Convolutional Neural Networks
abstract
Here we introduce a new model of natural textures based on the feature spaces of convolutional neural networks optimised for object recognition. Samples from the model are of high perceptual quality demonstrating the generative power of neural networks trained in a purely discriminative fashion. Within the model, textures are represented by the correlations between feature maps in several layers of the network. We show that across layers the texture representations increasingly capture the statistical properties of natural images while making object information more and more explicit. The model provides a new tool to generate stimuli for neuroscience and might offer insights into the deep representations learned by convolutional neural networks.
Leon A. Gatys, Alexander S. Ecker, Matthias Bethge
NIPS1