Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Gentaro Watanabe

dblp:178/7791 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
0since 2021 · last 2019
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Theoretical computer science
1 paper
Graph algorithms and graph theory · 100%
Artificial intelligence
1 paper
Efficient and distributed learning · 77% Deep learning architectures and training · 23%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning
memory-efficient training
0.412019
A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation · NeurIPS 2019
Graph algorithms and graph theory › graph algorithms
graph-theoretic optimization
0.412019
A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation · NeurIPS 2019
Graph algorithms and graph theory
graph theory
0.412019
A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation · NeurIPS 2019
Machine learning › Deep learning architectures and training
backpropagation
0.112019
A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation · NeurIPS 2019

Methods — techniques the papers use, named apart from their topics

graph theory · 0.8dynamic programming · 0.8
YearPublicationVenuePosition
2019 A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient Backpropagation
abstract
Recomputation algorithms collectively refer to a family of methods that aims to reduce the memory consumption of the backpropagation by selectively discarding the intermediate results of the forward propagation and recomputing the discarded results as needed. In this paper, we will propose a novel and efficient recomputation method that can be applied to a wider range of neural nets than previous methods. We use the language of graph theory to formalize the general recomputation problem of minimizing the computational overhead under a fixed memory budget constraint, and provide a dynamic programming solution to the problem. Our method can reduce the peak memory consumption on various benchmark networks by $36\%\sim81\%$, which outperforms the reduction achieved by other methods.
Mitsuru Kusumoto, Takuya Inoue, Gentaro Watanabe, Takuya Akiba, Masanori Koyama
NeurIPS3