Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Peter Hawkins

dblp:89/1170 · DBLP profile ↗
← Back
11ranked-venue papers
6as first author
2since 2021 · last 2023
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Software engineering, systems software and programming languages · 6 · 5 first-authorArtificial intelligence and machine learning · 3 · 1 first-author · 1 since 2021Systems, architecture and hardware · 1Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Deep learning architectures and training · 48% Efficient and distributed learning · 47% Language models and text generation · 5%
Software engineering, system software, and programming languages
2 papers
Program synthesis and code generation · 41% Compilers and program optimization · 22% Programming languages and type systems · 19%
Computer architecture, parallel and distributed computing, and storage systems
2 papers
High-performance computing · 50% Distributed systems · 50%

Topics — the 11 heaviest of 13, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Efficient and distributed learning
distributed training
0.722018
Mesh-TensorFlow: Deep Learning for Supercomputers · NeurIPS 2018
Dynamic control flow in large-scale machine learning · EuroSys 2018
Machine learning › Deep learning architectures and training
attention mechanism
0.512021
Rethinking Attention with Performers · ICLR 2021
Machine learning › Deep learning architectures and training › transformer
efficient transformer
0.512021
Rethinking Attention with Performers · ICLR 2021
Machine learning › Efficient and distributed learning › distributed training
model parallelism
0.312018
Mesh-TensorFlow: Deep Learning for Supercomputers · NeurIPS 2018
Distributed systems
distributed machine learning
0.312018
Dynamic control flow in large-scale machine learning · EuroSys 2018
Compilers and program optimization › parallel program optimization › synchronization optimization
synchronization placement
0.112012
Concurrent data representation synthesis · PLDI 2012
Programming languages and type systems
abstract data types
0.112011
Data representation synthesis · PLDI 2011
Requirements engineering and software design › formal specification
relational specification
0.112011
Data representation synthesis · PLDI 2011
Natural language and speech › Language models and text generation › language modeling › language model architecture
sequence-to-sequence model
0.112018
Mesh-TensorFlow: Deep Learning for Supercomputers · NeurIPS 2018
Transaction processing and concurrency control
serializability
0.012012
Concurrent data representation synthesis · PLDI 2012
Data models and query languages
relational algebra
0.012011
Data representation synthesis · PLDI 2011

Methods — techniques the papers use, named apart from their topics

collective communication · 0.7allreduce · 0.7SPMD programming · 0.7random features · 0.5linear attention · 0.5data flow graphs · 0.3data flow graph · 0.3relational specification · 0.3auto-tuning · 0.3functional dependencies · 0.2decomposition · 0.2
YearPublicationVenuePosition
2023 iCan: Psychological Look in Future Using Augmented Reality Technology
abstract
Looking to the future is always something people have been interested in from the old days. What people can do using their current ability is ambiguous, but this can be achieved psychologically. In this study, a systematic Augmented Reality (AR) system named iCan has been proposed to reveal the ability of what we can do and which way we should choose when facing any junction of choices. iCan has been developed in four steps: basic AR development implementation, building 3D-Models, making the best interaction UX(User-Experience) and test-debug-publish. In the first step, booklet pages have been chosen for AR development instruction. Next, 3D models have made and have been presented. Next, interaction methods are under development. Some individuals have tested the system, and the results show the robustness of the presented system, which there is a hope to change people's future soon.
Hessam Rastegari, Hoshang Kolivand, Peter Hawkins
DeSE3
2021 Rethinking Attention with Performers
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger 0002, Lucy J. Colwell, Adrian Weller
ICLR7
2018 Dynamic control flow in large-scale machine learning
abstract
Many recent machine learning models rely on fine-grained dynamic control flow for training and inference. In particular, models based on recurrent neural networks and on reinforcement learning depend on recurrence relations, data-dependent conditional execution, and other features that call for dynamic control flow. These applications benefit from the ability to make rapid control-flow decisions across a set of computing devices in a distributed system. For performance, scalability, and expressiveness, a machine learning system must support dynamic control flow in distributed and heterogeneous environments.
Martín Abadi, Paul Barham 0001, Eugene Brevdo, Michael Burrows, Andy Davis, Jeffrey Dean, Sanjay Ghemawat, Tim Harley, Peter Hawkins, Michael Isard, Manjunath Kudlur, Rajat Monga, Derek Gordon Murray, Xiaoqiang Zheng
EuroSys10
2018 Mesh-TensorFlow: Deep Learning for Supercomputers
abstract
Batch-splitting (data-parallelism) is the dominant distributed Deep Neural Network (DNN) training strategy, due to its universal applicability and its amenability to Single-Program-Multiple-Data (SPMD) programming. However, batch-splitting suffers from problems including the inability to train very large models (due to memory constraints), high latency, and inefficiency at small batch sizes. All of these can be solved by more general distribution strategies (model-parallelism). Unfortunately, efficient model-parallel algorithms tend to be complicated to discover, describe, and to implement, particularly on large clusters. We introduce Mesh-TensorFlow, a language for specifying a general class of distributed tensor computations. Where data-parallelism can be viewed as splitting tensors and operations along the "batch" dimension, in Mesh-TensorFlow, the user can specify any tensor-dimensions to be split across any dimensions of a multi-dimensional mesh of processors. A Mesh-TensorFlow graph compiles into a SPMD program consisting of parallel operations coupled with collective communication primitives such as Allreduce. We use Mesh-TensorFlow to implement an efficient data-parallel, model-parallel version of the Transformer sequence-to-sequence model. Using TPU meshes of up to 512 cores, we train Transformer models with up to 5 billion parameters, surpassing SOTA results on WMT'14 English-to-French translation task and the one-billion-word Language modeling benchmark. Mesh-Tensorflow is available at https://github.com/tensorflow/mesh
Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
NeurIPS7
2012 Reasoning about Lock Placements
Peter Hawkins, Alex Aiken, Kathleen Fisher, Martin C. Rinard, Shmuel Sagiv
ESOP1
2012 Concurrent data representation synthesis
abstract
We describe an approach for synthesizing data representations for concurrent programs. Our compiler takes as input a program written using concurrent relations and synthesizes a representation of the relations as sets of cooperating data structures as well as the placement and acquisition of locks to synchronize concurrent access to those data structures. The resulting code is correct by construction: individual relational operations are implemented correctly and the aggregate set of operations is serializable and deadlock free. The relational specification also permits a high-level optimizer to choose the best performing of many possible legal data representations and locking strategies, which we demonstrate with an experiment autotuning a graph benchmark.
Peter Hawkins, Alex Aiken, Kathleen Fisher, Martin C. Rinard, Shmuel Sagiv
PLDI1
2011 Data representation synthesis
abstract
We consider the problem of specifying combinations of data structures with complex sharing in a manner that is both declarative and results in provably correct code. In our approach, abstract data types are specified using relational algebra and functional dependencies. We describe a language of decompositions that permit the user to specify different concrete representations for relations, and show that operations on concrete representations soundly implement their relational specification. It is easy to incorporate data representations synthesized by our compiler into existing systems, leading to code that is simpler, correct by construction, and comparable in performance to the code it replaces.
Peter Hawkins, Alex Aiken, Kathleen Fisher, Martin C. Rinard, Shmuel Sagiv
PLDI1
2010 Data Structure Fusion
Peter Hawkins, Alex Aiken, Kathleen Fisher, Martin C. Rinard, Shmuel Sagiv
APLAS1
2007 An overview of the saturn project
abstract
We present an overview of the Saturn program analysis system, including a rationale for three major design decisions: the use of function-at-a-time, or summary-based, analysis, the use of constraints, and the use of a logic programming language to express program analysis algorithms. We argue that the combination of summaries and constraints allows Saturn to achieve both great scalability and great precision, while the use of a logic programming language with constraints allows for succinct, high-level expression of program analyses.
Alex Aiken, Suhabe Bugrara, Isil Dillig, Thomas Dillig, Brian Hackett, Peter Hawkins
PASTE6
2006 A Hybrid BDD and SAT Finite Domain Constraint Solver
Peter Hawkins, Peter J. Stuckey
PADL1
2005 Solving Set Constraint Satisfaction Problems using ROBDDs
abstract
In this paper we present a new approach to modeling finite set domain constraint problems using Reduced Ordered Binary Decision Diagrams (ROBDDs). We show that it is possible to construct an efficient set domain propagator which compactly represents many set domains and set constraints using ROBDDs. We demonstrate that the ROBDD-based approach provides unprecedented flexibility in modeling constraint satisfaction problems, leading to performance improvements. We also show that the ROBDD-based modeling approach can be extended to the modeling of integer and multiset constraint problems in a straightforward manner. Since domain propagation is not always practical, we also show how to incorporate less strict consistency notions into the ROBDD framework, such as set bounds, cardinality bounds and lexicographic bounds consistency. Finally, we present experimental results that demonstrate the ROBDD-based solver performs better than various more conventional constraint solvers on several standard set constraint problems.
Peter Hawkins, Vitaly Lagoon, Peter J. Stuckey
J. Artif. Intell. Res.1