EDBT 2026 Demo / reviewers in the wild / expert
David J. Wu 0001
dblp:32/10400-1
· DBLP profile ↗
73ranked-venue papers
3as first author
47since 2021 · last 2026
0000-0002-5191-692XORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Security and privacy · 66 · 3 first-author · 45 since 2021Theory of computation · 13 · 10 since 2021Artificial intelligence and machine learning · 3Software engineering, systems software and programming languages · 1Databases, data management, data science and information retrieval · 1Graphics, computer vision, multimedia, augmented reality and games · 1
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | From NIZK Arguments to ZAPs, Generically
Anish Banerjee, Brent Waters, David J. Wu 0001 |
CRYPTO (9) | 3 |
| 2026 | Fair-Weather No More: Guaranteed Efficiency in Secure Group Messaging
James Bartusek, Nir Bitansky, Yevgeniy Dodis, Rachit Garg 0001, David J. Wu 0001 |
CRYPTO (10) | 5 |
| 2026 | Pairing-Based Registered ABE for Boolean Formulas with a Linear-Size CRS
Roy Stracovsky, Brent Waters, David J. Wu 0001 |
CRYPTO (1) | 3 |
| 2026 | Simultaneous-Message and Succinct Secure Computation: Reusable and Multiparty Protocols
Siddharth Agarwal, Abhishek Jain 0002, Akshayaram Srinivasan, David J. Wu 0001 |
EUROCRYPT | 4 |
| 2026 | Distributed Monotone-Policy Encryption for DNFs from Lattices
Jeffrey Champion, David J. Wu 0001 |
EUROCRYPT (5) | 2 |
| 2026 | The Structured Generic-Group Model
Henry Corrigan-Gibbs, Alexandra Henzinger, David J. Wu 0001 |
EUROCRYPT (5) | 3 |
| 2026 | Threshold Batched Identity-Based Encryption from Pairings in the Plain Model
Junqing Gong 0001, Brent Waters, Hoeteck Wee, David J. Wu 0001 |
EUROCRYPT (5) | 4 |
| 2026 | Silent Threshold Cryptography from Pairings: Expressive Policies in the Plain Model
Brent Waters, David J. Wu 0001 |
EUROCRYPT (5) | 2 |
| 2025 | Pairing-Based Batch Arguments for NP with a Linear-Size CRS
Binyi Chen, Noel Elias, David J. Wu 0001 |
ASIACRYPT (5) | 3 |
| 2025 | Succinct Witness Encryption for Batch Languages and Applications
Lalita Devadas, Abhishek Jain 0002, Brent Waters, David J. Wu 0001 |
ASIACRYPT (8) | 4 |
| 2025 | Pairing-Based Aggregate Signatures Without Random Oracles
Susan Hohenberger, Brent Waters, David J. Wu 0001 |
ASIACRYPT (6) | 3 |
| 2025 | Registered ABE and Adaptively-Secure Broadcast Encryption from Succinct LWE
Jeffrey Champion, Yao-Ching Hsieh 0001, David J. Wu 0001 |
CRYPTO (3) | 3 |
| 2025 | A Pure Indistinguishability Obfuscation Approach to Adaptively-Sound SNARGs for sfNP
Brent Waters, David J. Wu 0001 |
CRYPTO (7) | 2 |
| 2025 | Unbounded Distributed Broadcast Encryption and Registered ABE from Succinct LWE
Hoeteck Wee, David J. Wu 0001 |
CRYPTO (3) | 2 |
| 2025 | A Generic Approach to Adaptively-Secure Broadcast Encryption in the Plain Model
Yao-Ching Hsieh 0001, Brent Waters, David J. Wu 0001 |
EUROCRYPT (3) | 3 |
| 2025 | Multi-authority Registered Attribute-Based Encryption
George Lu, Brent Waters, David J. Wu 0001 |
EUROCRYPT (3) | 3 |
| 2025 | New Techniques for Preimage Sampling: Improved NIZKs and More from LWE
Brent Waters, Hoeteck Wee, David J. Wu 0001 |
EUROCRYPT (4) | 3 |
| 2025 | Adaptively-Secure Big-Key Identity-Based Encryption
Jeffrey Champion, Brent Waters, David J. Wu 0001 |
PKC (1) | 3 |
| 2025 | Monotone-Policy BARGs and More from BARGs and Quadratic Residuosity
Shafik Nassar, Brent Waters, David J. Wu 0001 |
PKC (4) | 3 |
| 2025 | A Hidden-Bits Approach to Statistical ZAPs from LWE
Eli Bradley, George Lu, Shafik Nassar, Brent Waters, David J. Wu 0001 |
TCC (4) | 5 |
| 2025 | The Pseudorandomness of Legendre Symbols Under the Quadratic-Residuosity Assumption
Henry Corrigan-Gibbs, David J. Wu 0001 |
TCC (3) | 2 |
| 2024 | Respire: High-Rate PIR for Databases with Small RecordsabstractPrivate information retrieval (PIR) is a key building block in many privacy-preserving systems, and recent works have made significant progress on reducing the concrete computational costs of single-server PIR. However, existing constructions have high communication overhead, especially for databases with small records. In this work, we introduce Respire, a lattice-based PIR scheme tailored for databases of small records. To retrieve a single record from a database with over a million 256-byte records, the Respire protocol requires just 6.1 KB of online communication; this is a 5.9x reduction compared to the best previous lattice-based scheme. Moreover, Respire naturally extends to support batch queries. Compared to previous communication-efficient batch PIR schemes, Respire achieves a 3.4-7.1x reduction in total communication while maintaining comparable throughput (200-400 MB/s). The design of Respire relies on new query compression and response packing techniques based on ring switching in homomorphic encryption. Alexander Burton, Samir Jordan Menon, David J. Wu 0001 |
CCS | 3 |
| 2024 | The One-Wayness of Jacobi Signatures
Henry Corrigan-Gibbs, David J. Wu 0001 |
CRYPTO (5) | 2 |
| 2024 | Reducing the CRS Size in Registered ABE Systems
Rachit Garg 0001, George Lu, Brent Waters, David J. Wu 0001 |
CRYPTO (3) | 4 |
| 2024 | Succinct Functional Commitments for Circuits from k-sfLin
Hoeteck Wee, David J. Wu 0001 |
EUROCRYPT (2) | 2 |
| 2024 | Dot-Product Proofs and Their ApplicationsabstractA dot-product proof (DPP) is a simple probabilistic proof system in which the input statement$\boldsymbol{x}$and the proof$\boldsymbol{\pi}$are vectors over a finite field$\mathbb{F}$, and the proof is verified by making a single dot-product query$\langle \boldsymbol{q}, (\boldsymbol{x}\Vert\boldsymbol{\pi})\rangle$jointly to$\boldsymbol{x}$and$\boldsymbol{\pi}$. A DPP can be viewed as a 1-query fully linear PCP. We study the feasibility and efficiency of D PPs, obtaining the following results: •Small-field DPP. For any finite field$\mathbb{F}$and Boolean circuit$C$of size$S$, there is a D PP for proving that there exists$\boldsymbol{w}$such that$C(\boldsymbol{x},\ \boldsymbol{w})=1$with a proof$\boldsymbol{\pi}$of length$S\cdot \text{poly}(\vert \mathbb{F}\vert)$and soundness error$\varepsilon=O(1/\sqrt{\vert \mathbb{F}\vert })$. We show this error to be asymptotically optimal. In particular, and in contrast to the best known PCPs, there exist strictly linear-length DPPs over constant-size fields. •Large-field DPP. If$\vert \mathbb{F}\vert\geq$poly$(S/\varepsilon)$, there is a similar DPP with soundness error$\varepsilon$and proof length$O(S)$(in field elements). The above results do not rely on the PCP theorem and their proofs are considerably simpler. We apply our DPP constructions toward two kinds of applications. •Hardness of approximation. We obtain a simple proof for the NP-hardness of approximating MAXLIN (with dense instances) over any finite field$\mathbb{F}$up to some constant factor$c > 1$, independent of F. Unlike previous PCP-based proofs, our proof yields exponential-time hardness under the exponential time hypothesis (ETH). •Succinct arguments. We improve the concrete efficiency of succinct interactive arguments in the generic group model using input-independent preprocessing. In particular, the communication is comparable to sending two group elements and the verifier's computation is dominated by a single group exponentiation. We also show how to use DPPs together with linear-only encryption to construct succinct commit-and-prove arguments. Nir Bitansky, Prahladh Harsha, Yuval Ishai, Ron Rothblum, David J. Wu 0001 |
FOCS | 5 |
| 2024 | Adaptively-Sound Succinct Arguments for NP from Indistinguishability ObfuscationabstractA succinct non-interactive argument (SNARG) for NP allows a prover to convince a verifier that an NP statement x is true with a proof of size o(|x| + |w|), where w is the associated NP witness. A SNARG satisfies adaptive soundness if the malicious prover can choose the statement to prove after seeing the scheme parameters. In this work, we provide the first adaptively-sound SNARG for NP in the plain model assuming sub-exponentially-hard indistinguishability obfuscation, sub-exponentially-hard one-way functions, and either the (polynomial) hardness of the discrete log assumption or the (polynomial) hardness of factoring. This gives the first adaptively-sound SNARG for NP from falsifiable assumptions. All previous SNARGs for NP in the plain model either relied on non-falsifiable cryptographic assumptions or satisfied a weak notion of non-adaptive soundness (where the adversary has to choose the statement it proves before seeing the scheme parameters). Brent Waters, David J. Wu 0001 |
STOC | 2 |
| 2024 | Batch Arguments to NIZKs from One-Way Functions
Eli Bradley, Brent Waters, David J. Wu 0001 |
TCC (2) | 3 |
| 2024 | Distributed Broadcast Encryption from Lattices
Jeffrey Champion, David J. Wu 0001 |
TCC (3) | 2 |
| 2024 | Batching Adaptively-Sound SNARGs for NP
Lalita Devadas, Brent Waters, David J. Wu 0001 |
TCC (2) | 3 |
| 2024 | Monotone Policy BARGs from BARGs and Additively Homomorphic Encryption
Shafik Nassar, Brent Waters, David J. Wu 0001 |
TCC (2) | 3 |
| 2024 | YPIR: High-Throughput Single-Server PIR with Silent Preprocessing
Samir Jordan Menon, David J. Wu 0001 |
USENIX Security Symposium | 2 |
| 2023 | Lattice-Based Functional Commitments: Fast Verification and Cryptanalysis
Hoeteck Wee, David J. Wu 0001 |
ASIACRYPT (5) | 2 |
| 2023 | Realizing Flexible Broadcast Encryption: How to Broadcast to a Public-Key DirectoryabstractSuppose a user wants to broadcast an encrypted message to K recipients. With public-key encryption, the sender would construct K different ciphertexts, one for each recipient. The size of the broadcasted message then scales linearly with K. A natural question is whether the sender can encrypt the message with a ciphertext whose size scales \em sublinearly with the number of recipients. Rachit Garg 0001, George Lu, Brent Waters, David J. Wu 0001 |
CCS | 4 |
| 2023 | Non-interactive Zero-Knowledge from Non-interactive Batch Arguments
Jeffrey Champion, David J. Wu 0001 |
CRYPTO (2) | 2 |
| 2023 | How to Use (Plain) Witness Encryption: Registered ABE, Flexible Broadcast, and More
Cody Freitag, Brent Waters, David J. Wu 0001 |
CRYPTO (4) | 3 |
| 2023 | Registered Attribute-Based Encryption
Susan Hohenberger, George Lu, Brent Waters, David J. Wu 0001 |
EUROCRYPT (3) | 4 |
| 2023 | Succinct Vector, Polynomial, and Functional Commitments from Lattices
Hoeteck Wee, David J. Wu 0001 |
EUROCRYPT (3) | 2 |
| 2023 | Authenticated private information retrieval
Simone Colombo 0002, Kirill Nikitin 0001, Henry Corrigan-Gibbs, David J. Wu 0001, Bryan Ford |
USENIX Security Symposium | 4 |
| 2022 | Batch Arguments for sfNP and More from Standard Bilinear Group Assumptions
Brent Waters, David J. Wu 0001 |
CRYPTO (2) | 2 |
| 2022 | SPIRAL: Fast, High-Rate Single-Server PIR via FHE CompositionabstractWe introduce the SPIRAL family of single-server private information retrieval (PIR) protocols. SPIRAL relies on a composition of two lattice-based homomorphic encryption schemes: the Regev encryption scheme and the GentrySahai-Waters encryption scheme. We introduce new ciphertext translation techniques to convert between these two schemes and in doing so, enable new trade-offs in communication and computation. Across a broad range of database configurations, the basic version of SPIRAL simultaneously achieves at least a 4.5 × reduction in query size, 1.5 × reduction in response size, and 2 × increase in server throughput compared to previous systems. A variant of our scheme, SPIRALSTREAMPACK, is optimized for the streaming setting and achieves a server throughput of 1.9 GB/s for databases with over a million records (compared to 200 MB/s for previous protocols) and a rate of 0.81 (compared to 0.24 for previous protocols). For streaming large records (e.g., a private video stream), we estimate the monetary cost of SPIRALSTREAMPACK to be only 1.9 × greater than that of the no-privacy baseline where the client directly downloads the desired record. Samir Jordan Menon, David J. Wu 0001 |
SP | 2 |
| 2022 | Fully Succinct Batch Arguments for sfNP from Indistinguishability Obfuscation
Rachit Garg 0001, Kristin Sheridan, Brent Waters, David J. Wu 0001 |
TCC (1) | 4 |
| 2022 | Multi-authority ABE from Lattices Without Random Oracles
Brent Waters, Hoeteck Wee, David J. Wu 0001 |
TCC (1) | 3 |
| 2021 | Beyond Software Watermarking: Traitor-Tracing for Pseudorandom Functions
Rishab Goyal, Sam Kim, Brent Waters, David J. Wu 0001 |
ASIACRYPT (3) | 4 |
| 2021 | Shorter and Faster Post-Quantum Designated-Verifier zkSNARKs from LatticesabstractZero-knowledge succinct arguments of knowledge (zkSNARKs) enable efficient privacy-preserving proofs of membership for general NP languages. Our focus in this work is on post-quantum zkSNARKs, with a focus on minimizing proof size. Currently, there is a 1000x gap in the proof size between the best pre-quantum constructions and the best post-quantum ones. Here, we develop and implement new lattice-based zkSNARKs in the designated-verifier preprocessing model. With our construction, after an initial preprocessing step, a proof for an NP relation of size 2^20 is just over 16 KB. Our proofs are 10.3x shorter than previous post-quantum zkSNARKs for general NP languages. Compared to previous lattice-based zkSNARKs (also in the designated-verifier preprocessing model), we obtain a 42x reduction in proof size and a 60x reduction in the prover's running time, all while achieving a much higher level of soundness. Compared to the shortest pre-quantum zkSNARKs by Groth (Eurocrypt 2016), the proof size in our lattice-based construction is 131x longer, but both the prover and the verifier are faster (by 1.2x and 2.8x, respectively). Our construction follows the general blueprint of Bitansky et al. (TCC 2013) and Boneh et al. (Eurocrypt 2017) of combining a linear probabilistically checkable proof (linear PCP) together with a linear-only vector encryption scheme. We develop a concretely-efficient lattice-based instantiation of this compiler by considering quadratic extension fields of moderate characteristic and using linear-only vector encryption over rank-2 module lattices. Yuval Ishai, David J. Wu 0001 |
CCS | 3 |
| 2021 | CryptGPU: Fast Privacy-Preserving Machine Learning on the GPUabstractWe introduce CryptGPU, a system for privacy-preserving machine learning that implements all operations on the GPU (graphics processing unit). Just as GPUs played a pivotal role in the success of modern deep learning, they are also essential for realizing scalable privacy-preserving deep learning. In this work, we start by introducing a new interface to losslessly embed cryptographic operations over secret-shared values (in a discrete domain) into floating-point operations that can be processed by highly-optimized CUDA kernels for linear algebra. We then identify a sequence of "GPU-friendly" cryptographic protocols to enable privacy-preserving evaluation of both linear and non-linear operations on the GPU. Our microbenchmarks indicate that our private GPU-based convolution protocol is over 150× faster than the analogous CPU-based protocol; for non-linear operations like the ReLU activation function, our GPU-based protocol is around 10× faster than its CPU analog. With CryptGPU, we support private inference and training on convolutional neural networks with over 60 million parameters as well as handle large datasets like ImageNet. Compared to the previous state-of-the-art, our protocols achieve a 2× to 8× improvement in private inference for large networks and datasets. For private training, we achieve a 6× to 36× improvement over prior state-of-the-art. Our work not only showcases the viability of performing secure multiparty computation (MPC) entirely on the GPU to newly enable fast privacy-preserving machine learning, but also highlights the importance of designing new MPC primitives that can take full advantage of the GPU’s computing capabilities. Sijun Tan, Brian Knott, Yuan Tian 0001, David J. Wu 0001 |
SP | 4 |
| 2021 | Watermarking Cryptographic Functionalities from Standard Lattice Assumptions
Sam Kim, David J. Wu 0001 |
J. Cryptol. | 2 |
| 2020 | Collusion Resistant Trace-and-Revoke for Arbitrary Identities from Standard Assumptions
Sam Kim, David J. Wu 0001 |
ASIACRYPT (2) | 2 |
| 2020 | On Succinct Arguments and Witness Encryption from Groups
Ohad Barta, Yuval Ishai, Rafail Ostrovsky, David J. Wu 0001 |
CRYPTO (1) | 4 |
| 2020 | New Constructions of Statistical NIZKs: Dual-Mode DV-NIZKs and More
Benoît Libert, Alain Passelègue, Hoeteck Wee, David J. Wu 0001 |
EUROCRYPT (3) | 4 |
| 2020 | Can Verifiable Delay Functions Be Based on Random Oracles?abstractBoneh, Bonneau, Bünz, and Fisch (CRYPTO 2018) recently introduced the notion of a verifiable delay function (VDF). VDFs are functions that take a long sequential time T to compute, but whose outputs y := Eval(x) can be efficiently verified (possibly given a proof π) in time t ≪ T (e.g., t = poly(λ, log T) where λ is the security parameter). The first security requirement on a VDF, called uniqueness, is that no polynomial-time algorithm can find a convincing proof π' that verifies for an input x and a different output y' ≠ y. The second security requirement, called sequentiality, is that no polynomial-time algorithm running in time σ < T for some parameter σ (e.g., σ = T^{1/10}) can compute y, even with poly(T,λ) many parallel processors. Starting from the work of Boneh et al., there are now multiple constructions of VDFs from various algebraic assumptions. In this work, we study whether VDFs can be constructed from ideal hash functions in a black-box way, as modeled in the random oracle model (ROM). In the ROM, we measure the running time by the number of oracle queries and the sequentiality by the number of rounds of oracle queries. We rule out two classes of constructions of VDFs in the ROM: - We show that VDFs satisfying perfect uniqueness (i.e., VDFs where no different convincing solution y' ≠ y exists) cannot be constructed in the ROM. More formally, we give an attacker that finds the solution y in ≈ t rounds of queries, asking only poly(T) queries in total. - We also rule out tight verifiable delay functions in the ROM. Tight verifiable delay functions, recently studied by Döttling, Garg, Malavolta, and Vasudevan (ePrint Report 2019), require sequentiality for σ ≈ T-T^ρ for some constant 0 < ρ < 1. More generally, our lower bound also applies to proofs of sequential work (i.e., VDFs without the uniqueness property), even in the private verification setting, and sequentiality σ > T-(T)/(2t) for a concrete verification time t. Mohammad Mahmoody, Caleb Smith, David J. Wu 0001 |
ICALP | 3 |
| 2020 | Multi-theorem Preprocessing NIZKs from Lattices
Sam Kim, David J. Wu 0001 |
J. Cryptol. | 2 |
| 2019 | Watermarking Public-Key Cryptographic Primitives
Rishab Goyal, Sam Kim, Nathan Manohar, Brent Waters, David J. Wu 0001 |
CRYPTO (3) | 5 |
| 2019 | Watermarking PRFs from Lattices: Stronger Security via Extractable PRFs
Sam Kim, David J. Wu 0001 |
CRYPTO (3) | 2 |
| 2019 | New Constructions of Reusable Designated-Verifier NIZKs
Alex Lombardi, Willy Quach, Ron Rothblum, Daniel Wichs, David J. Wu 0001 |
CRYPTO (3) | 5 |
| 2018 | Multi-Theorem Preprocessing NIZKs from Lattices
Sam Kim, David J. Wu 0001 |
CRYPTO (2) | 2 |
| 2018 | Quasi-Optimal SNARGs via Linear Multi-Prover Interactive Proofs
Dan Boneh, Yuval Ishai, Amit Sahai, David J. Wu 0001 |
EUROCRYPT (3) | 4 |
| 2018 | Exploring Crypto Dark Matter: - New Simple PRF Candidates and Their Applications
Dan Boneh, Yuval Ishai, Alain Passelègue, Amit Sahai, David J. Wu 0001 |
TCC (2) | 5 |
| 2017 | Access Control Encryption for General Policies from Standard Assumptions
Sam Kim, David J. Wu 0001 |
ASIACRYPT (1) | 2 |
| 2017 | Watermarking Cryptographic Functionalities from Standard Lattice Assumptions
Sam Kim, David J. Wu 0001 |
CRYPTO (1) | 2 |
| 2017 | Functional Encryption: Deterministic to Randomized Functions from Simple Assumptions
Shashank Agrawal, David J. Wu 0001 |
EUROCRYPT (2) | 2 |
| 2017 | Lattice-Based SNARGs and Their Application to More Efficient Obfuscation
Dan Boneh, Yuval Ishai, Amit Sahai, David J. Wu 0001 |
EUROCRYPT (3) | 4 |
| 2017 | Quantum Operating SystemsabstractIf large-scale quantum computers become commonplace, the operating system will have to provide novel abstractions to capture the power of this bizarre new hardware. In this paper, we consider this and other systems-level issues that quantum computers would raise, and we demonstrate that these machines would offer surprising speed-ups for a number of everyday systems tasks, such as unit testing and CPU scheduling. Henry Corrigan-Gibbs, David J. Wu 0001, Dan Boneh |
HotOS | 2 |
| 2017 | Constrained Keys for Invertible Pseudorandom Functions
Dan Boneh, Sam Kim, David J. Wu 0001 |
TCC (1) | 3 |
| 2016 | Order-Revealing Encryption: New Constructions, Applications, and Lower BoundsabstractIn the last few years, there has been significant interest in developing methods to search over encrypted data. In the case of range queries, a simple solution is to encrypt the contents of the database using an order-preserving encryption (OPE) scheme (i.e., an encryption scheme that supports comparisons over encrypted values). However, Naveed et al. (CCS 2015) recently showed that OPE-encrypted databases are extremely vulnerable to "inference attacks." Kevin Lewi, David J. Wu 0001 |
CCS | 2 |
| 2016 | Privacy, Discovery, and Authentication for the Internet of Things
David J. Wu 0001, Ankur Taly, Asim Shankar, Dan Boneh |
ESORICS (2) | 1 |
| 2016 | Practical Order-Revealing Encryption with Limited Leakage
Nathan Chenette, Kevin Lewi, Stephen A. Weis, David J. Wu 0001 |
FSE | 4 |
| 2016 | Privacy-Preserving Shortest Path Computation
David J. Wu 0001, Joe Zimmerman, Jérémy Planul, John C. Mitchell |
NDSS | 1 |
| 2016 | Privately Evaluating Decision Trees and Random ForestsabstractAbstract Decision trees and random forests are common classifiers with widespread use. In this paper, we develop two protocols for privately evaluating decision trees and random forests. We operate in the standard two-party setting where the server holds a model (either a tree or a forest), and the client holds an input (a feature vector). At the conclusion of the protocol, the client learns only the model’s output on its input and a few generic parameters concerning the model; the server learns nothing. The first protocol we develop provides security against semi-honest adversaries. We then give an extension of the semi-honest protocol that is robust against malicious adversaries. We implement both protocols and show that both variants are able to process trees with several hundred decision nodes in just a few seconds and a modest amount of bandwidth. Compared to previous semi-honest protocols for private decision tree evaluation, we demonstrate a tenfold improvement in computation and bandwidth. David J. Wu 0001, Tony Feng, Michael Naehrig, Kristin E. Lauter |
Proc. Priv. Enhancing Technol. | 1 |
| 2013 | Private Database Queries Using Somewhat Homomorphic Encryption
Dan Boneh, Craig Gentry, Shai Halevi, Frank Wang, David J. Wu 0001 |
ACNS | 5 |
| 2013 | Deep learning with COTS HPC systemsabstractScaling up deep learning algorithms has been shown to lead to increased performance in benchmark tasks and to enable discovery of complex high-level features. Recent efforts to train extremely large networks (with over 1 billion parameters) have relied on cloud-like computing infrastructure and thousands of CPU cores. In this paper, we present technical details and results from our own system based on Commodity Off-The-Shelf High Performance Computing (COTS HPC) technology: a cluster of GPU servers with Infiniband interconnects and MPI. Our system is able to train 1 billion parameter networks on just 3 machines in a couple of days, and we show that it can scale to networks with over 11 billion parameters using just 16 machines. As this infrastructure is much more easily marshaled by others, the approach enables much wider-spread research with extremely large neural networks. Adam Coates 0002, Brody Huval, David J. Wu 0001, Bryan Catanzaro, Andrew Y. Ng |
ICML (3) | 4 |
| 2012 | End-to-end text recognition with convolutional neural networks
David J. Wu 0001, Adam Coates 0002, Andrew Y. Ng |
ICPR | 2 |
| 2011 | Text Detection and Character Recognition in Scene Images with Unsupervised Feature LearningabstractReading text from photographs is a challenging problem that has received a significant amount of attention. Two key components of most systems are (i) text detection from images and (ii) character recognition, and many recent methods have been proposed to design better feature representations and models for both. In this paper, we apply methods recently developed in machine learning -- specifically, large-scale algorithms for learning the features automatically from unlabeled data -- and show that they allow us to construct highly effective classifiers for both detection and recognition to be used in a high accuracy end-to-end system. Adam Coates 0002, Blake Carpenter, Carl Case, Sanjeev Satheesh, Bipin Suresh, David J. Wu 0001, Andrew Y. Ng |
ICDAR | 7 |