Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Erik Winfree

dblp:26/4609 · DBLP profile ↗
← Back
40ranked-venue papers
3as first author
3since 2021 · last 2025
0000-0002-5899-7523ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Applied, interdisciplinary, general and emerging computing · 21 · 1 first-author · 3 since 2021Theory of computation · 11 · 1 first-authorArtificial intelligence and machine learning · 6Systems, architecture and hardware · 2 · 1 first-authorSoftware engineering, systems software and programming languages · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
5 papers
Emerging computing paradigms · 84% Electronic design automation · 16%
Theoretical computer science
2 papers
Computational complexity · 55% Algorithms and data structures · 45%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Bioinformatics and computational biology · 100%

Topics — the 11 heaviest of 13, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Emerging computing paradigms › molecular computing
DNA computing
0.222009
Programmable Control of Nucleation for Algorithmic Self-Assembly · SIAM J. Comput. 2009
Toward molecular programming with DNA · ASPLOS 2008
Emerging computing paradigms
molecular computing
0.232008
Toward molecular programming with DNA · ASPLOS 2008
Neural Network Computation by In Vitro Transcriptional Circuits · NIPS 2004
The program-size complexity of self-assembled squares (extended abstract) · STOC 2000
Emerging computing paradigms › molecular computing › algorithmic self-assembly
tile assembly model
0.122009
Programmable Control of Nucleation for Algorithmic Self-Assembly · SIAM J. Comput. 2009
The program-size complexity of self-assembled squares (extended abstract) · STOC 2000
Computational complexity
kolmogorov complexity
0.122007
Complexity of Self-Assembled Shapes · SIAM J. Comput. 2007
The program-size complexity of self-assembled squares (extended abstract) · STOC 2000
Emerging computing paradigms › molecular computing
algorithmic self-assembly
0.112009
Programmable Control of Nucleation for Algorithmic Self-Assembly · SIAM J. Comput. 2009
Emerging computing paradigms › self-assembly
DNA self-assembly
0.112009
Programmable Control of Nucleation for Algorithmic Self-Assembly · SIAM J. Comput. 2009
Algorithms and data structures › self-assembly
tile assembly model
0.112007
Complexity of Self-Assembled Shapes · SIAM J. Comput. 2007
Bioinformatics and computational biology
synthetic biology
0.012004
Neural Network Computation by In Vitro Transcriptional Circuits · NIPS 2004
Computational fabrication
nanofabrication
0.012009
Programmable Control of Nucleation for Algorithmic Self-Assembly · SIAM J. Comput. 2009
Algorithms and data structures
self-assembly
0.012000
The program-size complexity of self-assembled squares (extended abstract) · STOC 2000
Computational complexity › complexity measures
turing machine complexity
0.012007
Complexity of Self-Assembled Shapes · SIAM J. Comput. 2007

Methods — techniques the papers use, named apart from their topics

simulation · 0.2kinetic barrier design · 0.2chemical logic circuits · 0.2DNA hybridization · 0.2rate equation modeling · 0.1associative memory simulation · 0.1wang tilings · 0.1universal constructor · 0.1
YearPublicationVenuePosition
2025 Differentiable Programming of Indexed Chemical Reaction Networks and Reaction-Diffusion Systems
abstract
Many molecular systems are best understood in terms of prototypical species and reactions. The central dogma and related biochemistry are rife with examples: gene i is transcribed into RNA i, which is translated into protein i; kinase n phosphorylates substrate m; protein p dimerizes with protein q. Engineered nucleic acid systems also often have this form: oligonucleotide i hybridizes to complementary oligonucleotide j; signal strand n displaces the output of seesaw gate m; hairpin p triggers the opening of target q. When there are many variants of a small number of prototypes, it can be conceptually cleaner and computationally more efficient to represent the full system in terms of indexed species (e.g. for dimerization, M_p, D_pq) and indexed reactions (M_p + M_q → D_pq). Here, we formalize the Indexed Chemical Reaction Network (ICRN) model and describe a Python software package designed to simulate such systems in the well-mixed and reaction-diffusion settings, using a differentiable programming framework originally developed for large-scale neural network models, taking advantage of GPU acceleration when available. Notably, this framework makes it straightforward to train the models’ initial conditions and rate constants to optimize a target behavior, such as matching experimental data, performing a computation, or exhibiting spatial pattern formation. The natural map of indexed chemical reaction networks onto neural network formalisms provides a tangible yet general perspective for translating concepts and techniques from the theory and practice of neural computation into the design of biomolecular systems.
Inhoo Lee, Salvador Buse, Erik Winfree
DNA3
2024 Learning and Inference in a Lattice Model of Multicomponent Condensates
Cameron T. Chalk, Salvador Buse, Krishna Shrinivas, Arvind Murugan, Erik Winfree
DNA5
2023 Revisiting Hybridization Kinetics with Improved Elementary Step Simulation
Jordan Lovrod, Boyan Beronov, Erik Winfree, Anne Condon
DNA4
2020 Stochastic chemical reaction networks for robustly approximating arbitrary probability distributions
abstract
We show that discrete distributions on the d-dimensional non-negative integer lattice can be approximated arbitrarily well via the marginals of stationary distributions for various classes of stochastic chemical reaction networks. We begin by providing a class of detailed balanced networks and prove that they can approximate any discrete distribution to any desired accuracy. However, these detailed balanced constructions rely on the ability to initialize a system precisely, and are therefore susceptible to perturbations in the initial conditions. We therefore provide another construction based on the ability to approximate point mass distributions and prove that this construction is capable of approximating arbitrary discrete distributions for any choice of initial condition. In particular, the developed models are ergodic, so their limit distributions are robust to a finite number of perturbations over time in the counts of molecules.
Daniele Cappelletti, Andrés Ortiz-Muñoz, David F. Anderson, Erik Winfree
Theor. Comput. Sci.4
2020 Verifying polymer reaction networks using bisimulation
Robert F. Johnson, Erik Winfree
Theor. Comput. Sci.2
2019 Reversible Computation Using Swap Reactions on a Surface
Tatiana Brailovskaya, Gokul Gowri, Sean Yu, Erik Winfree
DNA4
2019 Chemical Reaction Networks and Stochastic Local Search
Erik Winfree
DNA1
2019 Efficient Parameter Estimation for DNA Kinetics Modeled as Continuous-Time Markov Chains
Sedigheh Zolaktaf, Frits Dannenberg, Erik Winfree, Alexandre Bouchard-Côté, Mark Schmidt 0001, Anne Condon
DNA3
2019 Verifying chemical reaction network implementations: A bisimulation approach
abstract
Efforts in programming DNA and other biological molecules have recently focused on general schemes to physically implement arbitrary Chemical Reaction Networks. Errors in some of the proposed schemes have driven a desire for formal verification methods. By interpreting each implementation species as a multiset of formal species, the concept of weak bisimulation can be adapted to CRNs in a way that agrees with an intuitive notion of a correct implementation. The theory of CRN bisimulation can be used to prove the correctness of a general implementation scheme or to detect subtle problems. Given a specific formal CRN and a specific implementation CRN, the complexity of finding a valid interpretation between the two CRNs if one exists, and that of checking whether an interpretation is valid are both PSPACE-complete in the general case, but are NP-complete and polynomial-time respectively under an assumption that holds in many cases of interest. We present effective algorithms for both of those problems. We further discuss features of CRN bisimulation including a transitivity property and a modularity condition, the precise connection to the general theory of bisimulation, and an extension that takes into account spurious catalysts.
Robert F. Johnson, Erik Winfree
Theor. Comput. Sci.3
2019 Verifying chemical reaction network implementations: A pathway decomposition approach
abstract
The emerging fields of genetic engineering, synthetic biology, DNA computing, DNA nanotechnology, and molecular programming herald the birth of a new information technology that acquires information by directly sensing molecules within a chemical environment, stores information in molecules such as DNA, RNA, and proteins, processes that information by means of chemical and biochemical transformations, and uses that information to direct the manipulation of matter at the nanometer scale. To scale up beyond current proof-of-principle demonstrations, new methods for managing the complexity of designed molecular systems will need to be developed. Here we focus on the challenge of verifying the correctness of molecular implementations of abstract chemical reaction networks, where operation in a well-mixed “soup” of molecules is stochastic, asynchronous, concurrent, and often involves multiple intermediate steps in the implementation, parallel pathways, and side reactions. This problem relates to the verification of Petri nets, but existing approaches are not sufficient for providing a single guarantee covering an infinite set of possible initial states (molecule counts) and an infinite state space potentially explored by the system given any initial state. We address these issues by formulating a new theory of pathway decomposition that provides an elegant formal basis for comparing chemical reaction network implementations, and we present an algorithm that computes this basis. Our theory naturally handles certain situations that commonly arise in molecular implementations, such as what we call “delayed choice,” that are not easily accommodated by other approaches. We further show how pathway decomposition can be combined with weak bisimulation to handle a wider class that includes most currently known enzyme-free DNA implementation techniques. We anticipate that our notion of logical equivalence between chemical reaction network implementations will be valuable for other molecular implementations such as biochemical enzyme systems, and perhaps even more broadly in concurrency theory.
Seung Woo Shin, Chris Thachuk, Erik Winfree
Theor. Comput. Sci.3
2018 Optimizing Tile Set Size While Preserving Proofreading with a DNA Self-assembly Compiler
Constantine G. Evans, Erik Winfree
DNA2
2017 A General-Purpose CRN-to-DSD Compiler with Formal Verification, Optimization, and Simulation Capabilities
Stefan Badelt, Seung Woo Shin, Robert F. Johnson, Chris Thachuk, Erik Winfree
DNA6
2017 Chemical Boltzmann Machines
William Poole, Andrés Ortiz-Muñoz, Abhishek Behera, Nick S. Jones, Thomas E. Ouldridge, Erik Winfree, Manoj Gopalkrishnan
DNA6
2017 Inferring Parameters for an Elementary Step Model of DNA Structure Kinetics with Locally Context-Dependent Arrhenius Rates
Sedigheh Zolaktaf, Frits Dannenberg, Xander Rudelis, Anne Condon, Joseph M. Schaeffer, Mark Schmidt 0001, Chris Thachuk, Erik Winfree
DNA8
2016 Verifying Chemical Reaction Network Implementations: A Bisimulation Approach
Robert F. Johnson, Erik Winfree
DNA3
2016 Time Complexity of Computation and Construction in the Chemical Reaction Network-Controlled Tile Assembly Model
Nicholas Schiefer, Erik Winfree
DNA2
2015 Stochastic Simulation of the Kinetics of Multiple Interacting Nucleic Acid Strands
Joseph M. Schaeffer, Chris Thachuk, Erik Winfree
DNA3
2015 Universal Computation and Optimal Construction in the Chemical Reaction Network-Controlled Tile Assembly Model
Nicholas Schiefer, Erik Winfree
DNA2
2015 Leakless DNA Strand Displacement Systems
Chris Thachuk, Erik Winfree, David Soloveichik
DNA2
2014 Parallel and Scalable Computation and Spatial Dynamics with DNA-Based Chemical Reaction Networks on a Surface
Lulu Qian, Erik Winfree
DNA2
2013 DNA Sticky End Design and Assignment for Robust Algorithmic Self-assembly
Constantine G. Evans, Erik Winfree
DNA2
2013 Active self-assembly of algorithmic shapes and patterns in polylogarithmic time
abstract
We describe a computational model for studying the complexity of self-assembled structures with active molecular components. Our model captures notions of growth and movement ubiquitous in biological systems. The model is inspired by biology's fantastic ability to assemble biomolecules that form systems with complicated structure and dynamics, from molecular motors that walk on rigid tracks and proteins that dynamically alter the structure of the cell during mitosis, to embryonic development where large scale complicated organisms efficiently grow from a single cell. Using this active self-assembly model, we show how to efficiently self-assemble shapes and patterns from simple monomers. For example we show how to grow a line of monomers in time and number of monomer states that is merely logarithmic in its length. Our main results show how to grow arbitrary connected two-dimensional geometric shapes and patterns in expected time polylogarithmic in the size of the shape plus roughly the time required to run a Turing machine deciding whether or not a given pixel is in the shape. We do this while keeping the number of monomer types logarithmic in shape size, plus monomers required by the Kolmogorov complexity of the shape or pattern. This work thus highlights the fundamental efficiency advantage of active self-assembly over passive self-assembly and motivates experimental effort to construct self-assembly systems with active molecular components.
Damien Woods, Ho-Lin Chen, Scott Goodfriend, Nadine Dabby, Erik Winfree
ITCS5
2012 Simple evolution of complex crystal species
Rebecca Schulman, Erik Winfree
Nat. Comput.2
2011 Joint DAC/IWBDA special session design and synthesis of biological circuits
abstract
With the growing complexity of synthetic biological circuits, robust and systematic methods are needed for design and test. Leveraging lessons learned from the semiconductor and design automation industries, synthetic biologists are starting to adopt computer-aided design and verification software with some success. However, due to the great challenges associated with designing synthetic biological circuits, this nascent approach has to address many problems not present in electronic circuits. In this session, three leading synthetic biologists will share how they have developed software tools to help design and verify their synthetic circuits, the unique challenges they face, and their insights into the next generation of tools for synthetic biology.
Douglas Densmore, Mark Horowitz, Smita Krishnaswamy, Xiling Shen, Adam P. Arkin, Erik Winfree, Christopher A. Voigt
DAC6
2011 Erratum to "The computational power of Benenson automata" [Theoret. Comput. Sci. 344 (2005) 279-297]
David Soloveichik, Erik Winfree
Theor. Comput. Sci.2
2010 Efficient Turing-Universal Computation with DNA Polymers
Lulu Qian, David Soloveichik, Erik Winfree
DNA3
2010 Simple Evolution of Complex Crystal Species
Rebecca Schulman, Erik Winfree
DNA2
2009 Error suppression mechanisms for DNA tile self-assembly and their simulation
Kenichi Fujibayashi, David Yu Zhang, Erik Winfree, Satoshi Murata
Nat. Comput.3
2009 Programmable Control of Nucleation for Algorithmic Self-Assembly
abstract
Algorithmic self-assembly, a generalization of crystal growth processes, has been proposed as a mechanism for autonomous DNA computation and for bottom-up fabrication of complex nanostructures. A “program” for growing a desired structure consists of a set of molecular “tiles” designed to have specific binding interactions. A key challenge to making algorithmic self-assembly practical is designing tile set programs that make assembly robust to errors that occur during initiation and growth. One method for the controlled initiation of assembly, often seen in biology, is the use of a seed or catalyst molecule that reduces an otherwise large kinetic barrier to nucleation. Here we show how to program algorithmic self-assembly similarly, such that seeded assembly proceeds quickly but there is an arbitrarily large kinetic barrier to unseeded growth. We demonstrate this technique by introducing a family of tile sets for which we rigorously prove that, under the right physical conditions, linearly increasing the size of the tile set exponentially reduces the rate of spurious nucleation. Simulations of these “zig-zag” tile sets suggest that under plausible experimental conditions, it is possible to grow large seeded crystals in just a few hours such that less than 1 percent of crystals are spuriously nucleated. Simulation results also suggest that zig-zag tile sets could be used for detection of single DNA strands. Together with prior work showing that tile sets can be made robust to errors during properly initiated growth, this work demonstrates that growth of objects via algorithmic self-assembly can proceed both efficiently and with an arbitrarily low error rate, even in a model where local growth rules are probabilistic.
Rebecca Schulman, Erik Winfree
SIAM J. Comput.2
2008 Toward molecular programming with DNA
abstract
Biological organisms are beautiful examples of programming. The program and data are stored in biological molecules such as DNA, RNA, and proteins; the algorithms are carried out by molecular and biochemical processes; and the end result is the creation and function of an organism. If we understood how to program molecular systems, what could we create? Lifelike technologies whose basic operations are chemical reactions? The fields of chemistry, physics, biology, and computer science are converging as we begin to synthesize molecules, molecular machines, and molecular systems of ever increasing complexity, leading to subdisciplines such as DNA nanotechnology, DNA computing, and synthetic biology. Having demonstrated simple devices and systems -- self-assembled structures, molecular motors, chemical logic gates -- researchers are now turning to the question of how to create large-scale integrated systems. To do so, we must learn how to manage complexity: how to efficiently specify the structure and behavior of intricate molecular systems, how to compile such specifications down to the design of molecules to be synthesized in the lab, and how to ensure that such systems function robustly. These issues will be illustrated for chemical logic circuits based on cascades of DNA hybridization reactions.
Erik Winfree
ASPLOS1
2008 A Simple DNA Gate Motif for Synthesizing Large-Scale Circuits
Lulu Qian, Erik Winfree
DNA2
2008 DNA as a Universal Substrate for Chemical Kinetics
David Soloveichik, Georg Seelig, Erik Winfree
DNA3
2008 How crystals that sense and respond to their environments could evolve
Rebecca Schulman, Erik Winfree
Nat. Comput.2
2008 Combining self-healing and proofreading in self-assembly
David Soloveichik, Matthew Cook 0001, Erik Winfree
Nat. Comput.3
2008 Computation with finite stochastic chemical reaction networks
David Soloveichik, Matthew Cook 0001, Erik Winfree, Jehoshua Bruck
Nat. Comput.3
2007 Complexity of Self-Assembled Shapes
abstract
The connection between self‐assembly and computation suggests that a shape can be considered the output of a self‐assembly “program,” a set of tiles that fit together to create a shape. It seems plausible that the size of the smallest self‐assembly program that builds a shape and the shape’s descriptional (Kolmogorov) complexity should be related. We show that when using a notion of a shape that is independent of scale, this is indeed so: in the tile assembly model, the minimal number of distinct tile types necessary to self‐assemble a shape, at some scale, can be bounded both above and below in terms of the shape’s Kolmogorov complexity. As part of the proof, we develop a universal constructor for this model of self‐assembly that can execute an arbitrary Turing machine program specifying how to grow a shape. Our result implies, somewhat counterintuitively, that self‐assembly of a scaled‐up version of a shape often requires fewer tile types. Furthermore, the independence of scale in self‐assembly theory appears to play the same crucial role as the independence of running time in the theory of computability. This leads to an elegant formulation of languages of shapes generated by self‐assembly. Considering functions from bit strings to shapes, we show that the running‐time complexity, with respect to Turing machines, is polynomially equivalent to the scale complexity of the same function implemented via self‐assembly by a finite set of tile types. Our results also hold for shapes defined by Wang tiling—where there is no sense of a self‐assembly process—except that here time complexity must be measured with respect to nondeterministic Turing machines.
David Soloveichik, Erik Winfree
SIAM J. Comput.2
2006 Fault-Tolerance in Biochemical Systems
Erik Winfree
UC1
2005 The computational power of Benenson automata
David Soloveichik, Erik Winfree
Theor. Comput. Sci.2
2004 Neural Network Computation by In Vitro Transcriptional Circuits
abstract
The structural similarity of neural networks and genetic regulatory net- works to digital circuits, and hence to each other, was noted from the very beginning of their study [1, 2]. In this work, we propose a simple biochemical system whose architecture mimics that of genetic regula- tion and whose components allow for in vitro implementation of arbi- trary circuits. We use only two enzymes in addition to DNA and RNA molecules: RNA polymerase (RNAP) and ribonuclease (RNase). We develop a rate equation for in vitro transcriptional networks, and de- rive a correspondence with general neural network rate equations [3]. As proof-of-principle demonstrations, an associative memory task and a feedforward network computation are shown by simulation. A difference between the neural network and biochemical models is also highlighted: global coupling of rate equations through enzyme saturation can lead to global feedback regulation, thus allowing a simple network without explicit mutual inhibition to perform the winner-take-all computation. Thus, the full complexity of the cell is not necessary for biochemical computation: a wide range of functional behaviors can be achieved with a small set of biochemical components. 1 Introduction Biological organisms possess an enormous repertoire of genetic responses to everchang- ing combinations of cellular and environmental signals. Characterizing and decoding the connectivity of the genetic regulatory networks that govern these responses is a major chal- lenge of the post-genome era [4]. Understanding the operation of biological networks is in- tricately intertwined with the ability to create sophisticated biochemical networks de novo. Recent work developing synthetic genetic regulatory networks has focused on engineered circuits in bacteria wherein protein signals are produced and degraded [5, 6]. Although remarkable, such network implementations in bacteria have many unknown and uncontrol- lable parameters. We propose a biochemical model system a simplified analog of genetic regulatory circuits that provides well-defined connectivity and uses nucleic acid species as fuel and signals that control the network. Our goal is to establish an explicit model to guide the laboratory construction of synthetic biomolecular systems in which every component is known and RNAP transcript RNase inhibitor (A) activator DNA switch (B) Figure 1: (A) The components of an in vitro circuit. The switch template (blue) is shown with the activator (red) attached. The dotted box indicates the promoter sequence and the downstream direction. (B) The correspondence between a neural network and an in vitro biochemical network. Neuron activity corresponds to RNA transcript concentration, while synaptic connections correspond to DNA switches with specified input and output. where quantitative predictions can be tested. Only two enzymes are used in addition to syn- thetic DNA templates: RNA polymerase, which recognizes a specific promoter sequence in double-stranded DNA and transcribes the downstream DNA to produce an RNA tran- script, and ribonuclease, which degrades RNA but not DNA. In this system, RNA transcript concentrations are taken as signals. Synthetic DNA templates may assume two different conformations with different transcription efficiency: ON or OFF. Upon interaction with a RNA transcript of the appropriate sequence, the DNA template switches between differ- ent conformations like a gene regulated by transcription factors. The connectivity which RNA transcripts regulate which DNA templates is dictated by WatsonCrick base-pairing rules and is easy to program. The network computation is powered by rNTP that drives the synthesis of RNA signals by RNAP, while RNase forces transient signals to decay. With a few assumptions, we find that this stripped-down analog of genetic regulatory networks is mathematically equivalent to recurrent neural networks, confirming that a wide range of programmable dynamical behaviors is attainable. 2 Construction of the transcriptional network The DNA transcriptional switch. The elementary unit of our networks will be a DNA switch, which serves the role of a gene in a genetic regulatory circuit. The basic require- ments for a DNA switch are to have separate input and output domains, to transcribe poorly by itself [7], and to transcribe efficiently when an activator is bound to it. A possible mech- anism of activation is the complementation of an incomplete promoter region, allowing more favorable binding of RNAP to the DNA template. Figure 1A illustrates our proposed design for DNA transcriptional switches and circuits. We model a single DNA switch with the following binding reactions: A + I AI OFF D + A DA ON ON DA + I D + AI OFF where D (blue) is a DNA template with an incomplete promoter region, A (red) is an activator that complements the incomplete promoter region, and I (green) is an inhibitor complementary to A. Thus, I can bind free A. Furthermore, activator A contains a "toe- hold" region [8] that overhangs past the end of D, allowing inhibitor I to strip off A from the DA complex. D is considered OFF and DA is considered ON, based on their efficiency as templates for transcription. This set of binding reactions provides a means to choose the threshold of the sigmoidal activation function, as will be explained later. RNAP and RNase drive changes in RNA transcript concentration; their activity is modeled using a first-order approximation for enzyme kinetics. For the moment, we assume that the input species (activator and inhibitor) are held at constant levels by external control. By RNA polymerase By RNase k k DA p DA + R R d k D p D + R where 0 < < 1 due to lack of activation and represents the complete degradation of RNA products by RNase. kd and kp are set by the concentration of enzymes. In general, a set of chemical reactions obeying mass action have dynamics described by d[Xi] = k [X ) dt j ]r j (p i - ri j where k is the rate constant, ri is the stoichiometry of species Xi as a reactant (typically 0 or 1), and pi is the stoichiometry of Xi as a product in reaction . Analysis of our system is greatly simplified by the assumption that the binding reactions are fast and go to completion. We define Dtot as the sum of free and bound species:Dtot = [D] + [DA]. Similarly, Itot = [I]+[AI] and Atot = [A]+[DA]+[AI]. Then, [DA] depends on Dtot and , where = Atot - Itot. Because I can scavenge A whether the latter is free or bound to D, A can activate D only when > 0. The amount of [DA] is proportional to when 0 < < Dtot, as shown in Figure 2A. It is convenient to represent this nonlinearity using a piecewise-linear approximation of a sigmoidal function, specifically, (x) = |x+1|-|x-1| . 2 Thus, we can represent [DA] using and a rescaled : [DA] = 1 Dtot(1 + ( ^ )), where 2 ^ = 2 Dtot - 1 is called the signal activity. At steady-state, kd[R] = kp[DA] + kp[D]; thus, 1 k [R] = p Dtot((1 2 k - )(^) + 1 + ) . d If we consider the activator concentration as an input and the steady-state transcript con- centration as an output, then the (presumed constant) inhibitor concentration, I tot, sets the threshold, and the function assumes a sigmoidal shape (Fig. 2D). Adjusting the amount of template, Dtot, sets the magnitude of the output signal and the width of the transition re- gion (Fig. 2C). We can adjust the width of the transition region independent of the threshold such that a step function would be achieved in the limit. Thus, we have a sigmoidal func- tion with an adjustable threshold, without reliance on cooperative binding of transcription factors as is common in biological systems [9]. Networks of transcriptional switches. The input domain of a DNA switch is upstream of the promoter region; the output domain is downstream of the promoter region. This separation of domains allows us to design DNA switches that have any desired connectivity. [ DA ] (x) tot D 1 [ R ] [ R ] -1 1 x tot D -1 tot tot (A) (B) (C) A (D) A Figure 2: (A) [DA] as a function of . (B) The sigmoid (x). (C,D) [R] as a function of Atot for three values of Dtot and Itot, respectively. We assume that distinct signals in the network are represented as distinct RNA sequences that have negligible crosstalk (undesired binding of two molecules representing different signals). The set of legitimate binding reactions is as follows: j A + Ij j A I j OFF D ij j D ij j A ON + A ON ij D j A + I j D ij + j A I j OFF where Dij is the DNA template that has the jth input domain and ith output domain, the activator Aj complements the incomplete promoter region of Dij, and the inhibitor Ij is complementary to Aj. Note that Ij can strip off Aj from the DijAj complex, thus imposing a sharp threshold as before. Again, we assume fast and complete binding reactions. The set of enzyme reactions for the transcriptional network is as follows: By RNA polymerase By RNase k k D p d ij Aj k Dij Aj + Ai if sij = 1 Ij k D p d ij Dij + Ai Aj k k D p d ij Aj k Dij Aj + Ii if sij = -1 AjIj k D p d ij Dij + Ii DijAj Dij where sij {+1, -1} indicates whether switch ij will produce an activator or an inhibitor. This notation reflects that the production of Ii is equivalent to the consumption of Ai. The change of RNA concentrations over time is easy to express with i = Atot i - Itot i : di = s dt -kd i + kp ij ([Dij Aj ] + [Dij ]) . (1) j Network equivalence. We show next that the time evolution of this biochemical network model is equivalent to that of a general Hopfield neural network model [3]: dx i = w dt -xi + ij (xj ) + i . (2) j Equation 1 can be rewritten to use the same nonlinear activation function defined earlier. Let ^ i = 2i Dtot - 1 be a rescaled difference between activator and inhibitor concentrations, i where Dtot i is the load on Ai, i.e., the total concentration of all switches that bind to Ai: Dtot i = Dtot j ji and Dtot ij = [DijAj] + [Dij]. Then, we can derive the following rate equation, where ^ i plays the role of unit i's activity xi: 1 d ^ i k Dtot k Dtot = p (1 ij ( ^ p (1 + )s ij k -^i + - )sij j )+ ij - 1 . d dt k Dtot k Dtot j d i j d i (3) Given the set of constants describing an arbitrary transcriptional network, the constants for an equivalent neural network can be obtained immediately by comparing Equations 2 and 3. The time constant is the inverse of the RNase degradation rate: fast turnover of RNA molecules leads to fast response of the network. The synaptic weight wij is proportional to the concentration of switch template ij, attenuated by the load on Ai. However, the thresh- old i is dependent on the weights, perhaps implying a lack of generality. To implement an arbitrary neural network, we must introduce two new types of switches to the transcrip- tional network. To achieve arbitrary thresholds, we introduce bias switches DiB which have no input domain and thus produce outputs constitutively; this adds an adjustable con- stant to the right hand side of Equation 3. To balance the load on Ai, we add null switches D0i which bind to Ai but have no output domain; this allows us to ensure that all Dtot i are equal. Consequently, given any neural network with weights wij and thresholds i, we can specify concentrations Dtot ij such that the biochemical network has identical dynamics, for some . MichaelisMenten enzyme reactions. Next, we explore the validity of our assumption that enzyme kinetics are first-order reactions. A basic but more realistic model is the MichaelisMenten mechanism [10], in which the enzyme and substrate bind to form an enzyme-substrate complex. For example, if E is RNAP, k+ k E + D cat ij Aj EDijAj E + DijAj + Ii/Ai . k- An important ramification of MichaelisMenten reactions is that there is competition for the enzyme by the substrates, because the concentration of available enzymes is reduced as they bind to substrates, leading to saturation when the enzyme concentration is limit- ing. Using the steady-state assumption for MichaelisMenten reactions, we establish the following relations to the rate constants of first-order reactions: Etot k Etot k Etot k k cat cat d d,cat p = k (4) 1 + L K kp = d = M 1 + L K 1 + L K M d d,M where kcat and KM = (k- + kcat)/k+ are the catalytic constant (enzyme's speed) and Michaelis constant (enzyme's affinity to target) of RNAP for the ON state switch, kcat and KM are for the OFF state switch, and kd,cat and Kd,M are the constants of RNase. Etot [D and Etot ij Aj ] + d are the concentrations of RNAP and RNase, respectively. L = i,j KM [Dij ] is the load on RNAP and L [Aj ]+[Ij ]+[Aj Ij ]+[Dij Aj ] is the load on i,j K d = i,j K M d,M RNase (i.e., the total concentration of binding targets divided by the Michaelis constants of the enzymes), both of which may be time varying. To make the first-order approximation valid, we must keep L and Ld constant. Introduction of a new type of switch with different Michaelis constants can make L constant by balancing the load on the enzyme. A scheme to keep Ld constant is not obvious, so we set reaction conditions such that Ld 1. 3 Example computations by transcriptional networks Feed-forward networks. We first consider a feed-forward network to compute f (x, y, z) = xyz + yz + x. From the Boolean circuit shown in Figure 3A, we can construct an equivalent neural network. We label units 1 through 6: units 1, 2, 3 correspond to inputs x, y, z whereas units 4, 5, 6 are computation units. Using the conversion rule discussed in the network equivalence section, we can calculate the parameters of the transcriptional network. Under the first-order approximation of Equation 3, the simulation result is exact (Fig. 3C). For comparison, we also explicitly simulated mass action dynamics for the full set of chemical equations with the MichaelisMenten enzyme reactions, using biologically plausible rate constants and with Etot and Etot d calculated from Equation 4 using estimated values of L and Ld. The full model performs the correct calculation of f for all eight 3-bit inputs, although the magnitude of signals is exaggerated due to an underestimate of RNase load (Fig. 3C). Associative memories. Figure 4A shows three 4-by-4 patterns to be memorized in a con- tinuous neural network [3]. We chose orthogonal patterns because a 16 neuron network has limited capacity. Our training algorithm is gradient descent combined with the perceptron learning rule. After training, the parameters of the neural network are converted to the parameters of the transcriptional network as previously described. Starting from a random 6 x x 1 -1 4 1 -2 2 f 1 y 1 i^ 0 y -1 f 1 2 -2 1 -1 -4 (A) z (B) z 1 (C) 0 200 400 600 800 1000 time(sec) Figure 3: (A,B) A Boolean circuit and a neural network to compute f (x, y, z) = xyz+ yz+ x. (C) The activity of computation units (first-order approximation: solid lines; Michaelis- Menten reaction: dotted lines) for x=True=1, y=False=-1, z=True=1. 3 2 1 i^ 0 -1 -2 (A) (B) -30 200 400 600 time(sec) Figure 4: (A) The three patterns to be memorized. (B) Time-course for the transcriptional network recovery of the third pattern. (odd columns: blue lines, even columns: red lines) initial state, a typical response of the transcriptional network (with the first-order approx- imation of Equation 3) is shown in Figure 4B. Thus, our in vitro transcriptional networks can support complex sets of stable steady-states. A winner-take-all network. Instead of trying to compensate for the saturation phenomena of MichaelisMenten reactions, we can make use of it for computation. As an example, consider the winner-take-all computation [11], which is commonly implemented as a neu- ral network with O(N 2) mutually inhibitory connections (Fig. 5A), but which can also be implemented as an electrical circuit with O(N ) interconnections by using a single global inhibitory feedback gate [12]. In a biochemical system, a limited global resource, such as RNAP, can act to regulate all the DNA switches and thus similarly produce global inhibi- tion. This effect is exploited by the simple transcriptional network shown in Figure 5B, in which the output from each DNA switch activates the same DNA switch itself, and mutual inhibition is achieved by competition for RNAP. Specifically, we have switch templates Dii with fixed thresholds set by Ii, and Dii produces Ai as its output RNA. With the instant binding assumption, we then derive the following equation: dAtot i Etot k Etot k k = d d,cat Atot cat [D cat [D dt -1 + L i + iiAi] + ii] . (5) d Kd,M 1 + L KM KM The production rate of Ai depends on Atot i and on L, while the degradation rate of Ai depends on Atot i and on Ld, as shown in Figure 6A. For a winner-take-all network, an ON state switch draws more RNAP than an OFF state switch (because of the smaller Michaelis constant for the ON state). Thus, if the other switches are turned OFF, the load on RNAP (L) becomes small, leading to faster production of the remaining ON switches. When the production rate curve and the degradation rate curve have three intersections, bistability is achieved such that the switches remain ON or OFF, depending on their current state. Consider n equivalent switches starting with initial activator concentrations above the threshold, and with the highest concentration at least above the rest (as a percentage). Analysis indicates that a less leaky system (small ) and sufficient differences in initial activator concentrations (large ) can guarantee the existence of a unique winner. Simula- tions of a 10-switch winner-take-all network confirm this analysis, although we do not see perfect behavior (Fig. 6B). Figure 6C shows a time-course of a unique winner situation. Switches get turned OFF one by one whenever the activator level approaches the threshold, until only one switch remains ON. -1 -1 -1 -1 0.5 0.5 0.5 0.5 0.5 0.5 -1 -1 (A) 1 1 1 (B) 1 1 1 Figure 5: (A) A 3-unit WTA network with explicit mutual inhibition. (B) An equivalent biochemical network. 30 1 3 tot i d A 25 0.8 2.5 dt L : low 20 2 0.6 / M] 15 1/ i 1.5 0.4 [A L : high 10 1 0.2 5 0.5 0 tot tot tot tot 5 10 15 0 (A) i I i +D I ii A i (B) (%) (C) 0 5000 10000 15000 time(sec) Figure 6: For WTA networks: (A) Production rates (solid lines) for two different L's, compared to a linear degradation rate (dotted line). (B) Empirical probability of correct output as a function of and . (C) Time-course with = 0.33% and = 0.04. Similarly, we can consider a k-WTA network where k winners persist. If we set the pa- rameters appropriately such that k winners are stable but k + 1 winners are unstable, the simulation result recovered k winners most of the time. Even a single k-WTA gate can provide impressive computational power [13].
John J. Hopfield, Erik Winfree
NIPS3
2000 The program-size complexity of self-assembled squares (extended abstract)
abstract
Molecular self-assembly gives rise to a great diversityofcomplex forms, from crystals and DNA helices to microtubules and holoenzymes. We study a formal model of pseudocrystalline self-assembly, called the Tile Assembly Model, in which atilemay be added to the growing object when the total interaction strength with its neighbors exceeds a parameter T. This model has been shown to be Turinguniversal. Thus, self-assembled objects can be studied from the point of view of computational complexity. Here, we dene the program size complexity ofanNN square to be the minimum number of distinct tiles required to self-assemble the square and no other objects. We study this complexity under the Tile Assembly Model and nd a dramatic decrease in complexity, from N 2 tiles to O(log N) tiles,asT is increased from 1 (where bonding is noncooperative) to 2 (allowing cooperative bonding). Further, we nd that the size of the largest square uniquely produced by a set of n tiles grows faster than any computable function. 1.
Paul W. K. Rothemund, Erik Winfree
STOC2