Teresa Serrano-Gotarredona

dblp:14/1270 · DBLP profile ↗
← Back
77ranked-venue papers
14as first author
17since 2021 · last 2026
0000-0001-5714-2526ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Systems, architecture and hardware · 49 · 7 first-author · 12 since 2021Artificial intelligence and machine learning · 25 · 7 first-author · 5 since 2021Graphics, computer vision, multimedia, augmented reality and games · 7 · 2 since 2021Applied, interdisciplinary, general and emerging computing · 1
YearPublicationVenuePosition
2026 Implementation of Spike-Timing-Dependent Plasticity for epileptic seizure recovery on neuromorphic memristive hardware
Ivan Diez-de-los-Rios, Luis A. Camuñas-Mesa, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2026 A Smart Rotation-Tolerant and Self-Positioning WPT System for Freely Moving Small Animals
Saeideh Pahlavan, Shahin Jafarabadi-Ashtiani, Seyed Abdollah Mirbozorgi, Mostafa Shooshtari, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS5
2026 A Biomimetic Nanopore Memristor Model for Emulating Synaptic Plasticity in Neuromorphic Circuits
abstract
[EN] This study presents a comprehensive circuit-based nanopore model for emulating memristive and synaptic behaviors in neuromorphic systems. A set of governing mathematical equations describing the voltage- and time-dependent ion transport dynamics within the nanopore were derived and implemented in Verilog-A, enabling seamless integration into circuit simulators such as Cadence Virtuoso for hardware-level analysis. The model reproduces key electronic characteristics, including nonlinear current¿voltage (I¿V) hysteresis and voltage-controlled resistive switching, confirming its memristive nature. Beyond conventional memristive behavior, the nanopore model exhibits biologically inspired learning mechanisms such as spike-duration-, spike-voltage-, and spike-frequency-dependent plasticity (SDDP, SVDP, SFDP), as well as paired-pulse facilitation (PPF), closely mimicking the short-term and long-term adaptation observed in biological synapses. Simulation results demonstrate how the nanopore¿s conductance dynamically evolves with variations in pulse width, amplitude, and frequency, revealing tunable memory effects and temporal learning capabilities. These findings establish the nanopore-based memristor as a promising candidate for neuromorphic computing, bio-signal processing, and cognitive hardware architectures, providing a scalable bridge between nanoscale ionic transport physics and large-scale circuit-level implementation.
Mostafa Shooshtari, Saeideh Pahlavan, Teresa Serrano-Gotarredona, Juan Bisquert, Bernabé Linares-Barranco
ISCAS3
2026 Electrode-Dependent Gas Sensing Behavior of CNT-TiO2 Hybrids for Ethanol Detection
Mostafa Shooshtari, Sten Vollebregt, Alireza Salehi, Saeideh Pahlavan, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS5
2025 Real-Time Seizure Detection in Microelectrode Array based on Z-Test Spike Detection for Hardware Implementation
abstract
Epilepsy, affecting more than 50 million individuals globally, represents a significant clinical challenge, as numerous cases exhibit resistance to pharmacological treatment. Neural implants with advanced algorithms for on-device processing are transforming epilepsy management, enabling precise seizure detection and control. On-device algorithms must optimize computation to lower power use and minimize transmission bandwidth, ensuring long-term viability. We propose a new algorithm that combines a Z-test-based outlier detection approach with a heuristic decision tree to differentiate between interictal and ictal events. This algorithm operates in real-time to segment local field potentials (LFP) recorded via microelectrode arrays (MEA), detecting seizure onsets with minimal latency and low power requirements. Tested on an MEA dataset from brain slices, our algorithm achieved 98% sensitivity, 93% precision, 92% accuracy, and a 6% false detection rate (FDR), achieving a seizure detection latency of 0.5 ± 0.6 seconds. This work shows a robust, low-computation, low-latency approach resilient to noise requiring minimal configuration, advancing brain implantable devices for epilepsy treatment.
Gabriel Galeote-Checa, Teresa Serrano-Gotarredona, Gabriella Panuccio, Bernabé Linares-Barranco
ISCAS2
2025 New self-calibration algorithm for programmable multi-core memristor-CMOS chip for neuromorphic computing
abstract
The advent of hybrid memristor-CMOS technologies opens an exciting alternative to implement compact neuromorphic hardware with dense layers of neurons interconnected via memristive synapses for low-power energy-efficient high-speed inference applications and online learning. However, before implementing large multi-layer networks with higher number of neurons, many practical issues should be overcome, both associated to the memristive devices and the CMOS architecture. For that, we have designed a configurable and scalable multi-core architecture based on a computing core formed by 64 pre- and 64 post-synaptic neurons densely interconnected through 4k memristors. In this work, we present a chip including 16 cores, which allow for several different combinations with a total number of 64k memristors. A test infrastucture has been implemented to configure different architectures and run experiments from a processor. A new iterative self-calibration algorithm has been proposed to compensate for mismatch variations of the critical CMOS part, and an inference experiment with larger-resolution binary images has been demonstrated as a proof of concept.
Ivan Diez-de-los-Rios, Luis A. Camuñas-Mesa, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2024 Mismatch calibration strategy for query-driven AER read-out in a memristor-CMOS neuromorphic chip
abstract
The emergence of hybrid memristor-CMOS technologies open a promising way to implement compact neuromorphic systems with dense layers of neurons interconnected through memristive synapses for high-speed and low-power inference applications and online learning. However, there are still many practical issues which should be overcome, especially related to the memristive devices, but also to the CMOS circuitry. In particular, transistor mismatch can produce very different behaviors between neurons, reducing dramatically the performance of the system. In this work, we propose a mismatch calibration strategy to compensate this effect by performing a post-fabrication characterization of neurons behavior and applying proportional threshold voltages at the comparator which activates the generation of output events. We have implemented the proposed strategy on a CMOL-like memristor-CMOS neuromorphic chip with 64 input neurons, 64 output neurons and 4096 1T1R synapses, fabricated in 130nm CMOS with 200nmsized Ti/HfOx/TiN memristors on top, obtaining a performance improvement from 49% to 80% in an inference experiment.
Luis A. Camuñas-Mesa, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS2
2023 An Event-Based Tracking Control Framework for Multirotor Aerial Vehicles Using a Dynamic Vision Sensor and Neuromorphic Hardware
abstract
In this paper, we present an event-based control framework for the efficient tracking of contour-based areas, such as road pavements, using a multirotor aerial vehicle equipped with a bio-inspired Dynamic Vision Sensor (DVS). Concerning the detection part, the DVS camera captures events, which are asynchronously fed into a Neuromorphic Hough Transform algorithm running on a SpiNN-3 board and implemented as a Spiking Neural Network (SNN). Next, the asynchronous output of the detection module is fed into an analytically formulated event-based Partitioned Visual Servoing (PVS) algorithm, running on conventional processing hardware, which allows the multirotor to autonomously track and navigate along the detected contour. The proposed architecture achieves efficient tracking of contour-based areas, while constantly maintaining the latter inside the DVS camera's field of view. A set of real-time experiments in various settings employing an octorotor equipped with a downward-looking DVS and a SpiNN-3 board demonstrate the effectiveness of the suggested framework.
Sotirios N. Aspragkathos, Evangelos Ntouros, George C. Karras, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona, Kostas J. Kyriakopoulos
IROS5
2023 A multi-core memristor chip for Stochastic Binary STDP
abstract
This paper describes the design of a monolithic CMOS-memristive neuromorphic chip performing vector matrix multiplication between spike coded input vectors and the synaptic weights stored in the memristive array. A computing core including a$64\times 64$memristive array connecting 64 input and 64 output neurons has been fabricated. A Spiking Neural Network with a memristive synaptic layer exhibiting Stochastic Binary Spike-Time-Dependent-Plasticity has been experimentally demonstrated with the fabricated core. The CMOS-memristive neuromorphic processor is designed following a compact pseudo-CMOL design style that results in a modular and scalable computing core with a synaptic density of 22Ksynapses/mm2. A single core has been fabricated in CEA-LETI 130nm CMOS-RRAM technology and its operation has been experimentally characterized. A multicore architecture with reconfigurable connectivity, where cores can be interconnected to either share pre-synaptic neurons and expand post-synaptic neurons, or vice versa, share post-synaptic neurons and expand pre-synaptic neurons, is proposed and presented here.
Ivan Diez-de-los-Rios, Luis A. Camuñas-Mesa, Elisa Vianello, Carlo Reita, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS5
2023 Performance comparison of DVS data spatial downscaling methods using Spiking Neural Networks
abstract
Dynamic Vision Sensors (DVS) are an unconventional type of camera that produces sparse and asynchronous event data, which has recently led to a strong increase in its use for computer vision tasks namely in robotics. Embedded systems face limitations in terms of energy resources, memory, computational power, and communication bandwidth. Hence, this application calls for a way to reduce the amount of data to be processed while keeping the relevant information for the task at hand. We thus believe that a formal definition of event data reduction methods will provide a step further towards sparse data processing.The contributions of this paper are twofold: we introduce two complementary neuromorphic methods based on Spiking Neural Networks for DVS data spatial reduction, which is to best of our knowledge the first proposal of neuromorphic event data reduction; then we study for each method the trade-off between the amount of information kept after reduction, the performance of gesture classification after reduction and their capacity to handle events in real time. We demonstrate here that the proposed SNN-based methods outperform existing methods in a classification task for most dividing factors and are significantly better at handling data in real time, and make therefore the optimal choice for fully-integrated energy-efficient event data reduction running dynamically on a neuromorphic platform. Our code is publicly available online at: https://github.com/amygruel/EvVisu.
Amélie Gruel, Jean Martinet, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
WACV4
2023 Effect of Device Mismatches in Differential Oscillatory Neural Networks
abstract
Analog implementation of Oscillatory Neural Networks (ONNs) has the potential to implement fast and ultra-low-power computing capabilities. One of the drawbacks of analog implementation is component mismatches which cause desynchronization and instability in ONNs. Emerging devices like memristors and VO2are particularly prone to variations. In this paper, we study the effect of component mismatches on the performance of differential ONNs (DONNs). Mismatches were considered in two main blocks: differential oscillatory neurons and synaptic circuits. To measure DONN tolerance to mismatches in each block, performance was evaluated with mismatches being present separately in each block. Memristor-bridge circuits with four memristors were used as the synaptic circuits. The differential oscillatory neurons were based on VO2-devices. The simulation results showed that DONN performance was more vulnerable to mismatches in the components of the differential oscillatory neurons than to mismatches in the synaptic circuits. DONNs were found to tolerate up to 20% mismatches in the memristance of the synaptic circuits. However, mismatches in the differential oscillatory neurons resulted in non-uniformity of the natural frequencies, causing desynchronization and instability. Simulations showed that 0.5% relative standard deviation (RSD) in natural frequencies can reduce DONN performance dramatically. In addition, sensitivity analyses showed that the high threshold voltage of VO2-devices is the most sensitive parameter for frequency non-uniformity and desynchronization.
Jafar Shamsi, Maria J. Avedillo, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
IEEE Trans. Circuits Syst. I Regul. Pap.4
2023 Fully Parallel Stochastic Computing Hardware Implementation of Convolutional Neural Networks for Edge Computing Applications
abstract
Edge artificial intelligence (AI) is receiving a tremendous amount of interest from the machine learning community due to the ever-increasing popularization of the Internet of Things (IoT). Unfortunately, the incorporation of AI characteristics to edge computing devices presents the drawbacks of being power and area hungry for typical deep learning techniques such as convolutional neural networks (CNNs). In this work, we propose a power-and-area efficient architecture based on the exploitation of the correlation phenomenon in stochastic computing (SC) systems. The proposed architecture solves the challenges that a CNN implementation with SC (SC-CNN) may present, such as the high resources used in binary-to-stochastic conversion, the inaccuracy produced by undesired correlation between signals, and the complexity of the stochastic maximum function implementation. To prove that our architecture meets the requirements of edge intelligence realization, we embed a fully parallel CNN in a single field-programmable gate array (FPGA) chip. The results obtained showed a better performance than traditional binary logic and other SC implementations. In addition, we performed a full VLSI synthesis of the proposed design, showing that it presents better overall characteristics than other recently published VLSI architectures.
Christiam F. Frasser, Pablo Linares-Serrano, Ivan Diez-de-los-Rios, Alejandro Morán, Erik S. Skibinsky-Gitlin, Joan Font-Rosselló, Vicent Canals, Miquel Roca 0001, Teresa Serrano-Gotarredona, Josep L. Rosselló
IEEE Trans. Neural Networks Learn. Syst.9
2022 A Hybrid Memristor/CMOS SNN for Implementing One-Shot Winner-Takes-All Training
abstract
This paper presents a spiking neural network for pattern recognition. The network synapses are realized by resistive switching random access memory (ReRAM) cells, which are a stack of Au/Ti/C/Ti/HfO2/Pt. These cells are connected to an array of NMOS transistors (fabricated in a CMOS 180nm technology) to form a 4by4 1T1R crossbar between pre and postsynaptic circuitries. The pre-synaptic part contains conditioning circuits to reshape the inputs before applying them to the memristive crossbar. The post-synaptic section includes current attenuators that allowed the memristor domain currents to be mapped to neuron domain currents, as well as physiologically realistic neuron circuits fabricated in a CMOS 180nm technology. As a demonstrator, the network is trained with one-shot winner-takes-all method to differentiate four input patterns in its inference mode.
Javad Ahmadi-Farsani, Saverio Ricci, Shahin Hashemkhani, Daniele Ielmini, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
ISCAS6
2022 SL-Animals-DVS: event-driven sign language animals dataset
Ajay Vasudevan, Pablo Negri, Camila Di Ielsi, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
Pattern Anal. Appl.5
2021 Novel programmable single pulse generator for producing pulse widths in different time scales
abstract
A novel programmable single pulse generator for producing a pulse in different time scales and amplitudes is presented in this paper to drive integrate-and-fire neuron circuits. The proposed circuit generates pulses with controlled variable width from 1.3ns up to several milliseconds that coincide with a wide range of binary and analog memristor applications. The designed pulse generator is intended as a tool to precisely control the amount of charge injected in memristors devices so that precise characterization of the memristors can be done without using external controlling circuitry. Furthermore, a much finer precision in the control of total injected charge can be achieved using the proposed technique. The proposed single pulse generator has been designed in XFAB 0.35μm technology to characterize the properties of memristors.
Hamid Reza Erfani Jazi, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
CBMI2
2021 A Reduced-Scale Cortical Network with Izhikevich's Neurons on SpiNNaker
abstract
Following the initial implementation of a full-scale spiking neural network (SNN) of the cortical microcircuit on NEST, the work was replicated to simulate on SpiNNaker, the Juelich CPU cluster, and the Sussex GPU cluster, in order to compare the performances on the different platforms. All of these researches use the Leaky Integrate and Fire (LIF) model as the basic unit of spiking neurons. In comparison, Izhikevich's spiking neuron models (IZK) can mimic a larger variety of known cortical neuronal dynamics. In spite of this versatility, the IZK neuron is easy to implement and computes fast. In this work, we implement the above-mentioned cortical microcircuit at a reduced-scale and using IZK neurons on SpiNNaker. This is aligned with our ongoing research on a reduced-scale thalamocortical circuit of vision with changing IZK neuron dynamics on SpiNNaker. We validate our SNN with the LIF-based full-scale cortical microcircuit by providing Poisson noise inputs, and measuring objectively the outputs in terms of spike rate, irregularity and synchrony. Our reduced-scale SNN shows similar dynamics to the full-scale SNN and operates within the Asynchronous Irregular regime defined by set bounds on the three quantitative attributes. Next, we test our SNN with inputs from a Dynamic Vision Sensor- (DVS-)based electronic retina (e-retina) that converted a simple periodic environmental input to spike trains. With current parameter settings, the model output identifies the low-frequency, but not the high frequency periodic inputs.
Chinmay Chiplunkar, Nishant Gautam, Ishita Mediratta, Andrew Gait, Sujith Thomas, Andrew Rowley, Teresa Serrano-Gotarredona, Basabdatta Sen Bhattacharya
IJCNN7
2021 Implementation of Binary Stochastic STDP Learning Using Chalcogenide-Based Memristive Devices
abstract
The emergence of nano-scale memristive devices encouraged many different research areas to exploit their use in multiple applications. One of the proposed applications was to implement synaptic connections in bio-inspired neuromorphic systems. Large-scale neuromorphic hardware platforms are being developed with increasing number of neurons and synapses, having a critical bottleneck in the online learning capabilities. Spike-timing-dependent plasticity (STDP) is a widely used learning mechanism inspired by biology which updates the synaptic weight as a function of the temporal correlation between pre- and post-synaptic spikes. In this work, we demonstrate experimentally that binary stochastic STDP learning can be obtained from a memristor when the appropriate pulses are applied at both sides of the device.
C. Mohan 0005, Luis A. Camuñas-Mesa, José M. de la Rosa 0001, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS4
2020 Introduction and Analysis of an Event-Based Sign Language Dataset
abstract
Human gestures recognition is a complex visual recognition task where motion across time distinguishes the type of action. Automatic systems tackle this problem using complex machine learning architectures and training datasets. In recent years, the use and success of robust deep learning techniques was compatible with the availability of a great number of these sets. This paper presents SL-Animals-DVS, an event-based action dataset captured by a Dynamic Vision Sensor (DVS). The DVS records humans performing sign language gestures of various animals as a continuous spike flow at very low latency. This is especially suited for sign language gestures which are usually made at very high speeds. We also benchmark the recognition performance on this data using two state-of-the-art Spiking Neural Networks (SNN) recognition systems. SNNs are naturally compatible to make use of the temporal information that is provided by the DVS where the information is encoded in the spike times. The dataset has about 1100 samples of 58 subjects performing 19 sign language gestures in isolation at different scenarios, providing a challenging evaluation platform for this emerging technology.
Ajay Vasudevan, Pablo Negri, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
FG4
2020 Lessons Learned the Hard Way
abstract
“Fail often to succeed sooner” is a common mantra that we are told is the secret to success. When reporting research results, however, scholars rarely write about their failed attempts and only focus on the successful ones. Perhaps the source of this disconnect between what we preach and what we do can be found in the underlying assumption that published work is meant to move the field forward and failed attempts supposedly do not. The goal of the confessions presented in this paper is to show that even failed attempts are genuine and valuable contributions to our field provided that we learn from our mistakes and correct them. The 27 confessions span from planning oversights, digital and analog design errors, misunderstanding of devices, overlooked parasitics, LVS errors, and troubles in testing.
Tobi Delbruck, Ibrahim M. Elfadel, Shahzad Muzaffar, Germain Haessig, Bo Wang 0012, Amine Bermak, Rui Graca, Luis A. Camuñas-Mesa, Bathiya Senevirathna, Pamela Abshire, Bernabé Linares-Barranco, Saeed Afshar, Shih-Chii Liu, Runchun Wang, Piotr Dudek, Stephen J. Carey, José M. de la Rosa 0001, Marc Dandin, Sheung Lu, Vincent Frick, Teresa Serrano-Gotarredona, Paula López Martinez 0001, Melika Payvand, Advait Madhavan, Eric R. Fossum, Juan Camilo Vasquez Tieck, Yan Liu 0016, Timothy G. Constandinou, Alexander Serb, Ricardo Carmona-Galán, Robert Nawrocki, Walter D. Leon-Salas
ISCAS21
2020 Experimental Body-Input Three-Stage DC Offset Calibration Scheme for Memristive Crossbar
abstract
Reading several ReRAMs simultaneously in a neuromorphic circuit increases power consumption and limits scalability. Applying small inference read pulses is a vain attempt when offset voltages of the read-out circuit are decisively more. This paper presents an experimental validation of a three-stage calibration scheme to calibrate the DC offset voltage across the rows of the memristive crossbar. The proposed method is based on biasing the body terminal of one of the differential pair MOSFETs of the buffer through a series of cascaded resistor banks arranged in three stages-coarse, fine and finer stages. The circuit is designed in a 130 nm CMOS technology, where the OxRAM-based binary memristors are built on top of it. A dedicated PCB and other auxiliary boards have been designed for testing the chip. Experimental results validate the presented approach, which is only limited by mismatch and electrical noise.
Charanraj Mohan, Luis A. Camuñas-Mesa, Elisa Vianello, Carlo Reita, José M. de la Rosa 0001, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS6
2020 Event-driven implementation of deep spiking convolutional neural networks for supervised classification using the SpiNNaker neuromorphic platform
Alberto Patiño-Saucedo, Horacio Rostro-González, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
Neural Networks3
2019 A Current Attenuator for Efficient Memristive Crossbars Read-Out
abstract
This paper presents a new current attenuator circuit to scale down the inference currents in memristor based crossbars that drive integrate-and-fire neurons, which subsequently allows to reduce the size of integrating capacitors by several orders of magnitude, making IC integration possible. The proposed circuit uses a linear switch to divide the inference current and scale it down by a factor of about 104. The proposed attenuator has been designed in 130nm CMOS technology. Simulation results considering noise, process and temperature variations are shown to validate the presented approach.
Charanraj Mohan, José M. de la Rosa 0001, Elisa Vianello, Luca Perniola, Carlo Reita, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
ISCAS7
2018 Event-Driven Configurable Module with Refractory Mechanism for ConvNets on FPGA
abstract
We have developed a fully configurable event-driven convolutional module with refractory period mechanism that can be used to implement arbitrary Convolutional Neural Networks (ConvNets) on FPGAs following a 2D array structure. Using this module, we have implemented in a Spartan6 FPGA a 4-layer ConvNet with 22 convolutional modules trained for poker card symbol recognition. It has been tested with a stimulus where 40 poker cards were observed by a Dynamic Vision Sensor (DVS) in 1s time. A traffic control mechanism is implemented to down-sample high speed input stimuli while keeping spatio-temporal correlation. For slow stimulus play back, a 96% recognition rate is achieved with a power consumption of 0.85mW. At maximum play back speed, the recognition rate is still above 63% when less than 20% of the input events are processed.
Luis A. Camuñas-Mesa, Y. Domínguez-Cordero, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2018 An Intrinsic Method for Fast Parameter Update on the SpiNNaker Platform
abstract
Neuromorphic Computing or Spiking (also called Event-Driven) Neural Systems are becoming of high interest as they potentially allow for lower power hardware computing platforms, where power consumption is data driven. Traditional approaches (both in software and in hardware), which are not data driven, rely on generic system state updates, consuming a fixed amount of computing resources at each step, independent on the data itself. In neuromorphic spiking or (event-driven) computing systems power is consumed (in principle) if new data is transferred, either at the system input, system output, or internally between computing nodes. One such neuromorphic event-driven computing platform is the scalable SpiNNaker system, which is aimed for a million ARM core platform, capable of emulating in the order of a billion neurons in real time. An important practical drawback of the platform is the long time it takes to download to the hardware a given computational architecture. This step has to be repeated even if one wants to update a set of parameters. Here we present a method for updating internal parameters without downloading again the full architecture, by adding special neurons into the computing architecture which when they spike change given parameters. This allows to download the computing architecture only once to the SpiNNaker platform, and then take advantage of its highly efficient communication network to command specific parameter changes. This allows for intensive parameter searches in a more efficient manner.
Miguel Soto, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS2
2018 Hybrid Neural Network, An Efficient Low-Power Digital Hardware Implementation of Event-based Artificial Neural Network
abstract
Interest in event-based vision sensors has proliferated in recent years, with innovative technology becoming more accessible to new researchers and highlighting such sensors' potential to enable low-latency sensing at low computational cost. These sensors can outperform frame-based vision sensors regarding data compression, dynamic range, temporal resolution and power efficiency. However, available mature frame-based processing methods by using Artificial Neural Networks (ANNs) surpass Spiking Neural Networks (SNNs) in terms of accuracy of recognition. In this paper, we introduce a Hybrid Neural Network which is an intermediate solution to exploit advantages of both event-based and frame-based processing. We have implemented this network in FPGA and benchmarked its performance by using different event-based versions of MNIST dataset. HDL codes for this project are available for academic purpose upon request.
Amirreza Yousefzadeh, Garrick Orchard, Evangelos Stromatias, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS4
2018 Performance Comparison of Time-Step-Driven versus Event-Driven Neural State Update Approaches in SpiNNaker
abstract
The SpiNNaker chip is a multi-core processor optimized for neuromorphic applications. Many SpiNNaker chips are assembled to make a highly parallel million core platform. This system can be used for simulation of a large number of neurons in real-time. SpiNNaker is using a general purpose ARM processor that gives a high amount of flexibility to implement different methods for processing spikes. Various libraries and packages are provided to translate a high-level description of Spiking Neural Networks (SNN) to low-level machine language that can be used in the ARM processors. In this paper, we introduce and compare three different methods to implement this intermediate layer of abstraction. We have examined the advantages of each method by various criteria, which can be useful for professional users to choose between them. All the codes that are used in this paper are available for academic propose.
Amirreza Yousefzadeh, Mikel Soto, Teresa Serrano-Gotarredona, Francesco Galluppi, Luis A. Plana, Steve Furber, Bernabé Linares-Barranco
ISCAS3
2018 Event-Driven Stereo Visual Tracking Algorithm to Solve Object Occlusion
abstract
Object tracking is a major problem for many computer vision applications, but it continues to be computationally expensive. The use of bio-inspired neuromorphic event-driven dynamic vision sensors (DVSs) has heralded new methods for vision processing, exploiting reduced amount of data and very precise timing resolutions. Previous studies have shown these neural spiking sensors to be well suited to implementing single-sensor object tracking systems, although they experience difficulties when solving ambiguities caused by object occlusion. DVSs have also performed well in 3-D reconstruction in which event matching techniques are applied in stereo setups. In this paper, we propose a new event-driven stereo object tracking algorithm that simultaneously integrates 3-D reconstruction and cluster tracking, introducing feedback information in both tasks to improve their respective performances. This algorithm, inspired by human vision, identifies objects and learns their position and size in order to solve ambiguities. This strategy has been validated in four different experiments where the 3-D positions of two objects were tracked in a stereo setup even when occlusion occurred. The objects studied in the experiments were: 1) two swinging pens, the distance between which during movement was measured with an error of less than 0.5%; 2) a pen and a box, to confirm the correctness of the results obtained with a more complex object; 3) two straws attached to a fan and rotating at 6 revolutions per second, to demonstrate the high-speed capabilities of this approach; and 4) two people walking in a real-world environment.
Luis A. Camuñas-Mesa, Teresa Serrano-Gotarredona, Sio-Hoi Ieng, Ryad Benosman, Bernabé Linares-Barranco
IEEE Trans. Neural Networks Learn. Syst.2
2017 Spiking Hough for Shape Recognition
Pablo Negri, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
CIARP2
2017 Live demonstration: Multiplexing AER asynchronous channels over LVDS links with flow-control and clock-correction for scalable neuromorphic systems
abstract
In this live demonstration we exploit the use of a serial link for fast asynchronous communication in massively parallel processing platforms connected to a DVS for real-time implementation of bio-inspired vision processing on spiking neural networks.
Amirreza Yousefzadeh, Miroslaw Jablonski, Taras Iakymchuk, Alejandro Linares-Barranco, Alfredo Rosado Muñoz, Luis A. Plana, Teresa Serrano-Gotarredona, Steve Furber, Bernabé Linares-Barranco
ISCAS7
2017 Multiplexing AER asynchronous channels over LVDS links with flow-control and clock-correction for scalable neuromorphic systems
abstract
Address-Event-Representation (AER) is a widely extended asynchronous technique for interchanging “neural spikes” among different hardware elements in Neuromorphic Systems. Conventional AER links use parallel physical wires together with a pair of handshaking signals (Request and Acknowledge). Here we present a fully serial implementation using bidirectional SATA connectors with a pair of LVDS (low voltage differential signaling) wires for each direction. The proposed implementation can multiplex a number of conventional parallel AER links per LVDS physical connection. It uses flow control, clock correction, and byte alignment techniques to transmit 32-bit address events reliably over multiplexed serial connections. The setup has been tested using commercial Spartan6 FPGAs reaching a maximum event transmission speed of 75Meps (Mega Events per second) for 32-bit events at 3.0Gbps line data rate.
Amirreza Yousefzadeh, Miroslaw Jablonski, Taras Iakymchuk, Alejandro Linares-Barranco, Alfredo Rosado Muñoz, Luis A. Plana, Teresa Serrano-Gotarredona, Steve Furber, Bernabé Linares-Barranco
ISCAS7
2017 Live demonstration: Hardware implementation of convolutional STDP for on-line visual feature learning
abstract
We present live demonstration of a hardware that can learn visual features on-line and in real-time during presentation of objects. Input Spikes are coming from a bio-inspired silicon retina or Dynamic Vision Sensor (DVS) and are processed in a Spiking Convolutional Neural Network (SCNN) that is equipped with a Spike Timing Dependent Plasticity (STDP) learning rule implemented on FPGA.
Amirreza Yousefzadeh, Timothée Masquelier, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2017 Hardware implementation of convolutional STDP for on-line visual feature learning
abstract
We present a highly hardware friendly STDP (Spike Timing Dependent Plasticity) learning rule for training Spiking Convolutional Cores in Unsupervised mode and training Fully Connected Classifiers in Supervised Mode. Examples are given for a 2-layer Spiking Neural System which learns in real time features from visual scenes obtained with spiking DVS (Dynamic Vision Sensor) Cameras.
Amirreza Yousefzadeh, Timothée Masquelier, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2015 ConvNets experiments on SpiNNaker
abstract
The SpiNNaker Hardware platform allows emulating generic neural network topologies, where each neuron-to-neuron connection is defined by an independent synaptic weight. Consequently, weight storage requires an important amount of memory in the case of generic neural network topologies. This is solved in SpiNNaker by encapsulating with each SpiNNaker chip (which includes 18 ARM cores) a 128MB DRAM chip within the same package. However, ConvNets (Convolutional Neural Network) posses "weight sharing" property, so that many neuron-to-neuron connections share the same weight value. Therefore, a very reduced amount of memory is required to define all synaptic weights, which can be stored on local SRAM DTCM (data-tightly-coupled-memory) at each ARM core. This way, DRAM can be used extensively to store traffic data for off-line analyses. We show an implementation of a 5-layer ConvNet for symbol recognition. Symbols are obtained with a DVS camera. Neurons in the ConvNet operate in an event-driven fashion, and synapses operate instantly. With this approach it was possible to allocate up to 2048 neurons per ARM core, or equivalently 32k neurons per SpiNNaker chip.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco, Francesco Galluppi, Luis A. Plana, Steve Furber
ISCAS1
2014 Event-driven stereo vision with orientation filters
abstract
The recently developed Dynamic Vision Sensors (DVS) sense dynamic visual information asynchronously and code it into trains of events with sub-micro second temporal resolution. This high temporal precision makes the output of these sensors especially suited for dynamic 3D visual reconstruction, by matching corresponding events generated by two different sensors in a stereo setup. This paper explores the use of Gabor filters to extract information about the orientation of the object edges that produce the events, applying the matching algorithm to the events generated by the Gabor filters and not to those produced by the DVS. This strategy provides more reliably matched pairs of events, improving the final 3D reconstruction.
Luis A. Camuñas-Mesa, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco, Sio-Hoi Ieng, Ryad Benosman
ISCAS2
2014 An AER handshake-less modular infrastructure PCB with x8 2.5Gbps LVDS serial links
abstract
Nowadays spike-based brain processing emulation is taking off. Several EU and others worldwide projects are demonstrating this, like SpiNNaker, BrainScaleS, FACETS, or NeuroGrid. The larger the brain process emulation on silicon is, the higher the communication performance of the hosting platforms has to be. Many times the bottleneck of these system implementations is not on the performance inside a chip or a board, but in the communication between boards. This paper describes a novel modular Address-Event-Representation (AER) FPGA-based (Spartan6) infrastructure PCB (the AER-Node board) with 2.5Gbps LVDS high speed serial links over SATA cables that offers a peak performance of 32-bit 62.5Meps (Mega events per second) on board-to-board communications. The board allows back compatibility with parallel AER devices supporting up to x2 28-bit parallel data with asynchronous handshake. These boards also allow modular expansion functionality through several daughter boards. The paper is focused on describing in detail the LVDS serial interface and presenting its performance.
Taras Iakymchuk, Alfredo Rosado Muñoz, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco, Angel Jiménez-Fernandez, Alejandro Linares-Barranco, Gabriel Jiménez-Moreno
ISCAS3
2014 Spike-based VITE control with dynamic vision sensor applied to an arm robot
abstract
Spike-based motor control is very important in the field of robotics and also for the neuromorphic engineering community to bridge the gap between sensing / processing devices and motor control without losing the spike philosophy that enhances speed response and reduces power consumption. This paper shows an accurate neuro-inspired spike-based system composed of a DVS retina, a visual processing system that detects and tracks objects, and a SVITE motor control, where everything follows the spike-based philosophy. The control system is a spike version of the neuroinspired open loop VITE control algorithm implemented in a couple of FPGA boards: the first one runs the algorithm and the second one drives the motors with spikes. The robotic platform is a low cost arm with four degrees of freedom.
Fernando Perez-Peña, Arturo Morgado Estevez, Teresa Serrano-Gotarredona, Francisco Gomez-Rodriguez, V. Ferrer-Garcia, Angel Jiménez-Fernandez, Alejandro Linares-Barranco
ISCAS3
2014 Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output
abstract
State-of-the-art image sensors suffer from significant limitations imposed by their very principle of operation. These sensors acquire the visual information as a series of “snapshot” images, recorded at discrete points in time. Visual information gets time quantized at a predetermined frame rate which has no relation to the dynamics present in the scene. Furthermore, each recorded frame conveys the information from all pixels, regardless of whether this information, or a part of it, has changed since the last frame had been acquired. This acquisition method limits the temporal resolution, potentially missing important information, and leads to redundancy in the recorded image data, unnecessarily inflating data rate and volume. Biology is leading the way to a more efficient style of image acquisition. Biological vision systems are driven by events happening within the scene in view, and not, like image sensors, by artificially created timing and control signals. Translating the frameless paradigm of biological vision to artificial imaging systems implies that control over the acquisition of visual information is no longer being imposed externally to an array of pixels but the decision making is transferred to the single pixel that handles its own information individually. In this paper, recent developments in bioinspired, neuromorphic optical sensing and artificial vision are presented and discussed. It is suggested that bioinspired vision systems have the potential to outperform conventional, frame-based vision systems in many application fields and to establish new benchmarks in terms of redundancy suppression and data compression, dynamic range, temporal resolution, and power efficiency. Demanding vision tasks such as real-time 3-D mapping, complex multiobject tracking, or fast visual feedback loops for sensory-motor action, tasks that often pose severe, sometimes insurmountable, challenges to conventional artificial vision systems, are in reach using bioinspired vision sensing and processing techniques.
Christoph Posch, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco, Tobi Delbruck
Proc. IEEE2
2013 Improved contrast sensitivity DVS and its application to event-driven stereo vision
abstract
This paper presents a new DVS sensor with one order of magnitude improved contrast sensitivity over previous reported DVSs. This sensor has been applied to a bio-inspired event-based binocular system that performs 3D event-driven reconstruction of a scene. Events from two DVS sensors are matched by using precise timing information of their ocurrence. To improve matching reliability, satisfaction of epipolar geometry constraint is required, and simultaneously available information on the orientation is used as an additional matching constraint.
Teresa Serrano-Gotarredona, Jongkil Park 0001, Alejandro Linares-Barranco, Angel Jiménez-Fernandez, Ryad Benosman, Bernabé Linares-Barranco
ISCAS1
2013 Mapping from Frame-Driven to Frame-Free Event-Driven Vision Systems by Low-Rate Rate Coding and Coincidence Processing-Application to Feedforward ConvNets
abstract
Event-driven visual sensors have attracted interest from a number of different research communities. They provide visual information in quite a different way from conventional video systems consisting of sequences of still images rendered at a given "frame rate." Event-driven vision sensors take inspiration from biology. Each pixel sends out an event (spike) when it senses something meaningful is happening, without any notion of a frame. A special type of event-driven sensor is the so-called dynamic vision sensor (DVS) where each pixel computes relative changes of light or "temporal contrast." The sensor output consists of a continuous flow of pixel events that represent the moving objects in the scene. Pixel events become available with microsecond delays with respect to "reality." These events can be processed "as they flow" by a cascade of event (convolution) processors. As a result, input and output event flows are practically coincident in time, and objects can be recognized as soon as the sensor provides enough meaningful events. In this paper, we present a methodology for mapping from a properly trained neural network in a conventional frame-driven representation to an event-driven representation. The method is illustrated by studying event-driven convolutional neural networks (ConvNet) trained to recognize rotating human silhouettes or high speed poker card symbols. The event-driven ConvNet is fed with recordings obtained from a real DVS camera. The event-driven ConvNet is simulated with a dedicated event-driven simulator and consists of a number of event-driven processing modules, the characteristics of which are obtained from individually manufactured hardware modules.
José Antonio Pérez-Carrasco, Bo Zhao 0018, Carmen Serrano, Begoña Acha, Teresa Serrano-Gotarredona, Shoushun Chen, Bernabé Linares-Barranco
IEEE Trans. Pattern Anal. Mach. Intell.5
2012 A Real-Time, Event-Driven Neuromorphic System for Goal-Directed Attentional Selection
Francesco Galluppi, Kevin Brohan, Simon Davidson, Teresa Serrano-Gotarredona, José Antonio Pérez-Carrasco, Bernabé Linares-Barranco, Steve Furber
ICONIP (2)4
2011 Voltage mode driver for low power transmission of high speed serial AER Links
abstract
This paper presents a voltage-mode high speed driver to transmit serial AER data in scalable multi-chip AER systems. To take advantage of the asynchronous nature of AER (Address Event Representation) streams, this implementation al- lows an energy efficient burst-mode operation. This is achieved by switching on/off the driver in data pauses to reduce static power consumption. Impedance matching is calibrated continuously to track temperature variations, obtaining an optimal performance without degrading the data rate. Power management techniques for switching drivers are discussed and an internally compensated high speed regulator is presented. The system has been designed in a 0.35μm CMOS technology to transmit data rates up to 500Mbps using Manchester enconding. Layout extracted simulation results are presented, which include all interconnect parasitics. Estimated peak rate is 15Meps for 32 bit events. Simulated power consumption of transmitter and receiver at peak rate is 33.2mW, while below 100 Keps is 1.3mW.
Carlos Zamarreño-Ramos, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco, Raghavendra Kulkarni, José Silva-Martínez
ISCAS2
2010 Spike-Based Convolutional Network for Real-Time Processing
abstract
In this paper we propose the first bio-inspired six layer convolutional network (ConvNet) non-frame based that can be implemented with already physically available spike-based electronic devices. The system was designed to recognize people in three different positions: standing, lying or up-side down. The inputs were spikes obtained with a motion retina chip. We provide simulation results showing recognition delays of 16 milliseconds from stimulus onset (time-to-first spike) with a recognition rate of 94%. The weight sharing property in ConvNets and the use of AER protocol allow a great reduction in the number of both trainable parameters and connections (only 748 trainable parameters and 123 connections in our AER system (out of 506998 connections that would be required in a frame-based implementation).
José Antonio Pérez-Carrasco, Carmen Serrano, Begoña Acha, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ICPR4
2010 Neocortical frame-free vision sensing and processing through scalable Spiking ConvNet hardware
abstract
This paper summarizes how Convolutional Neural Networks (ConvNets) can be implemented in hardware using Spiking neural network Address-Event-Representation (AER) technology, for sophisticated pattern and object recognition tasks operating at mili second delay throughputs. Although such hardware would require hundreds of individual convolutional modules and thus is presently not yet available, we discuss methods and technologies for implementing it in the near future. On the other hand, we provide precise behavioral simulations of large scale spiking AER convolutional hardware and evaluate its performance, by using performance figures of already available AER convolution chips fed with real sensory data obtained from physically available AER motion retina chips. We provide simulation results of systems trained for people recognition, showing recognition delays of a few miliseconds from stimulus onset. ConvNets show good up scaling behavior and possibilities for being implemented efficiently with new nano scale hybrid CMOS/nonCMOS technologies.
Luis A. Camuñas-Mesa, José Antonio Pérez-Carrasco, Carlos Zamarreño-Ramos, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
IJCNN4
2010 On scalable spiking convnet hardware for cortex-like visual sensory processing systems
abstract
This paper summarizes how Convolutional Neural Networks (ConvNets) can be implemented in hardware using Spiking neural network Address-Event-Representation (AER) technology, for sophisticated pattern and object recognition tasks operating at mili second delay throughputs. Although such hardware would require hundreds of individual convolutional modules and thus is presently not yet available, we discuss methods and technologies for implementing it in the near future. On the other hand, we provide precise behavioral simulations of large scale spiking AER convolutional hardware and evaluate its performance, by using performance figures of already available AER convolution chips fed with real sensory data obtained from physically available AER motion retina chips. We provide simulation results of systems trained for people recognition, showing recognition delays of a few miliseconds from stimulus onset. ConvNets show good up scaling behavior and possibilities for being implemented efficiently with new nano scale hybrid CMOS/nonCMOS technologies.
Luis A. Camuñas-Mesa, José Antonio Pérez-Carrasco, Carlos Zamarreño-Ramos, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS4
2010 A signed spatial contrast event spike retina chip
abstract
Reported AER (Address Event Representation) contrast retinae perform a contrast computation based on the ratio between a pixel's local light intensity and a spatially weighted average of its neighbourhood. This results in compact circuits, but with the penalty of all pixels generating output signals even if they sense no contrast. In this paper we present a spatial contrast retina with bipolar output: contrast is computed as the relative normalized difference (not the ratio) between a pixel's local light and its weighted spatial average, normalized to average light. As a result, contrast includes a sign, is ambient light independent, and the output will be zero if there is no contrast. Furthermore, an adjustable thresholding mechanism has been included, such that pixels remain silent until they sense an absolute contrast above the adjustable threshold. The pixel contrast computation circuit is based on Boahen's Biharmonic operator contrast circuit, which has been improved to include mismatch calibration and adaptive current based biasing. As a result, the contrast computation circuit shows much less mismatch, is almost insensitive to ambient light illumination, and biasing is much less critical than in the original voltage biasing scheme. The retina also includes an optional TFS (Time-to-First-Spike) integration mode. A full AER retina version has been fabricated and tested. In the present paper we provide preliminary experimental results.
Juan A. Leñero-Bardallo, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS2
2010 On neuromorphic spiking architectures for asynchronous STDP memristive systems
abstract
Neuromorphic circuits and systems techniques have great potential for exploiting novel nanotechnology devices, which suffer from great parametric spread and high defect rate. In this paper we explore some potential ways of building neural network systems for sophisticated pattern recognition tasks using memristors. We will focus on spiking signal coding because of its energy and information coding efficiency, and concentrate on Convolutional Neural Networks because of their good scaling behavior, both in terms of number of synapses and temporal processing delay. We propose asynchronous architectures that exploit memristive synapses with specially designed neurons that allow for arbitrary scalability as well as STDP learning. We present some behavioral simulation results for small neural arrays using electrical circuit simulators, and system level spike processing results on human detection using a custom made event based simulator.
José Antonio Pérez-Carrasco, Carlos Zamarreño-Ramos, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2010 Fast vision through frameless event-based sensing and convolutional processing: application to texture recognition
abstract
Address-event representation (AER) is an emergent hardware technology which shows a high potential for providing in the near future a solid technological substrate for emulating brain-like processing structures. When used for vision, AER sensors and processors are not restricted to capturing and processing still image frames, as in commercial frame-based video technology, but sense and process visual information in a pixel-level event-based frameless manner. As a result, vision processing is practically simultaneous to vision sensing, since there is no need to wait for sensing full frames. Also, only meaningful information is sensed, communicated, and processed. Of special interest for brain-like vision processing are some already reported AER convolutional chips, which have revealed a very high computational throughput as well as the possibility of assembling large convolutional neural networks in a modular fashion. It is expected that in a near future we may witness the appearance of large scale convolutional neural networks with hundreds or thousands of individual modules. In the meantime, some research is needed to investigate how to assemble and configure such large scale convolutional networks for specific applications. In this paper, we analyze AER spiking convolutional neural networks for texture recognition hardware applications. Based on the performance figures of already available individual AER convolution chips, we emulate large scale networks using a custom made event-based behavioral simulator. We have developed a new event-based processing architecture that emulates with AER hardware Manjunath's frame-based feature recognition software algorithm, and have analyzed its performance using our behavioral simulator. Recognition rate performance is not degraded. However, regarding speed, we show that recognition can be achieved before an equivalent frame is fully sensed and transmitted.
José Antonio Pérez-Carrasco, Begoña Acha, Carmen Serrano, Luis A. Camuñas-Mesa, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
IEEE Trans. Neural Networks5
2009 Advanced Vision Processing Systems: Spike-Based Simulation and Processing
José Antonio Pérez-Carrasco, Carmen Serrano, Begoña Acha, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ACIVS4
2009 A Mismatch Calibrated Bipolar Spatial Contrast AER Retina with Adjustable Contrast Threshold
abstract
Address event representation (AER) is an emergent technology for assembling modular multi-blocks bio-inspired sensory and processing systems. Visual sensors (retinae) are among the first AER modules to be reported since the introduction of the technology. Spatial contrast AER retinae are of special interest since they provide highly compressed data flow without reducing the relevant information required for performing recognition. Reported AER contrast retinae perform a contrast computation based on the ratio between a pixel's local light intensity and a spatially weighted average of its neighbourhood. This resulted in compact circuits, but with the penalty of all pixels generating output signals even if they sensed no contrast. In this paper we present a spatial contrast retina with bipolar output: contrast is computed as the relative difference between a pixel's local light and its weighted spatial average. As a result, contrast includes a sign and the output will be zero if there is no contrast. Furthermore, an adjustable thresholding mechanism has been included, such that pixels remain silent until they sense an absolute contrast above the adjustable threshold. The pixel contrast computation circuit is based on Boahen's biharmonic operator contrast circuit, which has been improved to include mismatch calibration and adaptive current based biasing. As a result, the contrast computation circuit shows much less mismatch, is almost insensitive to ambient light illumination, and biasing is much less critical than in the original voltage biasing scheme. A full AER retina version has been submitted for fabrication. In the present paper we provide simulation results.
Juan A. Leñero-Bardallo, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS2
2009 OTA-C Oscillator with Low Frequency Variations for On-chip Clock Generation in Serial LVDS-AER Links
abstract
This paper presents the design and simulation of an OTA-C oscillator intended to be used as on-chip frequency reference. This reference will be part of the high speed clock generation circuit for Manchester serial LVDS-AER links. A Manchester LVDS receiver can adapt its operation in a limited range of frequencies, so the most important specification is the frequency stability over temperature and process variations. A novel design methodology is presented to design two oscillators in a 90 nm technology using transistors with 2.5 V supply voltage. Intensive simulations with temperature, process, supply voltage variations and mismatch effects were performed in order to analyze the validity of this approach, obtaining Delta ap 7%.
Carlos Zamarreño-Ramos, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS2
2009 CAVIAR: A 45k Neuron, 5M Synapse, 12G Connects/s AER Hardware Sensory-Processing- Learning-Actuating System for High-Speed Visual Object Recognition and Tracking
abstract
This paper describes CAVIAR, a massively parallel hardware implementation of a spike-based sensing-processing-learning-actuating system inspired by the physiology of the nervous system. CAVIAR uses the asychronous address-event representation (AER) communication framework and was developed in the context of a European Union funded project. It has four custom mixed-signal AER chips, five custom digital AER interface components, 45k neurons (spiking cells), up to 5M synapses, performs 12G synaptic operations per second, and achieves millisecond object recognition and tracking latencies.
Rafael Serrano-Gotarredona, Matthias Oster, Patrick Lichtsteiner, Alejandro Linares-Barranco, Rafael Paz-Vicente, Francisco Gomez-Rodriguez, Luis A. Camuñas-Mesa, Raphael Berner, Manuel Rivas Pérez, Tobi Delbruck, Shih-Chii Liu, Rodney J. Douglas, Philipp Häfliger, Gabriel Jiménez-Moreno, Antonio Abad Civit Balcells, Teresa Serrano-Gotarredona, Antonio J. Acosta 0001, Bernabé Linares-Barranco
IEEE Trans. Neural Networks16
2008 Event based vision sensing and processing
abstract
In this paper we briefly summarize the fundamental properties of spike events processing applied to artificial vision systems. This sensing and processing technology is capable of very high speed throughput, because it does not rely on sensing and processing sequences of frames, and because it allows for complex hierarchically structured cortical-like layers for sophisticated processing. The paper describes briefly cortex-like spike event vision processing principles, and the AER (Address Event Representation) technique used in hardware spiking systems. Then a texture-based image retrieval using the AER technique is proposed. Realistic behavioral simulations based on existing hardware characteristics, reveal that the application, although processing large kernel convolutions, is capable of performing recognition in less than 10 ms.
José Antonio Pérez-Carrasco, Carmen Serrano, Begoña Acha, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ICIP4
2008 Fully digital AER convolution chip for vision processing
abstract
We present a neuromorphic fully digital convolution microchip for Address Event Representation (AER) spike-based processing systems. This microchip computes 2-D convolutions with a programmable kernel in real time. It operates on a pixel array of size 32 x 32, and the kernel is programmable and can be of arbitrary shape and size up to 32 x 32 pixels. The chip receives and generates data in AER format, which is asynchronous and digital. The paper describes the architecture of the chip, the test setup, and experimental results obtained from a fabricated prototype.
Luis A. Camuñas-Mesa, Antonio J. Acosta 0001, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2008 Compact calibration circuit for large neuromorphic arrays
abstract
Low current applications, like neuromorphic circuits, where operating currents can be as low as few nano amps or less, suffer from huge transistor mismatches, resulting in around or less than 1-bit precision. Here we present a new calibration approach based on individually calibrated current sources made with MOS transistors of digitally adjustable length, which require only N unit transistors. The scheme includes a translinear circuit based tuning scheme, which allows to expand the operating range of the calibrated circuits with graceful precision degradation, over 4 decades of operating currents. Experimental results are provided for 5-bit resolution DACs operating at 20 nA.
Juan A. Leñero-Bardallo, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS2
2008 High-speed character recognition system based on a complex hierarchical AER architecture
abstract
In this paper we briefly summarize the fundamental properties of spikes processing applied to artificial vision systems. This sensing and processing technology is capable of very high speed throughput, because it does not rely on sensing and processing sequences of frames, and because it allows for complex hierarchically structured cortical-like layers for sophisticated processing. The paper describes briefly cortex-like spiking vision processing principles, and the AER (address event representation) technique used in hardware spiking systems. Afterwards an example application is described, which is a simplification of Fukushima's Neocognitron. Realistic behavioral simulations based on existing AER hardware characteristics, reveal that the simplified neocognitron, although it processes 52 large kernel convolutions, is capable of performing recognition in less than 10 mus.
José Antonio Pérez-Carrasco, Teresa Serrano-Gotarredona, Carmen Serrano, Begoña Acha, Bernabé Linares-Barranco
ISCAS2
2008 LVDS interface for AER links with burst mode operation capability
abstract
This paper presents the design and simulation of a serial AER LVDS communication link. It converts data from classical AER parallel bus with a 4-phase handshaking protocol into a bit stream which is transmitted serially into a single LVDS wire. At the receiver side data from the LVDS cable are transformed back to a parallel AER bus and handshaking signals are also properly managed. The link has been designed in a 90 nms technology. Extensive simulations have been performed demonstrating that the link can operate at a speed of 1 Gbps for all the technology corners, exhibiting a power consumption of 27.8 mW for the transmitter and 12.3 mW for the receiver. In the simulation the transmission channel was modelled as a 50 cm cat5E UTP cable, connected to the AER chip through 5 cm PCB traces modelled as a coupled microstrip transmission line. The design has been completed up to the layout level and has been submitted for fabrication. The transmitter and the receiver take up an area of 311times148 mum2and 300x148 mum2respectively.
Carlos Zamarreño-Ramos, Rafael Serrano-Gotarredona, Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS3
2008 On Real-Time AER 2-D Convolutions Hardware for Neuromorphic Spike-Based Cortical Processing
abstract
In this paper, a chip that performs real-time image convolutions with programmable kernels of arbitrary shape is presented. The chip is a first experimental prototype of reduced size to validate the implemented circuits and system level techniques. The convolution processing is based on the address–event-representation (AER) technique, which is a spike-based biologically inspired image and video representation technique that favors communication bandwidth for pixels with more information. As a first test prototype, a pixel array of 16$\,\times\,$16 has been implemented with programmable kernel size of up to 16$\, \times\,$16. The chip has been fabricated in a standard 0.35-${\mu }$m complimentary metal–oxide–semiconductor (CMOS) process. The technique also allows to process larger size images by assembling 2-D arrays of such chips. Pixel operation exploits low-power mixed analog–digital circuit techniques. Because of the low currents involved (down tonanoamperesor evenpicoamperes), an important amount of pixel area is devoted to mismatch calibration. The rest of the chip uses digital circuit techniques, both synchronous and asynchronous. The fabricated chip has been thoroughly tested, both at the pixel level and at the system level. Specific computer interfaces have been developed for generating AER streams from conventional computers and feeding them as inputs to the convolution chip, and for grabbing AER streams coming out of the convolution chip and storing and analyzing them on computers. Extensive experimental results are provided. At the end of this paper, we pro
Rafael Serrano-Gotarredona, Teresa Serrano-Gotarredona, Antonio J. Acosta 0001, Carmen Serrano, José Antonio Pérez-Carrasco, Bernabé Linares-Barranco, Alejandro Linares-Barranco, Gabriel Jiménez-Moreno, Antonio Abad Civit Balcells
IEEE Trans. Neural Networks2
2007 An AER Contrast Retina with On-Chip Calibration
abstract
The paper presents a contrast retina microchip that provides its output as an AER (Address Event Representation) stream. Contrast is computed as the ratio between pixel photocurrent and a local average between neighboring pixels obtained with a diffusive network. This current based computation produces a large mismatch between neighboring pixels, because the currents can be as low as a few pico amperes. Consequently, a compact calibration circuitry has been included to calibrate each pixel. The paper describes the design of the pixel with its contrast computation and calibration sections. Experimental results are provided for a prototype fabricated in a standard 0.35μm CMOS process.
Jesús Costas-Santos, Teresa Serrano-Gotarredona, Rafael Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS2
2007 A Physical Interpretation of the Distance Term in Pelgrom's Mismatch Model results in very Efficient CAD
abstract
In 1989 Pelgrom et al. published a mismatch model for MOS transistors, where the standard quadratic deviation of the mismatch in a parameter between two identical transistors, is given by two independent terms: (1) a transistor size-dependent term; and (2) an inter-transistor distance-dependent term. To include the distance term, some researchers have developed CAD tools based on the so called σ-Space Methodology, which result in very computationally expensive algorithms. Such algorithms become non-viable even for circuits with a reduced number of transistors. On the other hand, by understanding and interpreting correctly the physical origin of Pelgrom's model distance term, one can implement in a straight forward manner this mismatch contribution in a CAD tool. Furthermore, the computational cost results negligible and viable for any number of transistors.
Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
ISCAS2
2007 Spike Events Processing for Vision Systems
abstract
In this paper we briefly summarize the fundamental properties of spike events processing applied to artificial vision systems. This sensing and processing technology is capable of very high speed throughput, because it does not rely on sensing and processing sequences of frames, and because it allows for complex hierarchically structured cortical-like layers for sophisticated processing. The paper includes a few examples that have demonstrated the potential of this technology for high-speed vision processing, such as a multilayer event processing network of 5 sequential cortical-like layers, and a recognition system capable of discriminating propellers of different shape rotating at 5000 revolutions per second (300000 revolutions per minute).
Rafael Serrano-Gotarredona, Teresa Serrano-Gotarredona, Antonio J. Acosta 0001, Alejandro Linares-Barranco, Gabriel Jiménez-Moreno, Antonio Abad Civit Balcells, Bernabé Linares-Barranco
ISCAS2
2007 On an Efficient CAD Implementation of the Distance Term in Pelgrom's Mismatch Model
abstract
In 1989, Pelgrom et al. published a mismatch model for MOS transistors, where the variation of parameter mismatch between two identical transistors is given by two independent terms: a size-dependent term and a distance-dependent term. Some CAD tools based on a nonphysical interpretation of Pelgrom's distance term result in excessive computationally expensive algorithms, which become nonviable even for circuits with a reduced number of transistors. Furthermore, some researchers are reporting new variations on the original nonphysically interpreted algorithms, which may render false results. The purpose of this paper is to clarify the physical interpretation of the distance term of Pelgrom and indicate how to model it efficiently in prospective CAD tools.
Bernabé Linares-Barranco, Teresa Serrano-Gotarredona
IEEE Trans. Comput. Aided Des. Integr. Circuits Syst.2
2006 High-speed image processing with AER-based components
abstract
A high speed sample image processing application using AER-based components is presented. The setup objective is to distinguish between two propellers of different shape rotating at high speed (around 1000 revolutions/sec) to show event-based systems capabilities in high speed applications. Event-based schemes allow the most relevant information to propagate faster through the system layers. So image processing is sped up because a rough result may be available when only a little part of the input has arrived. This setup is much faster than the conventional frame-based image processing systems because they would need to process more than 10kFrames/s to do the same task proposed here, whereas only few events are required with the event based technique
Rafael Serrano-Gotarredona, Bernabé Linares-Barranco, Teresa Serrano-Gotarredona, Antonio J. Acosta 0001, Alejandro Linares-Barranco, Rafael Paz-Vicente, Francisco Gomez-Rodriguez
ISCAS3
2006 An arbitrary kernel convolution AER-transceiver chip for real-time image filtering
abstract
A chip that performs real-time image convolutions with programmable kernels of arbitrary shape is presented. This is a first prototype of reduced size (16 times 16 pixels) to validate system level techniques. It has been fabricated in AMS-0.35 mum, 2-poly, 3-metal technology. Chip inputs and outputs are coded using address event representation (AER). This is an emergent neuromorphic interchip communication protocol that allows for real-time virtual massive connectivity between huge numbers of pixels located on different chips. Pixels generate 'events' according to their activity levels. More active pixels generate more events per unit time and access the interchip communication channel more frequently, whereas pixels with low activity consume less communication bandwidth. This allows communicating more relevant information in a very short time. Specific PCI boards have been developed to feed images into the chip and to read images out of it
Rafael Serrano-Gotarredona, Teresa Serrano-Gotarredona, Antonio J. Acosta 0001, Bernabé Linares-Barranco
ISCAS2
2006 A Low-Power Current Mode Fuzzy-ART Cell
abstract
This paper presents a very large scale integration (VLSI) implementation of a low-power current-mode fuzzy-adaptive resonance theory (ART) cell. The cell is based on a compact new current source multibit memory cell with online learning capability. A small prototype of the designed cell and its peripheral block has been fabricated in the AustriaMicroSystems (AMS)-0.35-microm technology. The cell occupies a total area of 44 x 34 microm2 and consumes a maximum current of 22 nA.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
IEEE Trans. Neural Networks1
2005 AER Building Blocks for Multi-Layer Multi-Chip Neuromorphic Vision Systems
abstract
A 5-layer neuromorphic vision processor whose components communicate spike events asychronously using the address-event- representation (AER) is demonstrated. The system includes a retina chip, two convolution chips, a 2D winner-take-all chip, a delay line chip, a learning classifier chip, and a set of PCBs for computer interfacing and address space remappings. The components use a mixture of analog and digital computation and will learn to classify trajectories of a moving object. A complete experimental setup and measurements results are shown.
Rafael Serrano-Gotarredona, Matthias Oster, Patrick Lichtsteiner, Alejandro Linares-Barranco, Rafael Paz-Vicente, Francisco Gomez-Rodriguez, Håvard Kolle Riis, Tobi Delbruck, Shih-Chii Liu, S. Zahnd, Adrian M. Whatley, Rodney J. Douglas, Philipp Häfliger, Gabriel Jiménez-Moreno, Antonio Abad Civit Balcells, Teresa Serrano-Gotarredona, Antonio J. Acosta 0001, Bernabé Linares-Barranco
NIPS16
2003 Compact low-power calibration mini-DACs for neural arrays with programmable weights
abstract
This paper considers the viability of compact low-resolution low-power mini digital-to-analog converters (mini-DACs) for use in large arrays of neural type cells, where programmable weights are required. Transistors are biased in weak inversion in order to yield small currents and low power consumptions, a necessity when building large size arrays. One important drawback of weak inversion operation is poor matching between transistors. The resulting effective precision of a fabricated array of 50 DACs turned out to be 47% (1.1 bits), due to transistor mismatch. However, it is possible to combine them two by two in order to build calibrated DACs, thus compensating for inter-DAC mismatch. It is shown experimentally that the precision can be improved easily by a factor of 10 (4.8% or 4.4 bits), which makes these DACs viable for low-resolution applications such as massive arrays of neural processing circuits. A design methodology is provided, and illustrated through examples, to obtain calibrated mini-DACs of a given target precision. As an example application, we show simulation results of using this technique to calibrate an array of digitally controlled integrate-and-fire neurons.
Bernabé Linares-Barranco, Teresa Serrano-Gotarredona, Rafael Serrano-Gotarredona
IEEE Trans. Neural Networks2
2003 Log-domain implementation of complex dynamics reaction-diffusion neural networks
abstract
We have identified a second-order reaction-diffusion differential equation able to reproduce through parameter setting different complex spatio-temporal behaviors. We have designed a log-domain hardware that implements the spatially discretized version of the selected reaction-diffusion equation. The logarithmic compression of the state variables allows several decades of variation of these state variables within subthreshold operation of the MOS transistors. Furthermore, as all the equation parameters are implemented as currents, they can be adjusted several decades. As a demonstrator, we have designed a chip containing a linear array of ten second-order dynamics coupled cells. Using this hardware, we have experimentally reproduced two complex spatio-temporal phenomena: the propagation of travelling waves and of trigger waves, as well as isolated oscillatory cells.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
IEEE Trans. Neural Networks1
2000 Programmable Kernel Analog VLSI Convolution Chip for Real Time Vision Processing
abstract
A neural architecture that implements a programmable 2D image filter has been presented. The architecture allows to implement any 2D filter F(p,q) decomposable into x-axis and y-axis components F(p,q) = H(p)V(q) such that the product can be approximated by a signed minimum. Positive and negative values of H(p) and V(q) can be programmed. The architecture requires an address even representation (AER) input. This allows to rotate the 2D convolution kernel any angle. Circuit simulation results of critical components were given. System-level behavioral simulations of a 128x128 array have been included which validate the proposed approach.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco, Andreas G. Andreou
IJCNN (4)1
2000 A methodology for MOS transistor mismatch parameter extraction and mismatch simulation
abstract
This paper presents a methodology for mismatch parameter extraction and mismatch simulation using conventional electrical simulators, like HSpice. A measurement and extraction procedure has been carefully designed to be able to obtain reliable measurements of the mismatch parameters of a given technology. The correctness of this extraction procedure method has been checked through three different validation methods. We also present two methods for performing mismatch simulation with conventional circuit simulators (like HSpice) using the extracted parameters.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS1
2000 A new strong inversion 5-parameter transistor mismatch model
abstract
A new 5-parameter MOS transistor mismatch model is introduced capable of predicting transistor mismatch with very high accuracy for ohmic and saturation strong inversion regions, including short channel transistors. The new model is based on splitting the contribution of the mobility degradation parameter mismatch into two components, and modulating them as the transistor transitions from ohmic to saturation regions. The model is tested for a wide range of transistor sizes (30), and shows excellent precision, never reported before for such a wide range of transistor sizes, including short channel transistors.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS1
2000 A Programmable VLSI Filter Architecture for Application in Real-Time Vision Processing Systems
abstract
An architecture is proposed for the realization of real-time edge-extraction filtering operation in an Address-Event-Representation (AER) vision system. Furthermore, the approach is valid for any 2D filtering operation as long as the convolutional kernel F(p,q) is decomposable into an x-axis and a y-axis component, i.e. F(p,q)=H(p)V(q), for some rotated coordinate system [p,q]. If it is possible to find a coordinate system [p,q], rotated with respect to the absolute coordinate system a certain angle, for which the above decomposition is possible, then the proposed architecture is able to perform the filtering operation for any angle we would like the kernel to be rotated. This is achieved by taking advantage of the AER and manipulating the addresses in real time. The proposed architecture, however, requires one approximation: the product operation between the horizontal component H(p) and vertical component V(q) should be able to be approximated by a signed minimum operation without significant performance degradation. It is shown that for edge-extraction applications this filter does not produce performance degradation. The proposed architecture is intended to be used in a complete vision system known as the Boundary-Contour-System and Feature-Contour-System Vision Model, proposed by Grossberg and collaborators. The present paper proposes the architecture, provides a circuit implementation using MOS transistors operated in weak inversion, and shows behavioral simulation results at the system level operation and electrical simulation and experimental results at the circuit level operation of some critical subcircuits.
Teresa Serrano-Gotarredona, Andreas G. Andreou, Bernabé Linares-Barranco
Int. J. Neural Syst.1
1997 An ART1 microchip and its use in multi-ART1 systems
abstract
Recently, a real-time clustering microchip neural engine based on the ART1 architecture has been reported. However, that chip rendered an extremely high silicon area consumption of 1 cm(2), and consequently an extremely low yield of 6%. Redundant circuit techniques can be introduced to improve yield performance at the cost of further increasing chip size. In this paper we present an improved ART1 chip prototype based on a different approach to implement the most area consuming circuit elements of the first prototype: an array of several thousand current sources which have to match within a precision of around 1%. Such achievement was possible after a careful transistor mismatch characterization of the fabrication process (ES2-1.0 mum CMOS). A new prototype chip has been fabricated which can cluster 50-b input patterns into up to ten categories. The chip has 15 times less area, shows a yield performance of 98%, and presents the same precision and speed than the previous prototype. Due to its higher robustness multichip systems are easily assembled. As a demonstration we show results of a two-chip ART1 system, and of an ARTMAP system made of two ART1 chips and an extra interfacing chip.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
IEEE Trans. Neural Networks1
1996 A Modified ART 1 Algorithm more Suitable for VLSI Implementations
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
Neural Networks1
1996 A real-time clustering microchip neural engine
abstract
This paper presents an analog current-mode VLSI implementation of an unsupervised clustering algorithm. The clustering algorithm is based on the popular ART1 algorithm, but has been modified resulting in a more VLSI-friendly algorithm that allows a more efficient hardware implementation with simple circuit operators, little memory requirements, modular chip assembly capability, and higher speed figures. The chip described in this paper implements a network that can cluster 100 binary pixel input patterns into up to 18 different categories. Modular expansibility of the system is directly possible by assembling a V/spl times/M array of chips without any extra interfacing circuitry, so that the maximum number of clusters is 18/spl times/M and the maximum number of bits of the input pattern is N/spl times/100. Pattern classification and learning is performed in 1.8 /spl mu/s, which is an equivalent computing power of 4.4/spl times/10/sup 9/ connections per second plus connection-updates per second. The chip has been fabricated in a standard low cost 1.6 /spl mu/m double-metal single-poly CMOS process, has a die area of 1 cm/sup 2/, and is mounted in a 120-pin PGA package. Although internally the chip is analog in nature, it interfaces to the outside world through digital signals, and thus has a true asynchronous digital behavior. Experimental chip test results are available, obtained through digital chip test equipment. Fault tolerance at the system level operation is demonstrated through the experimental testing of faulty chips.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
IEEE Trans. Very Large Scale Integr. Syst.1
1995 Experimental Results of an Analog Current-Mode ART1 Chip
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS1
1994 A Modular Current-Mode High-Precision Winner-Take-All Circuit
abstract
In this paper we present a Winner-Take-All (WTA) circuit realized using current-mode circuit design techniques. The operation of the WTA is based on current comparators and current mirrors. Speed and precision is determined primarily by the characteristics of the current mirror used. Using special current mirrors, resolutions below 1% and settling times below 100 ns were simulated. The circuit remains operative with reasonable speed and precision for an input-signal range wider than two decades. It requires current input signals and provides voltage output signals.>
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco
ISCAS1
1994 A Real Time Clustering CMOS Neural Engine
abstract
We describe an analog VLSI implementation of the ARTI algorithm (Carpenter, 1987). A prototype chip has been fabricated in a standard low cost 1.5~m double-metal single-poly CMOS process. It has a die area of lcm2 and is mounted in a 12O-pins PGA package. The chip realizes a modified version of the original ARTI architecture. Such modification has been shown to preserve all computational properties of the original algorithm (Serrano, 1994a), while being more appropriate for VLSI realizations. The chip implements an ARTI network with 100 F 1 nodes and 18 F2 nodes. It can therefore cluster 100 binary pixels input patterns into up to 18 different categories. Modular expansibility of the system is possible by assembling an NxM array of chips without any extra interfacing circuitry, resulting in an F 1 layer with l00xN nodes, and an F2 layer with 18xM nodes. Pattern classification is performed in less than 1.8~s, which means an equivalent computing power of 2.2x109 connections and connection-updates per second. Although internally the chip is analog in nature, it interfaces to the outside world through digital signals, thus having a true asynchrounous digital behavior. Experimental chip test results are available, which have been obtained through test equipments for digital chips.
Teresa Serrano-Gotarredona, Bernabé Linares-Barranco, José Luis Huertas
NIPS1