ID: 2305.12025

Biomembrane-based Memcapacitive Reservoir Computing System for Energy Efficient Temporal Data Processing

May 19, 2023

View on ArXiv
Md Razuan Hossain, Ahmed Salah Mohamed, Nicholas Xavier Armendarez, Joseph S. Najem, Md Sakib Hasan
Computer Science
Machine Learning
Artificial Intelligence
Emerging Technologies
Neural and Evolutionary Comp...

Reservoir computing is a highly efficient machine learning framework for processing temporal data by extracting features from the input signal and mapping them into higher dimensional spaces. Physical reservoir layers have been realized using spintronic oscillators, atomic switch networks, silicon photonic modules, ferroelectric transistors, and volatile memristors. However, these devices are intrinsically energy-dissipative due to their resistive nature, which leads to increased power consumption. Therefore, capacitive memory devices can provide a more energy-efficient approach. Here, we leverage volatile biomembrane-based memcapacitors that closely mimic certain short-term synaptic plasticity functions as reservoirs to solve classification tasks and analyze time-series data in simulation and experimentally. Our system achieves a 99.6% accuracy rate for spoken digit classification and a normalized mean square error of 7.81*10^{-4} in a second-order non-linear regression task. Furthermore, to showcase the device's real-time temporal data processing capability, we achieve 100% accuracy for a real-time epilepsy detection problem from an inputted electroencephalography (EEG) signal. Most importantly, we demonstrate that each memcapacitor consumes an average of 41.5 fJ of energy per spike, regardless of the selected input voltage pulse width, while maintaining an average power of 415 fW for a pulse width of 100 ms. These values are orders of magnitude lower than those achieved by state-of-the-art memristors used as reservoirs. Lastly, we believe the biocompatible, soft nature of our memcapacitor makes it highly suitable for computing and signal-processing applications in biological environments.

Similar papers 1

Intrinsic Voltage Offsets in Memcapacitive Bio-Membranes Enable High-Performance Physical Reservoir Computing

April 27, 2024

92% Match
Ahmed S. Mohamed, Anurag Dhungel, ... , Najem Joseph S.
Emerging Technologies
Artificial Intelligence
Machine Learning

Reservoir computing is a brain-inspired machine learning framework for processing temporal data by mapping inputs into high-dimensional spaces. Physical reservoir computers (PRCs) leverage native fading memory and nonlinearity in physical substrates, including atomic switches, photonics, volatile memristors, and, recently, memcapacitors, to achieve efficient high-dimensional mapping. Traditional PRCs often consist of homogeneous device arrays, which rely on input encoding met...

Find SimilarView on arXiv

Simulation platform for pattern recognition based on reservoir computing with memristor networks

December 1, 2021

92% Match
Gouhei Tanaka, Ryosho Nakane
Emerging Technologies
Neural and Evolutionary Comp...

Memristive systems and devices are potentially available for implementing reservoir computing (RC) systems applied to pattern recognition. However, the computational ability of memristive RC systems depends on intertwined factors such as system architectures and physical properties of memristive elements, which complicates identifying the key factor for system performance. Here we develop a simulation platform for RC with memristor device networks, which enables testing diffe...

Find SimilarView on arXiv

Brain-Inspired Reservoir Computing Using Memristors with Tunable Dynamics and Short-Term Plasticity

October 25, 2023

92% Match
Nicholas X. Armendarez, Ahmed S. Mohamed, Anurag Dhungel, Md Razuan Hossain, ... , Najem Joseph S.
Machine Learning

Recent advancements in reservoir computing research have created a demand for analog devices with dynamics that can facilitate the physical implementation of reservoirs, promising faster information processing while consuming less energy and occupying a smaller area footprint. Studies have demonstrated that dynamic memristors, with nonlinear and short-term memory dynamics, are excellent candidates as information-processing devices or reservoirs for temporal classification and...

Find SimilarView on arXiv

Analysis and Fully Memristor-based Reservoir Computing for Temporal Data Classification

March 4, 2024

90% Match
Ankur Singh, Sanghyeon Choi, Gunuk Wang, ... , Lee Byung-Geun
Neural and Evolutionary Comp...
Artificial Intelligence

Reservoir computing (RC) offers a neuromorphic framework that is particularly effective for processing spatiotemporal signals. Known for its temporal processing prowess, RC significantly lowers training costs compared to conventional recurrent neural networks. A key component in its hardware deployment is the ability to generate dynamic reservoir states. Our research introduces a novel dual-memory RC system, integrating a short-term memory via a WOx-based memristor, capable o...

Find SimilarView on arXiv

Electromechanical memcapacitive neurons for energy-efficient spiking neural networks

April 21, 2023

90% Match
Zixi Zhang, Yuriy V. Pershin, Ivar Martin
Emerging Technologies
Mesoscale and Nanoscale Phys...

In this article, we introduce a new nanoscale electromechanical device -- a leaky memcapacitor -- and show that it may be useful for the hardware implementation of spiking neurons. The leaky memcapacitor is a movable-plate capacitor that becomes quite conductive when the plates come close to each other. The equivalent circuit of the leaky memcapacitor involves a memcapacitive and memristive system connected in parallel. In the leaky memcapacitor, the resistance and capacitanc...

Find SimilarView on arXiv

LiNbO$_3$ volatile memristors for reservoir computing

May 11, 2023

90% Match
Zhao Yuanxi, Duan Wenrui, Li Huanglong
Applied Physics

In conventional digital computers, data and information are represented in binary form and encoded in the steady states of transistors. They are then processed in a quasi-static way. However, with transistors approaching their physical limits and the von Neumann bottleneck, the rate of improvement in computing efficiency has slowed down. Therefore, drawing inspiration from the dynamic and adaptive properties of biological systems, research in neural morphology computing has g...

Find SimilarView on arXiv
Forrest C. Sheldon, Artemy Kolchinsky, Francesco Caravelli
Neural and Evolutionary Comp...
Statistical Mechanics
Emerging Technologies
Adaptation and Self-Organizi...

Reservoir computing is a machine learning paradigm that uses a high-dimensional dynamical system, or \emph{reservoir}, to approximate and predict time series data. The scale, speed and power usage of reservoir computers could be enhanced by constructing reservoirs out of electronic circuits, and several experimental studies have demonstrated promise in this direction. However, designing quality reservoirs requires a precise understanding of how such circuits process and store...

Toward bio-inspired information processing with networks of nano-scale switching elements

November 25, 2013

90% Match
Zoran Konkoli, Göran Wendin
Emerging Technologies

Unconventional computing explores multi-scale platforms connecting molecular-scale devices into networks for the development of scalable neuromorphic architectures, often based on new materials and components with new functionalities. We review some work investigating the functionalities of locally connected networks of different types of switching elements as computational substrates. In particular, we discuss reservoir computing with networks of nonlinear nanoscale componen...

Find SimilarView on arXiv

Neuromorphic Electronic Systems for Reservoir Computing

August 26, 2019

90% Match
Fatemeh Hadaeghi
Emerging Technologies
Machine Learning

This chapter provides a comprehensive survey of the researches and motivations for hardware implementation of reservoir computing (RC) on neuromorphic electronic systems. Due to its computational efficiency and the fact that training amounts to a simple linear regression, both spiking and non-spiking implementations of reservoir computing on neuromorphic hardware have been developed. Here, a review of these experimental studies is provided to illustrate the progress in this a...

Find SimilarView on arXiv

Memristor models for machine learning

June 9, 2014

89% Match
Juan Pablo Carbajal, Joni Dambre, ... , Schrauwen Benjamin
Machine Learning
Materials Science

In the quest for alternatives to traditional CMOS, it is being suggested that digital computing efficiency and power can be improved by matching the precision to the application. Many applications do not need the high precision that is being used today. In particular, large gains in area- and power efficiency could be achieved by dedicated analog realizations of approximate computing engines. In this work, we explore the use of memristor networks for analog approximate comput...

Find SimilarView on arXiv