ID: 2112.00248

Simulation platform for pattern recognition based on reservoir computing with memristor networks

December 1, 2021

View on ArXiv
Gouhei Tanaka, Ryosho Nakane
Computer Science
Emerging Technologies
Neural and Evolutionary Comp...

Memristive systems and devices are potentially available for implementing reservoir computing (RC) systems applied to pattern recognition. However, the computational ability of memristive RC systems depends on intertwined factors such as system architectures and physical properties of memristive elements, which complicates identifying the key factor for system performance. Here we develop a simulation platform for RC with memristor device networks, which enables testing different system designs for performance improvement. Numerical simulations show that the memristor-network-based RC systems can yield high computational performance comparable to that of state-of-the-art methods in three time series classification tasks. We demonstrate that the excellent and robust computation under device-to-device variability can be achieved by appropriately setting network structures, nonlinearity of memristors, and pre/post-processing, which increases the potential for reliable computation with unreliable component devices. Our results contribute to an establishment of a design guide for memristive reservoirs toward a realization of energy-efficient machine learning hardware.

Similar papers 1

Brain-Inspired Reservoir Computing Using Memristors with Tunable Dynamics and Short-Term Plasticity

October 25, 2023

93% Match
Nicholas X. Armendarez, Ahmed S. Mohamed, Anurag Dhungel, Md Razuan Hossain, ... , Najem Joseph S.
Machine Learning

Recent advancements in reservoir computing research have created a demand for analog devices with dynamics that can facilitate the physical implementation of reservoirs, promising faster information processing while consuming less energy and occupying a smaller area footprint. Studies have demonstrated that dynamic memristors, with nonlinear and short-term memory dynamics, are excellent candidates as information-processing devices or reservoirs for temporal classification and...

Find SimilarView on arXiv

Memristor models for machine learning

June 9, 2014

93% Match
Juan Pablo Carbajal, Joni Dambre, ... , Schrauwen Benjamin
Machine Learning
Materials Science

In the quest for alternatives to traditional CMOS, it is being suggested that digital computing efficiency and power can be improved by matching the precision to the application. Many applications do not need the high precision that is being used today. In particular, large gains in area- and power efficiency could be achieved by dedicated analog realizations of approximate computing engines. In this work, we explore the use of memristor networks for analog approximate comput...

Find SimilarView on arXiv

Time-Series Forecasting and Sequence Learning Using Memristor-based Reservoir System

May 22, 2024

93% Match
Abdullah M. Zyarah, Dhireesha Kudithipudi
Machine Learning
Artificial Intelligence
Hardware Architecture

Pushing the frontiers of time-series information processing in ever-growing edge devices with stringent resources has been impeded by the system's ability to process information and learn locally on the device. Local processing and learning typically demand intensive computations and massive storage as the process involves retrieving information and tuning hundreds of parameters back in time. In this work, we developed a memristor-based echo state network accelerator that fea...

Find SimilarView on arXiv

Analysis and Fully Memristor-based Reservoir Computing for Temporal Data Classification

March 4, 2024

92% Match
Ankur Singh, Sanghyeon Choi, Gunuk Wang, ... , Lee Byung-Geun
Neural and Evolutionary Comp...
Artificial Intelligence

Reservoir computing (RC) offers a neuromorphic framework that is particularly effective for processing spatiotemporal signals. Known for its temporal processing prowess, RC significantly lowers training costs compared to conventional recurrent neural networks. A key component in its hardware deployment is the ability to generate dynamic reservoir states. Our research introduces a novel dual-memory RC system, integrating a short-term memory via a WOx-based memristor, capable o...

Find SimilarView on arXiv

Neuromorphic Electronic Systems for Reservoir Computing

August 26, 2019

92% Match
Fatemeh Hadaeghi
Emerging Technologies
Machine Learning

This chapter provides a comprehensive survey of the researches and motivations for hardware implementation of reservoir computing (RC) on neuromorphic electronic systems. Due to its computational efficiency and the fact that training amounts to a simple linear regression, both spiking and non-spiking implementations of reservoir computing on neuromorphic hardware have been developed. Here, a review of these experimental studies is provided to illustrate the progress in this a...

Find SimilarView on arXiv

Biomembrane-based Memcapacitive Reservoir Computing System for Energy Efficient Temporal Data Processing

May 19, 2023

92% Match
Md Razuan Hossain, Ahmed Salah Mohamed, Nicholas Xavier Armendarez, ... , Hasan Md Sakib
Machine Learning
Artificial Intelligence
Emerging Technologies
Neural and Evolutionary Comp...

Reservoir computing is a highly efficient machine learning framework for processing temporal data by extracting features from the input signal and mapping them into higher dimensional spaces. Physical reservoir layers have been realized using spintronic oscillators, atomic switch networks, silicon photonic modules, ferroelectric transistors, and volatile memristors. However, these devices are intrinsically energy-dissipative due to their resistive nature, which leads to incre...

Find SimilarView on arXiv

Toward bio-inspired information processing with networks of nano-scale switching elements

November 25, 2013

92% Match
Zoran Konkoli, Göran Wendin
Emerging Technologies

Unconventional computing explores multi-scale platforms connecting molecular-scale devices into networks for the development of scalable neuromorphic architectures, often based on new materials and components with new functionalities. We review some work investigating the functionalities of locally connected networks of different types of switching elements as computational substrates. In particular, we discuss reservoir computing with networks of nonlinear nanoscale componen...

Find SimilarView on arXiv

Hierarchical Composition of Memristive Networks for Real-Time Computing

April 11, 2015

92% Match
Jens Bürger, Alireza Goudarzi, ... , Teuscher Christof
Emerging Technologies
Disordered Systems and Neura...
Neural and Evolutionary Comp...

Advances in materials science have led to physical instantiations of self-assembled networks of memristive devices and demonstrations of their computational capability through reservoir computing. Reservoir computing is an approach that takes advantage of collective system dynamics for real-time computing. A dynamical system, called a reservoir, is excited with a time-varying signal and observations of its states are used to reconstruct a desired output signal. However, such ...

Find SimilarView on arXiv

A tool for emulating neuromorphic architectures with memristive models and devices

July 16, 2022

91% Match
Jinqi Huang, Spyros Stathopoulos, ... , Prodromakis Themis
Neural and Evolutionary Comp...

Memristors have shown promising features for enhancing neuromorphic computing concepts and AI hardware accelerators. In this paper, we present a user-friendly software infrastructure that allows emulating a wide range of neuromorphic architectures with memristor models. This tool empowers studies that exploit memristors for online learning and online classification tasks, predicting memristor resistive state changes during the training process. The versatility of the tool is ...

Find SimilarView on arXiv
Forrest C. Sheldon, Artemy Kolchinsky, Francesco Caravelli
Neural and Evolutionary Comp...
Statistical Mechanics
Emerging Technologies
Adaptation and Self-Organizi...

Reservoir computing is a machine learning paradigm that uses a high-dimensional dynamical system, or \emph{reservoir}, to approximate and predict time series data. The scale, speed and power usage of reservoir computers could be enhanced by constructing reservoirs out of electronic circuits, and several experimental studies have demonstrated promise in this direction. However, designing quality reservoirs requires a precise understanding of how such circuits process and store...