OSPEN: An Open Source Platform For Emulating Neuromorphic Hardware
OSPEN: An Open Source Platform For Emulating Neuromorphic Hardware
Corresponding Author:
Arfan Ghani
Department of Computer Science and Engineering, School of Engineering
American University of Ras al Khaimah
American University of Ras al Khaimah Road, Seih Al Araibi, Ras Al Khaimah, United Arab Emirates
Email: [email protected]
1. INTRODUCTION
With silicon pushed to its limits, we must look beyond conventional computing platforms. The brain
realizes a huge number of tasks through flexible and power-efficient networks of neurons. To enable brain-
like computations, a power-efficient neural fabric is needed to emulate the basic functionality of the human
brain. The task of neural hardware implementation is challenging due to a large number of processing nodes
(roughly 1011) and rich interconnectivity (roughly 1015) [1], [2]. Research work has recently focused on
models which exhibit more plausibility to the human neural system. Similarly, wearable devices and sensors
are commonly used for detecting abnormalities such as detection of seizures, patterns of movement, and
behaviour [1]. However, continuous sampling of input signals requires power, hence neuro-inspired
paradigms offer an alternative to the existing limitation of continuous signal measurement. The power aspect
becomes even more important when it comes to applications based on lightweight portable devices.
Biologically plausible spiking neural models such as the spike response model (SRM) are
particularly suitable in computational neuroscience because it is compute-efficient and captures most of the
biological dynamics [2]-[4]. Nonetheless, to efficiently emulate thousands of such neural entities on
hardware/software platforms is challenging. As one of the main features of the human neural system is its
parallel processing capability, during the past few years, significant advances have been made in techniques,
methodologies, and applications of neural-based hardware [5]-[12]. The brain realizes a huge number of tasks
such as adaptation, vision and recognition through flexible and power-efficient networks of neurons. It is
challenging to investigate an unconventional multidisciplinary area of neural engineering because of the
background knowledge required to understand biological principles and then apply them in computing-
related applications. Growing research in the area of low-power neural engineering and related areas has
triggered the interest to model such systems on electronic platforms [13]. The task of neural hardware
implementation requires an extremely large number of processing nodes, rich interconnectivity, and
adaptation mechanisms [14]. It is well understood that low-power devices with particular applications in
environmental sensing, healthcare and internet of things (IoTs) represent unprecedented challenges with the
growing need for trillions of interconnected devices, ubiquitous sensors, and actuators that are expected to be
interconnected. There are several challenges that the scientific community faces today such as compatible
architectures and platforms for such devices to talk to each other and actual hardware with battery-less
energy scavenging techniques, to name a few.
This paper offers a novel neuro-inspired platform that could potentially be used for research as well
as integrating several neuro-inspired applications such as healthcare electronics and integrated low-power
sensors. Hence, IoT-based devices are particularly promising for applications in medicine and healthcare
[15]-[18]. Such devices have greater potential to reduce the ever-increasing cost of care in developed as well
as developing countries. To provide quality of care and remote healthcare monitoring facilities, it is
imperative to have an open-source hardware platform for modelling, analysis, and prototyping. In this paper,
results are reported from experiments conducted in both software and hardware. The hardware chip is
fabricated with a 0.35 um complementary metal-oxide-semiconducto (CMOS) process [19], [20]. This paper
offers a systematic approach to building a platform from software prototyping, silicon implementation,
electrical characterization, and empirical modelling. Section 2 details the research method where spiking
neural model was investigated in software domain. Section 3 presents the hardware circuits to capture neural
responses akin to the biological neurons. The hardware structures were fabricated and characterized whereas
the data extracted through the fabricated device was empirically modelled in the form of mathematical
equations and embedded into software domain for benchmarking applications. It is envisaged that this work
will offer an open-source platform where generic neural fabric is available to researchers and practitioners for
prototyping applications in the domain of neuromorphic hardware. Our long-term objective is to offer the
very first, an open-source neuromorphic hardware platform for artificial intelligence (AI) enabled healthcare
devices and related industrial applications.
2. RESEARCH METHOD
Recent advances in machine learning necessitate computation-efficient paradigms on both software
and hardware platforms. When spike-based computation models, such as spiking neural networks (SNNs),
are run on neuromorphic hardware, they have a huge potential to reduce energy usage. Nonetheless, due to
the large number of neurons and synapses required at a biological scale, simulating and mapping SNN
architectures on a hardware platform is a daunting task. The proposed method takes a novel approach by
simulating neuronal entities in software before capturing and replicating their dynamics. Rather than
designing and fabricating custom hardware circuits and architectures for a specific application, generic
customised neural cells are investigated and developed. Empirical models developed from the data extracted
through the fabricated structures. This approach offers true replication of the neuromorphic hardware which
is cost-effective and saves time and effort to develop neuro-inspired applications. As spiking neurons are
considered more biologically plausible, they use spikes as the communication mechanism between different
entities. Depending on the model, each spike can be defined as a binary event where the actual timestamp of
the spike carries information. Spiking neuron communication behaviour is shown in Figure 1 where In are the
input currents, s synapses and n the neuron membrane which connects with following synapses and outputs
are generated, as denoted by On.
Int J Reconfigurable & Embedded Syst, Vol. 12, No. 1, March 2023: 1-8
Int J Reconfigurable & Embedded Syst ISSN: 2089-4864 3
𝑡 𝑡
𝜀𝑖𝑗 (𝑡 − 𝑡 (𝑓) ) = exp (− ) (2)
𝜏 𝜏
As shown in (1), the expressions represent as follows: Vm is the membrane potential, 𝜂𝑖 (action
(𝑓) (𝑓)
potential), 𝑡𝑖 (the last firing time of neuron I), 𝑡𝑗 pre-synaptic input spike from neuron j), 𝜀𝑖𝑗 (𝑡−𝑡 (𝑓)) (the
PSP of neuron i caused by a spike from neuron j), 𝑤𝑖𝑗 (synaptic strength), 𝐹𝑖 (the set of all firing times of
neuron I, and Γi represents the set of all presynaptic neurons. Whereas in (2), tau represents the rise and fall
time of the postsynaptic response.
In order to replicate and capture the neural dynamics, the simulated neural circuit is shown in
Figure 2. As shown in the Figure 2, input stimuli (I1 and I2) are connected with two SRM neurons (N1 and
N2) respectively where N1 is considered excitatory and N2 inhibitory. The neurons are connected via static
synapses. The parameters used for simulating this circuit are shown in Table 1. To have insight into the
biological domain, different papers were surveyed to collect realistic biological data sets. We need to know
our limitations in terms of hardware implementation and the values required to develop a biologically
plausible SNN platform. These parameters have also been widely used in computing-related tasks. For the
neuron model and related parameters used for simulations, we refer the reader to [21] and [2].
The software simulation results are shown in Figure 3 where the top plot shows the input stimuli
(analogue and digital) and the second plot from the top shows the output spike times at different time steps.
Plot 3 from the top shows the membrane potential of both neurons and the bottom plot shows the
postsynaptic potentials for all four synapses. As shown in the figure, two inputs (analogue and spiking) were
OSPEN: an open source platform for emulating neuromorphic hardware (Arfan Ghani)
4 ISSN: 2089-4864
connected with two neurons (excitatory and inhibitory) via synapses. Whereas the main difference between
excitatory and inhibitory neurons is that the excitatory neurons fire an action potential in the postsynaptic
neuron and inhibitory neurons inhibit the firing of an action potential. For further details on synaptic
potentials and membrane dynamics, we refer the reader to [2].
Figure 3. SRM circuit response in terms of membrane voltages and synaptic potentials
Int J Reconfigurable & Embedded Syst, Vol. 12, No. 1, March 2023: 1-8
Int J Reconfigurable & Embedded Syst ISSN: 2089-4864 5
Figure 4. This figure shows the input spike train, postsynaptic responses and corresponding membrane
potentials
𝑥.(𝑥−𝑥𝑐 )2
−
𝑦 = [𝑦0 + 𝐴𝑒 2𝑤2 ] . (1 − 𝑒 −𝑏𝑥 ). 𝜀(𝑥 − 𝑡𝑠𝑝𝑖𝑘𝑒 ) (3)
These three parts are an amplitude version of the Gaussian peak function, a Box Lucas function, and
a step function. Whereas yo, A, b, w and xc are real constants and 𝜀 is a response kernel that exhibits the
typical time course of an excitatory postsynaptic potential in terms of response voltage approaching zero
from above. By using this approach, the responses of the spikes with different synaptic weights were
modelled mathematically. It is particularly important to have an empirical model that mimics the actual
behaviour of the fabricated device.
Figure 5. Synapse and neuron circuit [19], [20] Figure 6. Chip layout (3.7x3.7 mm) [20]
(a) (b)
Figure 7. This figure shows the comparison between actual data extracted from the chip
and the empirical model for (a) a single and (b) multiple synapses
Int J Reconfigurable & Embedded Syst, Vol. 12, No. 1, March 2023: 1-8
Int J Reconfigurable & Embedded Syst ISSN: 2089-4864 7
4. CONCLUSION
To summarize, this paper offers a proof-of-concept demonstration of the spiking neural circuits
capturing some of the neural dynamics. It is shown by experimental results (software and hardware) that it is
viable to look beyond traditional paradigms and explore neuro-inspired cells as computational entities.
Empirical models were developed from the data extracted through the fabricated device and accuracy was
confirmed. This work demonstrates the feasibility of an open-source neural hardware platform where neural
fabric can be provided for rapid investigation and development. Authors have set up a GitHub repository
where mathematical equations and MATLAB code for empirically modelled postsynaptic potentials and
neural membranes are provided. Due to the analogue nature of neural cells and synapses, millions of such
computational entities are possible to realize on-chip and with the provision of an open-source neuromorphic
repository, further applications related to machine learning, deep neural networks and IoTs can be explored.
ACKNOWLEDGEMENTS
The authors would like to thank Prof. Stephen Hall from the Faculty of Science and Engineering,
Liverpool University, UK for his feedback and valuable suggestions on the manuscript.
REFERENCES
[1] A. Ghani, “Healthcare electronics-a step closer to future smart cities,” ICT Express, vol. 5, no. 4, pp. 256-260, 2019, doi:
10.1016/j.icte.2018.01.009.
[2] W. Gerstner and W. Kistler, Spiking neuron models: single neurons populations plasticity, MA, Cambridge: Cambridge
University Press, 2002, doi: 10.1017/CBO9780511815706.
[3] E. M. Izhikevich, “Simple model of spiking neurons,” IEEE Transactions on Neural Networks, vol. 14, no. 6, pp. 1569-1572,
Nov. 2003, doi: 10.1109/TNN.2003.820440.
[4] W. Maass and H.Markram, “On the computational power of circuits of spiking neurons,” Journal of Computer and System
Sciences, vol. 69, no. 4, pp. 593-616, 2004, 10.1016/j.jcss.2004.04.001.
[5] S.-C. Liu, T. Delbruck, G. Indiveri, A. Whatley, and R. Douglas, Event-based neuromorphic systems, Hoboken, NJ:Wiley, 2014.
[6] X. Xu et al., “Scaling for edge inference of deep neural networks,” Nature Electronics, vol. 1, no. 4, pp. 216-222, 2018, doi:
10.1038/s41928-018-0059-3.
[7] K. Roy, A. Jaiswal, and P. Panda, “Towards spike-based machine intelligence with neuromorphic computing,” Nature, vol. 575,
no. 7784, pp. 607-617, 2019, doi: 10.1038/s41586-019-1677-2.
[8] “Welcome to the human brain project,” Human Brain Project, https://www.humanbrainproject.eu/en/ (accessed Mar. 21, 2022).
[9] S. Q. Khan, A. Ghani, and M. Khurram, “Population coding for neuromorphic hardware,” Neurocomputing, vol. 239, pp. 153-
164, May 2017, doi: 10.1016/j.neucom.2017.02.013.
[10] H. Markram, “The human brain project,” Scientific American, vol. 306, no. 6, pp. 50-55, 2012.
[11] S. Furber and P. Bogdan, Eds., SpiNNaker: a spiking neural network architecture. Now Publishers, 2020, doi:
10.1561/9781680836523.
[12] S. Appukuttan, L. L. Bologna, F. Schürmann, M. Migliore, and A. P. Davison, “EBRAINS live papers - interactive resource
sheets for computational studies in neuroscience,” Neuroinformatics, 2022, doi: 10.1007/s12021-022-09598-z.
[13] W. Zhang et al., “Neuro-inspired computing chips,” Nature Electronics, vol. 3, no. 7, pp. 371-382, 2020, doi: 10.1038/s41928-
020-0435-7.
[14] L.-J. Lin, C.-Y. Wu, B. Roska, F. Werblin, D. Balya, and Tá. Roska, “A neuromorphic chip that imitates the ON brisk transient
Ganglion cell set in the retinas of rabbits,” IEEE Sensors Journal, vol. 7, no. 9, pp. 1248–1261, Sep. 2007, doi:
10.1109/JSEN.2007.901194.
OSPEN: an open source platform for emulating neuromorphic hardware (Arfan Ghani)
8 ISSN: 2089-4864
[15] G. Chen, L. Hong, J. Dong, P. Liu, J. Conradt, and A. Knoll, “EDDD: event-based drowsiness driving detection through facial
motion analysis with neuromorphic vision sensor,” IEEE Sensors Journal, vol. 20, no. 11, pp. 6170-6181, 2020, doi:
10.1109/JSEN.2020.2973049.
[16] J. A. Castro-García, A. J. Molina-Cantero, M. Merino-Monge and I. M. Gómez-González, “An open-source hardware acquisition
platform for physiological measurements,” IEEE Sensors Journal, vol. 19, no. 23, pp. 11526-11534, 2019, doi:
10.1109/JSEN.2019.2933917.
[17] A. Ghani, A. Aina, C. H. See, H. Yu, and S. Keates, “Accelerated diagnosis of novel coronavirus (COVID-19)—computer vision
with convolutional neural networks (CNNs),” Electronics, vol. 11, no. 7, 2022, doi: 10.3390/electronics11071148.
[18] A. Ghani, T. McGinnity, L. Maguire, and J. Harkin, “Area efficient architecture for large scale implementation of biologically
plausible spiking neural networks on reconfigurable hardware,” 2006 International Conference on Field Programmable Logic
and Applications, 2006, pp. 1-2, doi: 10.1109/FPL.2006.311352.
[19] T. Dowrick, S. Hall, and L. McDaid, “A simple programmable axonal delay scheme for spiking neural networks,”
Neurocomputing, vol. 108, pp. 79-83, 2013, doi: 10.1016/j.neucom.2012.12.004.
[20] T. Dowrick, S. Hall, and L. J. McDaid, “Silicon-based dynamic synapse with depressing response,” IEEE Transactions on Neural
Networks and Learning Systems, vol. 23, no. 10, pp. 1513-1525, 2012, doi: 10.1109/TNNLS.2012.2211035.
[21] P. Dayan and L. F. Abbott, Computational neuroscience series theoretical neuroscience computational and mathematical
modeling of neural systems. Massachusetts London: The MIT Press, 2001.
[22] T. Dowrick, L. McDaid, and S. Hall, “Fan-in analysis of a leaky integrator circuit using charge transfer synapses,”
Neurocomputing, vol. 314, pp. 78-85, Nov. 2018, doi: 10.1016/j.neucom.2018.06.065.
[23] A. Ghani et al., “Evaluating the generalisation capability of a CMOS based synapse,” Neurocomputing, vol. 83, pp. 188–197, Apr.
2012, doi: 10.1016/j.neucom.2011.12.010.
[24] Neuromorphic-os “open-source-neuromorphic-hardware,” Github, Jun 16, 2022. https://github.com/neuromorphic-os/open-
source-neuromorphic-hardware/tree/main (accessed Mar. 21, 2022).
[25] J. Eshraghian “Deep and online learning with spiking neural networks in Python,” Github, Feb 19, 2022
https://github.com/jeshraghian/QSNNs (accessed October, 27, 2022)
BIOGRAPHIES OF AUTHORS
Prof. Liam J. McDaid received the B.Eng. degree (Hons.) in electrical and
electronics engineering and the PhD degree in solid-state devices from the University of
Liverpool, Liverpool, U.K., in 1985 and 1989, respectively. He is currently a Professor of
computational neuroscience at Ulster University, Derry, U.K., where he leads the
Computational Neuroscience and Neural Engineering Research Team. He is also involved in
the development of software/hardware models of neural-based computational systems with a
particular emphasis on the mechanisms that underpin self-repair in the human brain. He has co-
authored over 120 publications in his career to date. His current research interests include
modeling the role of glial cells in the functional and dysfunctional brain. Dr. McDaid received
several research grants in this domain. He is currently a collaborator on the Human Frontier
Science Program and Engineering and Physical Sciences Research Council-funded projects.
He can be contacted at email: [email protected].
Int J Reconfigurable & Embedded Syst, Vol. 12, No. 1, March 2023: 1-8