A network of spiking neurons demonstrated

IIT Bombay team has designed the first spiking neuro-synaptic core on 45 nanometre silicon-on-insulator technology

Using the phenomenon of quantum tunnelling, IIT Bombay researchers have demonstrated, for the first time, a spiking neuron network that is highly compact and shows potential for brain-scale implementation. The research, published in the journal  IEEE Transactions on Circuits and Systems, demonstrates the use of a 36-member network of spiking neurons in a speech recognition module.

The inter-disciplinary work, led by Maryam Shojaei Baghini, who brought in expertise in circuit design, and Professor Udayan Ganguly who provided the technology and algorithm knowhow, from the Electrical Engineering department of Indian Institute of Technology (IIT), Bombay, showed that their concept of a neuron could be realised and that it works in an energy efficient mode with low power requirement, suitable for emulating the brain.

“This specific work started in 2020, though the relevant knowledge has built over many years and by many people in the team… Our goal was to show a neuron in a network doing something useful. So, we took a prototypical spoken word recognition problem, that is, mimicking the auditory cortex,” says Mr. Ganguly.

In second generation, artificial neural networks, neurons represent their state in eight-bit precision. This does not mimic biological systems.

Instead in a spiking neural network, the next step, the neuron’s output state is “spike” (equivalent to a “one”) or “no spike” (equivalent to a “zero”). This has a binary representation and is closer to the natural workings of neurons in the brain. If such a neural network should also occupy less space and consume little power, it could meet the decadal challenge of brain scale computing.

“We have conceptualised and experimentally demonstrated a very compact and highly energy efficient neuron — a key building block of a neural network,” says Mr. Ganguly.

First, the algorithm of (audio) processing had to be developed. While mathematically the algorithm may be framed in an ideal situation, in actuality, the developer faces non-linearities and other variables. This part of the development was handled by Vivek Saraswat, a graduate student in the department.