Booij04SNNThesis

Temporal Pattern Classification using Spiking Neural Networks

Olaf Booij
August 2004

Abstract:

A novel supervised learning-rule is derived for Spiking Neural Networks (SNNs) using the gradient descent method, which can be applied on networks with a multi-layered architecture. All existing learning-rules for SNNs limit the spiking neurons to fire only once. Our algorithm however is specially designed to cope with neurons that fire multiple spikes, taking full advantage of the capabilities of spiking neurons. SNNs are well-suited for the processing of temporal data, because of their dynamic nature, and with our learning rule they can now be used for classification tasks on temporal patterns. We show this by successfully applying the algorithm on a task of lipreading, which involves the classification of video-fragments of spoken words. We also show that the computational power of a one-layered SNN is even greater than was assumed, by showing that it can compute the Exclusive-OR function, as opposed to conventional neural networks.

keywords: spiking neural networks, temporal pattern recognition, classification, gradient descent.

Download:

gzipped postscript (614 Kb), pdf (719 Kb).

bibtex entry.

See also:

research notes