Long-Term Learning Behavior in a Recurrent Neural Network for Sound Recognition
File version
Accepted Manuscript (AM)
Author(s)
Oldoni, Damiano
De Coensel, Bert
Botteldooren, Dick
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
Size
File type(s)
Location
Beijing, PEOPLES R CHINA
License
Abstract
In this paper, the long-term learning properties of an artificial neural network model, designed for sound recognition and computational auditory scene analysis in general, are investigated. The model is designed to run for long periods of time (weeks to months) on low-cost hardware, used in a noise monitoring network, and builds upon previous work by the same authors. It consists of three neural layers, connected to each other by feedforward and feedback excitatory connections. It is shown that the different mechanisms that drive auditory attention emerge naturally from the way in which neural activation and intra-layer inhibitory connections are implemented in the model. Training of the artificial neural network is done following the Hebb principle, dictating that "Cells that fire together, wire together", with some important modifications, compared to standard Hebbian learning. As the model is designed to be on-line for extended periods of time, also learning mechanisms need to be adapted to this. The learning needs to be strongly attention- and saliency-driven, in order not to waste available memory space for sounds that are of no interest to the human listener. The model also implements plasticity, in order to deal with new or changing input over time, without catastrophically forgetting what it already learned. On top of that, it is shown that also the implementation of short-term memory plays an important role in the long-term learning properties of the model. The above properties are investigated and demonstrated by training on real urban sound recordings.
Journal Title
Conference Title
2014 International Joint Conference on Neural Networks (IJCNN)
Book Title
Edition
Volume
Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
© 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Item Access Status
Note
Access the data
Related item(s)
Subject
Artificial Intelligence and Image Processing
Science & Technology
Computer Science, Artificial Intelligence
Engineering, Electrical & Electronic
Telecommunications
Persistent link to this record
Citation
Boes, M; Oldoni, D; De Coensel, B; Botteldooren, D, Long-Term Learning Behavior in a Recurrent Neural Network for Sound Recognition, PROCEEDINGS OF THE 2014 International Joint Conference on Neural Networks (IJCNN), 2014, pp. 3116-3123