Behavioral Learning in a Cognitive Neuromorphic Robot: An Integrative Approach

RAST, Alexander D, ADAMS, Samantha V, DAVIDSON, Simon, DAVIES, Sergio, HOPKINS, Michael, ROWLEY, Andrew, STOKES, Alan Barry, WENNEKERS, Thomas, FURBER, Steve and CANGELOSI, Angelo (2018). Behavioral Learning in a Cognitive Neuromorphic Robot: An Integrative Approach. IEEE Transactions on Neural Networks and Learning Systems, 29 (12), 6132-6144.

[img]
Preview
PDF
Davies Behavioral Learning in a Cognitive Neuromorphic Robot.pdf - Published Version
Creative Commons Attribution.

Download (5MB) | Preview
Official URL: https://ieeexplore.ieee.org/document/8353507
Open Access URL: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&ar... (Published version)
Link to published version:: https://doi.org/10.1109/tnnls.2018.2816518

Abstract

We present here a learning system using the iCub humanoid robot and the SpiNNaker neuromorphic chip to solve the real-world task of object-specific attention. Integrating spiking neural networks with robots introduces considerable complexity for questionable benefit if the objective is simply task performance. But, we suggest, in a cognitive robotics context, where the goal is understanding how to compute, such an approach may yield useful insights to neural architecture as well as learned behavior, especially if dedicated neural hardware is available. Recent advances in cognitive robotics and neuromorphic processing now make such systems possible. Using a scalable, structured, modular approach, we build a spiking neural network where the effects and impact of learning can be predicted and tested, and the network can be scaled or extended to new tasks automatically. We introduce several enhancements to a basic network and show how they can be used to direct performance toward behaviorally relevant goals. Results show that using a simple classical spike-timing-dependent plasticity (STDP) rule on selected connections, we can get the robot (and network) to progress from poor task-specific performance to good performance. Behaviorally relevant STDP appears to contribute strongly to positive learning: “do this” but less to negative learning: “don't do that.” In addition, we observe that the effect of structural enhancements tends to be cumulative. The overall system suggests that it is by being able to exploit combinations of effects, rather than any one effect or property in isolation, that spiking networks can achieve compelling, task-relevant behavior.

Item Type: Article
Identification Number: https://doi.org/10.1109/tnnls.2018.2816518
Page Range: 6132-6144
SWORD Depositor: Symplectic Elements
Depositing User: Symplectic Elements
Date Deposited: 13 Dec 2019 10:38
Last Modified: 18 Mar 2021 03:04
URI: https://shura.shu.ac.uk/id/eprint/24473

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics