+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Kernel temporal differences for neural decoding



Kernel temporal differences for neural decoding



Computational Intelligence and Neuroscience 2015: 481375



We study the feasibility and capability of the kernel temporal difference (KTD)(λ) algorithm for neural decoding. KTD(λ) is an online, kernel-based learning algorithm, which has been introduced to estimate value functions in reinforcement learning. This algorithm combines kernel-based representations with the temporal difference approach to learning. One of our key observations is that by using strictly positive definite kernels, algorithm's convergence can be guaranteed for policy evaluation. The algorithm's nonlinear functional approximation capabilities are shown in both simulations of policy evaluation and neural decoding problems (policy improvement). KTD can handle high-dimensional neural states containing spatial-temporal information at a reasonable computational complexity allowing real-time applications. When the algorithm seeks a proper mapping between a monkey's neural states and desired positions of a computer cursor or a robot arm, in both open-loop and closed-loop experiments, it can effectively learn the neural state to action mapping. Finally, a visualization of the coadaptation process between the decoder and the subject shows the algorithm's capabilities in reinforcement learning brain machine interfaces.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 058184620

Download citation: RISBibTeXText

PMID: 25866504

DOI: 10.1155/2015/481375


Related references

Neural decoding with kernel-based metric learning. Neural Computation 26(6): 1080-1107, 2014

Non-linear neural spike train decoding via polynomial kernel regression. Conference Proceedings 2007: 4102-4105, 2007

Utilizing temporal information in fMRI decoding: classifier using kernel regression methods. Neuroimage 58(2): 560-571, 2011

A tensor-product-kernel framework for multiscale neural activity decoding and control. Computational Intelligence and Neuroscience 2014: 870160, 2014

Spiking neural circuits with dendritic stimulus processors : encoding, decoding, and identification in reproducing kernel Hilbert spaces. Journal of Computational Neuroscience 38(1): 1-24, 2015

Decoding neural responses to temporal cues for sound localization. Elife 2: E01312, 2013

Towards a fronto-temporal neural network for the decoding of angry vocal expressions. Neuroimage 62(3): 1658-1666, 2012

Neural decoding of visual object categories using temporal patterns of ECoG signals. Neuroscience Research 68: E381-E382, 2010

Temporal-kernel recurrent neural networks. Neural Networks 23(2): 239-243, 2010

Optimal temporal decoding of neural population responses in a reaction-time visual detection task. Journal of Neurophysiology 99(3): 1366-1379, 2008

An analysis of hippocampal spatio-temporal representations using a Bayesian algorithm for neural spike train decoding. IEEE Transactions on Neural Systems and Rehabilitation Engineering 13(2): 131-136, 2005

Improving neural decoding in the central auditory system using bio-inspired spectro-temporal representations and a generalized bilinear model. Conference Proceedings 2015: 5146-5150, 2015

Relationship between neural and hemodynamic signals during spontaneous activity studied with temporal kernel CCA. Magnetic Resonance Imaging 28(8): 1095-1103, 2010

Neural decoding of code modulated visual evoked potentials by spatio-temporal inverse filtering for brain computer interfaces. Conference Proceedings 2016: 1484-1487, 2016

Spike communication of dynamic stimuli: rate decoding versus temporal decoding. Neurocomputing 58-60: 101-107, 2004