Reactivation in biological and artificial neural networks

Add to your list(s) Download to your calendar using vCal

• Gido van de Ven, PhD; Baylor College of Medicine
• Tuesday 11 September 2018, 10:00-11:00
• Cambridge University Engineering Dept., Board Room (2nd floor, Baker building).

If you have a question about this talk, please contact Yul Kang.

The brain’s ability to retain memories over a lifespan is thought to rely on the reactivation of memory-representing cell assemblies. To experimentally test this, for my PhD I performed multi-unit recordings in the hippocampus of mice exploring novel environments. We found that selectively disrupting reactivation by closed-loop optogenetic silencing of sharp-wave/ripples impaired the later reinstatement of recently-formed place cell assemblies, thereby providing the first direct evidence that reactivation stabilizes new cell assemblies. To gain deeper insight into the computational role of reactivation, for my postdoc I turned to machine learning. Current state-of-the-art artificial neural networks are my ideal “model organism” as they can perform extremely well on a wide variety of individual tasks, but they struggle to retain old information when trained on new tasks. Could reactivation improve memory consolidation in artificial neural networks? To test this, we equipped deep feed-forward networks for classification with feedback connections trained to have generative capability. We found that interleaving “reactivation” generated by these feedback connections with new task data substantially reduced the catastrophic forgetting of old tasks. Notably, for classification of MNIST -digits, this approach outperforms and is more widely applicable then current deep learning strategies for alleviating catastrophic forgetting. To finish, I will discuss (1) why I believe this approach could scale to more complicated inputs and (2) how I plan to use further insights from the brain to achieve this.

This talk is part of the Computational Neuroscience series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Biology
• Biology
• CBL important
• CamBridgeSens
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Neuroscience Seminars
• Cambridge University Engineering Dept., Board Room (2nd floor, Baker building)
• Cambridge talks
• Chris Davis' list
• Computational Neuroscience
• Computational and Biological Learning Seminar Series
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Life Science
• Life Science Interface Seminars
• Life Sciences
• Life Sciences
• ME Seminar
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Quantum Matter Journal Club
• Required lists for MLG
• Stem Cells & Regenerative Medicine
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• dh539
• my_list
• ndk22's list
• ob366-ai4er
• other talks
• rp587
• se456's list
• yk373's list

Note that ex-directory lists are not shown.