University of Cambridge > Talks.cam > Computational Neuroscience > Discovering reward-guided learning strategies from large-scale datasets

  Browse A-Z

Log in

Cambridge users (raven)details Other usersdetails No account?details

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

Discovering reward-guided learning strategies from large-scale datasets

Add to your list(s) Download to your calendar using vCal

If you have a question about this talk, please contact Daniel Kornai.

Understanding the neural mechanisms of reward-guided learning is a long-standing goal of computational neuroscience. Recent methodological innovations enable us to collect ever larger neural and behavioral datasets. This presents opportunities to achieve greater understanding of learning in the brain at scale, as well as methodological challenges. In the first part of the talk, I will discuss our recent insights into the mechanisms by which zebra finch songbirds learn to sing. Dopamine has been long thought to guide reward-based trial-and-error learning by encoding reward prediction errors. However, it is unknown whether the learning of natural behaviours, such as developmental vocal learning, occurs through dopamine-based reinforcement. Longitudinal recordings of dopamine and bird songs reveal that dopamine activity is indeed consistent with encoding a reward prediction error during naturalistic learning.

In the second part of the talk, I will talk about recent work we are doing at DeepMind to develop tools for automatically discovering interpretable models of behavior directly from animal choice data. Our method, dubbed CogFunSearch, uses LLMs within an evolutionary search process in order to “discover” novel models in the form of Python programs that excel at accurately predicting animal behavior during reward-guided learning. The discovered programs reveal novel patterns of learning and choice behavior that update our understanding of how the brain solves reinforcement learning problems.

This talk is part of the Computational Neuroscience series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Cavendish Knowledge Exchange Working Lunch Series Talks related to atmosphere and ocean dynamics and climate science Ergodic Theory seminar

Other talks

MIP Chalk talk MIP Seminars in Cancer A combined palaeoecological and archaeological approach: reconstructing Bronze Age and Iron Age land use patterns around a Northumberland rewilding estate Exciton (De)Localization and Dissociation in Heterogeneous Semiconductors from First Principles Computational Modeling
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity