University of Cambridge > Talks.cam > Computational Neuroscience > Computational Neuroscience Journal Club

  Browse A-Z

Log in

Cambridge users (raven)details Other usersdetails No account?details

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

Computational Neuroscience Journal Club

Add to your list(s) Download to your calendar using vCal

  • UserCalvin Kao and Marine Schimel
  • ClockTuesday 15 December 2020, 15:00-16:30
  • HouseOnline on Zoom.

If you have a question about this talk, please contact Jake Stroud.

Please join us for our fortnightly journal club online via zoom where two presenters will jointly present a topic together. The next topic is ‘Successor representations in RL and neuroscience’ presented by Calvin Kao and Marine Schimel.

Zoom information:

https://us02web.zoom.us/j/84197886178?pwd=SVFKbjc0dmVFR3JwYTQ5ek5UM1pTQT09

Meeting ID: 841 9788 6178

Passcode: 659046

Topic summary:

Reinforcement learning algorithms are commonly categorised as either model-based, where the agent has an explicit model of the environment, or model-free, where it does not. Successor representations (SR) are used in a class of reinforcement learning algorithms that lie between these two extremes. These algorithms enable fast generalisation to new tasks with different reward distributions but the same transition dynamics. In recent years, there has been increasing interest in SR within both the neuroscience and machine learning communities, as SR are useful for meta-reinforcement learning and there is growing behavioural and neural evidence that the brain uses SR for learning. In this journal club, we will briefly review basic concepts in reinforcement learning before introducing the SR framework for reinforcement learning. We will then review two recent papers that provide evidence for SR in the brain:

1. The successor representation in human reinforcement learning, Momennejad et al., 2017, Nature Human Behaviour

2. The hippocampus as a predictive map, Stachenfeld et al., 2017, Nature Neuroscience

This talk is part of the Computational Neuroscience series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Clinical Science Seminars EPOC CUCS

Other talks

Novel Mitochondrial Mechanisms for Cardiometabolic Disease The Biology of Eating Seth Masters, Title “NLRP1 inflammasome activation in mice and humans resulting from DPP9 deficiency” and Petr Broz, Title: “How do bystander cells respond to pyroptosis and other forms of death?” Nongenetic mechanisms of tumor evolution and therapy resistance Genomic Scope of Adaptive Mutations in the Face of Environmental Challenges How Are Geochemical Reactions in Aquifers Connected to Climate Change Mitigation?
 

© 2006-2024 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity