Causal Inference and Causal Reinforcement Learning

Add to your list(s) Download to your calendar using vCal

• Chaochao Lu (University of Cambridge)
• Wednesday 27 February 2019, 13:45-15:15
• Engineering Department, CBL Room BE-438.

If you have a question about this talk, please contact Robert Pinsler.

We have probably all heard the saying “correlation does not imply causation”. But what actually are the differences between a causal and a probabilistic model? How can we learn causal relations from data? And what can causal thinking contribute to machine learning problems such as reinforcement learning?

The first part of this talk (presented by Julius) will be a tutorial-style introduction to causal inference from a statistics and machine learning perspective [1]. After motivating and introducing causal models, we will present different assumptions for causal inference and show how they can all be seen as consequences of a fundamental principle: the principle of independent mechanisms. We will then present different causal discovery methods, with a focus on learning from observational data alone. Time-permitting, we will conclude the first part with connections to semi-supervised and transfer learning.

The second part of the talk (presented by Chaochao) will focus on Causal Reinforcement Learning (Causal RL), which is a promising virgin field and will, without doubt, become an indispensable part of artificial general intelligence. The philosophy behind the integration of Causal Inference and RL is obvious but charming. That is, when looking back at the history of science, human beings always progress in a similar manner to that of Causal RL:

Humans summarize rules or experience from their interaction with nature and then exploit this to improve their adaptation in the next exploration. What CausalRL does is exactly to mimic human behaviors, learning causal relations from an agent communicating with the environment and then optimizing its policy based on the learned causal structures.

In this talk, we will learn what Causal RL is, why we need Causal RL, and how Causal RL works.

This talk is part of the Machine Learning Reading Group @ CUED series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge University Engineering Department Talks
• Cambridge talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Computational Continuum Mechanics Group Seminars
• Engineering Department, CBL Room BE-438
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• ML
• Machine Learning Reading Group
• Machine Learning Reading Group @ CUED
• Machine Learning Summary
• Quantum Matter Journal Club
• Required lists for MLG
• School of Technology
• Simon Baker's List
• TQS Journal Clubs
• Trust & Technology Initiative - interesting events
• bld31
• custom
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.