Virtual Seminar: 'Statistical Inference with M-Estimators on Bandit Data’

Add to your list(s) Download to your calendar using vCal

• Kelly Zhang, Harvard University
• Thursday 29 April 2021, 14:00-15:00
• Virtual Seminar .

If you have a question about this talk, please contact Alison Quenault.

If you would like to join this virtual seminar, please email alison.quenault@mrc-bsu.cam.ac.uk for more information.

Bandit algorithms are increasingly used in real world sequential decision making problems, from online advertising to mobile health. As a result, there are more datasets collected using bandit algorithms and with that an increased desire to be able to use these datasets to answer scientific questions like: Did one type of ad increase the click-through rate more or lead to more purchases? In which contexts is a mobile health intervention effective? However, it has been shown that classical statistical estimators, like the ordinary least squares estimator, fail to provide reliable confidence intervals when used with bandit data. Recently methods have been developed to conduct statistical inference using simple models fit to data collected with multi-arm bandits. However there is a lack of general methods for conducting statistical inference using more complex models. In this work, we develop theory justifying the use of M-estimation (Van der Vaart, 2000), traditionally used with i.i.d data, to provide inferential methods for a large class of estimators—including least squares and maximum likelihood estimators—but now with data collected with (contextual) bandit algorithms. To do this we generalize the use of adaptive weights pioneered by Hadad et al. (2019) and Deshpande et al. (2018). Specifically, in settings in which the data is collected via a (contextual) bandit algorithm, we prove that adaptively weighted M-estimators are uniformly asymptotically normal and demonstrate empirically that we can use their asymptotic distribution to construct reliable confidence regions for a variety of inferential targets.

This talk is part of the MRC Biostatistics Unit Seminars series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• BHRU Annual Lecture 2015
• BHRU Annual Lecture 2016
• Biology
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Immunology
• Cambridge talks
• Cardiovascular Epidemiology Unit Special Seminars
• Chris Davis' list
• Department of Public Health and Primary Care
• Graduate-Seminars
• Interested Talks
• Life Sciences
• Life Sciences
• ME Seminar
• MRC Biostatistics Unit Seminars
• Primary Care
• PublicHealth@Cambridge
• Trust & Technology Initiative - interesting events
• Virtual Seminar
• bld31
• my_list
• ndk22's list
• ob366-ai4er
• other talks
• primary care
• rp587

Note that ex-directory lists are not shown.