University of Cambridge > Talks.cam > Graduate Programme in Cognitive and Brain Sciences > Circularity and selection bias in neuroscience and beyond: double dipping, publication bias, and the decline of significant effects

  Browse A-Z

Log in

Cambridge users (raven)details Other usersdetails No account?details

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

Circularity and selection bias in neuroscience and beyond: double dipping, publication bias, and the decline of significant effects

Add to your list(s) Download to your calendar using vCal

If you have a question about this talk, please contact Mandy Carter.

A neuroscientific experiment typically generates a large amount of data, of which only a small fraction is analyzed in detail and presented in a publication. However, selection among noisy measurements can render circular an otherwise appropriate analysis and invalidate results. Systems neuroscience needs to adjust some widespread practices to avoid the circularity that can arise from selection. In particular, ‘double dipping’, the use of the same dataset for selection and selective analysis, will give distorted descriptive statistics and invalid statistical inference whenever the results statistics are not inherently independent of the selection criteria under the null hypothesis. To demonstrate the problem, we can apply widely used analyses to noise data known to not contain the experimental effects in question. Spurious effects can appear in the context of both univariate activation analysis and multivariate pattern-information analysis. I will explain how circularity can be safely avoided in neuroimaging experiments. In the last 15 minutes, I will broaden the scope beyond neuroscience and discuss how selection at the level of studies and publications can introduce spurious results into the literature and create biases affecting entire fields of science.

This talk is part of the Graduate Programme in Cognitive and Brain Sciences series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Disease Ontologies and Information (EBI, Hinxton, 19th June 2008) Number theory study group: Iwasawa theory Question and Answer with Stuart Corbridge Modelling Biology Generation to Reproduction Seminars

Other talks

Refugees and Migration Mothers & Daughters: a psychoanalytical perspective Cosmology from the Kilo-Degree Survey Machine learning, social learning and self-driving cars A Bourdiesian analysis of songwriting habitus CANCELLED-Open tools in Marchantia for plant bioengineering work and as a platform for elucidating morphogenesis Liver Regeneration in the Damaged Liver Molecular mechanisms of cardiomyopathies in patients with severe non-ischemic heart failure The Rise of Augmented Intelligence in Edge Networks mTORC1 signaling coordinates different POMC neurons subpopulations to regulate feeding Cambridge-Lausanne Workshop 2018 - Day 2 Dynamical large deviations in glassy systems
 

© 2006-2024 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity