COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring. |

University of Cambridge > Talks.cam > Machine Learning Reading Group @ CUED > The unreasonable effectiveness of mathematics in large scale deep learning

## The unreasonable effectiveness of mathematics in large scale deep learningAdd to your list(s) Download to your calendar using vCal - Greg Yang, Microsoft Research
- Wednesday 06 July 2022, 11:00-12:30
- Cambridge University Engineering Department, CBL Seminar room BE4-38.
If you have a question about this talk, please contact James Allingham. Recently, the theory of infinite-width neural networks led to the first technology, muTransfer, for tuning enormous neural networks that are too expensive to train more than once. For example, this allowed us to tune the 6.7 billion parameter version of GPT -3 using only 7% of its pretraining compute budget, and with some asterisks, we get a performance comparable to the original GPT -3 model with twice the parameter count. In this talk, I will explain the core insight behind this theory. In fact, this is an instance of what I call the There’s no required reading for the talk but folks can look at my homepage for an overview of Tensor Programs. This talk is part of the Machine Learning Reading Group @ CUED series. ## This talk is included in these lists:- All Talks (aka the CURE list)
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge University Engineering Department Talks
- Cambridge University Engineering Department, CBL Seminar room BE4-38
- Cambridge talks
- Centre for Smart Infrastructure & Construction
- Chris Davis' list
- Computational Continuum Mechanics Group Seminars
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Journal Clubs
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- ML
- Machine Learning Reading Group
- Machine Learning Reading Group @ CUED
- Machine Learning Summary
- Quantum Matter Journal Club
- Required lists for MLG
- School of Technology
- Simon Baker's List
- TQS Journal Clubs
- Trust & Technology Initiative - interesting events
- bld31
- custom
- ndk22's list
- ob366-ai4er
- rp587
- yk373's list
Note that ex-directory lists are not shown. |
## Other listsflashacademy talks Biological Geog-biogeo## Other talksPanel Discussion TBA Registration Desk Opens Synthesis United: Reactive Synthesis modulo Theories Benedikt Maderbacher Reactive Synthesis tutorial Antarctica:Isolated Continent |