Automating stochastic gradient methods with adaptive batch sizes

Add to your list(s) Download to your calendar using vCal

• Tom Goldstein (University of Maryland, College Park)
• Wednesday 06 September 2017, 09:50-10:40
• Seminar Room 1, Newton Institute.

If you have a question about this talk, please contact INI IT.

VMVW01 - Variational methods, new optimisation techniques and new fast numerical algorithms

This talk will address several issues related to training neural networks using stochastic gradient methods.  First, we'll talk about the difficulties of training in a distributed environment, and present a new method called centralVR for boosting the scalability of training methods.  Then, we'll talk about the issue of automating stochastic gradient descent, and show that learning rate selection can be simplified using “Big Batch” strategies that adaptively choose minibatch sizes.

This talk is part of the Isaac Newton Institute Seminar Series series.

This talk is included in these lists:

• All CMS events
• Featured lists
• INI info aggregator
• Isaac Newton Institute Seminar Series
• School of Physical Sciences
• Seminar Room 1, Newton Institute
• bld31

Note that ex-directory lists are not shown.