COOKIES: By using this website you agree that we can place Google Analytics Cookies on your device for performance monitoring. |

University of Cambridge > Talks.cam > Isaac Newton Institute Seminar Series > Deep learning as optimal control problems and Riemannian discrete gradient descent.

## Deep learning as optimal control problems and Riemannian discrete gradient descent.Add to your list(s) Download to your calendar using vCal - Elena Celledoni (Norwegian University of Science and Technology; Norwegian University of Science and Technology)
- Thursday 21 November 2019, 15:05-15:45
- Seminar Room 2, Newton Institute.
If you have a question about this talk, please contact INI IT. GCS - Geometry, compatibility and structure preservation in computational differential equations We consider recent work where deep learning neural networks have been interpreted as discretisations of an optimal control problem subject to an ordinary differential equation constraint. We review the first order conditions for optimality, and the conditions ensuring optimality after discretisation. This leads to a class of algorithms for solving the discrete optimal control problem which guarantee that the corresponding discrete necessary conditions for optimality are fulfilled. The differential equation setting lends itself to learning additional parameters such as the time discretisation. We explore this extension alongside natural constraints (e.g. time steps lie in a simplex). We compare these deep learning algorithms numerically in terms of induced flow and generalisation ability. References - M Benning, E Celledoni, MJ Ehrhardt, B Owren, CB Schönlieb This talk is part of the Isaac Newton Institute Seminar Series series. ## This talk is included in these lists:- All CMS events
- Featured lists
- INI info aggregator
- Isaac Newton Institute Seminar Series
- School of Physical Sciences
- Seminar Room 2, Newton Institute
- bld31
Note that ex-directory lists are not shown. |
## Other listsBeyond Profit POLIS Department Research Seminars Other medicinal chemistry symposia## Other talksIs equilibrium overrated? Processing of optical materials at finite time scales Turning cells inside out: how epithelial cells polarise and why this goes wrong in cancer Properties of Particle Fluxes in Cosmic Rays Measured with the Alpha Magnetic Spectrometer on the ISS Can the face predict the brain? The association between facial morphology and autism spectrum disorder Nuclear topology organisation and cell cycle regulation of the first transcription in the embryo Step size control for Newton type MCMC samplers Jonathan Goodman |