University of Cambridge > Talks.cam > Applied and Computational Analysis > Deep learning as optimal control problems: models and numerical methods

Deep learning as optimal control problems: models and numerical methods

Add to your list(s) Download to your calendar using vCal

  • UserElena Celledoni (NTNU, Norway)
  • ClockThursday 14 November 2019, 15:00-16:00
  • HouseMR 14.

If you have a question about this talk, please contact Carola-Bibiane Schoenlieb.

We consider recent work where deep learning neural networks have been interpreted as discretisations of an optimal control problem subject to an ordinary differential equation constraint. We review the first order conditions for optimality, and the conditions ensuring optimality after discretisation. This leads to a class of algorithms for solving the discrete optimal control problem which guarantee that the corresponding discrete necessary conditions for optimality are fulfilled. The differential equation setting lends itself to learning additional parameters such as the time discretisation. We explore this extension alongside natural constraints (e.g. time steps lie in a simplex). We compare these deep learning algorithms numerically in terms of induced flow and generalisation ability.

This talk is part of the Applied and Computational Analysis series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

 

© 2006-2019 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity