![]() |
Automatic differentiation - an RSE's eye viewAdd to your list(s) Download to your calendar using vCal
If you have a question about this talk, please contact Jack Atkinson. Automatic or algorithmic differentiation (AD) underpins much of the current boom in use of machine learning methods but is also widely used in other scientific computing contexts. In this talk I will give an overview of what automatic differentiation is and a brief summary of its history. I will then review how it relates to symbolic and numerical differentiation, how forward- and reverse-mode AD differ and some of the different approaches to implementing AD frameworks, before demonstrating how AD is used in practice with some applied examples. I will conclude with some discussion of my experiences of using various automatic differentiation implementations in research software projects I have worked on, particularly from a context of the trade-offs between ease of use and maintainability and generality of code a framework can differentiate. This talk is part of the RSE Seminars series. This talk is included in these lists:
Note that ex-directory lists are not shown. |
Other listsSpanish Researchers in the United Kingdom (SRUK) The Cultures of Climate Change Trinity Politics SocietyOther talksAlgorithms for Zariski dense subgroups and their applications Morning Coffee Messy, Self-organized Networks as Metamaterials Lunch at Churchill College Share your front page Generative AI and Diffusion Models: a Statistical Physics Analysis |