Docentship lecture: Learning Dynamics of Neural Networks: Continuous Approximations and Metastability
- Date: 18 March 2025, 13:15–14:00
- Location: Ångström Laboratory, 80127
- Type: Docent trial lecture
- Lecturer: Benny Avelin
- Organiser: Matematiska institutionen
- Contact person: Benny Avelin
The Department of Mathematics hereby invite all interested to a docentship lecture in subject Applied mathematics and statistics with Associate Professor Benny Avelin.
Chairperson: professor Erik Ekström
Representative of the Docentship Committee: professor Nataša Sladoje
Abstract: In this lecture I will give an introduction to learning dynamics of neural networks. I will show how such training dynamics can be analyzed through continuous approximations such as Langevin dynamics, which capture the stochasticity of optimization. I will pay special attention to the concept of metastability, and what role it plays in understanding learning algorithms escape from local minima.
The lecture is an obligatory teaching test for those applying for admittance as docent and it should be possible for students and others with basic academic education in the relevant field to follow it. The lecture lasts 40-45 minutes with subsequent discussion. The lecture will be given in Swedish.
Welcome!