Olivier Bernard

Olivier Bernard

Professor at the university of Lyon (INSA), France and deputy director of the CREATIS laboratory

Optimization of neural networks

Course, INSA, university of Lyon, electrical department, 2023

French course on the optimization steps involved in neural networks. The following aspects are covered: mini-batch gradient descent, momentum/RMSprop/ADAM scheme, batch normalization, dropout, training/validation/test scheme.
[pdf-fr]


Teaching optimization