Optimization of neural networks
Course, INSA, university of Lyon, electrical department, 2023
French course on the optimization steps involved in neural networks. The following aspects are covered: mini-batch gradient descent, momentum/RMSprop/ADAM scheme, batch normalization, dropout, training/validation/test scheme.
