Course, INSA, university of Lyon, electrical department, 2023
French course on transformers. The following aspects are covered: tokenisation, positional embeding, encoding blocs, self-attention module, multi-head attention, vision transformer. A complementary description of the transformer paradigm can be found in this post
Course, INSA, university of Lyon, electrical department, 2023
French course on variational auto-encoder networks. The following aspects are covered: fundamental concepts, Kullback-Liebler divergence, variational inference, VAE architectures. The complete derivation of the VAE equations can be found in this post
Course, INSA, university of Lyon, electrical department, 2023
French course on convolutional neural network. The following aspects are covered: convolutional layer, feature maps, receptive field, classification, segmentation.
Course, INSA, university of Lyon, electrical department, 2023
French course on the optimization steps involved in neural networks. The following aspects are covered: mini-batch gradient descent, momentum/RMSprop/ADAM scheme, batch normalization, dropout, training/validation/test scheme.
Course, INSA, university of Lyon, electrical department, 2023
French course on neural network. The following aspects are covered: modeling of a perceptron, modeling of a neural network, activation functions, backpropagation principle, loss function, gradient descent needs.
Course, INSA, university of Lyon, electrical department, 2023
French course on signal sampling and quantization. The following aspects are covered: modeling of the sampling and quantization operations, energy assessment of the acquisition chain.
Course, INSA, university of Lyon, electrical department, 2023
French course on signal modeling. The following aspects are covered: basic signals / elementary operations, linear time-invariant systems, Fourier transform.