Transformers

Course, INSA, university of Lyon, electrical department, 2024

French course on transformers. The following aspects are covered: tokenisation, positional embeding, encoding blocs, self-attention module, multi-head attention, vision transformer.
[pdf-fr] [pdf-en] [code 1] [post]


Teaching transformer