Transformers

Course, INSA, university of Lyon, electrical department, 2023

French course on transformers. The following aspects are covered: tokenisation, positional embeding, encoding blocs, self-attention module, multi-head attention, vision transformer. A complementary description of the transformer paradigm can be found in this post


Teaching transformer