Seminar 3 : Paul Michel

, par M. Rita

Title : Introductory class on transformers 

Abstract : I will give a quick introduction on the transformer, a neural network architecture that has become ubiquitous in natural language processing since its introduction in 2017. I will describe the artchitecture itself, why and how it came to be and describe some of the research looking into why it works so well.