Title : BigScience : Collaboratively training a large multilingual language model
Abstract :
Over the last few years, pre-trained self-supervised language models have shown their usefulness for many applications in many domains. These models aim at discovering general representations from a (...)
Title : Introductory class on transformers
Abstract : I will give a quick introduction on the transformer, a neural network architecture that has become ubiquitous in natural language processing since its introduction in 2017. I will describe the artchitecture itself, why and how it came to (...)
Title : Best programming practices, computer tools and quality-of-life tricks
Abstract : Most of us use computers daily for programming and running experiments. I think it would be very profitable for everybody if we shared our tips to increase productivity (and most importantly, reduce (...)
Title : On the role of population heterogeneity in emergent communication
Abstract : Populations have often been perceived as a structuring component for language to emerge and evolve : the larger the population, the more systematic the language. While this observation is widespread in the (...)
PhD Seminar - news, planning, topics
Centre Sciences des Données
de l’Ecole Normale Supérieure