GPT Fundamentals

This workshop offers a general introduction to the GPT (Generative Pretrained Transformers) model. We will explore how they reflect and shape our cultural narratives and social interactions, and which drawbacks and constraints they have. We will explore the transformer architecture upon which GPTs are built, how GPTs encode natural language into embeddings, and how it predicts text. We will also use geometric similarity approaches to represent varying types of similarity between words.