About
The Graduate Division serves more than 13,000 students in over 100 graduate degree programs. We are here to help you from the time you are admitted until you complete your graduate program.
Admissions
We're thrilled you're considering Berkeley for your graduate study. We offer more than 100 programs for master's, professional, and doctoral students to pursue their dreams.
Financial Support
Working toward obtaining your graduate degree at Berkeley is an exciting and challenging endeavor, but funding your graduate education shouldn’t be your greatest challenge.
Academics
We're here to support you as you progress through your degree, and help you understand the policies and procedures that inform your graduate education.
Professional Development
GradPro, the Graduate Writing Center, and the GSI Teaching & Resource Center can support you in your academic and professional development at all stages of your degree program and in preparing for your career.
Diversity
The Office for Graduate Diversity provides support and services for prospective and continuing students in an effort to support and sustain a more diverse graduate student community.
Giving
Your gift allows us to deliver an inclusive, world-class experience to graduate students, so they can make a difference at Berkeley and beyond.
Back to All Events
This workshop offers a general introduction to the GPT (Generative Pretrained Transformers) model. We will explore how they reflect and shape our cultural narratives and social interactions, and which drawbacks and constraints they have. We will explore the transformer architecture upon which GPTs are built, how GPTs encode natural language into embeddings, and how it predicts text. We will also use geometric similarity approaches to represent varying types of similarity between words.