Signin

Let's reproduce GPT-2 (124M)

Andrej Karpathy • June 30, 2024

Video Thumbnail

You May Also Like

Video Thumbnail

Olympiad level counting (Generating functions)

3Blue1Brown

Video Thumbnail

How Hoover Dam Works

Animagraffs

Video Thumbnail

Deep Dive into LLMs like ChatGPT

Andrej Karpathy

Video Thumbnail

Let's build the GPT Tokenizer

Andrej Karpathy

Video Thumbnail

I Trained AI to Predict Sports

Green Code

Video Thumbnail

Let's build GPT: from scratch, in code, spelled out.

Andrej Karpathy

Video Thumbnail

Attention is All You Need: Ditching Recurrence for Good!

Priyam Mazumdar

Video Thumbnail

NASAs Coding Requirements Are Insane

ThePrimeTime

Video Thumbnail

How DeepSeek Rewrote the Transformer [MLA]

Welch Labs

Video Thumbnail

Veritasium: What Everyone Gets Wrong About AI and Learning – Derek Muller Explains

Perimeter Institute for Theoretical Physics

Video Thumbnail

The moment we stopped understanding AI [AlexNet]

Welch Labs

Video Thumbnail

Shaolin Warrior Master: Hidden Epidemic Nobody Talks About! This Modern Habit Is Killing Millions!

The Diary Of A CEO

Video Thumbnail

The True Story of How GPT-2 Became Maximally Lewd

Rational Animations

Video Thumbnail

The Most Dangerous Building in Manhattan

Veritasium

Video Thumbnail

RAG vs. CAG: Solving Knowledge Gaps in AI Models

IBM Technology

Video Thumbnail

CUDA Mode Keynote | Andrej Karpathy | Eureka Labs

Accel

Video Thumbnail

How I use LLMs

Andrej Karpathy

Video Thumbnail

Why Does Diffusion Work Better than Auto-Regression?

Algorithmic Simplicity

Video Thumbnail

Prime Reacts - Why I Stopped Using AI Code Editors

ThePrimeTime

Video Thumbnail

Why does Vegas have its own value of pi?

Stand-up Maths

Andrej Karpathy

About

No channel description available.

Latest Posts

Video Thumbnail

How I use LLMs

Andrej Karpathy

Video Thumbnail

Deep Dive into LLMs like ChatGPT

Andrej Karpathy

Video Thumbnail

[1hr Talk] Intro to Large Language Models

Andrej Karpathy

Video Thumbnail

Let's build GPT: from scratch, in code, spelled out.

Andrej Karpathy