Account

Let's reproduce GPT-2 (124M)

Andrej Karpathy • June 9, 2024

Video Thumbnail

Andrej Karpathy

About

No channel description available.

Latest Posts

Video Thumbnail

How I use LLMs

Andrej Karpathy

Video Thumbnail

Deep Dive into LLMs like ChatGPT

Andrej Karpathy

Video Thumbnail

Let's build the GPT Tokenizer

Andrej Karpathy

Video Thumbnail

Let's build GPT: from scratch, in code, spelled out.

Andrej Karpathy

You May Also Like

Let's build GPT: from scratch, in code, spelled out.

Let's build GPT: from scratch, in code, spelled out.

Andrej Karpathy2 years ago

Deep Dive into LLMs like ChatGPT

Deep Dive into LLMs like ChatGPT

Andrej Karpathy10 months ago

Let's build the GPT Tokenizer

Let's build the GPT Tokenizer

Andrej Karpathy1 year ago

Andrej Karpathy: Software Is Changing (Again)

Andrej Karpathy: Software Is Changing (Again)

Y Combinator5 months ago

Building the PERFECT Linux PC with Linus Torvalds

Building the PERFECT Linux PC with Linus Torvalds

Linus Tech Tips2 weeks ago

4 Hours Chopin for Studying, Concentration & Relaxation

4 Hours Chopin for Studying, Concentration & Relaxation

HALIDONMUSIC4 years ago

The Strange Math That Predicts (Almost) Anything

The Strange Math That Predicts (Almost) Anything

Veritasium4 months ago

Something Weird Happens When E=−mc²

Something Weird Happens When E=−mc²

Veritasium1 week ago

Richard Sutton – Father of RL thinks LLMs are a dead end

Richard Sutton – Father of RL thinks LLMs are a dead end

Dwarkesh Patel2 months ago

The spelled-out intro to neural networks and backpropagation: building micrograd

The spelled-out intro to neural networks and backpropagation: building micrograd

Andrej Karpathy3 years ago

Driving Xiaomi's Electric Car: Are we Cooked?

Driving Xiaomi's Electric Car: Are we Cooked?

Marques Brownlee1 week ago

Stanford CS229 I Machine Learning I Building Large Language Models (LLMs)

Stanford CS229 I Machine Learning I Building Large Language Models (LLMs)

Stanford Online1 year ago

But how do AI images and videos actually work? | Guest video by Welch Labs

But how do AI images and videos actually work? | Guest video by Welch Labs

3Blue1Brown and Welch Labs4 months ago

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Grant Sanderson1 year ago

Motorcycle Engines Are WAY BETTER than Car Engines

Motorcycle Engines Are WAY BETTER than Car Engines

SuperfastMatt2 weeks ago

What the Books Get Wrong about AI [Double Descent]

What the Books Get Wrong about AI [Double Descent]

Welch Labs1 month ago

Why Koenigsegg’s new 2,300hp hypercar changes everything

Why Koenigsegg’s new 2,300hp hypercar changes everything

carwow2 weeks ago

Fully autonomous robots are much closer than you think – Sergey Levine

Fully autonomous robots are much closer than you think – Sergey Levine

Dwarkesh Patel3 months ago

How I use LLMs

How I use LLMs

Andrej Karpathy9 months ago

Ilya Sutskever – We're moving from the age of scaling to the age of research

Ilya Sutskever – We're moving from the age of scaling to the age of research

Dwarkesh Patel2 weeks ago

Home AiChat Shop Saved Account