Signin

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

Umar Jamil • April 23, 2024

Video Thumbnail

You May Also Like

Video Thumbnail

AI’s ‘Her’ Era Has Arrived

AI Uncovered

Video Thumbnail

2.7 BERT (from scratch)

AIT Brain Lab

Video Thumbnail

Transformers, explained: Understand the model behind GPT, BERT, and T5

Google Cloud Tech

Video Thumbnail

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar Jamil

Video Thumbnail

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Umar Jamil

Video Thumbnail

Transformers, explained: Understand the model behind ChatGPT

Leon Petrou

Video Thumbnail

PyTorch in 100 Seconds

Fireship

Video Thumbnail

Planck Stars: Alive Inside a Black Hole

Astrographics

Video Thumbnail

But what is a GPT? Visual intro to transformers | Chapter 5, Deep Learning

3Blue1Brown

Video Thumbnail

I visited the world's hardest math class

Gohar Khan

Video Thumbnail

ML Was Hard Until I Learned These 5 Secrets!

Boris Meinardus

Video Thumbnail

Debunking Every Common Misconception in 8 Minutes

Brushed Insights

Video Thumbnail

Who's Adam and What's He Optimizing? | Deep Dive into Optimizers for Machine Learning!

Sourish Kundu

Video Thumbnail

[1hr Talk] Intro to Large Language Models

Andrej Karpathy

Video Thumbnail

What are Transformers (Machine Learning Model)?

IBM Technology

Video Thumbnail

I gave 127 interviews. Top 5 Algorithms they asked me.

Sahil & Sarra

Video Thumbnail

Transformer Neural Networks - EXPLAINED! (Attention is all you need)

CodeEmporium

Video Thumbnail

The Truth About Learning Python in 2024

Internet Made Coder

Umar Jamil

About

No channel description available.

Latest Posts

Video Thumbnail

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Umar Jamil

Video Thumbnail

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Umar Jamil

Video Thumbnail

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Umar Jamil

Video Thumbnail

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar Jamil