Signin

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Umar Jamil • April 30, 2024

Video Thumbnail

You May Also Like

Video Thumbnail

How AI Image Generators Work (Stable Diffusion / Dall-E) - Computerphile

Computerphile

Video Thumbnail

Live -Transformers Indepth Architecture Understanding- Attention Is All You Need

Krish Naik

Video Thumbnail

The math behind Attention: Keys, Queries, and Values matrices

Serrano.Academy

Video Thumbnail

Transformer Neural Networks, ChatGPT's foundation, Clearly Explained!!!

StatQuest with Josh Starmer

Video Thumbnail

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

Umar Jamil

Video Thumbnail

Keeping Your Leadership Team Focused with Danny Shader

Bolster

Video Thumbnail

But what is a GPT? Visual intro to transformers | Chapter 5, Deep Learning

3Blue1Brown

Video Thumbnail

Orignal transformer paper "Attention is all you need" introduced by a layman | Shawn's ML Notes

Yuxiang "Shawn" Wang

Video Thumbnail

Let's build GPT: from scratch, in code, spelled out.

Andrej Karpathy

Video Thumbnail

Attention in transformers, visually explained | Chapter 6, Deep Learning

3Blue1Brown

Video Thumbnail

Transformers explained | The architecture behind LLMs

AI Coffee Break with Letitia

Video Thumbnail

What are Transformer Models and how do they work?

Serrano.Academy

Video Thumbnail

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar Jamil

Video Thumbnail

Decoder-Only Transformers, ChatGPTs specific Transformer, Clearly Explained!!!

StatQuest with Josh Starmer

Video Thumbnail

Variational Autoencoder - Model, ELBO, loss function and maths explained easily!

Umar Jamil

Video Thumbnail

[ 100k Special ] Transformers: Zero to Hero

CodeEmporium

Video Thumbnail

The Attention Mechanism in Large Language Models

Serrano.Academy

Video Thumbnail

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token

Umar Jamil

Video Thumbnail

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Umar Jamil

Video Thumbnail

ChatGPT: 30 Year History | How AI Learned to Talk

Art of the Problem

Umar Jamil

About

No channel description available.

Latest Posts

Video Thumbnail

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Umar Jamil

Video Thumbnail

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Umar Jamil

Video Thumbnail

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Umar Jamil

Video Thumbnail

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar Jamil