PC97.com - Plus+ Channels for Creators and Shoppers

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Umar JamilNov 25, 2024

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Umar JamilNov 23, 2024

PT5H46M5S

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation

Umar JamilAug 7, 2024

114k

PT48M46S

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Umar JamilApr 14, 2024

31k

PT1H14M29S

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math

Umar JamilJan 7, 2024

56k

PT1H12M53S

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Umar JamilDec 19, 2023

31k

PT49M24S

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)

Umar JamilNov 27, 2023

81k

Segment Anything - Model explanation with code

Umar JamilNov 2, 2023

PT54M52S

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token

Umar JamilOct 26, 2023

72k

PT1H10M55S

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar JamilAug 24, 2023

107k

PT26M55S

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Umar JamilJul 25, 2023

45k

PT27M12S

Variational Autoencoder - Model, ELBO, loss function and maths explained easily!

Umar JamilJun 7, 2023

61k

PT2H59M24S

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

Umar JamilMay 25, 2023

332k

Featured Results

Titans: Learning to Memorize at Test Time

Paper: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)

Segment Anything - Model explanation with code

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Variational Autoencoder - Model, ELBO, loss function and maths explained easily!

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

Featured Results

Titans: Learning to Memorize at Test Time

Paper: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)

Segment Anything - Model explanation with code

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Variational Autoencoder - Model, ELBO, loss function and maths explained easily!

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

Loading...