Sign In

Titans: Learning to Memorize at Test Time

Umar Jamil • January 26, 2025

About

No channel description available.

Latest Posts

Paper: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
PT4M

Paper: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Umar Jamil1 year ago

58775

Flash Attention derived and coded from first principles with Triton (Python)
PT4M

Flash Attention derived and coded from first principles with Triton (Python)

Umar Jamil1 year ago

70025

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation
PT4M

Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation

Umar Jamil1 year ago

113998

ML Interpretability: feature visualization, adversarial example, interp. for language models
PT4M

ML Interpretability: feature visualization, adversarial example, interp. for language models

Umar Jamil1 year ago

11544

Video Description

Titans: Learning to Memorize at Test Time Paper link: https://arxiv.org/abs/2501.00663

You May Also Like

ML Interpretability: feature visualization, adversarial example, interp. for language models
PT4M

ML Interpretability: feature visualization, adversarial example, interp. for language models

Umar Jamil1 year ago

11544

Kolmogorov-Arnold Networks: MLP vs KAN, Math, B-Splines, Universal Approximation Theorem
PT4M

Kolmogorov-Arnold Networks: MLP vs KAN, Math, B-Splines, Universal Approximation Theorem

Umar Jamil1 year ago

38331

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math
PT4M

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Umar Jamil1 year ago

33294

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.
PT4M

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Umar Jamil2 years ago

64770

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math
PT4M

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math

Umar Jamil2 years ago

58436

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer
PT4M

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Umar Jamil2 years ago

39241

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code
PT4M

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Umar Jamil2 years ago

36297

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training
PT4M

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training

Umar Jamil2 years ago

49039

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)
PT4M

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)

Umar Jamil2 years ago

83409

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token
PT4M

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token

Umar Jamil2 years ago

76110

Coding Stable Diffusion from scratch in PyTorch
PT4M

Coding Stable Diffusion from scratch in PyTorch

Umar Jamil2 years ago

209397

Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm
PT4M

Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm

Umar Jamil2 years ago

61776

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU
PT4M

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar Jamil2 years ago

113209

Segment Anything - Model explanation with code
PT4M

Segment Anything - Model explanation with code

Umar Jamil2 years ago

36726

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch
PT4M

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Umar Jamil2 years ago

48416

LongNet: Scaling Transformers to 1,000,000,000 tokens: Python Code + Explanation
PT4M

LongNet: Scaling Transformers to 1,000,000,000 tokens: Python Code + Explanation

Umar Jamil2 years ago

6949

Master Memory: Study Tools Now

AI-recommended products based on this video

Loading...
BIC Brite Liner Grip Pastel Highlighter Set, Non-Toxic with Chisel Tip for Fine and Broad Lines, 6-Count Pack in Pastel Assorted Colours

BIC Brite Liner Grip Pastel Highlighter Set, Non-Toxic with Chisel Tip for Fine and Broad Lines, 6-Count Pack in Pastel Assorted Colours

(22,854)
$4.69
FREE delivery Mon, Sep 15 on your first order
7K+ bought in past month
Loading...
Monster N-Lite 211 Wireless Earbuds， Bluetooth 6.0 Stereo Headphones with Noise-Cancelling Mic and LED Display, Built-in Mic for Clear Calls, Waterproof Design for Sports

Monster N-Lite 211 Wireless Earbuds， Bluetooth 6.0 Stereo Headphones with Noise-Cancelling Mic and LED Display, Built-in Mic for Clear Calls, Waterproof Design for Sports

(8)
$39.99
FREE delivery Tue, Nov 4
Loading...
Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Powerful Bass, Built-in Noise-Cancelling Mic for Clear Calls, LED Display, 36H Playtime, IPX5 Waterproof Design for Sports

Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Powerful Bass, Built-in Noise-Cancelling Mic for Clear Calls, LED Display, 36H Playtime, IPX5 Waterproof Design for Sports

(40)
$39.99
FREE delivery Thu, Nov 13
Loading...
YAOHUOO Computer Desk with 4 Fabric Drawers Organizer - 55"/140 Office Desks with File Drawer Organization, PC Work Desk Study Writing Table Workstation for Home Office Space Rustic Brown

YAOHUOO Computer Desk with 4 Fabric Drawers Organizer - 55"/140 Office Desks with File Drawer Organization, PC Work Desk Study Writing Table Workstation for Home Office Space Rustic Brown

(169)
$169.99
FREE delivery Thu, Jun 26
Loading...
IBF Black Desk, Modern Computer Desk for Home Office, Industrial Simple Pc Gaming Writing Study Desk in Bedroom, Wood Metal Laptop Workstation Executive Work Computer Table, Black Oak, 55 Inch

IBF Black Desk, Modern Computer Desk for Home Office, Industrial Simple Pc Gaming Writing Study Desk in Bedroom, Wood Metal Laptop Workstation Executive Work Computer Table, Black Oak, 55 Inch

(131)
$199.96
FREE delivery Jul 2 - 10
Loading...
CubiCubi 40inch Small L Shaped Computer Desk with Storage Shelves Home Office Corner Desk Study Writing Table, Light Brown

CubiCubi 40inch Small L Shaped Computer Desk with Storage Shelves Home Office Corner Desk Study Writing Table, Light Brown

(3,331)
$89.99
FREE delivery Thu, Jun 26
Loading...
ODK 32 inch Small Computer Desk Study Table for Small Spaces Home Office Student Laptop PC Writing Desks with Storage Bag Headphone Hook, White + White Leg

ODK 32 inch Small Computer Desk Study Table for Small Spaces Home Office Student Laptop PC Writing Desks with Storage Bag Headphone Hook, White + White Leg

(15,442)
$59.99
FREE delivery Thu, Jun 26
100+ bought in past month
Loading...
Posture Corrector for Women and Men,Adjustable Upper Back Brace, Breathable Back Support straightener, Providing Pain Relief from Lumbar, Neck, Shoulder, and Clavicle, Back.

Posture Corrector for Women and Men,Adjustable Upper Back Brace, Breathable Back Support straightener, Providing Pain Relief from Lumbar, Neck, Shoulder, and Clavicle, Back.

(141)
$24.99
FREE delivery Thu, Mar 12 on your first order
500+ bought in past month
Loading...
Posture Corrector for Women and Men,Adjustable Upper Back Brace, Breathable Back Support straightener, Providing Pain Relief from Lumbar, Neck, Shoulder, and Clavicle, Back.

Posture Corrector for Women and Men,Adjustable Upper Back Brace, Breathable Back Support straightener, Providing Pain Relief from Lumbar, Neck, Shoulder, and Clavicle, Back.

(149)
$23.74
FREE delivery Mon, Feb 23 on your first order
600+ bought in past month
Loading...
Expo Dry Erase Markers, Whiteboard Markers with Low Odour Ink, Chisel Tip, Assorted Colours, 4 Count

Expo Dry Erase Markers, Whiteboard Markers with Low Odour Ink, Chisel Tip, Assorted Colours, 4 Count

(42,242)
$5.48
FREE delivery Sat, Jun 14 on your first order
1K+ bought in past month
Loading...
Dry Erase Markers Low Odor Fine Whiteboard Markers Thin Box of 12，10 Colors
Best Seller

Dry Erase Markers Low Odor Fine Whiteboard Markers Thin Box of 12，10 Colors

(46,489)
$9.98
FREE delivery Sat, Jun 14 on your first order
1K+ bought in past month
AiChat Products Saved Account