Signin

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Yannic Kilcher • May 2, 2024

Video Thumbnail

You May Also Like

Video Thumbnail

Attention in transformers, step-by-step | DL6

3Blue1Brown

Video Thumbnail

Were RNNs All We Needed? (Paper Explained)

Yannic Kilcher

Video Thumbnail

ComfyUI Tutorial Series Ep 44: HiDream AI – How to Set Up & Choose the Best Model

pixaroma

Video Thumbnail

RAG vs. CAG: Solving Knowledge Gaps in AI Models

IBM Technology

Video Thumbnail

Veritasium: What Everyone Gets Wrong About AI and Learning – Derek Muller Explains

Perimeter Institute for Theoretical Physics

Video Thumbnail

Feed Your OWN Documents to a Local Large Language Model!

Dave's Garage

Video Thumbnail

On the Biology of a Large Language Model (Part 1)

Yannic Kilcher

Video Thumbnail

How might LLMs store facts | DL7

3Blue1Brown

Video Thumbnail

The Biggest Misconception in Physics

Veritasium

Video Thumbnail

How DeepSeek Rewrote the Transformer [MLA]

Welch Labs

Video Thumbnail

Byte Latent Transformer: Patches Scale Better Than Tokens (Paper Explained)

Yannic Kilcher

Video Thumbnail

RAG vs Fine-Tuning vs Prompt Engineering: Optimizing AI Models

IBM Technology

Video Thumbnail

Model Context Protocol (MCP), clearly explained (why it matters)

Greg Isenberg

Video Thumbnail

How FlashAttention Accelerates Generative AI Revolution

Jia-Bin Huang

Video Thumbnail

Transformers (how LLMs work) explained visually | DL5

3Blue1Brown

Video Thumbnail

The moment we stopped understanding AI [AlexNet]

Welch Labs

Video Thumbnail

Mixtral of Experts (Paper Explained)

Yannic Kilcher

Video Thumbnail

Rotary Positional Embeddings: Combining Absolute and Relative

Efficient NLP

Video Thumbnail

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Grant Sanderson

Video Thumbnail

Everything We Know About 'Oumuamua

Astrum

Yannic Kilcher

About

No channel description available.

Latest Posts

Video Thumbnail

All about AI Accelerators: GPU, TPU, Dataflow, Near-Memory, Optical, Neuromorphic & more (w/ Author)

Yannic Kilcher

Video Thumbnail

xLSTM: Extended Long Short-Term Memory

Yannic Kilcher

Video Thumbnail

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Yannic Kilcher

Video Thumbnail

[GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Yannic Kilcher