Signin

TransformerFAM: Feedback attention is working memory

Yannic Kilcher • May 23, 2024
Video Thumbnail

You May Also Like

Video Thumbnail

xLSTM: Extended Long Short-Term Memory

Yannic Kilcher

Video Thumbnail

GPT-4chan: This is the worst AI ever

Yannic Kilcher

Video Thumbnail

Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping (Searchformer)

Yannic Kilcher

Video Thumbnail

MIT 6.S191 (2023): Recurrent Neural Networks, Transformers, and Attention

Alexander Amini

Video Thumbnail

ORPO: Monolithic Preference Optimization without Reference Model (Paper Explained)

Yannic Kilcher

Video Thumbnail

Scalable MatMul-free Language Modeling (Paper Explained)

Yannic Kilcher

Video Thumbnail

What is Q-Learning (back to basics)

Yannic Kilcher

Video Thumbnail

∞-former: Infinite Memory Transformer (aka Infty-Former / Infinity-Former, Research Paper Explained)

Yannic Kilcher

Video Thumbnail

Golang Tutorial for Beginners | Full Go Course

TechWorld with Nana

Video Thumbnail

[ML News] Chips, Robots, and Models

Yannic Kilcher

Video Thumbnail

Mixtral of Experts (Paper Explained)

Yannic Kilcher

Video Thumbnail

Mamba: Linear-Time Sequence Modeling with Selective State Spaces (Paper Explained)

Yannic Kilcher

Video Thumbnail

This is why Deep Learning is really weird.

Machine Learning Street Talk

Video Thumbnail

Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (Paper Explained)

Yannic Kilcher

Video Thumbnail

MIT 6.S191: Recurrent Neural Networks, Transformers, and Attention

Alexander Amini

Video Thumbnail

[ML News] Jamba, CMD-R+, and other new models (yes, I know this is like a week behind 🙃)

Yannic Kilcher

Video Thumbnail

Mamba, Mamba-2 and Post-Transformer Architectures for Generative AI with Albert Gu - 693

The TWIML AI Podcast with Sam Charrington

Video Thumbnail

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Yannic Kilcher

Video Thumbnail

Hugging Face got hacked

Yannic Kilcher

Video Thumbnail

Flow Matching for Generative Modeling (Paper Explained)

Yannic Kilcher

Video Thumbnail

How AI Is Unlocking the Secrets of Nature and the Universe | Demis Hassabis | TED

TED

Video Thumbnail

[ML News] Devin exposed | NeurIPS track for high school students

Yannic Kilcher

Video Thumbnail

Four Ways of Thinking: Statistical, Interactive, Chaotic and Complex - David Sumpter

Oxford Mathematics

Video Thumbnail

Nvidia CEO Jensen Huang and the $2 trillion company powering today's AI | 60 Minutes

60 Minutes

Video Thumbnail

I Tried a Disney Secret Project!

Marques Brownlee

Yannic Kilcher

View Channel

About

No channel description available.

Latest Posts

Video Thumbnail

All about AI Accelerators: GPU, TPU, Dataflow, Near-Memory, Optical, Neuromorphic & more (w/ Author)

Yannic Kilcher

Video Thumbnail

xLSTM: Extended Long Short-Term Memory

Yannic Kilcher

Video Thumbnail

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Yannic Kilcher

Video Thumbnail

[GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Yannic Kilcher

AI Assistant

Loading...