Signin

TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters (Paper Explained)

Yannic Kilcher • December 2, 2024

Video Thumbnail

You May Also Like

Video Thumbnail

ORPO: Monolithic Preference Optimization without Reference Model (Paper Explained)

Yannic Kilcher

Video Thumbnail

Mixtral of Experts (Paper Explained)

Yannic Kilcher

Video Thumbnail

Two decades of Git: A conversation with creator Linus Torvalds

GitHub

Video Thumbnail

The unexpected logic behind rolling multiple dice and picking the highest.

Stand-up Maths

Video Thumbnail

[GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Yannic Kilcher

Video Thumbnail

On the Biology of a Large Language Model (Part 1)

Yannic Kilcher

Video Thumbnail

AI can't cross this line and we don't know why.

Welch Labs

Video Thumbnail

Were RNNs All We Needed? (Paper Explained)

Yannic Kilcher

Video Thumbnail

Why is space three-dimensional? with Stephen Wolfram

The Last Theory

Video Thumbnail

What P vs NP is actually about

Polylog

Video Thumbnail

Geheimnis Konklave - Geschichte der Papstwahl | Terra X

Terra X History

Video Thumbnail

How might LLMs store facts | DL7

3Blue1Brown

Video Thumbnail

Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters (Paper)

Yannic Kilcher

Video Thumbnail

Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (Paper Explained)

Yannic Kilcher

Video Thumbnail

3D Gaussian Splatting! - Computerphile

Computerphile

Video Thumbnail

How DeepSeek Rewrote the Transformer [MLA]

Welch Labs

Video Thumbnail

Mamba: Linear-Time Sequence Modeling with Selective State Spaces (Paper Explained)

Yannic Kilcher

Video Thumbnail

Understand Tensors Like a Physicist! (The Easy Way)

Physics - problems and solutions

Video Thumbnail

Build Bigger With Small Ai: Running Small Models Locally

MotherDuck

Video Thumbnail

Visualizing transformers and attention | Talk for TNG Big Tech Day '24

Grant Sanderson

Yannic Kilcher

About

No channel description available.

Latest Posts

Video Thumbnail

All about AI Accelerators: GPU, TPU, Dataflow, Near-Memory, Optical, Neuromorphic & more (w/ Author)

Yannic Kilcher

Video Thumbnail

xLSTM: Extended Long Short-Term Memory

Yannic Kilcher

Video Thumbnail

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Yannic Kilcher

Video Thumbnail

[GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Yannic Kilcher