Signin

Mixture of Experts Explained: From Vowel Recognition to Trillion-Parameter LLMs (Llama 4, DeepSeek)

Julia Turc • April 23, 2025

Video Thumbnail

You May Also Like

Video Thumbnail

The Biggest Misconception in Physics

Veritasium

Video Thumbnail

Everything We Know About 'Oumuamua

Astrum

Video Thumbnail

The Real Reason Windows is Free - And what that costs you!

Dave's Garage

Video Thumbnail

RISC-V 2025 Update

ExplainingComputers

Video Thumbnail

Veritasium: What Everyone Gets Wrong About AI and Learning – Derek Muller Explains

Perimeter Institute for Theoretical Physics

Video Thumbnail

Why every 80s home computer used BASIC (almost)

Little Car

Video Thumbnail

The Art Of Poison-Pilling Music Files

Benn Jordan

Video Thumbnail

Why Didn’t Antimatter Destroy The Universe? | LHC Breakthrough

PBS Space Time

Video Thumbnail

Yann LeCun "Mathematical Obstacles on the Way to Human-Level AI"

Joint Mathematics Meetings

Video Thumbnail

The Man Who Almost Broke Math (And Himself...)

Veritasium

Video Thumbnail

What I Saw in Antarctica

StarTalk

Video Thumbnail

Llama 4 Explained: Architecture, Long Context, and Native Multimodality

Julia Turc

Video Thumbnail

What China Is Doing on Tiangong Is Game-Changing

Astrum

Video Thumbnail

What Happens When a Program Calls Sleeps?

Core Dumped

Video Thumbnail

A Visual Guide to Mixture of Experts (MoE) in LLMs

Maarten Grootendorst

Video Thumbnail

Build Bigger With Small Ai: Running Small Models Locally

MotherDuck

Video Thumbnail

Why do New Rockets Love Methane?

Eager Space

Video Thumbnail

Ai Will Try to Cheat & Escape (aka Rob Miles was Right!) - Computerphile

Computerphile

Video Thumbnail

This Might Be The End of 4chan..

Low Level

Video Thumbnail

Richard Wolff: Trump, Hitler, and the End of the American Empire

Robinson Erhardt

Julia Turc

About

No channel description available.

Latest Posts

Video Thumbnail

Knowledge Distillation: How LLMs train each other

Julia Turc

Video Thumbnail

DeepSeek's GRPO (Group Relative Policy Optimization) | Reinforcement Learning for LLMs

Julia Turc

Video Thumbnail

Mixture of Experts Explained: From Vowel Recognition to Trillion-Parameter LLMs (Llama 4, DeepSeek)

Julia Turc

Video Thumbnail

Proximal Policy Optimization (PPO) for LLMs Explained Intuitively

Julia Turc