Text diffusion: A new paradigm for LLMs

Julia Turc • October 22, 2025

Julia Turc

About

AI explainer videos from a former Google Research engineer, now startup founder. Expect American optimism with a solid dose of Eastern European cynicism. Find (free) supplemental materials (slide decks, paper reading lists, Colab notebooks) on Patreon 👉 https://www.patreon.com/c/JuliaTurc

Text diffusion: A new paradigm for LLMs

Julia Turc

About

Latest Posts

Transformers & Diffusion LLMs: What's the connection?

The physics behind diffusion models

How LLMs survive in low precision | Quantization Fundamentals

Knowledge Distillation: How LLMs train each other

You May Also Like

Essentials for Mastering LLMs

ENOMIR Wireless Carplay Adapter for iPhone, Android Auto Wireless Adapter Fast Stable Auto-Connect, Mini USB Design Plug &amp; Play Most Car Models &amp; iOS Systems

Wireless CarPlay Adapter– Android Auto Wireless Adapter, 5.8GHz Wi-Fi Plug &amp; Play,Mini and Stable iOS 10+/Android 10+, Fast Auto-Connect for Cars 2016+.

Philips Hue Bridge - Unlock the Full Potential of Hue - Multi-Room and Out-of-Home Control - Create Automations and Zones - Secure, Stable Connection Won&#x27;t Strain Your Wi-Fi - Works with Voice, Matter

Portable Waist Fan with 5 Speeds, 16000RPM Strong Airflow, 10000mAh Rechargeable Hands-Free Neck Fan with Flashlight &amp; SOS Mode, Wearable Clip Belt Fans for Camping Travel Jobsite Farms Fishing

Ranch Guitar Tuner Clip On Professional for Acoustic/Electric Guitar, Ukulele, Violin, Bass, Banjo and Chromatic Tuning Modes - Classical Black

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 &amp; PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super &amp; AMD GPU Compatible

tomtoc 360° Protective Laptop Sleeve for 15-inch MacBook Air M4/A3241 2025, M3/A3114 2024, M2/A2941 2023, 15-inch MacBook Pro A1990 A1707, Dell XPS 15 Plus Laptop, Water-Resistant Computer Case Bag Global Recycled Standard

Replacement for Dell 130W Laptop Charger USB C - XPS 17 15 7590 9700 9500 9510 Precision 5560 3560 5540 5570 5550 3561 3550 5510 5520 Latitude 7410 7310 7210 Type C Computer AC Adapter Power Cord

MOSISO 360 Protective Laptop Bag 15 inch, 15 inch Computer Shoulder Bag Compatible with MacBook Air 15 M4 M3 M2 2025-2023, Dell XPS 15, Side Open Messenger Case &amp;4 Zipper Pockets&amp;Handle, Black Global Recycled Standard

45W 65W AC Adapter Laptop Charger for Dell Inspiron 15 14 13 17 3000 5000 7000 Series 5558 5559 Charger Latitude E6440 E6430 3520 3420 XPS 13 14 9333 9350 Notebook Dell Computer Power Supply Cord

Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code

Google Pixel Buds Pro 2 - Noise Canceling Earbuds - Up to 31 Hour Battery Life with Charging Case - Bluetooth Headphones - Compatible with Android - Hazel

Deeyaple USB C to Aux, 4FT/1.2M, Type C to 3.5mm Audio Cable Headphone Jack Cable for Car Mobile Phone, iPhone 16 15, iPad Pro, Samsung Galaxy S24 S23 S2010, Google Pixel,Oneplus Grey (1)

Car Carplay Woven Cable for iPhone 16 15 3.3FT USB A to USB C 3.2 Gen 2 Carplay Adapter Wire for iPhone 16 15 Pro Max, iPad Pro/Air, Samsung Galaxy S25/S24/S23/S22/S21 Google Pixel, Car Charger Cable

6-Tube Pedal Resistance Band, Premium Elastic Tension Rope for Full Body Workout, Natural Latex Fitness Bands for Strength Training,Yoga Stretching Slimming Training, Home Gym Exercise Equipment

Jamieson Vitamin B50 Complex, Blend of 8 Essential B Vitamins, with Folate for Cellular Health, Supports Energy Production and Metabolism. Vegetarian, Non-GMO, Gluten-Free, Bonus Size, 120 Caplets, Proudly Canadian

Pumpkin Seed Oil with Saw Palmetto Capsules | Cold Pressed, Pure Virgin Oil, Essential Fatty Acids &amp; Phytosterols 180 Softgels, Good for hair health | Non-GMO

BRITA Hub Replacement Water Filter, BPA-Free, Replaces 900 Plastic Water Bottles, Lasts Six Months or 120 Gallons, Includes 1 Filter, Kitchen Essential, White

Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Powerful Bass, Built-in Noise-Cancelling Mic for Clear Calls, LED Display, 36H Playtime, IPX5 Waterproof Design for Sports

Monster N-Lite 211 Wireless Earbuds， Bluetooth 6.0 Stereo Headphones with Noise-Cancelling Mic and LED Display, Built-in Mic for Clear Calls, Waterproof Design for Sports

Corsair MP600 PRO LPX 4TB M.2 NVMe PCIe x4 Gen4 SSD - Optimized for PS5 (Up to 7,100MB/sec Sequential Read &amp; 6,800MB/sec Sequential Write Speeds, High-Speed Interface, Compact Form Factor) Black

Loading...

ENOMIR Wireless Carplay Adapter for iPhone, Android Auto Wireless Adapter Fast Stable Auto-Connect, Mini USB Design Plug & Play Most Car Models & iOS Systems

Wireless CarPlay Adapter– Android Auto Wireless Adapter, 5.8GHz Wi-Fi Plug & Play,Mini and Stable iOS 10+/Android 10+, Fast Auto-Connect for Cars 2016+.

Philips Hue Bridge - Unlock the Full Potential of Hue - Multi-Room and Out-of-Home Control - Create Automations and Zones - Secure, Stable Connection Won't Strain Your Wi-Fi - Works with Voice, Matter

Portable Waist Fan with 5 Speeds, 16000RPM Strong Airflow, 10000mAh Rechargeable Hands-Free Neck Fan with Flashlight & SOS Mode, Wearable Clip Belt Fans for Camping Travel Jobsite Farms Fishing

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

MOSISO 360 Protective Laptop Bag 15 inch, 15 inch Computer Shoulder Bag Compatible with MacBook Air 15 M4 M3 M2 2025-2023, Dell XPS 15, Side Open Messenger Case &4 Zipper Pockets&Handle, Black Global Recycled Standard

Pumpkin Seed Oil with Saw Palmetto Capsules | Cold Pressed, Pure Virgin Oil, Essential Fatty Acids & Phytosterols 180 Softgels, Good for hair health | Non-GMO

Corsair MP600 PRO LPX 4TB M.2 NVMe PCIe x4 Gen4 SSD - Optimized for PS5 (Up to 7,100MB/sec Sequential Read & 6,800MB/sec Sequential Write Speeds, High-Speed Interface, Compact Form Factor) Black