Tülu 3 from AI2: Full open-source fine-tuning recipe for LLMs

Julia Turc • February 23, 2025

Julia Turc

About

AI explainer videos from a former Google Research engineer, now startup founder. Expect American optimism with a solid dose of Eastern European cynicism. Find (free) supplemental materials (slide decks, paper reading lists, Colab notebooks) on Patreon 👉 https://www.patreon.com/c/JuliaTurc

Tülu 3 from AI2: Full open-source fine-tuning recipe for LLMs

Julia Turc

About

Latest Posts

Transformers & Diffusion LLMs: What's the connection?

Text diffusion: A new paradigm for LLMs

The physics behind diffusion models

How LLMs survive in low precision | Quantization Fundamentals

You May Also Like

Essential LLM Fine-Tuning Gear

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 &amp; PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super &amp; AMD GPU Compatible

HP Victus 15.6&quot; 144Hz FHD Gaming Laptop, Intel i5-12450H, 32GB RAM, 1TB PCIe SSD, NVIDIA GeForce RTX 3050, Backlit Keyboard, HD Webcam, Win 11, Blue, 256GB Docking Station Set

Acer Swift X 14&quot; FHD Laptop, AMD Ryzen 7 5825U, NVIDIA GeForce RTX 3050Ti, 16GB RAM, 512GB SSD, Windows 11 Home

GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&amp;2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display

GMKtec K11 Mini PC, AMD Ryzen 9 8945HS(8C/16T, Up to 5.2GHz) W11 Pro, 32GB DDR5 RAM 1TB Mini Desktop Computer, HDMI/DisplayPort/USB4*2

MINISFORUM AMD Ryzen 9 9955HX MS-A2 Mini PC (16C/32T, up to 5.4GHz), 64GB DDR5 1TB SSD, PCIe×16, HDMI/2x USB-C (8K@60Hz), 2X SFP+ 10G, 2X 2.5G LAN, 3X SSD M.2 (2280/22110/U.2)

AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD &amp; 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

LG UltraWide 34WP65C-B 34 Inch 21:9 Curved FreeSync 1ms 160 Hz WQHD(3440 x 1440) Gaming Monitor, Black

Lg gram 16-inch +View Portable Monitor with USB Type-C, DCI-P3 99% (Typ.), Auto Rotate, Two-Way Supported Folio Cover

StanbyME LG 27-Inch Class Smart Portable Touch Screen Monitor 27ART10AKPL. Built-in 3 Hour Battery, Full Swivel Rotation, Rollable. LG Stanbyme, Standbyme, Stand by me.

LG 24U411A-B 23.8&quot; FHD (1920x1080) IPS Display Computer Monitor, 120Hz Refresh Rate, sRGB 99% (Typ.), USB-C, Reader Mode &amp; Flicker Safe, Dynamic Action Sync, Black Stabilizer, Slim Stand Base, Black

Dell Inspiron 3535 Laptop - 15.6 inch FHD (1920 x 1080) 120Hz Display, AMD Ryzen 5-7520U Processor, 8GB LPDDR5 RAM, 512GB SSD, AMD Radeon Graphics, Windows 11 Home, Migrate Service - Carbon Black EPEAT

MINISFORUM UM890 Pro Mini PC Ryzen 9 8945HS (up to 5.2GHz) Desktop Computer 64GB RAM DDR5 5600MHz &amp;1TB PCIe 4.0 SSD, Cculink Mini PC Quad Display HDMI/DP1.4/USB-C, AMD Radeon 780M/Dual LAN 2.5G

HP 17.3&quot; FHD Laptop, AMD Ryzen 5 5500U, 16GB RAM, 1TB SSD, AMD Radeon Graphics, Numeric Keyboard, 720p HD Webcam, WiFi, Windows 11 Pro, Silver, 32GB Hotface USB Card

AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC

Google Pixel Buds Pro 2 - Noise Canceling Earbuds - Up to 31 Hour Battery Life with Charging Case - Bluetooth Headphones - Compatible with Android - Hazel

Deeyaple USB C to Aux, 4FT/1.2M, Type C to 3.5mm Audio Cable Headphone Jack Cable for Car Mobile Phone, iPhone 16 15, iPad Pro, Samsung Galaxy S24 S23 S2010, Google Pixel,Oneplus Grey (1)

Car Carplay Woven Cable for iPhone 16 15 3.3FT USB A to USB C 3.2 Gen 2 Carplay Adapter Wire for iPhone 16 15 Pro Max, iPad Pro/Air, Samsung Galaxy S25/S24/S23/S22/S21 Google Pixel, Car Charger Cable

Loading...

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

HP Victus 15.6" 144Hz FHD Gaming Laptop, Intel i5-12450H, 32GB RAM, 1TB PCIe SSD, NVIDIA GeForce RTX 3050, Backlit Keyboard, HD Webcam, Win 11, Blue, 256GB Docking Station Set

Acer Swift X 14" FHD Laptop, AMD Ryzen 7 5825U, NVIDIA GeForce RTX 3050Ti, 16GB RAM, 512GB SSD, Windows 11 Home

GEEKOM A8 AI Mini PC (3-Year Quality Support) with AMD Ryzen 9 8945HS Mini Computers, 32GB DDR5 RAM&2TB M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro Mini Desktop, WiFi 6E/BT5.2/USB4/8K/Quad Display

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

LG 24U411A-B 23.8" FHD (1920x1080) IPS Display Computer Monitor, 120Hz Refresh Rate, sRGB 99% (Typ.), USB-C, Reader Mode & Flicker Safe, Dynamic Action Sync, Black Stabilizer, Slim Stand Base, Black

MINISFORUM UM890 Pro Mini PC Ryzen 9 8945HS (up to 5.2GHz) Desktop Computer 64GB RAM DDR5 5600MHz &1TB PCIe 4.0 SSD, Cculink Mini PC Quad Display HDMI/DP1.4/USB-C, AMD Radeon 780M/Dual LAN 2.5G

HP 17.3" FHD Laptop, AMD Ryzen 5 5500U, 16GB RAM, 1TB SSD, AMD Radeon Graphics, Numeric Keyboard, 720p HD Webcam, WiFi, Windows 11 Pro, Silver, 32GB Hotface USB Card