Les 4 étapes pour entrainer un LLM
ScienceEtonnante
@scienceetonnanteAbout
Des vidéos pour raconter la science étonnante, amusante, passionnante et stupéfiante ! Chaîne secondaire : https://www.youtube.com/channel/UC5q6wJ9ffFFz-laOT6bTPYA Discord : https://discord.gg/GPamYjVYxA Retrouvez moi aussi sur mon blog "Science étonnante" http://scienceetonnante.com Soutenez-moi sur Tipeee : https://www.tipeee.com/science-etonnante Tiktok : https://www.tiktok.com/@scienceetonnante (compte inactif, méfiez-vous des copies)
Latest Posts
Video Description
Qu'est-ce qu'a bien pu faire la start-up chinoise DeepSeek pour secouer le monde de la tech ? Pour le comprendre, on se demande comment passer d'un simple compléteur de texte, à un assistant IA capable de raisonner ! Détails et compléments dans le billet de blog qui accompagne la vidéo : https://scienceetonnante.com/blog/2025/04/25/les-4-etapes-pour-entrainer-un-llm/ 00:00 Introduction 01:37 Le prétraining auto-supervisé 13:30 Le fine-tuning supervisé 19:07 Le fine-tuning par les préférences 26:40 Le fine-tuning par le raisonnement 32:30 Les innovations de DeepSeek 37:35 L'avenir de l'IA Le serveur Discord de Science étonnante ➡️ https://discord.gg/GPamYjVYxA Écrit et réalisé par David Louapre © Science étonnante Abonnez-vous : https://www.youtube.com/scienceetonnante Me soutenir sur Tipeee : http://www.tipeee.com/science-etonnante ou Patreon : https://www.patreon.com/scienceetonnante Mes livres : https://scienceetonnante.com/livres/ Facebook : http://www.facebook.com/sciencetonnante Twitter : http://www.twitter.com/dlouapre
![La formule qui a radicalement transformé la finance mondiale [Black-Scholes]](https://imgz.pc97.com/?width=500&fit=cover&image=https://i.ytimg.com/vi/XE7FKLfZzBA/hqdefault.jpg)
Master LLM Training Today
AI-recommended products based on this video
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible
PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU
Skytech Archangel Gaming PC Desktop – AMD Ryzen 5 3600 3.6 GHz, NVIDIA RTX 3060, 1TB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit
Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set
ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set
Lenovo Legion Pro 5 16" WQXGA 165Hz Gaming Laptop, AMD Ryzen 9 9955HX, GeForce RTX 5070, 32GB DDR5, 3TB Storage (2TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, WiFi 7, Win 11, Black
Beelink EQR5 Mini PC, AMD Ryzen 5 5650U(7nm, 6C/12T) up to 4.2GHz, Mini Computer 32GB DDR4 RAM 1TB PCIe3.0x4 SSD, Micro PC 4K@60Hz Dual HDMI Display/WiFi6/BT5.2/Office/Home/HTPC/W-11 Pro
BOSGAME Mini PC Intel Core i5 12600H(12C/16T, up 4.5GHz), 32GB DDR4 RAM 512GB PCIe SSD, Mini Desktop Computers Dual LAN/4x USB3.2/WiFi6E/BT5.2/HDMI+DP+USB-C/4K Triple Display
Beelink Mini PC, AMD Ryzen 7 5825U(6nm, 8C/16T) up to 4.5GHz, Mini Computer 32GB DDR4 RAM 500GB PCIe3.0x4 SSD, Micro PC 4K@60Hz Dual HDMI Display/WiFi6/BT5.2/Office/Home/HTPC/W-11 Pro
M9 Plus Mini PC with 2.1" Display, Intel Core i9-12900HK (14C/20T 5.0GHz), 32GB DDR4 RAM + 1TB NVMe SSD, Mini Desktop Computer, Compact Desktop Triple 4K Display, WiFi6, BT5.2, USB-C
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620
Skytech Archangel Gaming PC Desktop – AMD Ryzen 5 3600 3.6 GHz, NVIDIA RTX 3060, 1TB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit
MSI Thin 15 15.6" 144Hz Gaming Laptop, Intel® Core™ 5-210H, RTX 4050, 16GB DDR5, 1TB NVMe SSD, Windows 11 Home
Fanless Mini PC 13th Gen Core i7 1355U(10C/12T), Win11 Pro Mini Desktop PC Dual 2.5G LAN Mini PC Fanless, Iris Xe Graphics, Dual HD+ DP Triple Display, USB-C, WiFi6, BT5.2, 64GB RAM 1TB NVME SSD
Skytech Chronos 3 Gaming PC Desktop, Ryzen 7 9700X 3.8 GHz (5.5GHz Turbo), NVIDIA RTX 5060 8GB, 1TB NVMe SSD, 32GB DDR5 RAM 5200 RGB, 850W Gold ATX 3 PSU, 360mm ARGB AIO, Wi-Fi, Win 11
Crucial X9 4TB Portable SSD, Up to 1050MB/s, USB 3.2 USB-C, External Solid State Drive, Compatible with Windows, Mac, & Android, Reliable Storage for Games, Files, & Backups, Black - CT4000X9SSD902
Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - CT4000X10PROSSD902
Crucial X9 Pro 4TB Portable SSD, Up to 1050MB/s Read & Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC and Mac, for Professional Creators, Silver - CT4000X9PROSSD902
