How LLM Pre-Training Works

HashLips Academy September 28, 2025
Video Thumbnail
HashLips Academy Logo

HashLips Academy

View Channel

About

Welcome to the HashLips channel. On this channel, I share awesome things you can do with code, while also exploring my journey as an artist. You’ll find tutorials where I try to be as descriptive and clear as possible, along with creative art videos that blend technology and creativity. Disclaimer HashLips / Daniel shares educational and artistic content, and open-source code, for informational purposes only. We make no guarantees of accuracy or completeness. Nothing here is financial, legal, or professional advice. Use at your own risk — we accept no liability for any loss or damage of any kind.

Video Description

Ever wondered how large language models like GPT are actually trained? In this video, I break down the full pre-training process ...

You May Also Like

Master LLM Pre-Training Today

AI-recommended products based on this video

Loading...
MSI Thin 15 Gaming Laptop, 15.6" 144 Hz IPS Display, AMD Ryzen 9 8945HS, NVIDIA RTX 4060 8GB GDDR6, 32 GB DDR5, 2 TB SSD, with Windows 11 Pro, Office Pro Lifetime License, Mouse, USB C Flash Drive

MSI Thin 15 Gaming Laptop, 15.6" 144 Hz IPS Display, AMD Ryzen 9 8945HS, NVIDIA RTX 4060 8GB GDDR6, 32 GB DDR5, 2 TB SSD, with Windows 11 Pro, Office Pro Lifetime License, Mouse, USB C Flash Drive

(2,122)
1,559.99
FREE delivery Wednesday, June 11.
Loading...
Skytech Rampage Gaming PC, Intel i7 14700K 3.4 GHz (5.5GHz Turbo Boost), NVIDIA RTX 4070 Super 12GB GDDR6X, 2TB SSD, 32GB DDR5 RAM 5600 RGB, 750W Gold PSU, 360mm AIO, Wi-Fi, Win 11 Home

Skytech Rampage Gaming PC, Intel i7 14700K 3.4 GHz (5.5GHz Turbo Boost), NVIDIA RTX 4070 Super 12GB GDDR6X, 2TB SSD, 32GB DDR5 RAM 5600 RGB, 750W Gold PSU, 360mm AIO, Wi-Fi, Win 11 Home

(14)
Loading...
acer Nitro V 15 Gaming Laptop, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64 GB DDR5 RAM, 4 TB SSD, Backlit Keyboard, Microsoft Office Lifetime License, Windows 11 Pro

acer Nitro V 15 Gaming Laptop, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64 GB DDR5 RAM, 4 TB SSD, Backlit Keyboard, Microsoft Office Lifetime License, Windows 11 Pro

(827)
$1,659.99
FREE delivery Jun 17 - 20
Loading...
acer Nitro V 15 Gaming Laptop, Microsoft Office Lifetime License & Windows 11 Pro, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64GB DDR5 RAM, 4TB SSD, Backlit Keyboard

acer Nitro V 15 Gaming Laptop, Microsoft Office Lifetime License & Windows 11 Pro, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64GB DDR5 RAM, 4TB SSD, Backlit Keyboard

(348)
$1,579.99
FREE delivery Jun 17 - 20
Loading...
0.5 Sec Instant Read Meat Thermometer Digital with ±0.5℉ Precision, Food Thermometer for Cooking Kitchen Gadgets, Oven Grill Candy BBQ Essentials Accessories, Gifts for Him Dad Men Birthday, Red

0.5 Sec Instant Read Meat Thermometer Digital with ±0.5℉ Precision, Food Thermometer for Cooking Kitchen Gadgets, Oven Grill Candy BBQ Essentials Accessories, Gifts for Him Dad Men Birthday, Red

(2,964)
$9.99
FREE delivery Wed, Dec 31 on $35 of items shipped by Amazon
90K+ bought in past month
Loading...
Lexar ES3 1TB External SSD, USB 3.2 Gen2 Portable SSD, PSSD Up to 1050MB/s Read, 1000MB/s Write, External Solid State Drive Compatible with iPhone 16/15 Series/Mac/PS5/XBOX/Laptop/PC

Lexar ES3 1TB External SSD, USB 3.2 Gen2 Portable SSD, PSSD Up to 1050MB/s Read, 1000MB/s Write, External Solid State Drive Compatible with iPhone 16/15 Series/Mac/PS5/XBOX/Laptop/PC

(37)
69.99
PrimeFREE delivery Saturday, June 14
300+ bought in past month
Loading...
SABRENT 1TB External Aluminum SSD, Rocket Nano V2, USB 3.2 Gen 2x2 [SB-1TB-NAV2]

SABRENT 1TB External Aluminum SSD, Rocket Nano V2, USB 3.2 Gen 2x2 [SB-1TB-NAV2]

(547)
107.99
PrimeFREE delivery Saturday, June 14
50+ bought in past month
Loading...
Lenovo V-Series V15 Business Laptop | 15.6" FHD 1920 * 1080 | 13th Gen Intel Core i7-13620H | 40GB RAM | 1TB SSD | Webcam | Wi-Fi 6 | Windows 11 Pro | Black | Bundle with ADATA 512GB External SSD

Lenovo V-Series V15 Business Laptop | 15.6" FHD 1920 * 1080 | 13th Gen Intel Core i7-13620H | 40GB RAM | 1TB SSD | Webcam | Wi-Fi 6 | Windows 11 Pro | Black | Bundle with ADATA 512GB External SSD

(6)
$849.00
FREE delivery Jun 18 - 23
50+ bought in past month