Inside the World's Largest AI Supercluster xAI Colossus

ServeTheHome October 28, 2024
Video Thumbnail
ServeTheHome Logo

ServeTheHome

@servethehomevideo

About

The official ServeTheHome.com YouTube channel. From time to time we will have videos that are part of our reviews posted here.

Video Description

We FINALLY get to show the largest AI supercomputer in the world, xAI Colossus. This is the 100,000 (at the time we filmed this) GPU cluster in Memphis Tennessee that has been on the news a lot. This video has been five months in the making, and finally Elon Musk gave us the green light to not just film, but also show everyone the Supermicro side of the cluster. This video is being sponsored by Supermicro and that is why we are only showing the Supermicro side, which is the more advanced side. Unlike our normal content creation, this video had to be reviewed by Elon and his team before going live and we were asked to blur out portions at their request. STH Main Site Article: https://www.servethehome.com/inside-100000-nvidia-gpu-xai-colossus-cluster-supermicro-helped-build-for-elon-musk/ Join Our Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Related Supermicro Sponsored Content Mentioned in this Video ---------------------------------------------------------------------- https://www.supermicro.com/ai https://www.supermicro.com/ai-supercluster ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 01:44 Inside a xAI Colossus Data Hall 02:22 Supermicro Liquid Cooled GPU Racks 08:30 Supermicro Compute and Storage Racks 08:54 Networking is Awesome 11:51 Supermicro Storage Servers 12:26 Data Center Liquid Cooling 13:33 Tesla Megapacks for Power 14:08 Future Expansion and Thank Yous

Build Your AI Supercluster Today

AI-recommended products based on this video

Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R660XS R760XS

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge XE9680

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge R6625 R760 R7615 R7625

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

OWC 64GB DDR5 4800 PC5-38400 CL40 2Rx4 288-pin 1.1V ECC Registered RDIMM Memory RAM Module Upgrade Compatible with Dell PowerEdge HS5610 HS5620

(0)
$1,474.98
FREE delivery Aug 14 - 22
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

(2,409)
$181.38
FREE delivery Mon, Aug 11
Loading...
SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]

(41,656)
$399.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
SAMSUNG T9 4TB Portable SSD, USB 3.2 Gen. 2x2, Black, Upto 2000MB/s Read Speed - MU-PG4T0B/AM [Canada Version]

SAMSUNG T9 4TB Portable SSD, USB 3.2 Gen. 2x2, Black, Upto 2000MB/s Read Speed - MU-PG4T0B/AM [Canada Version]

(1,607)
$419.97
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
EVGA 10G-P5-3897-KR GeForce RTX 3080 FTW3 Ultra Gaming, 10GB GDDR6X, iCX3 Technology, ARGB LED, Metal Backplate

EVGA 10G-P5-3897-KR GeForce RTX 3080 FTW3 Ultra Gaming, 10GB GDDR6X, iCX3 Technology, ARGB LED, Metal Backplate

(489)
$869.99
Loading...
Alienware Aurora Gaming Desktop ACT1250 - Intel Core Ultra 9 285 Processor, Liquid Cooled, NVIDIA GeForce RTX 5080, 32GB DDR5 RAM, 1TB SSD, 1000W Platinum Rated PSU, Windows 11 Home - Clear Panel

Alienware Aurora Gaming Desktop ACT1250 - Intel Core Ultra 9 285 Processor, Liquid Cooled, NVIDIA GeForce RTX 5080, 32GB DDR5 RAM, 1TB SSD, 1000W Platinum Rated PSU, Windows 11 Home - Clear Panel

(248)
$3,699.00$3,514.05
FREE delivery Feb 18 - 19Only 7 left in stock.
Loading...
Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

(9)
$3,950.00$3,752.50
FREE delivery Wed, Jun 18
Loading...
Gamdias PCIe 5.1 & ATX3.1 Gold 1000W Power Supply for GeForce RTX 5000 Series, 1000W Fully Modular ATX 80 Plus Gold Computer PSU for Gaming PC Desktops, Low-Noise Fan, Helios P2-1000G

Gamdias PCIe 5.1 & ATX3.1 Gold 1000W Power Supply for GeForce RTX 5000 Series, 1000W Fully Modular ATX 80 Plus Gold Computer PSU for Gaming PC Desktops, Low-Noise Fan, Helios P2-1000G

(9)
$159.99
FREE delivery Wed, Oct 8
Loading...
Wireless CarPlay Adapter for iPhone, Convert Wired to Wireless CarPlay Adapter,Equipped with Bluetooth 5.3 and Dual-Band WiFi, Plug and Play, Stable Car Control & No Delay,Mini Edition

Wireless CarPlay Adapter for iPhone, Convert Wired to Wireless CarPlay Adapter,Equipped with Bluetooth 5.3 and Dual-Band WiFi, Plug and Play, Stable Car Control & No Delay,Mini Edition

(137)
$30.86
FREE delivery Mar 17 - 19 on your first order
Loading...
230W Charger Compatible with Razer Blade 14” 15” 16" 17” (2025-2018) RZ09 RTX-3060/3070/3080/4060/4070 Gaming Laptop RC30-0530 RC30-0238 RC30-0248 Replacement Power Adapter

230W Charger Compatible with Razer Blade 14” 15” 16" 17” (2025-2018) RZ09 RTX-3060/3070/3080/4060/4070 Gaming Laptop RC30-0530 RC30-0238 RC30-0248 Replacement Power Adapter

(16)
$67.99
FREE delivery Mon, Feb 16
Loading...
PNY GeForce RTX™ 4070 Super 12GB Verto™ OC Dual Fan Graphics Card DLSS 3 (NVIDIA GeForce SFF-Ready, 192-bit, GDDR6X, PCIe 4.0, HDMI/DisplayPort, Supports 4k, incl. Adapter, 2 Slot)

PNY GeForce RTX™ 4070 Super 12GB Verto™ OC Dual Fan Graphics Card DLSS 3 (NVIDIA GeForce SFF-Ready, 192-bit, GDDR6X, PCIe 4.0, HDMI/DisplayPort, Supports 4k, incl. Adapter, 2 Slot)

(262)
$994.99
Loading...
INIU USB C Charger Block, 100W 3-Port PD Fast Charging, Advanced GaN Power Adapter, Foldable Charger with USB C Cable for MacBook Air 13 Pro, iPad, iPhone 17 16 Pro Max, Samsung S25 S24, Switch 2 etc ClimatePartner certified

INIU USB C Charger Block, 100W 3-Port PD Fast Charging, Advanced GaN Power Adapter, Foldable Charger with USB C Cable for MacBook Air 13 Pro, iPad, iPhone 17 16 Pro Max, Samsung S25 S24, Switch 2 etc ClimatePartner certified

(804)
$36.99
FREE delivery Fri, Feb 13
1K+ bought in past month