Running LLM Clusters on ALL THIS ๐Ÿš€

Alex Ziskind โ€ข November 7, 2024
Video Thumbnail
Alex Ziskind Logo

Alex Ziskind

View Channel

About

Cracking code and curiosities, I turn caffeine-fueled late nights into bytes of wisdom. Welcome aboard! Iโ€™m Alex, with 20+ years of mastering the art of coding and now, the craft of content creation. Subscribe to my channel and join me in unraveling software enigmas with in-depth tech reviews tailored for developers, with a dash of humor. Emojis suck ๐Ÿš€ https://www.youtube.com/@azisk?sub_confirmation=1

Video Description

I test the cluster workflow on MacBook Pro and MacBook Airs, all sharing LLM models via an all-SSD NAS, while talking to each other via Thunderbolt. ๐Ÿ›’ Gear Links ๐Ÿ›’ * ๐Ÿ๐Ÿ’ฅ All SSD NAS: https://amzn.to/3YCTr9R * ๐Ÿ’ป๐Ÿ”„ Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk * ๐Ÿ’ป๐Ÿ”„ MacBook Air M2 Deal: https://amzn.to/3Ay78PC * ๐Ÿ› ๏ธ๐Ÿš€ MacBook Air M3: https://amzn.to/4fz8Hvq * ๐ŸŽงโšก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW * ๐Ÿ› ๏ธ๐Ÿš€ My nvme ssd: https://amzn.to/3YLEySo * ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ * ๐Ÿค– REALITY vs Appleโ€™s Memory Claims - https://youtu.be/fdvzQAWXU7A * ๐ŸŒ— RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * ๐Ÿ› ๏ธ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo * ๐Ÿ› ๏ธ Set up Conda - https://youtu.be/2Acht_5_HTo * ๐Ÿค– INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * ๐Ÿ› ๏ธ Conda setup for Python dev - https://youtu.be/2Acht_5_HTo * ๐Ÿ› ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐Ÿ”— AI for Coding Playlist: ๐Ÿ“š - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw Exo project: https://github.com/exo-explore/exo โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” ๐Ÿ“ฑ ALEX ON X: https://twitter.com/digitalix #machinelearning #llm #softwaredevelopment

You May Also Like

Boost Your LLM Setup Today

AI-recommended products based on this video

Loading...
acer Nitro V 15 Gaming Laptop, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64 GB DDR5 RAM, 4 TB SSD, Backlit Keyboard, Microsoft Office Lifetime License, Windows 11 Pro

acer Nitro V 15 Gaming Laptop, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64 GB DDR5 RAM, 4 TB SSD, Backlit Keyboard, Microsoft Office Lifetime License, Windows 11 Pro

(827)
$1,659.99
FREE delivery Jun 17 - 20
Loading...
acer Nitro V 15 Gaming Laptop, Microsoft Office Lifetime License & Windows 11 Pro, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64GB DDR5 RAM, 4TB SSD, Backlit Keyboard

acer Nitro V 15 Gaming Laptop, Microsoft Office Lifetime License & Windows 11 Pro, 15.6" 144Hz FHD Display, Intel 10-Core i7-13620H, NVIDIA GeForce RTX 4060, 64GB DDR5 RAM, 4TB SSD, Backlit Keyboard

(348)
$1,579.99
FREE delivery Jun 17 - 20
Loading...
acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | 8-Core AMD Ryzen 7-5700U | AMD Radeon | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | 8-Core AMD Ryzen 7-5700U | AMD Radeon | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

(3)
$979.99$739.99
FREE delivery Jun 18 - 23
Loading...
acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | AMD Radeon | 8-Core AMD Ryzen 7-5700U | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

acer Aspire 3 Laptop | 15.6" FHD (1920 x 1080) Display | AMD Radeon | 8-Core AMD Ryzen 7-5700U | 64GB RAM | 4.5TB SSD (4TB PCIe SSD withHP P500 512GB Portable SSD) | Ethernet Port | Windows 11 Pro

(14)
$979.99$739.99
FREE delivery Jun 18 - 23
Loading...
Lenovo IdeaPad 3 Laptop| Intel Core i7-1255U Processor| Touchscreen| 15.6 inch Full HD Display| 40GB RAM, 1TB PCIe SSD|USB-C, HDMI, Card Reader| Office Trial| Backlit Keyboard| Windows 11

Lenovo IdeaPad 3 Laptop| Intel Core i7-1255U Processor| Touchscreen| 15.6 inch Full HD Display| 40GB RAM, 1TB PCIe SSD|USB-C, HDMI, Card Reader| Office Trial| Backlit Keyboard| Windows 11

(1)
$699.99
FREE delivery Tue, Jun 17
Loading...
Lenovo V-Series V15 Business Laptop | 15.6" FHD 1920 * 1080 | 13th Gen Intel Core i7-13620H | 40GB RAM | 1TB SSD | Webcam | Wi-Fi 6 | Windows 11 Pro | Black | Bundle with ADATA 512GB External SSD

Lenovo V-Series V15 Business Laptop | 15.6" FHD 1920 * 1080 | 13th Gen Intel Core i7-13620H | 40GB RAM | 1TB SSD | Webcam | Wi-Fi 6 | Windows 11 Pro | Black | Bundle with ADATA 512GB External SSD

(6)
$849.00
FREE delivery Jun 18 - 23
50+ bought in past month
Loading...
Lenovo IdeaPad 15.6โ€ FHD Touchscreen Laptop, 40GB RAM 2.5TB Storage (2TB SSD+512GB Docking Station Set), 6-Cores Intel Core i3, Windows 11 Pro with Microsoft Office Included, Plusera Earphones

Lenovo IdeaPad 15.6โ€ FHD Touchscreen Laptop, 40GB RAM 2.5TB Storage (2TB SSD+512GB Docking Station Set), 6-Cores Intel Core i3, Windows 11 Pro with Microsoft Office Included, Plusera Earphones

(94)
$599.99
FREE delivery Tue, Jun 17
300+ bought in past month
Loading...
Lenovo 2025 New Touchscreen Laptop โ€ข 6-Cores Intel Core i3 โ€ข 40GB RAM โ€ข 2TB SSD โ€ข 15.6 inch FHD (1920 x 1080) Display โ€ข Long Battery Life โ€ข WOWPC Recovery USB โ€ข Windows 11 Pro with Microsoft Office

Lenovo 2025 New Touchscreen Laptop โ€ข 6-Cores Intel Core i3 โ€ข 40GB RAM โ€ข 2TB SSD โ€ข 15.6 inch FHD (1920 x 1080) Display โ€ข Long Battery Life โ€ข WOWPC Recovery USB โ€ข Windows 11 Pro with Microsoft Office

(2)
$1,159.99$469.99
FREE delivery Jun 23 - 25
300+ bought in past month
Loading...
Redragon RGPS-850W 80+ Gold 850 Watt ATX 3.0 & PCIe 5.0 Fully Modular Power Supply w/ 80 Plus Gold Certified, Compact 160mm Size, Smart ECO Low Noise RGB Fan, 100% Japanese Capacitors, Full Mod Cables

Redragon RGPS-850W 80+ Gold 850 Watt ATX 3.0 & PCIe 5.0 Fully Modular Power Supply w/ 80 Plus Gold Certified, Compact 160mm Size, Smart ECO Low Noise RGB Fan, 100% Japanese Capacitors, Full Mod Cables

(1,550)
114.99
PrimeFREE delivery Saturday, June 14
200+ bought in past month
Loading...
ASUS TUF Gaming A16 (2024) Copilot+ PC Gaming Laptop, 16 16:10 165Hz Display, AMD Ryzenโ„ข AI 9 HX 370, NVIDIAยฎ GeForce RTXโ„ข 4060, 16GB LPDDR5X, 1TB PCIe Gen 4.0 SSD, Wi-Fi 6E, Windows 11, FA608WV-DB94

ASUS TUF Gaming A16 (2024) Copilot+ PC Gaming Laptop, 16 16:10 165Hz Display, AMD Ryzenโ„ข AI 9 HX 370, NVIDIAยฎ GeForce RTXโ„ข 4060, 16GB LPDDR5X, 1TB PCIe Gen 4.0 SSD, Wi-Fi 6E, Windows 11, FA608WV-DB94

(24)
1,599.00
PrimeFREE delivery Saturday, June 14
Loading...
ASUS TUF Gaming GeForce RTX โ„ข 5070 Ti 16GB GDDR7 OC Edition Gaming Graphics Card (PCIeยฎ 5.0, HDMIยฎ/DP 2.1, 3.125-slot, Military-Grade Components, Protective PCB Coating, axial-tech Fans)

ASUS TUF Gaming GeForce RTX โ„ข 5070 Ti 16GB GDDR7 OC Edition Gaming Graphics Card (PCIeยฎ 5.0, HDMIยฎ/DP 2.1, 3.125-slot, Military-Grade Components, Protective PCB Coating, axial-tech Fans)

(433)
999.99
1K+ bought in past month