4 levels of LLMs (on the go)

Alex Ziskind โ€ข March 11, 2025
Video Thumbnail

About

No channel description available.

Video Description

I put four portable systems to the local LLM test. ๐Ÿ›’ Gear Links ๐Ÿ›’ * ๐Ÿ’ป๐Ÿ”„ K8 Plus with 32GB RAM: https://amzn.to/3FnjJY0 * ๐Ÿ“ฆ๐ŸŽฎ GPU2: https://onexplayerstore.com/products/onexgpu-2-ultimate-egpu-with-amd-radeon-rx-7800m?variant=49781029437734 * ๐Ÿ› ๏ธ๐Ÿš€ 96GB RAM kit: https://amzn.to/3ZhQ4qR * ๐Ÿ๐Ÿ’ฅ M4 Max: https://amzn.to/3XIRw3X * ๐ŸŽงโšก RTX 4090: https://amzn.to/3YvvHpg * ๐Ÿ› ๏ธ๐Ÿš€ Mini PC with Oculink: https://amzn.to/3UgLNAK * ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ * ๐Ÿคฏ Cheap mini runs a 70B LLM - https://youtu.be/xyKEQjUzfAk * ๐Ÿค– Itโ€™s overโ€ฆmy new LLM Rig - https://youtu.be/IXixbu7Kkd8 * ๐ŸŒ— RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * ๐Ÿ› ๏ธ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo * ๐Ÿ› ๏ธ Set up Conda - https://youtu.be/2Acht_5_HTo * ๐Ÿค– INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * ๐Ÿ› ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐Ÿ”— AI for Coding Playlist: ๐Ÿ“š - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” ๐Ÿ“ฑ ALEX ON X: https://twitter.com/digitalix #machinelearning #llm #softwaredevelopment

You May Also Like

Upgrade Your LLM Setup Now

AI-recommended products based on this video

Loading...
eazpower for Magsafe Power Bank 10000mAh, Magnetic Battery Pack Wireless, 20W PD Fast Charging, Compact Portable Charger with Built-in Cables and Stand for iPhone 16/15/14/13/12/ Apple Watch/Airpods

eazpower for Magsafe Power Bank 10000mAh, Magnetic Battery Pack Wireless, 20W PD Fast Charging, Compact Portable Charger with Built-in Cables and Stand for iPhone 16/15/14/13/12/ Apple Watch/Airpods

(330)
$39.99
PrimeFREE delivery Sat, Jun 14
200+ bought in past month
Loading...
iPhone Charger Cord Lightning Cable (Apple MFi Certified) 6/6/10ft 3 Pack iPhone Cable Fast Charging Long Apple Charger Cable for iPhone 13 13 Pro 12 Pro 11 SE Max XS XR X, iPad Mini Air, iPod, AirPod

iPhone Charger Cord Lightning Cable (Apple MFi Certified) 6/6/10ft 3 Pack iPhone Cable Fast Charging Long Apple Charger Cable for iPhone 13 13 Pro 12 Pro 11 SE Max XS XR X, iPad Mini Air, iPod, AirPod

(4,371)
$9.99
FREE delivery Sat, Sep 20 on your first order
6K+ bought in past month
Loading...
iPhone Charger [Apple MFi Certified] 3FT, 3Pack USB A to Lightning Cable Braided Fast Charging Apple Cord Compatible with iPhone 14 13 12 11 Pro Max XS XR X 8 7 6 5 Plus iPad/iPod/AirPods

iPhone Charger [Apple MFi Certified] 3FT, 3Pack USB A to Lightning Cable Braided Fast Charging Apple Cord Compatible with iPhone 14 13 12 11 Pro Max XS XR X 8 7 6 5 Plus iPad/iPod/AirPods

(5,626)
$17.99
FREE delivery Sat, Jun 14 on your first order
50+ bought in past month
Loading...
iPhone Charger Fast Charging [Apple MFi Certified] USB C to Lightning Cable 6FT USBC to Lightning Cable Nylon Braided Type C Cord for iPhone 14 13 12 11 Pro Max XR XS X 8 7 6 Plus SE, iPad

iPhone Charger Fast Charging [Apple MFi Certified] USB C to Lightning Cable 6FT USBC to Lightning Cable Nylon Braided Type C Cord for iPhone 14 13 12 11 Pro Max XR XS X 8 7 6 Plus SE, iPad

(4,036)
$8.99
FREE delivery Sun, Jun 29 on your first order
2K+ bought in past month
Loading...
Coiled Lightning Cable, iPhone Charger Cable 3FT for Car [Apple MFi Certified] 3 Feet Lightning Cord Compatible with iPhone 14 13/12/11 Pro Max/XS MAX/XR/XS/X/8/7/Plus/6S iPad/iPod - Black

Coiled Lightning Cable, iPhone Charger Cable 3FT for Car [Apple MFi Certified] 3 Feet Lightning Cord Compatible with iPhone 14 13/12/11 Pro Max/XS MAX/XR/XS/X/8/7/Plus/6S iPad/iPod - Black

(7,361)
$18.99
FREE delivery Sat, Jun 14 on your first order
400+ bought in past month
Loading...
Anker Nano USB C Wall Charger,45W Fast Charging Smart Display Charger,with 180ยฐFoldable Plug,Smart Recognition,Built-in Care Mode,for iPhone17/16/15 (Non-Battery,One USB-C Port,No Cable Included) ClimatePartner certified

Anker Nano USB C Wall Charger,45W Fast Charging Smart Display Charger,with 180ยฐFoldable Plug,Smart Recognition,Built-in Care Mode,for iPhone17/16/15 (Non-Battery,One USB-C Port,No Cable Included) ClimatePartner certified

(698)
$39.99
FREE delivery Wed, Mar 4
1K+ bought in past month
Loading...
eazpower for Magsafe Power Bank 10000mAh, Magnetic Battery Pack Wireless, 20W PD Fast Charging, Compact Portable Charger with Built-in Cables and Stand for iPhone 16/15/14/13/12/ Apple Watch/Airpods

eazpower for Magsafe Power Bank 10000mAh, Magnetic Battery Pack Wireless, 20W PD Fast Charging, Compact Portable Charger with Built-in Cables and Stand for iPhone 16/15/14/13/12/ Apple Watch/Airpods

(330)
$39.99
PrimeFREE delivery Sat, Jun 14
200+ bought in past month
Loading...
Anker 332 USB-C Hub (5-in-1) with 4K HDMI Display, 5Gbps - and 2 5Gbps USB-A Data Ports and for MacBook Pro, MacBook Air, Dell XPS, Lenovo Thinkpad, HP Laptops and More

Anker 332 USB-C Hub (5-in-1) with 4K HDMI Display, 5Gbps - and 2 5Gbps USB-A Data Ports and for MacBook Pro, MacBook Air, Dell XPS, Lenovo Thinkpad, HP Laptops and More

(11,639)
$23.99
FREE delivery Sat, Jun 14 on your first order
1K+ bought in past month
Loading...
eazpower for Magsafe Power Bank 10000mAh, Magnetic Battery Pack Wireless, 20W PD Fast Charging, Compact Portable Charger with Built-in Cables and Stand for iPhone 16/15/14/13/12/ Apple Watch/Airpods

eazpower for Magsafe Power Bank 10000mAh, Magnetic Battery Pack Wireless, 20W PD Fast Charging, Compact Portable Charger with Built-in Cables and Stand for iPhone 16/15/14/13/12/ Apple Watch/Airpods

(330)
$39.99
PrimeFREE delivery Sat, Jun 14
200+ bought in past month
Loading...
soundcore by Anker Q20i Hybrid Active Noise Cancelling Headphones, Wireless Over-Ear Bluetooth, 40H Long ANC Playtime, Hi-Res Audio, Big Bass, Customize via an App, Transparency Mode, Ideal for Travel

soundcore by Anker Q20i Hybrid Active Noise Cancelling Headphones, Wireless Over-Ear Bluetooth, 40H Long ANC Playtime, Hi-Res Audio, Big Bass, Customize via an App, Transparency Mode, Ideal for Travel

(39,496)
$52.99
FREE delivery Sun, Oct 19
3K+ bought in past month
Loading...
soundcore by Anker P20i True Wireless Earbuds, 10mm Drivers with Big Bass, Bluetooth 5.3, 30H Long Playtime, IPX5 Water-Resistant, 2 Mics for AI Clear Calls, 22 Preset EQs, Customization via App

soundcore by Anker P20i True Wireless Earbuds, 10mm Drivers with Big Bass, Bluetooth 5.3, 30H Long Playtime, IPX5 Water-Resistant, 2 Mics for AI Clear Calls, 22 Preset EQs, Customization via App

(61,759)
$29.99
FREE delivery Sat, Jun 14 on your first order
4K+ bought in past month
Loading...
soundcore by Anker Q20i Hybrid Active Noise Cancelling Headphones, Wireless Over-Ear Bluetooth, 40H Long ANC Playtime, Hi-Res Audio, Big Bass, Customize via an App, Transparency Mode, Ideal for Travel

soundcore by Anker Q20i Hybrid Active Noise Cancelling Headphones, Wireless Over-Ear Bluetooth, 40H Long ANC Playtime, Hi-Res Audio, Big Bass, Customize via an App, Transparency Mode, Ideal for Travel

(30,156)
49.98
PrimeFREE delivery Saturday, June 14
500+ bought in past month
Loading...
soundcore by Anker Q20i Hybrid Active Noise Cancelling Headphones, Wireless Over-Ear Bluetooth, 40H Long ANC Playtime, Hi-Res Audio, Big Bass, Customize via an App, Transparency Mode, Ideal for Travel
Amazon's Choice

soundcore by Anker Q20i Hybrid Active Noise Cancelling Headphones, Wireless Over-Ear Bluetooth, 40H Long ANC Playtime, Hi-Res Audio, Big Bass, Customize via an App, Transparency Mode, Ideal for Travel

(30,156)
49.97
PrimeFREE delivery Saturday, June 14
3K+ bought in past month
Loading...
Mini Karaoke Machine for Kids Adults, Portable Bluetooth Speaker with 2 Wireless Microphones,Toys Birthday Gifts for Girls Ages 4, 5, 6, 7, 8,9,10,11,12+ Years Old Toddler Teens (Lightpink)
Best Seller

Mini Karaoke Machine for Kids Adults, Portable Bluetooth Speaker with 2 Wireless Microphones,Toys Birthday Gifts for Girls Ages 4, 5, 6, 7, 8,9,10,11,12+ Years Old Toddler Teens (Lightpink)

(5,013)
$37.99
PrimeFREE delivery Sat, Jun 14
700+ bought in past month
Loading...
8GB MP4 Player with 5 Inch HD Touch Screen for Android, Portable Streaming MP4 Music Player HiFi Sound MP3 Player with Speaker and Camera,Expandable Up to 128GB (Black)

8GB MP4 Player with 5 Inch HD Touch Screen for Android, Portable Streaming MP4 Music Player HiFi Sound MP3 Player with Speaker and Camera,Expandable Up to 128GB (Black)

(4)
$96.62
PrimeFREE delivery Sat, Jun 14
Loading...
Monster Mini Karaoke Machine for Kids Adults, Portable Bluetooth Speakers with 2 Wireless Microphones and Lights, Christmas Birthday Gifts Toys for Boys Girls 4, 5, 6, 7, 8, 9, 10, 12+ Toddler

Monster Mini Karaoke Machine for Kids Adults, Portable Bluetooth Speakers with 2 Wireless Microphones and Lights, Christmas Birthday Gifts Toys for Boys Girls 4, 5, 6, 7, 8, 9, 10, 12+ Toddler

(51)
$39.99
FREE delivery Thu, Nov 13
100+ bought in past month