FREE Local LLMs on Apple Silicon | FAST!

Alex Ziskind โ€ข May 10, 2024
Video Thumbnail
Alex Ziskind Logo

Alex Ziskind

View Channel

About

Cracking code and curiosities, I turn caffeine-fueled late nights into bytes of wisdom. Welcome aboard! Iโ€™m Alex, with 20+ years of mastering the art of coding and now, the craft of content creation. Subscribe to my channel and join me in unraveling software enigmas with in-depth tech reviews tailored for developers, with a dash of humor. Emojis suck ๐Ÿš€ https://www.youtube.com/@azisk?sub_confirmation=1

Video Description

Step by step setup guide for a totally local LLM with a ChatGPT-like UI, backend and frontend, and a Docker option. Temperature/fan on your Mac: https://www.tunabellysoftware.com/tgpro/index.php?fpr=alex (affiliate link) Run Windows on a Mac: https://prf.hn/click/camref:1100libNI (affiliate) Use COUPON: ZISKIND10 ๐Ÿ›’ Gear Links ๐Ÿ›’ * ๐Ÿ๐Ÿ’ฅ New MacBook Air M1 Deal: https://amzn.to/3S59ID8 * ๐Ÿ’ป๐Ÿ”„ Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk * ๐ŸŽงโšก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW * ๐Ÿ› ๏ธ๐Ÿš€ My nvme ssd: https://amzn.to/3YLEySo * ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ * ๐ŸŒ— RAM torture test on Mac - https://youtu.be/l3zIwPgan7M * ๐Ÿ› ๏ธ Host the PERFECT Prompt - https://youtu.be/LTL3MSFVpm0 * ๐Ÿ› ๏ธ Set up Conda on Mac - https://youtu.be/2Acht_5_HTo * ๐Ÿ› ๏ธ Set up Node on Mac - https://youtu.be/AEuI0PBvgfM * ๐Ÿค– INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k * ๐Ÿ’ฐ This is what spending more on a MacBook Pro gets you - https://youtu.be/iLHrYuQjKPU * ๐Ÿ› ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐Ÿ”— AI for Coding Playlist: ๐Ÿ“š - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw Repo https://github.com/open-webui/open-webui Docs https://docs.openwebui.com/ Docker Single Command docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” ๐Ÿ“ฑ ALEX ON X: https://twitter.com/digitalix #machinelearning #llm #softwaredevelopment

You May Also Like

Upgrade Your Apple Silicon Setup

AI-recommended products based on this video

Loading...
PYS 4-Way Privacy Screen for MacBook Pro 13 Inch (2016-2022, M1, M2) & MacBook Air 13 Inch (2018-2021, M1) - 360ยฐ Anti-Spy Filter, Matte Anti-Glare Protector, Scratch-Resistant Film, Laptop Privacy Filter Shield

PYS 4-Way Privacy Screen for MacBook Pro 13 Inch (2016-2022, M1, M2) & MacBook Air 13 Inch (2018-2021, M1) - 360ยฐ Anti-Spy Filter, Matte Anti-Glare Protector, Scratch-Resistant Film, Laptop Privacy Filter Shield

(373)
15.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
300+ bought in past month
Loading...
Apple iPad 11-inch: A16 chip, 11-inch Model, Liquid Retina Display, 128GB, Wi-Fi 6, 12MP Front/12MP Back Camera, Touch ID, All-Day Battery Life โ€” Blue EPEAT
Best Seller

Apple iPad 11-inch: A16 chip, 11-inch Model, Liquid Retina Display, 128GB, Wi-Fi 6, 12MP Front/12MP Back Camera, Touch ID, All-Day Battery Life โ€” Blue EPEAT

(10,496)
$279.00$276.21
FREE delivery Fri, Oct 17
10K+ bought in past month
Loading...
Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip
Best Seller

Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip

(26,751)
$118.98$114.22
FREE delivery Fri, Oct 17
10K+ bought in past month
Loading...
Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone
Best Seller

Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, Personalized Spatial Audio, Sweat and Water Resistant, USB-C Charging Case, H2 Chip, Up to 30 Hours of Battery Life, Effortless Setup for iPhone

(23,152)
$89.99$83.69
FREE delivery Thu, Sep 4
10K+ bought in past month
Loading...
Apple AirPods Pro 2 Wireless Earbuds, Active Noise Cancellation, Hearing Aid Feature, Bluetooth Headphones, Transparency, Personalized Spatial Audio, High-Fidelity Sound, H2 Chip, USB-C Charging

Apple AirPods Pro 2 Wireless Earbuds, Active Noise Cancellation, Hearing Aid Feature, Bluetooth Headphones, Transparency, Personalized Spatial Audio, High-Fidelity Sound, H2 Chip, USB-C Charging

(38,487)
$199.00$187.32
FREE delivery Fri, Oct 3
10K+ bought in past month
Loading...
Belkin BoostCharge Lightning Cable - 6.6ft/2M - MFi Certified Apple iPhone Charger USB to Lightning Cable - iPhone Cable - iPhone Charger Cord - Apple Charger - USB Phone Charger - Black

Belkin BoostCharge Lightning Cable - 6.6ft/2M - MFi Certified Apple iPhone Charger USB to Lightning Cable - iPhone Cable - iPhone Charger Cord - Apple Charger - USB Phone Charger - Black

(3,522)
11.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
100+ bought in past month
Loading...
Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified
Best Seller

Anker USB C to USB C Cable, Type-C 60W Fast Charging Cable (6FT, 2Pack) for iPhone 16 Series, iPad mini 6 and More (Black) ClimatePartner certified

(44,096)
$8.49
FREE delivery Thu, Jul 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

(16,565)
13.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
10K+ bought in past month
Loading...
G.SKILL Ripjaws DDR4 SO-DIMM Series DDR4 RAM 32GB (2x16GB) 2400MT/s CL16-16-16-39 1.20V Unbuffered Non-ECC Notebook/Laptop Memory SODIMM (F4-2400C16D-32GRS)

G.SKILL Ripjaws DDR4 SO-DIMM Series DDR4 RAM 32GB (2x16GB) 2400MT/s CL16-16-16-39 1.20V Unbuffered Non-ECC Notebook/Laptop Memory SODIMM (F4-2400C16D-32GRS)

(2,521)
52.99
PrimeFREE delivery Saturday, June 14
Loading...
HP EliteDesk 805 G9 Business SFF Desktop, AMD Ryzen 5 8500G, 32GB DDR5 RAM, 1TB SSD, HDMI, DisplayPort, RJ-45, Wi-Fi, Windows 11 Pro, Black, Bundle with ADATA UC310 64GB USB Flash Drive

HP EliteDesk 805 G9 Business SFF Desktop, AMD Ryzen 5 8500G, 32GB DDR5 RAM, 1TB SSD, HDMI, DisplayPort, RJ-45, Wi-Fi, Windows 11 Pro, Black, Bundle with ADATA UC310 64GB USB Flash Drive

(3)
669.00
PrimeFREE delivery June 13 - 17.
Loading...
Skytech Rampage Gaming PC, Intel i7 14700K 3.4 GHz (5.5GHz Turbo Boost), NVIDIA RTX 4070 Super 12GB GDDR6X, 2TB SSD, 32GB DDR5 RAM 5600 RGB, 750W Gold PSU, 360mm AIO, Wi-Fi, Win 11 Home

Skytech Rampage Gaming PC, Intel i7 14700K 3.4 GHz (5.5GHz Turbo Boost), NVIDIA RTX 4070 Super 12GB GDDR6X, 2TB SSD, 32GB DDR5 RAM 5600 RGB, 750W Gold PSU, 360mm AIO, Wi-Fi, Win 11 Home

(14)
Loading...
LG 32UR500K-B Ultrafine 32-inch 4K UHD (3840x2160) Computer Monitor HDR10 Built-in Speaker x2 OnScreen Control Reader Mode Flicker Safe Borderless Design HDMIx2 DisplayPort Black

LG 32UR500K-B Ultrafine 32-inch 4K UHD (3840x2160) Computer Monitor HDR10 Built-in Speaker x2 OnScreen Control Reader Mode Flicker Safe Borderless Design HDMIx2 DisplayPort Black

(95)
329.99
FREE delivery June 14 - 16
200+ bought in past month
Loading...
Lenovo V15 Laptop | 15.6" FHD Anti-Glare Display | AMD Ryzen 7 7730U | 40GB RAM | 1TB PCIe SSD | HDMI | Type-C | Webcam | Wi-Fi | THUNDEROBOT Wireless Ergonomic Mouse | Windows 11 Pro | Black

Lenovo V15 Laptop | 15.6" FHD Anti-Glare Display | AMD Ryzen 7 7730U | 40GB RAM | 1TB PCIe SSD | HDMI | Type-C | Webcam | Wi-Fi | THUNDEROBOT Wireless Ergonomic Mouse | Windows 11 Pro | Black

(26)
$649.00$636.02
FREE delivery Jun 18 - 23
Loading...
acer Nitro V 15 Gaming Laptop, Intel i9-13900H Up to 5.4GHz, GeForce RTX 4060, 15.6" 144 Hz IPS Display, 64 GB DDR5, 4 TB SSD, Wi-Fi 6, Backlit Keyboard, Windows 11 Pro, Gaming Mouse, 256GB UFD

acer Nitro V 15 Gaming Laptop, Intel i9-13900H Up to 5.4GHz, GeForce RTX 4060, 15.6" 144 Hz IPS Display, 64 GB DDR5, 4 TB SSD, Wi-Fi 6, Backlit Keyboard, Windows 11 Pro, Gaming Mouse, 256GB UFD

(2,753)
$1,899.99
FREE delivery Tomorrow, Jun 12Arrives before Father's Day
Loading...
Macally Small Wired Keyboard for Mac and Windows - 78 Scissor Switch Keys Compatible Apple Keyboard - USB Mini Keyboard That Saves Space and Looks Great - Plug and Play Wired Mac Keyboard - Aluminum

Macally Small Wired Keyboard for Mac and Windows - 78 Scissor Switch Keys Compatible Apple Keyboard - USB Mini Keyboard That Saves Space and Looks Great - Plug and Play Wired Mac Keyboard - Aluminum

(4,883)
27.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
200+ bought in past month
Loading...
Apple EarPods Headphones with USB-C Plug, Wired Ear Buds with Built-in Remote to Control Music, Phone Calls, and Volume

Apple EarPods Headphones with USB-C Plug, Wired Ear Buds with Built-in Remote to Control Music, Phone Calls, and Volume

(18,713)
$16.99$14.90
FREE delivery Tue, Nov 4 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Apple EarPods Headphones with Lightning Connector, Wired Ear Buds for iPhone with Built-in Remote to Control Music, Phone Calls, and Volume
Best Seller

Apple EarPods Headphones with Lightning Connector, Wired Ear Buds for iPhone with Built-in Remote to Control Music, Phone Calls, and Volume

(16,952)
$15.96$12.80
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip
Best Seller

Apple AirPods 4 Wireless Earbuds, Bluetooth Headphones, with Active Noise Cancellation, Adaptive Audio, Transparency Mode, Personalized Spatial Audio, USB-C Charging Case, Wireless Charging, H2 Chip

(26,751)
$118.98$114.22
FREE delivery Fri, Oct 17
10K+ bought in past month
Loading...
ANKER 737 Power Bank, 24,000mAh 3-Port Laptop Portable Charger with 140W Fast Charging, Smart Display, for Outdoor Work, Compatible with iPhone 16/15/14 Series, Vision Pro, Samsung, MacBook, and More

ANKER 737 Power Bank, 24,000mAh 3-Port Laptop Portable Charger with 140W Fast Charging, Smart Display, for Outdoor Work, Compatible with iPhone 16/15/14 Series, Vision Pro, Samsung, MacBook, and More

(13,939)
109.99
FREE delivery Saturday, June 14
9K+ bought in past month
Loading...
Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

(16,565)
13.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
10K+ bought in past month