I'm running my LLMs locally now!
Maximilian SchwarzmĂĽller
@maximilian-schwarzmuellerAbout
I'm Maximilian SchwarzmĂĽller - a self-taught developer & online course instructor. On this channel, I share my opinions on coding, AI & the world.
Latest Posts
Video Description
I've slept for too long on open LLMs like Gemma, Llama, Qwen, DeepSeek etc. They're AMAZING! Using them is simple (with LM Studio or Ollama) and they're not far behind the "big models" you can access via ChatGPT etc. At least in my experience. I'm using them for all kinds of tasks... I'm truly excited about running LLMs locally - that's why I created a course to share my experience & knowledge on using & configuring LM Studio and Ollama. 👉 https://acad.link/local-llms My Website: https://maximilian-schwarzmueller.com/ Socials: 👉 Twitch: https://www.twitch.tv/maxedapps 👉 X: https://x.com/maxedapps 👉 Udemy: https://www.udemy.com/user/maximilian-schwarzmuller/ 👉 LinkedIn: https://www.linkedin.com/in/maximilian-schwarzmueller/ Want to become a web developer or expand your web development knowledge? I have multiple bestselling online courses on React, Angular, NodeJS, Docker & much more! 👉 https://academind.com/courses
Local LLM Setup Essentials
AI-recommended products based on this video
EZDIY-FAB RTX 3000 Series 12 Pin to Dual 8 Pin PCIe Sleeved Extension Cable 300 MM- Connector for NVIDIA Ampere GEFORCE RTX 3060ti 3070 3080 FE Funder Edition- White
AtomMan G7 Pt Mini PC AMD Ryzen 9 7945HX(16C/32T, up to 5.4GHz) 32GB DDR5 1TB PCIe4.0 SSD Micro Computer, HDMI+DP+USB-C Output, 2.5G LAN, WiFi7, BT5.4, 4xUSB AMD Radeon RX 7600M XT Graphics Gaming PC
STGAubron Gaming Desktop PC, AMD Athlon 3000G 3.5G, Radeon RX 580 16G GDDR5, 16G RAM, 512G SSD, 600M WiFi, BT 5.0, RGB Fan x4, Windows 11 Home
90W AC Power Adapter for Dell OptiPlex 3000 5000 7000 9020 Series Micro Desktop Inspiron 20" 22" 24" 27" AIO Desktop, Inspiron 15 16 17 14 13 3000 5000 7000 Series Laptop Charger
Intel NUC 13 Pro Mini PC, NUC13ANKI7 Intel Core i7-1360P (12C/16T & Up to 5.0GHz), 32GB 3200Mhz DDR4 RAM & 1TB PCIe 4.0 NVMe SSD, Support 8K/HDR/WiFi6E/BT5.3/Windows 11 Pro/Office/Business
GEEKOM IT13 2025 Mini PC 2025 Edition with 13th Gen Intel i9-13900HK, NUC 13 Mini Computers(14C/20T), 32GB RAM&1T M.2 2280 NVMe Gen4*4 SSD, Windows 11 Pro/Wi-Fi 6E/Bluetooth 5.2/USB 4.0/2.5G LAN
EVGA GeForce GTX 1660 Ti XC Ultra Gaming, 6GB GDDR6, HDB Fan Graphics Card 06G-P4-1267-KR
EVGA GeForce RTX 2060 SC, Overclocked, 2.75 Slot Extreme Cool, 70C Gaming, 06G-P4-2062-KR, 6GB GDDR6
EVGA GeForce RTX 2060 Super SC Black Gaming, 8GB GDDR6, Dual Fans, 08G-P4-3062-KR
EVGA GeForce RTX 2060 12GB XC Gaming, 12G-P4-2263-KR, 12GB GDDR6,Dual Fans, Metal Backplate
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)
![SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]](https://m.media-amazon.com/images/I/71lzXt4djxL._AC_UY654_FMwebp_QL65_.jpg)
SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]
![Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]](https://m.media-amazon.com/images/I/71gQWJ9ufdL._AC_UL960_FMwebp_QL65_.jpg)
Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]
![SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]](https://m.media-amazon.com/images/I/911ujeCkGfL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]
95MM T129215SU Cooling Fan for ASUS ROG Strix for GeForce RTX 3060 3070 3080 3090 Ti Graphics Card CF1010U12S/D T129215BU(Black A-Fan T12)
ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set
ASUS ROG Strix G16 (2024) Gaming Laptop, 16” 16:10 FHD+ 165Hz, GeForce RTX 4060, Intel Core i7-13650HX, 16GB DDR5, 1TB PCIe SSD, Wi-Fi 6E, Windows 11, G614JV-AS71-CA
Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intel® Core™ Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderbolt™ 4, USB Type-C, AI OC
