AutoGen Studio with 100% Local LLMs (LM Studio)
Prompt Engineering
@engineerpromptAbout
👋 I'm Muhammad! I am an AI/ML Expert with a PhD and have led ML teams at startups over the last 8 years. I am also a Google Developer Expert for ML/AI. The goal of this channel is to share my learning without all the "fluff" and "hype". I offer consulting services to startups and https://calendly.com/engineerprompt/consulting-call Learn more about me @: engineerprompt.ai For business inquiries email: [email protected]
Latest Posts
Video Description
Learn how to run AutoGen Studio UI with local LLMs as agents. 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: [email protected] Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). LINKS: AutoGen UI: https://microsoft.github.io/autogen/blog/tags/ui/ LM Studio: https://lmstudio.ai/ TIMESTAMPS: [00:00] Introduction [00:26] Setting Up LM Studio for Local LLMs [00:54] Downloading and Running an Instance of LM Studio [01:50] Serving the Model through an API Endpoint [02:48] Starting an Instance of AutoGen Studio [03:26] Creating Agents and Workflows in AutoGen Studio [06:30] Testing the Workflow in the Playground [07:35] Analyzing the Results and Issues
Upgrade Your Local LLMs Today
AI-recommended products based on this video
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible
KAMRUI Hyper H1 Mini PC W-11 Pro, AMD Ryzen 7 6800H Processor (up to 4.7GHz), Mini Desktop Computers with 32GB RAM 512GB M.2 SSD, Micro Computer Support 4K UHD for Home Server Business Office Global Recycled Standard
Beelink SER Mini PC W11 Pro, AMD Ryzen 5 5500(6C/12T up to 4 GHz), 16GB DDR4 500GB NVME SSD Graphics 6 core, WiFi 6/BT5.2/Dual Display Mini PC Computer
Beelink SER8 Mini PC W11 Pro, AMD Ryzen 7 8845HS(8C/16T up to 5.1GHz), 32GB DDR5 1TB NVME SSD Radeon 780M 12 core 2700 MHz WiFi 6/BT5.2/USB4.0 Triple Display Mini Gaming PC Computer
BOSGAME P5 Pro Mini PC, AMD Ryzen 7 6800H Mini Gaming PC, 32GB DDR5 512GB SSD Desktops Computer, Quad Display, Dual USB 4.0 & HDMI, 2.5G RJ45 LAN, Wi-Fi 6E, BT 5.2
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5
![SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]](https://m.media-amazon.com/images/I/71W2nK7LUrL._AC_UL960_FMwebp_QL65_.jpg)
SAMSUNG 870 EVO SATA III SSD 4TB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E4T0B/AM [Canada Version]
Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11
MSI MAG Coreliquid A13 360 - AIO ARGB CPU Liquid Cooler - 360mm Radiator - LGA 1851 Ready - Triple 120mm ARGB PWM Fans, Black
MSI MAG PANO 100R PZ - Premium Mid-Tower Gaming PC Case - Tempered Glass Side Panel - ARGB 120mm Fans - Liquid Cooling Support up to 360mm Radiator - Black Color Case
Intel Core i9-12900KF Desktop Processor 16 (8P+8E) Cores up to 5.2 GHz Unlocked LGA1700 600 Series Chipset 125W
Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intel® Core™ Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderbolt™ 4, USB Type-C, AI OC
Asus ROG Strix B850-A Gaming WiFi AMD AM5 B850 ATX Motherboard 14+2+2 Power Stages, DDR5 AEMP, 2.5G LAN, WiFi 7 with Q-Antenna, 4X M.2, PCIe® 5.0, USB 20Gbps Type-C, AI Networking II, ASUS AI Advisor
Asus ROG Strix B550-F Gaming WiFi II AMD AM4 (3rd Gen Ryzen) ATX Motherboard (PCIe 4.0,WiFi 6E, 2.5Gb LAN, BIOS Flashback, HDMI 2.1, Addressable Gen 2 RGB Header and Aura Sync)
Asus ROG Strix X870-A Gaming WiFi AMD AM5 X870 ATX Motherboard 16+2+2 Power Stages, Dynamic OC Switcher, Core Flex, DDR5 AEMP, WiFi 7, 4X M.2, PCIe® 5.0, Q-Release Slim, USB4®, AI OCing & Networking
VENOEN Firewall Mini PC Firewall Appliance 2.5gbe, 8GB RAM 128GB SSD Fanless Mini PC Firewall Hardware, 4 LAN Mini PC Fanless Firewall Celeron J4125, AES-NI, HD, USB 3.0, SIM Slot, RTC
Battery Cover for Xbox Series S, Cheap Replacement Back Shell Door Lid Repair Part to Microsoft Xbox Series X Controller, Black Batteries Port Cap Outside Case for New Xbox Core Wireless Remote,4 Pack
New Balance Mens 574 Core Sneaker
100FT Garden Hose - 2025 New Version Expandable Garden Hose with 10 Function Spray Nozzle, 3/4" Brass Fittings and 4-Layer Latex Core, Lightweight, Durable, No-Kink Flexible Water Hoses (Black Gold)