AI agent + Vision = Incredible

AI Jason October 16, 2023
Video Thumbnail

About

No channel description available.

Video Description

A step by step tutorial of how to build vision powered AI agent via autogen + llava + stable diffusion AND Break down of 160-page analysis of GPT4V capabilities 🤘 Get 15% off on sceneXplain via my code AIJASON : https://go.jina.ai/scenexplainjason 🔗 Links - Follow me on twitter: https://twitter.com/jasonzhou1993 - Join my AI email list: https://www.ai-jason.com/ - My discord: https://discord.gg/eZXprSaCDE - sceneXplain: https://go.jina.ai/scenexplainjason - Vision-agent Github: https://github.com/JayZeeDesign/vision-agent-with-llava ⏱️ Timestamps 0:00 Intro 1:15 What is multi-modal model 2:12 GPT4V ability break down 4:34 sceneXplain 6:00 Visual prompt techniques 10:53 Use cases 13:00 Build vision agent #1 - Setup 14:20 Build vision agent #2 - Use Llava model 15:58 Build vision agent #3 - Use Stable diffusion 16:52 Build vision agent #4 - Set agent system via autogen 18:53 Build vision agent #5 - Demo 👋🏻 About Me My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! [email protected] #gpt4 #autogen #autogpt #ai #artificialintelligence #tutorial #stepbystep #openai #llm #chatgpt #largelanguagemodels #largelanguagemodel #bestaiagent #chatgpt #agentgpt #agent #babyagi #llava #stablediffusion

AI Vision Upgrade Essentials

AI-recommended products based on this video

Loading...
Intel NUC 13 Pro Mini PC, NUC13ANKI7 Intel Core i7-1360P (12C/16T & Up to 5.0GHz), 32GB 3200Mhz DDR4 RAM & 1TB PCIe 4.0 NVMe SSD, Support 8K/HDR/WiFi6E/BT5.3/Windows 11 Pro/Office/Business

Intel NUC 13 Pro Mini PC, NUC13ANKI7 Intel Core i7-1360P (12C/16T & Up to 5.0GHz), 32GB 3200Mhz DDR4 RAM & 1TB PCIe 4.0 NVMe SSD, Support 8K/HDR/WiFi6E/BT5.3/Windows 11 Pro/Office/Business

(0)
$1,149.00
FREE delivery Wed, Jun 18
Loading...
10.1 Inch Touch Portable Monitor IPS Screen 1366x768P 60Hz 400 Brightness 99% sRGB HDMI USB-C Monitors Switch for Xbox PS3/4/5 Laptop Compatible with Raspberry Pi, Mini Touch Screen

10.1 Inch Touch Portable Monitor IPS Screen 1366x768P 60Hz 400 Brightness 99% sRGB HDMI USB-C Monitors Switch for Xbox PS3/4/5 Laptop Compatible with Raspberry Pi, Mini Touch Screen

(1)
$99.99
FREE delivery Mon, Aug 11
Loading...
ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

(49)
$117.29$102.21
$6.86 delivery Thu, Aug 14
Loading...
7 Inch Portable Monitor Touchscreen HD 1024x600 LED Display Dual HDMI Port Small Monitor for PC Raspberry Pi Laptop Computer Xbox PS4/5 Switch Built-in Speakers

7 Inch Portable Monitor Touchscreen HD 1024x600 LED Display Dual HDMI Port Small Monitor for PC Raspberry Pi Laptop Computer Xbox PS4/5 Switch Built-in Speakers

(61)
$68.99
FREE delivery Tue, Aug 12
Loading...
BrosTrend 1800Mbps WiFi 6 Linux WiFi Adapter for PC and Raspberry Pi 2+, Long Range USB WiFi Dongle Linux for Ubuntu, Mint, Debian, Kubuntu, Lubuntu, Zorin, Windows 11/10, Dual Band Wireless Antenna

BrosTrend 1800Mbps WiFi 6 Linux WiFi Adapter for PC and Raspberry Pi 2+, Long Range USB WiFi Dongle Linux for Ubuntu, Mint, Debian, Kubuntu, Lubuntu, Zorin, Windows 11/10, Dual Band Wireless Antenna

(288)
$54.14
FREE delivery Sun, Jun 22
Loading...
Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intel® Core™ Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderbolt™ 4, USB Type-C, AI OC

Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intel® Core™ Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderbolt™ 4, USB Type-C, AI OC

(54)
$299.99
FREE delivery Jan 11 - Feb 5
Loading...
Asus ROG Strix B850-A Gaming WiFi AMD AM5 B850 ATX Motherboard 14+2+2 Power Stages, DDR5 AEMP, 2.5G LAN, WiFi 7 with Q-Antenna, 4X M.2, PCIe® 5.0, USB 20Gbps Type-C, AI Networking II, ASUS AI Advisor

Asus ROG Strix B850-A Gaming WiFi AMD AM5 B850 ATX Motherboard 14+2+2 Power Stages, DDR5 AEMP, 2.5G LAN, WiFi 7 with Q-Antenna, 4X M.2, PCIe® 5.0, USB 20Gbps Type-C, AI Networking II, ASUS AI Advisor

(2,377)
$249.99$224.99
FREE delivery Jan 13 - Feb 7
100+ bought in past month
Loading...
Reatan X7 AI Oculink Gaming Mini PC AMD Ryzen 7 255(Upgraded 8745HS) 32GB DDR5 1TB PCIe4.0 SSD 5600MHz RAM, Desktop Mini Computers Radeon 780M Graphics, 2.5G LAN/HDMI 2.1/2 * 8K USB 4.0/Wi-Fi 7/BT5.4

Reatan X7 AI Oculink Gaming Mini PC AMD Ryzen 7 255(Upgraded 8745HS) 32GB DDR5 1TB PCIe4.0 SSD 5600MHz RAM, Desktop Mini Computers Radeon 780M Graphics, 2.5G LAN/HDMI 2.1/2 * 8K USB 4.0/Wi-Fi 7/BT5.4

(38)
$749.00
FREE delivery Sat, Jan 3Only 3 left in stock.
Loading...
BASESAILOR iPhone 16 15 Pro Max Charger Cord,USB to USB C Cable 6.6FT/2Pack,Type C Charging Power Cord for Apple iPad 10,Samsung Galaxy AI S25 S24 S23 S22 S20 Plus Ultra Flip,A52 A53 A54,Google Pixel

BASESAILOR iPhone 16 15 Pro Max Charger Cord,USB to USB C Cable 6.6FT/2Pack,Type C Charging Power Cord for Apple iPad 10,Samsung Galaxy AI S25 S24 S23 S22 S20 Plus Ultra Flip,A52 A53 A54,Google Pixel

(29,760)
$12.59
FREE delivery Sat, Jun 14 on your first order
500+ bought in past month
Loading...
10ft Rolling Library Ladder Hardware Kit, Sliding Track Kit with Floor Rollers, Loft Hardware for Home Bookshelf Warehouse (No Ladder)

10ft Rolling Library Ladder Hardware Kit, Sliding Track Kit with Floor Rollers, Loft Hardware for Home Bookshelf Warehouse (No Ladder)

(4)
$144.99
FREE delivery Sat, Jun 28
Loading...
Real-Time AI Translation Earbuds - 198 Languages 3-in-1 Translating Device, Écouteurs traducteurs Anglais-français, Clear Voice Translation Headphones with Charging Case for Travel & Learning Global Recycled Standard

Real-Time AI Translation Earbuds - 198 Languages 3-in-1 Translating Device, Écouteurs traducteurs Anglais-français, Clear Voice Translation Headphones with Charging Case for Travel & Learning Global Recycled Standard

(78)
$99.99
FREE delivery Thu, Apr 9
100+ bought in past month
Loading...
Translation Earbuds Real Time - AI 144 Language Translator Earbuds, Audifonos Traductores Inglés Español, 3-in-1 Translating Device, Translate Ear Buds for Travel Learning with Charging Cradle

Translation Earbuds Real Time - AI 144 Language Translator Earbuds, Audifonos Traductores Inglés Español, 3-in-1 Translating Device, Translate Ear Buds for Travel Learning with Charging Cradle

(30)
$99.99
FREE delivery Sun, Jan 4
300+ bought in past month