DeepSeek‑r1, o3‑mini & Gemini Flash 2.0: Which model should you use in your AI Agents?

aiwithbrandon February 10, 2025
Video Thumbnail
aiwithbrandon Logo

aiwithbrandon

@aiwithbrandon

About

I teach developers how to build fullstack AI applications 🤖

Video Description

🤖 Download the full source code here: 👉 https://brandonhancock.io/ai-agent-comparison Don’t forget to Like & Subscribe for more high-quality AI tutorials and free resources! 🎉 📆 Need help with AI development? Join my FREE AI Developer Accelerator Skool Community for weekly coaching calls and exclusive insights: 👉 https://www.skool.com/ai-developer-accelerator/about 📰 Stay Updated with My Latest Projects: LinkedIn: https://www.linkedin.com/in/brandon-hancock-ai/ Twitter/X: https://twitter.com/bhancock_ai New AI models just dropped, but which one is best for AI agents? I tested O3 Mini, Gemini Flash 2.0, and DeepSeek-R1 inside CrewAI against Claude 3.5 & GPT-4o to find out. We put them through three real-world tests inside CrewAI: Instruction Overload – Can they follow complex, rule-heavy prompts? Tool Calling Challenge – How well do they handle multi-step tool calls? Needle in a Haystack (RAG Test) – Which model retrieves and processes massive data best? Some models performed surprisingly well, while others struggled. Watch the breakdown to see the results! Timestamps: 00:00 – Start 01:09 – Model Overview 02:56 – Test #1: Instruction Overload 15:33 – Test #2: Tool Calling Challenge 22:21 – Test #3: Needle in a Haystack (RAG Performance) 29:37 – Final Recommendation

You May Also Like

Up Your AI Game Today

AI-recommended products based on this video

Loading...
8000mAh Hand Warmers Rechargeable 2 Pack, AI Smart Chip Long Safe Heat, Quick Charge Electric Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories

8000mAh Hand Warmers Rechargeable 2 Pack, AI Smart Chip Long Safe Heat, Quick Charge Electric Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories

(9)
$20.99
FREE delivery Sat, Jun 14 on your first order
Loading...
Hand Warmers Rechargeable 2 Pack, AI Smart Chip 20Hrs Long Safe Heat, 2s Fast Heating Up to 140℉, Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories

Hand Warmers Rechargeable 2 Pack, AI Smart Chip 20Hrs Long Safe Heat, 2s Fast Heating Up to 140℉, Portable Pocket Heater, Warm Gifts for Christmas, Outdoor, Golf, Hunting, Camping Accessories

(6)
$20.29
FREE delivery Sat, Jun 14 on your first order
Loading...
Flotstiga AI Hand Warmers Rechargeable 2 Pack,6000mAh Electric Hand Warmers,AI Smart Chips 20Hrs Long Safe Heat Pocket Size Heater Great Warm,Gifts for Christmas, Golf, Hunting, Camping Accessories

Flotstiga AI Hand Warmers Rechargeable 2 Pack,6000mAh Electric Hand Warmers,AI Smart Chips 20Hrs Long Safe Heat Pocket Size Heater Great Warm,Gifts for Christmas, Golf, Hunting, Camping Accessories

(29)
$18.99
FREE delivery Sat, Jun 14 on your first order
Loading...
RELLECIGA Women's High Waisted Board Shorts Swimwear Shorts Bike Shorts

RELLECIGA Women's High Waisted Board Shorts Swimwear Shorts Bike Shorts

(2,054)
$16.79
FREE delivery Thu, Sep 4 on your first order
Loading...
Bkayp Apple MFi Certified iPhone Charger 3pack 10FT Long Lightning Cable Fast Charging High Speed Data Sync USB Cable Compatible iPhone 13/12/11 Pro Max/XS MAX/XR/XS/X/8/7/Plus/6S (Grey White)

Bkayp Apple MFi Certified iPhone Charger 3pack 10FT Long Lightning Cable Fast Charging High Speed Data Sync USB Cable Compatible iPhone 13/12/11 Pro Max/XS MAX/XR/XS/X/8/7/Plus/6S (Grey White)

(7,514)
$12.99
Prime
5K+ bought in past month
Loading...
Syntech Link Cable Compatible with Meta/Oculus Quest 3S/Quest 3/Quest2/Pro/Pico 4/Ultra and PC/SteamVR, 16FT Upgraded Type C Cable with USB 3.0 Adapter, High Speed Data Transfer Cord for VR Headset
Best Seller

Syntech Link Cable Compatible with Meta/Oculus Quest 3S/Quest 3/Quest2/Pro/Pico 4/Ultra and PC/SteamVR, 16FT Upgraded Type C Cable with USB 3.0 Adapter, High Speed Data Transfer Cord for VR Headset

(1,405)
$26.99
FREE delivery Tue, Jun 17 on your first order
100+ bought in past month
Loading...
Laplink PCmover Ultimate 11 - Migration of your Applications, Files and Settings from an Old PC to a New PC - Data Transfer Software - With Optional High Speed Ethernet Cable - 1 License

Laplink PCmover Ultimate 11 - Migration of your Applications, Files and Settings from an Old PC to a New PC - Data Transfer Software - With Optional High Speed Ethernet Cable - 1 License

(4,609)
$54.95
PrimeFREE delivery Sat, Jun 14
Loading...
Syntech Link Cable 16FT for PCVR Compatible with Oculus/Quest 3/Meta Quest 3S, Quest2/Pro/Pico 4/Ultra Accessories and PC/SteamVR, High Speed PC Data Transfer, USB 3.0 to USB C Cable for VR Headset
Best Seller

Syntech Link Cable 16FT for PCVR Compatible with Oculus/Quest 3/Meta Quest 3S, Quest2/Pro/Pico 4/Ultra Accessories and PC/SteamVR, High Speed PC Data Transfer, USB 3.0 to USB C Cable for VR Headset

(19,554)
$24.99
FREE delivery Tue, Jun 17 on your first order
300+ bought in past month
Loading...
6-Tube Pedal Resistance Band, Premium Elastic Tension Rope for Full Body Workout, Natural Latex Fitness Bands for Strength Training,Yoga Stretching Slimming Training, Home Gym Exercise Equipment

6-Tube Pedal Resistance Band, Premium Elastic Tension Rope for Full Body Workout, Natural Latex Fitness Bands for Strength Training,Yoga Stretching Slimming Training, Home Gym Exercise Equipment

(0)
$11.05$11.00
FREE delivery Aug 20 - 25
Loading...
Translation Earbuds Real Time - AI 144 Language Translator Earbuds, Audifonos Traductores Inglés Español, 3-in-1 Translating Device, Translate Ear Buds for Travel Learning with Charging Cradle

Translation Earbuds Real Time - AI 144 Language Translator Earbuds, Audifonos Traductores Inglés Español, 3-in-1 Translating Device, Translate Ear Buds for Travel Learning with Charging Cradle

(30)
$99.99
FREE delivery Sun, Jan 4
300+ bought in past month
Loading...
AI Translation Earbuds Real Time with Audio and Video Calls, 164 Language/7 Translation Modes Translator Earbuds Bluetooth 5.4 with APP, 50H Translate Ear Buds Device for Business/Learning/Travel

AI Translation Earbuds Real Time with Audio and Video Calls, 164 Language/7 Translation Modes Translator Earbuds Bluetooth 5.4 with APP, 50H Translate Ear Buds Device for Business/Learning/Travel

(249)
$40.84
Prime
100+ bought in past month