Account

How to evaluate AI agents with Braintrust

Braintrust • June 10, 2025
Video Thumbnail
Braintrust Logo

Braintrust

View Channel

About

The observability layer for production AI.

Latest Posts

Video Thumbnail

Evaluating agents: how we built Loop, the AI assistant for evals

Braintrust

You May Also Like

Intro to Evals with Braintrust
PT4M

Intro to Evals with Braintrust

Braintrust2 months ago
Five hard earned lessons about Evals — Ankur Goyal, Braintrust
PT4M

Five hard earned lessons about Evals — Ankur Goyal, Braintrust

AI Engineer3 months ago
Evaluating Agents with Braintrust
PT4M

Evaluating Agents with Braintrust

Greylock2 months ago
From Zero to Your First AI Agent in 25 Minutes (No Coding)
PT4M

From Zero to Your First AI Agent in 25 Minutes (No Coding)

Futurepedia and AI Agent Lab6 months ago
In the Loop with Braintrust: Technical Q&A
PT4M

In the Loop with Braintrust: Technical Q&A

Braintrust7 months ago
The Strange Math That Predicts (Almost) Anything
PT4M

The Strange Math That Predicts (Almost) Anything

Veritasium4 months ago
Measure what matters with Braintrust: Intro to AI evals
PT4M

Measure what matters with Braintrust: Intro to AI evals

Braintrust2 months ago
RAG vs Agentic AI: How LLMs Connect Data for Smarter AI
PT4M

RAG vs Agentic AI: How LLMs Connect Data for Smarter AI

IBM Technology1 week ago
LLM Eval Tools Compared: Braintrust
PT4M

LLM Eval Tools Compared: Braintrust

Hamel Husain2 months ago
Memory, evals, and efficient storage in AI systems with turbopuffer and Braintrust | Full discussion
PT4M

Memory, evals, and efficient storage in AI systems with turbopuffer and Braintrust | Full discussion

Bessemer Venture Partners3 months ago
Why MCP really is a big deal | Model Context Protocol with Tim Berglund
PT4M

Why MCP really is a big deal | Model Context Protocol with Tim Berglund

Confluent Developer6 months ago
Andrew Ng: Building Faster with AI
PT4M

Andrew Ng: Building Faster with AI

Y Combinator5 months ago
Model Context Protocol (MCP) Explained for Beginners: AI Flight Booking Demo!
PT4M

Model Context Protocol (MCP) Explained for Beginners: AI Flight Booking Demo!

KodeKloud5 months ago
Evals 101 — Doug Guthrie, Braintrust
PT4M

Evals 101 — Doug Guthrie, Braintrust

AI Engineer5 months ago
.NET AI Community Standup - Getting Started with the Microsoft Agent Framework
PT4M

.NET AI Community Standup - Getting Started with the Microsoft Agent Framework

dotnet2 months ago
How to Improve AI Apps with (Automated) Evals
PT4M

How to Improve AI Apps with (Automated) Evals

Shaw Talebi5 months ago
Anthropic C.E.O.: Massive A.I. Spending Could Haunt Some Companies
PT4M

Anthropic C.E.O.: Massive A.I. Spending Could Haunt Some Companies

The New York Times and New York Times Events1 week ago
Driving Xiaomi's Electric Car: Are we Cooked?
PT4M

Driving Xiaomi's Electric Car: Are we Cooked?

Marques Brownlee1 week ago
Beginner's Guide to Agent Evaluations
PT4M

Beginner's Guide to Agent Evaluations

LangChain11 months ago
Build Agentic Workflows with Mastra - The TypeScript Agent Framework
PT4M

Build Agentic Workflows with Mastra - The TypeScript Agent Framework

MongoDB6 months ago

Essential Gear for Your Next Shoot

AI-recommended products based on this video

Loading...
NEEWER Advanced 18 inch LED Ring Light for Phone, LCD Touch Screen, 2.4G Remote Lights Control, 3200-5600K, Tripod Light for iPhone Action Camera, for Studio Makeup TikTok YouTube Video Salon (Black)

NEEWER Advanced 18 inch LED Ring Light for Phone, LCD Touch Screen, 2.4G Remote Lights Control, 3200-5600K, Tripod Light for iPhone Action Camera, for Studio Makeup TikTok YouTube Video Salon (Black)

(2,807)
$181.49
FREE delivery Sun, Aug 10
Loading...
Lexar 128GB Micro SD Card, microSDXC UHS-I Flash Memory Card with Adapter - Up to 100MB/s, A1, U3, Class10, V30, High Speed TF Card

Lexar 128GB Micro SD Card, microSDXC UHS-I Flash Memory Card with Adapter - Up to 100MB/s, A1, U3, Class10, V30, High Speed TF Card

(26,884)
$18.99
FREE delivery Wed, Aug 20 on your first order
5K+ bought in past month
Loading...
Lexar D40E 128GB Dual Drive USB 3.2 Gen 1 Type-C™ Jump Drive, USB-C Flash Drive Metal Housing Swivel Design Thumb Drive

Lexar D40E 128GB Dual Drive USB 3.2 Gen 1 Type-C™ Jump Drive, USB-C Flash Drive Metal Housing Swivel Design Thumb Drive

(2,310)
$22.99
FREE delivery Sun, Aug 10 on your first order
2K+ bought in past month
Loading...
GTOCE Portable Charger,40000mAh Power Bank with 22.5W Fast Charging LED Digital Display Battery Pack with 6 Outputs 2 Inputs, Type C Powerbank Portable Charger for iPhone 16 pro Samsung AirPods,Black

GTOCE Portable Charger,40000mAh Power Bank with 22.5W Fast Charging LED Digital Display Battery Pack with 6 Outputs 2 Inputs, Type C Powerbank Portable Charger for iPhone 16 pro Samsung AirPods,Black

(334)
$42.99
FREE delivery Thu, Oct 16
1K+ bought in past month
Loading...
Wireless Power Bank 40800mAh,7-in-1 Portable Charger with 3 Built in Cables,15W Wireless Charging 25W PD QC 4.0 Fast Charging USB C LCD Display Battery Pack for iPhone 16/15/13/12,Samsung,Android etc

Wireless Power Bank 40800mAh,7-in-1 Portable Charger with 3 Built in Cables,15W Wireless Charging 25W PD QC 4.0 Fast Charging USB C LCD Display Battery Pack for iPhone 16/15/13/12,Samsung,Android etc

(65)
$56.95
FREE delivery Tue, Aug 12
200+ bought in past month
Loading...
AsperX for Magsafe Power Bank, 10000mAh Wireless Magnetic Power Bank, 22.5W Wire Fast Charging Portable Charger with USB C Cable, LCD Display for Magsafe Battery Pack for iPhone 16/15/14/13/12

AsperX for Magsafe Power Bank, 10000mAh Wireless Magnetic Power Bank, 22.5W Wire Fast Charging Portable Charger with USB C Cable, LCD Display for Magsafe Battery Pack for iPhone 16/15/14/13/12

(895)
$37.98
FREE delivery Sat, Sep 20
400+ bought in past month
Loading...
OYEAELX 3 in 1 with Built in Cable Portable Charger 15800mAh Cell Phone Battery Backup Ultra Slim Mini Power Bank with LCD Display Compatible with iPhone iPad Android Samsung Galaxy and More

OYEAELX 3 in 1 with Built in Cable Portable Charger 15800mAh Cell Phone Battery Backup Ultra Slim Mini Power Bank with LCD Display Compatible with iPhone iPad Android Samsung Galaxy and More

(118)
$18.26
FREE delivery Sun, Aug 10 on your first order
Loading...
NEEWER Advanced 18 inch LED Ring Light for Phone, LCD Touch Screen, 2.4G Remote Lights Control, 3200-5600K, Tripod Light for iPhone Action Camera, for Studio Makeup TikTok YouTube Video Salon (Black)

NEEWER Advanced 18 inch LED Ring Light for Phone, LCD Touch Screen, 2.4G Remote Lights Control, 3200-5600K, Tripod Light for iPhone Action Camera, for Studio Makeup TikTok YouTube Video Salon (Black)

(2,807)
$181.49
FREE delivery Sun, Aug 10
Loading...
SENDEFN Leather Wristlet Clutch Small Women Crossbody Shoulder Bag Wallet Purses RIFD Card Slots

SENDEFN Leather Wristlet Clutch Small Women Crossbody Shoulder Bag Wallet Purses RIFD Card Slots

(1,016)
$26.99
FREE delivery Thu, Sep 4 on your first order
200+ bought in past month
Loading...
FuninCrea Mens Sling Bag, Oxford Chest Bag Shoulder Bag with Adjustable Shoulder Straps

FuninCrea Mens Sling Bag, Oxford Chest Bag Shoulder Bag with Adjustable Shoulder Straps

(35)
$9.99
FREE delivery Thu, Jun 19 on your first order
Loading...
VNINE Small Sling Crossbody Backpack Shoulder Bag for Men Women, Lightweight One Strap Back Pack Sling Bag Backpack for Hiking Walking Biking Travel Cycling with Headphone Port

VNINE Small Sling Crossbody Backpack Shoulder Bag for Men Women, Lightweight One Strap Back Pack Sling Bag Backpack for Hiking Walking Biking Travel Cycling with Headphone Port

(1)
$29.99
FREE delivery Thu, Jun 19 on your first order
Loading...
OSOCE RFID Mens Sling Bag, Anti-theft Crossbody Shoulder Bag Travel Cycling Sport Hiking Bags for Men Women Casual Daypack(2.0Black-S)

OSOCE RFID Mens Sling Bag, Anti-theft Crossbody Shoulder Bag Travel Cycling Sport Hiking Bags for Men Women Casual Daypack(2.0Black-S)

(170)
$16.38
FREE delivery Jul 8 - 29
Loading...
Kaiess 62" Tripod for iPhone, Selfie Stick Tripod & Phone Tripod Stand with Remote, Cell Phone Tripod for iPhone, Extendable Travel Tripod Compatible with iPhone 14/13/12 Pro Max/Android
Best Seller

Kaiess 62" Tripod for iPhone, Selfie Stick Tripod & Phone Tripod Stand with Remote, Cell Phone Tripod for iPhone, Extendable Travel Tripod Compatible with iPhone 14/13/12 Pro Max/Android

(5,298)
$28.98
FREE delivery Sat, Jun 14 on your first order
1K+ bought in past month
Loading...
SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

(3)
$44.99
FREE delivery Thu, Jun 19
Loading...
SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

(85)
$38.24
FREE delivery Thu, Jun 19
Loading...
SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

(3)
$44.99
FREE delivery Thu, Jun 19
Loading...
SmallRig FX3 / FX30 HawkLock Quick Release Camera Cage Kit for Sony with Cable Clamp, Bulit-in QR Cold Shoe NATO Rail/QR Plate for Arca, Modular Design Compatible with Original XLR Handle - 4770

SmallRig FX3 / FX30 HawkLock Quick Release Camera Cage Kit for Sony with Cable Clamp, Bulit-in QR Cold Shoe NATO Rail/QR Plate for Arca, Modular Design Compatible with Original XLR Handle - 4770

(35)
$124.94
FREE delivery Thu, Jun 19
Loading...
SmallRig FX3 / FX30 HawkLock Quick Release Camera Cage Kit for Sony with XLR Handle Extension, Wrist Strap and Cable Clamp for HDMI, QR Cold Shoe, NATO Rail/QR Plate for Arca,Titanium Gray - 4771

SmallRig FX3 / FX30 HawkLock Quick Release Camera Cage Kit for Sony with XLR Handle Extension, Wrist Strap and Cable Clamp for HDMI, QR Cold Shoe, NATO Rail/QR Plate for Arca,Titanium Gray - 4771

(72)
$174.24$162.04
FREE delivery Thu, Jun 19
Loading...
AC Power Cord Cable Fit for Sony PS5 PS4 PS3 Slim PlayStation 5 4 3, Xbox Series X/S, Xbox One X/S, TV, Printer Universal 2 Prong Supply Replacement - (ETL Listed Cable)

AC Power Cord Cable Fit for Sony PS5 PS4 PS3 Slim PlayStation 5 4 3, Xbox Series X/S, Xbox One X/S, TV, Printer Universal 2 Prong Supply Replacement - (ETL Listed Cable)

(5,351)
$8.49
Prime
500+ bought in past month
Home AiChat Shop Saved Account