Evaluating LLM-based Applications

Databricks July 26, 2023
Video Thumbnail
Databricks Logo

Databricks

@databricks

About

Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Genie, Lakebase, Lakeflow, Lakehouse, and Unity Catalog.

Video Description

Evaluating LLM-based applications can feel like more of an art than a science. In this workshop, we'll give a hands-on introduction to evaluating language models. You'll come away with knowledge and tools you can use to evaluate your own applications, and answers to questions like: - Where do I get evaluation data from, anyway? - Is it possible to evaluate generative models in an automated way? - What metrics can I use? - What's the role of human evaluation? Talk by: Josh Tobin Here’s more to explore: LLM Compact Guide: https://dbricks.co/43WuQyb Big Book of MLOps: https://dbricks.co/3r0Pqiz Connect with us: Website: https://databricks.com Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc Facebook: https://www.facebook.com/databricksinc

You May Also Like

LLM Learning Kit Essentials

AI-recommended products based on this video

Loading...
Magnetic Nasal Strips Starter Kit: Comfortable Nasal Breathing Support for Sleep, Helps Reduce Snoring Noise, Includes 60 Tabs (30 Uses) with 4 Sizes

Magnetic Nasal Strips Starter Kit: Comfortable Nasal Breathing Support for Sleep, Helps Reduce Snoring Noise, Includes 60 Tabs (30 Uses) with 4 Sizes

(40)
$17.99
FREE delivery Wed, Mar 18 on your first orderOnly 7 left in stock.
1K+ bought in past month
Loading...
Environet Hydroponic Growing Kit, Self-Watering Mason Jar Herb Garden Starter Kit Indoor, Windowsill Herb Garden, Grow Your Own Herbs from Organic Seeds (Basil)

Environet Hydroponic Growing Kit, Self-Watering Mason Jar Herb Garden Starter Kit Indoor, Windowsill Herb Garden, Grow Your Own Herbs from Organic Seeds (Basil)

(786)
$69.15$33.51
FREE delivery Jun 13 - 17
Loading...
Herb Garden Planter Indoor Kit 21Pcs Kitchen Herb Garden Starter Kit Growing Kit Including Wooden Box Burlap Pots Soil Discs Gardening Tools Unique Easter Birthday Christmas Gift Ideas for Women Mom

Herb Garden Planter Indoor Kit 21Pcs Kitchen Herb Garden Starter Kit Growing Kit Including Wooden Box Burlap Pots Soil Discs Gardening Tools Unique Easter Birthday Christmas Gift Ideas for Women Mom

(0)
$30.99
FREE delivery Jun 19 - Jul 3
Loading...
Bonsai Starter Kit – 1x Bonsai Tree | Complete Indoor Starter Kit for Growing Plants with Bonsai Seeds, Tools & Planters – Gardening Gifts for Women & Men
Best Seller

Bonsai Starter Kit – 1x Bonsai Tree | Complete Indoor Starter Kit for Growing Plants with Bonsai Seeds, Tools & Planters – Gardening Gifts for Women & Men

(243)
$19.99
FREE delivery Sat, Jun 14 on your first order
300+ bought in past month
Loading...
Lenovo LOQ 15.6" FHD 144Hz Gaming Laptop, Intel Core i5-12450HX, NVIDIA GeForce RTX 2050, 16GB DDR5, 2TB Storage (1TB SSD+1TB Docking Station Set), Number Pad, 720p Camera, Wi-Fi 6, Win 11, Gray

Lenovo LOQ 15.6" FHD 144Hz Gaming Laptop, Intel Core i5-12450HX, NVIDIA GeForce RTX 2050, 16GB DDR5, 2TB Storage (1TB SSD+1TB Docking Station Set), Number Pad, 720p Camera, Wi-Fi 6, Win 11, Gray

(2)
$1,369.00
FREE delivery Feb 24 - Mar 5
Loading...
MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

(0)
$4,697.44
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse

acer Nitro 50 N50-620-UA91 Gaming Desktop | 11th Gen Intel Core i5-11400F 6-Core Processor | NVIDIA GeForce GTX 1650 | 8GB DDR4 | 512GB NVMe M.2 SSD | Intel Wi-Fi 6 AX201 | Keyboard and Mouse

(283)
$1,658.99
Loading...
Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

(786)
$1,414.11
FREE delivery Thu, Feb 19Only 4 left in stock.
Loading...
TP-Link Tapo 2K Pan/Tilt Indoor Security WiFi Camera, Baby & Pet Camera w/ 360° Motion Tracking, 2-Way Audio, Night Vision, Cloud & Local Storage (Up to 256 GB), Works w/ Alexa & Google (Tapo C210)
Amazon's Choice

TP-Link Tapo 2K Pan/Tilt Indoor Security WiFi Camera, Baby & Pet Camera w/ 360° Motion Tracking, 2-Way Audio, Night Vision, Cloud & Local Storage (Up to 256 GB), Works w/ Alexa & Google (Tapo C210)

(46,779)
32.99
FREE delivery Saturday, June 14 on your first order
2K+ bought in past month
Loading...
TP-Link Tapo 3K 5MP Pan/Tilt Security WiFi Camera, Baby & Pet Camera, 360° Motion Tracking, 2-Way Audio, 40Ft. Night Vision, Cloud & Local Storage (Up to 512 GB), Works w/Alexa & Google (Tapo C230)

TP-Link Tapo 3K 5MP Pan/Tilt Security WiFi Camera, Baby & Pet Camera, 360° Motion Tracking, 2-Way Audio, 40Ft. Night Vision, Cloud & Local Storage (Up to 512 GB), Works w/Alexa & Google (Tapo C230)

(49,118)
$49.99
FREE delivery Wed, Aug 20
500+ bought in past month
Loading...
LEGO Technic Kawasaki Ninja H2R Motorcycle Toy - Building Toys for Kids, Boys & Girls, Ages 10+ - Kickstand for Display - Model Kit Birthday Gift - 42170

LEGO Technic Kawasaki Ninja H2R Motorcycle Toy - Building Toys for Kids, Boys & Girls, Ages 10+ - Kickstand for Display - Model Kit Birthday Gift - 42170

(439)
$78.34
PrimeFREE delivery Sat, Jun 14
100+ bought in past month
Loading...
LEGO Icons Williams Racing FW14B & Nigel Mansell F1 Model Car Kit - Building Set for Adults, Ages 18+ - F1 DIY Craft for Display - Gift Idea for Fans of F1-10353

LEGO Icons Williams Racing FW14B & Nigel Mansell F1 Model Car Kit - Building Set for Adults, Ages 18+ - F1 DIY Craft for Display - Gift Idea for Fans of F1-10353

(40)
$89.99
PrimeFREE delivery Sat, Jun 14
200+ bought in past month
Loading...
LEGO Star Wars TIE Bomber Model Building Kit, Star Wars Toy Starfighter with Gonk Droid Figure, Darth Vader Minifigure and Lightsaber, Collectible Star Wars Gift for 9 Year Olds, 75347

LEGO Star Wars TIE Bomber Model Building Kit, Star Wars Toy Starfighter with Gonk Droid Figure, Darth Vader Minifigure and Lightsaber, Collectible Star Wars Gift for 9 Year Olds, 75347

(2,818)
$54.98$54.96
PrimeFREE delivery Sat, Jun 14
900+ bought in past month
Loading...
LEGO City F1 Driver with McLaren Race Car Toy - Model Car Building Toy Kit for Kids, Boys and Girls, Ages 6+ - F1 Collectible for Fans - with a Driver Minifigure - Gift Idea for Birthdays - 60442

LEGO City F1 Driver with McLaren Race Car Toy - Model Car Building Toy Kit for Kids, Boys and Girls, Ages 6+ - F1 Collectible for Fans - with a Driver Minifigure - Gift Idea for Birthdays - 60442

(177)
$13.98
FREE delivery Sat, Jun 14 on your first order
200+ bought in past month