Account

open-rag-eval: RAG Evaluation without "golden" answers — Ofer Mendelevitch, Vectara

AI Engineer • June 3, 2025

Video Thumbnail

AI Engineer

About

Talks, workshops, events, and training for AI Engineers.

Latest Posts

Video Thumbnail

The State of AI Code Quality: Hype vs Reality — Itamar Friedman, Qodo

AI Engineer

Video Thumbnail

RL Environments at Scale – Will Brown, Prime Intellect

AI Engineer

Video Thumbnail

Don't Build Agents, Build Skills Instead – Barry Zhang & Mahesh Murag, Anthropic

AI Engineer

Video Thumbnail

2026: The Year The IDE Died — Steve Yegge & Gene Kim, Authors, Vibe Coding

AI Engineer

You May Also Like

RAG Evaluation Is Broken! Here's Why (And How to Fix It) - Yuval Belfer and Niv Granot

RAG Evaluation Is Broken! Here's Why (And How to Fix It) - Yuval Belfer and Niv Granot

AI Engineer6 months ago

When Vectors Break Down: Graph-Based RAG for Dense Enterprise Knowledge - Sam Julien, Writer

When Vectors Break Down: Graph-Based RAG for Dense Enterprise Knowledge - Sam Julien, Writer

AI Engineer4 months ago

Session 7: RAG Evaluation with RAGAS and How to Improve Retrieval

Session 7: RAG Evaluation with RAGAS and How to Improve Retrieval

AI Makerspace2 years ago

RAG Evaluation Sucks: Here's a Totally New Way to Do It - e17 RAG Masters

RAG Evaluation Sucks: Here's a Totally New Way to Do It - e17 RAG Masters

EyeLevel1 year ago

Stop Using RAG as Memory

Stop Using RAG as Memory

Zep AI6 months ago

RAG Optimization: A Practical Overview for Improving Retrieval Augmented Generation

RAG Optimization: A Practical Overview for Improving Retrieval Augmented Generation

Snorkel AI1 year ago

[Evals Workshop] Mastering AI Evaluation: From Playground to Production

[Evals Workshop] Mastering AI Evaluation: From Playground to Production

AI Engineer5 months ago

RAGAS: A New Framework for Evaluating RAG

RAGAS: A New Framework for Evaluating RAG

Oxen10 months ago

Most devs don’t understand how context windows work

Most devs don’t understand how context windows work

Matt Pocock1 month ago

Step by step RAG evaluation using deepeval |Tutorial:127

Step by step RAG evaluation using deepeval |Tutorial:127

Total Technology Zonne9 months ago

Navigating RAG Optimization with an Evaluation Driven Compass: Atita Arora and Deanna Emery

Navigating RAG Optimization with an Evaluation Driven Compass: Atita Arora and Deanna Emery

AI Engineer1 year ago

The 3 Stages of RAG Every AI Engineer Gets Wrong

The 3 Stages of RAG Every AI Engineer Gets Wrong

The Cloud Girl1 day ago

Fine-tune your own LLM in 13 minutes, here’s how

Fine-tune your own LLM in 13 minutes, here’s how

David Ondrej2 months ago

Strategies for LLM Evals (GuideLLM, lm-eval-harness, OpenAI Evals Workshop) — Taylor Jordan Smith

Strategies for LLM Evals (GuideLLM, lm-eval-harness, OpenAI Evals Workshop) — Taylor Jordan Smith

AI Engineer4 months ago

7 measurements that help minimize model risk for RAG

7 measurements that help minimize model risk for RAG

IBM Technology1 year ago

Ex-OpenAI Scientist WARNS: "You Have No Idea What's Coming"

Ex-OpenAI Scientist WARNS: "You Have No Idea What's Coming"

AI Upload4 months ago

Lessons from the Trenches: Building LLM Evals That Work IRL: Aparna Dhinkaran

Lessons from the Trenches: Building LLM Evals That Work IRL: Aparna Dhinkaran

AI Engineer10 months ago

Layering every technique in RAG, one query at a time - David Karam, Pi Labs (fmr. Google Search)

Layering every technique in RAG, one query at a time - David Karam, Pi Labs (fmr. Google Search)

AI Engineer4 months ago

RAG vs Agentic AI: How LLMs Connect Data for Smarter AI

RAG vs Agentic AI: How LLMs Connect Data for Smarter AI

IBM Technology1 week ago

Free and Open Source software licenses explained

Free and Open Source software licenses explained

The Linux Experiment3 years ago

Home AiChat Shop Saved Account