Why Fine Tuning is Dead w/Emmanuel Ameisen

Hamel Husain July 1, 2024
Video Thumbnail
Hamel Husain Logo

Hamel Husain

@hamelhusain7140

About

I am a machine learning engineer with over 20 years of experience. I have worked with innovative companies such as Airbnb and GitHub, which included early LLM research used by OpenAI, for code understanding. I have also led and contributed to numerous popular open-source machine-learning tools. I am currently an independent consultant helping companies operationalize Large Language Models (LLMs) to accelerate their AI product journey.

Video Description

Join the AI Evals Course starting Jan 27, 2026: https://maven.com/parlance-labs/evals?promoCode=tf-yt-c4 . Arguments for why fine-tuning has become less useful over time, as well as some opinions as to where the field is going with Emmanuel Ameisen. Slides, notes, and additional resources are here: https://parlance-labs.com/education/fine_tuning/emmanuel.html 00:00: Introduction and Background 01:23: Disclaimers and Opinions 01:53: Main Themes: Trends, Performance, and Difficulty 02:53: Trends in Machine Learning 03:16: Evolution of Machine Learning Practices 06:03: The Rise of Large Language Models (LLMs) 08:18: Embedding Models and Fine-Tuning 11:17: Benchmarking Prompts vs. Fine-Tuning 12:23: Fine-Tuning vs. RAG: A Comparative Analysis 25:03: Adding Knowledge to Models 33:14: Moving Targets: The Challenge of Fine-Tuning 38:10: Essential ML Practices: Data and Engineering 44:43: Trends in Model Prices and Context Sizes 47:22: Future Prospects of Fine-Tuning

You May Also Like

Essential Tuning Tools

AI-recommended products based on this video

Loading...
MULWARK 17pcs Folding Allen Wrench Set | Metric & Standard SAE - Key Tool 2 Pack Portable Hex for Basic Home Repair and General Applications

MULWARK 17pcs Folding Allen Wrench Set | Metric & Standard SAE - Key Tool 2 Pack Portable Hex for Basic Home Repair and General Applications

(4,520)
18.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
3K+ bought in past month
Loading...
AIRROMI A2001 HEPA Air Purifier Replacement Filter, 3-In-1 Original Filter, Remove 99.97% of 0.3 Micron Particle 2 Pack White Activated Carbon

AIRROMI A2001 HEPA Air Purifier Replacement Filter, 3-In-1 Original Filter, Remove 99.97% of 0.3 Micron Particle 2 Pack White Activated Carbon

(105)
31.44
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
100+ bought in past month
Loading...
Carburetor Kit Fit for DXGNR7000 8000 8750 Watt with Spark Plug

Carburetor Kit Fit for DXGNR7000 8000 8750 Watt with Spark Plug

(1)
10.44
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
Loading...
A411000290 C10146 Ignition Coil Kit and Spark Plug Compatible with Echo Shindaiwa Kioritz Mantis Leaf Blower PB-255LN PB-251 ES255 PB265L PB265LN PB251 Replaces A411000291

A411000290 C10146 Ignition Coil Kit and Spark Plug Compatible with Echo Shindaiwa Kioritz Mantis Leaf Blower PB-255LN PB-251 ES255 PB265L PB265LN PB251 Replaces A411000291

(0)
8.49
PrimeFREE delivery Sunday, June 15 on orders shipped by Amazon over $35.
Loading...
Sunzel No Front Seam High Waist Biker Shorts for Women, Squat Proof Yoga Workout Gym Bike Shorts

Sunzel No Front Seam High Waist Biker Shorts for Women, Squat Proof Yoga Workout Gym Bike Shorts

(6,402)
$19.99
FREE delivery Mon, Aug 18 on $35 of items shipped by Amazon
2K+ bought in past month
Loading...
Lamicall Bike Phone Holder, Motorcycle Mount - Motorcycle Phone Holder, Handlebar Cell Phone Clamp, Scooter Phone Clip for iPhone Air 17 Pro Max, 16 15 Pro Max Plus, S20, More 4.7 to 6.8" Smartphones Global Recycled Standard
Best Seller

Lamicall Bike Phone Holder, Motorcycle Mount - Motorcycle Phone Holder, Handlebar Cell Phone Clamp, Scooter Phone Clip for iPhone Air 17 Pro Max, 16 15 Pro Max Plus, S20, More 4.7 to 6.8" Smartphones Global Recycled Standard

(61,683)
$15.99$15.83
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
30K+ bought in past month