Group Relative Policy Optimization (GRPO) - Formula and Code

Deep Learning with Yacine • February 5, 2025

Deep Learning with Yacine

View Channel

About

Deep learning project and theory videos every week! 👺

Latest Posts

What are RLVR environments for LLMs? | Policy - Rollouts - Rubrics

Deep Learning with Yacine

Master GRPO with These Essentials

AI-recommended products based on this video

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

(22)

$423.35

FREE delivery Oct 8 - 10

Laptop Sleeve Case 11–14 Inch MacBook Air MacBook Pro Surface Laptop Dell XPS 13 HP Envy Pavilion Lenovo Yoga Slim IdeaPad Acer Swift Chromebook Samsung Galaxy Book Shockproof Leather Bag Colour Blue

(98)

$81.45

Charger for Dell Computer Inspiron XPS Laptop 65W 45W Power Supply AC Adapter for Dell-Inspiron 15-3000 15-5000 15-7000 11-3000 13-5000 13-7000 17-5000 XPS 13 Series 5559 5558 5755 5758 Laptop Charger

(621)

$21.99

FREE delivery Sun, Aug 24 on your first order

100+ bought in past month

tomtoc 360° Protective Laptop Sleeve for 15-inch MacBook Air M4/A3241 2025, M3/A3114 2024, M2/A2941 2023, 15-inch MacBook Pro A1990 A1707, Dell XPS 15 Plus Laptop, Water-Resistant Computer Case Bag Global Recycled Standard

(12,968)

$39.55

FREE delivery Tue, Jun 17

Replacement for Dell 130W Laptop Charger USB C - XPS 17 15 7590 9700 9500 9510 Precision 5560 3560 5540 5570 5550 3561 3550 5510 5520 Latitude 7410 7310 7210 Type C Computer AC Adapter Power Cord

(1,131)

$45.98

FREE delivery Sun, Aug 24

100+ bought in past month

Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code

(382)

$94.95

PrimeFREE delivery Sat, Jun 14

Google Pixel Buds Pro 2 - Noise Canceling Earbuds - Up to 31 Hour Battery Life with Charging Case - Bluetooth Headphones - Compatible with Android - Hazel

(183)

199.99

PrimeFREE delivery Saturday, June 14

400+ bought in past month

Best Seller

Deeyaple USB C to Aux, 4FT/1.2M, Type C to 3.5mm Audio Cable Headphone Jack Cable for Car Mobile Phone, iPhone 16 15, iPad Pro, Samsung Galaxy S24 S23 S2010, Google Pixel,Oneplus Grey (1)

(78)

$6.99

FREE delivery Fri, Sep 5 on your first order

1K+ bought in past month

Car Carplay Woven Cable for iPhone 16 15 3.3FT USB A to USB C 3.2 Gen 2 Carplay Adapter Wire for iPhone 16 15 Pro Max, iPad Pro/Air, Samsung Galaxy S25/S24/S23/S22/S21 Google Pixel, Car Charger Cable

(213)

$12.99

FREE delivery Sat, Jun 14 on your first order

100+ bought in past month

Casio FX300MSPLUS2 Engineering/Scientific Calculator

(1,541)

$12.99$12.49

FREE delivery Mon, Sep 15 on your first order

4K+ bought in past month

Monster N-Lite 211 Wireless Earbuds， Bluetooth 6.0 Stereo Headphones with Noise-Cancelling Mic and LED Display, Built-in Mic for Clear Calls, Waterproof Design for Sports

(8)

$39.99

FREE delivery Tue, Nov 4

Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Powerful Bass, Built-in Noise-Cancelling Mic for Clear Calls, LED Display, 36H Playtime, IPX5 Waterproof Design for Sports

(40)

$39.99

FREE delivery Thu, Nov 13

HLDIRECT 47 Inch Gaming Desk with LED Lights, Home Office Gamer Desk, Ergonomic Computer Table with Large Carbon Fiber Desktop, Computer Desk with Cup Holder & Headphone Hook for Home Office, Black

(591)

$107.99

FREE delivery Thu, Jun 26

FOYTOKI 2 Sets Rechargeable Hand Warmers Portable with Temperature Levels Ergonomic Design for School Office

(0)

$14.15

FREE delivery Jul 2 - 22

Best Seller

IMGadgets 47 x 24 Inches Height Adjustable Electric Standing Desk 2024, 5th Gen Quieter Motor Ergonomic Sit Stand Up Home Office Computer Desk with Height Memory Buttons, Display, 2 Headphone Holders

(438)

$169.95

FREE delivery Thu, Jun 26

200+ bought in past month

SEVEN WARRIOR Gaming Desk with LED Lights & Power Outlets, 55" Computer Desk with Monitor Shelf, Home Office Desk with Cup Holder and Headphone Hook, Ergonomic, Carbon Fiber Surface Black

(693)

$109.99

FREE delivery Thu, Jun 26

Group Relative Policy Optimization (GRPO) - Formula and Code

Deep Learning with Yacine

About

Latest Posts

What are RLVR environments for LLMs? | Policy - Rollouts - Rubrics

You May Also Like

Master GRPO with These Essentials

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 &amp; PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super &amp; AMD GPU Compatible

Laptop Sleeve Case 11–14 Inch MacBook Air MacBook Pro Surface Laptop Dell XPS 13 HP Envy Pavilion Lenovo Yoga Slim IdeaPad Acer Swift Chromebook Samsung Galaxy Book Shockproof Leather Bag Colour Blue

Charger for Dell Computer Inspiron XPS Laptop 65W 45W Power Supply AC Adapter for Dell-Inspiron 15-3000 15-5000 15-7000 11-3000 13-5000 13-7000 17-5000 XPS 13 Series 5559 5558 5755 5758 Laptop Charger

tomtoc 360° Protective Laptop Sleeve for 15-inch MacBook Air M4/A3241 2025, M3/A3114 2024, M2/A2941 2023, 15-inch MacBook Pro A1990 A1707, Dell XPS 15 Plus Laptop, Water-Resistant Computer Case Bag Global Recycled Standard

Replacement for Dell 130W Laptop Charger USB C - XPS 17 15 7590 9700 9500 9510 Precision 5560 3560 5540 5570 5550 3561 3550 5510 5520 Latitude 7410 7310 7210 Type C Computer AC Adapter Power Cord

Freenove Ultimate Starter Kit for BBC micro bit (V2 Included), 316-Page Detailed Tutorial, 225 Items, 44 Projects, Blocks and Python Code

Google Pixel Buds Pro 2 - Noise Canceling Earbuds - Up to 31 Hour Battery Life with Charging Case - Bluetooth Headphones - Compatible with Android - Hazel

Deeyaple USB C to Aux, 4FT/1.2M, Type C to 3.5mm Audio Cable Headphone Jack Cable for Car Mobile Phone, iPhone 16 15, iPad Pro, Samsung Galaxy S24 S23 S2010, Google Pixel,Oneplus Grey (1)

Car Carplay Woven Cable for iPhone 16 15 3.3FT USB A to USB C 3.2 Gen 2 Carplay Adapter Wire for iPhone 16 15 Pro Max, iPad Pro/Air, Samsung Galaxy S25/S24/S23/S22/S21 Google Pixel, Car Charger Cable

Casio FX300MSPLUS2 Engineering/Scientific Calculator

Monster N-Lite 211 Wireless Earbuds， Bluetooth 6.0 Stereo Headphones with Noise-Cancelling Mic and LED Display, Built-in Mic for Clear Calls, Waterproof Design for Sports

Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Powerful Bass, Built-in Noise-Cancelling Mic for Clear Calls, LED Display, 36H Playtime, IPX5 Waterproof Design for Sports

HLDIRECT 47 Inch Gaming Desk with LED Lights, Home Office Gamer Desk, Ergonomic Computer Table with Large Carbon Fiber Desktop, Computer Desk with Cup Holder &amp; Headphone Hook for Home Office, Black

FOYTOKI 2 Sets Rechargeable Hand Warmers Portable with Temperature Levels Ergonomic Design for School Office

IMGadgets 47 x 24 Inches Height Adjustable Electric Standing Desk 2024, 5th Gen Quieter Motor Ergonomic Sit Stand Up Home Office Computer Desk with Height Memory Buttons, Display, 2 Headphone Holders

SEVEN WARRIOR Gaming Desk with LED Lights &amp; Power Outlets, 55&quot; Computer Desk with Monitor Shelf, Home Office Desk with Cup Holder and Headphone Hook, Ergonomic, Carbon Fiber Surface Black

Loading...

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

HLDIRECT 47 Inch Gaming Desk with LED Lights, Home Office Gamer Desk, Ergonomic Computer Table with Large Carbon Fiber Desktop, Computer Desk with Cup Holder & Headphone Hook for Home Office, Black

SEVEN WARRIOR Gaming Desk with LED Lights & Power Outlets, 55" Computer Desk with Monitor Shelf, Home Office Desk with Cup Holder and Headphone Hook, Ergonomic, Carbon Fiber Surface Black