AI的下一步:强化学习是正确的AGI解法吗?|硅谷101年度线下大会|Alignment 2025

硅谷101 November 20, 2025
Video Thumbnail
硅谷101 Logo

硅谷101

@thevalley101

About

驶向未来。 一档深度科技与商业视频栏目,旗下有同名播客。通过对前沿科技及商业的一手视角和深度挖掘,我们希望带来深度有趣的前沿选题。Solid journalism still matters. 联系我们:[email protected]

Video Description

【硅谷101年度线下大会回放】2016年,AlphaGo击败围棋世界冠军,让强化学习一战成名。如今,从推荐算法到自动驾驶,强化学习已成为推动AI向AGI进化的第二引擎。然而,其效率低下与自身缺陷等问题,也遭到了包括OpenAI联合创始人Andrej Karpathy等专家们的质疑。 今年的硅谷101 Alignment大会的强化学习专题论坛上,我们邀请到了来自OpenAI、亚马逊、前Meta以及LinkedIn的四位重量级嘉宾,围绕RLVR(基于可验证奖励的强化学习)、人类反馈数据的“黄金标准”、探索与抽象以及被称为“强化学习之父”的 “OaK” 架构等前沿议题,展开了一场极其坦诚、也极其硬核的讨论。他们眼中强化学习的极限在哪里?最终,AI能否凭借强化学习,走向真正的知识创新? 硅谷101于2025年10月5日在硅谷线下举办的Alignment2025年度科技大会上,不少演讲嘉宾分享了极具价值的观点,我们将会把一些重要观点逐渐整理上线。我们的线下大会是全英文,嘉宾的分享将用中文字幕的方式呈现。 圆桌嘉宾: 朱哲清(主持人):Pokee.ai创始人、前Meta AI应用强化学习负责人 Lihong Li:亚马逊高级首席科学家 Alborz Geramifard:LinkedIn杰出科学家 Zheng Wen:OpenAI技术团队成员、斯坦福大学兼任讲师 你会看到: 00:00 - 05:01 AI时代转折点:强化学习是救命稻草还是低效路径 05:01 - 08:59 RLVR的潜力与局限: 可验证奖励能否突破数学与编程领域 08:59 - 14:24 黄金标准难题:如何平衡低质的人类数据与昂贵的专家标注 14:24 - 19:22 探索的平衡:预训练和后训练如何分工,才能让AI更高效思考 19:22 - 28:18 强化学习之父的OaK架构:将复杂任务拆解成子任务 28:18 - 38:26 强化学习只能在框架内探索,无法创造新的理论 38:26 - 39:45 未来展望:“抽象”与“分层”是强化学习近期的突破口 【关于硅谷101】 我们是由海内外一线媒体记者/主持人创办的栏目,深度解析硅谷创新趋势,以轻松的风格分享科技行业的最新动态。我们采过顶级科技大佬,积累了数万小时的媒体经验,做过调查性报道,操盘过千万级传播量的知名深度稿,引发全国讨论和微博热搜;致力于将最专业的媒体素养和信息搜集能力转化为易传播的新媒体力量。 旗下同名播客栏目:https://www.youtube.com/@valley101podcast 关注我们,从这里驶向未来。 联系我们:[email protected] 【往期精彩视频】 https://www.youtube.com/watch?v=0mrko3cYqBs&t=651s https://www.youtube.com/watch?v=EsaUQNx59vA&t=135s https://www.youtube.com/watch?v=0mrko3cYqBs&t=1499s https://www.youtube.com/watch?v=EUsIYVtt3y0&t=1162s https://www.youtube.com/watch?v=8ndEN6VVlUw&t=778s https://www.youtube.com/watch?v=9RMvKWHgyF8&t=1093s https://www.youtube.com/watch?v=sdsiJAyO4Fw&t=1144s https://www.youtube.com/watch?v=sdsiJAyO4Fw&t=1164s https://www.youtube.com/watch?v=DFyc0rFBptE&t=566s https://www.youtube.com/watch?v=Tzp0EF-sysI&t=364s https://www.youtube.com/watch?v=44skDPOPbgo https://www.youtube.com/watch?v=65TkswVEd5Y&t=422s https://www.youtube.com/watch?v=8uHur4G1ZVI&t=2240s https://www.youtube.com/watch?v=H-G76kecXfY&t=1136s https://www.youtube.com/watch?v=h8FTJxGu_hA&t=704s https://www.youtube.com/watch?v=_f2c0eZ-N7M&t=302s https://www.youtube.com/watch?v=3el8ppdGnSk https://www.youtube.com/watch?v=AGLzjvykebo https://www.youtube.com/watch?v=pdcT2jwXP0s&t https://www.youtube.com/watch?v=2PSCnOFkR3U&t https://www.youtube.com/watch?v=b_OpjUz7zN8 https://www.youtube.com/watch?v=CfxuqbB9dj4&t=2510s https://www.youtube.com/watch?v=Jy5OozI1zMs https://www.youtube.com/watch?v=58bS_-215vI&t=137s https://www.youtube.com/watch?v=sKVVl89pv_0&t=107s https://www.youtube.com/watch?v=PSfdilqMxRM&t=875s https://www.youtube.com/watch?v=LyCv2Dm9A1o&t=1725s https://www.youtube.com/watch?v=lyAP8bRKUJo&t=1472s

You May Also Like

Upgrade Your Everyday

AI-recommended products based on this video

Loading...
Kasa Smart Outdoor Smart Plug by TP-Link (KP400) - Smart WiFi Outlet with 2 Sockets, IP64 Waterproof, Works with Alexa and Google Home, 2.4GHz WiFi Required, No Hub Required, Sunset & Sunrise Offset

Kasa Smart Outdoor Smart Plug by TP-Link (KP400) - Smart WiFi Outlet with 2 Sockets, IP64 Waterproof, Works with Alexa and Google Home, 2.4GHz WiFi Required, No Hub Required, Sunset & Sunrise Offset

(28,846)
$21.99$17.99
FREE delivery Wed, Aug 20 on your first order
1K+ bought in past month
Loading...
Oraolo Open Ear Headphones, Bluetooth 5.4 Wireless Earbuds with Stereo Sound, ENC Clear Call, 21H Playtime, Type-C Charging, Touch Control, IPX6 Waterproof Open Ear Clip-On Earbuds for outdoor workout

Oraolo Open Ear Headphones, Bluetooth 5.4 Wireless Earbuds with Stereo Sound, ENC Clear Call, 21H Playtime, Type-C Charging, Touch Control, IPX6 Waterproof Open Ear Clip-On Earbuds for outdoor workout

(4)
$29.99
FREE delivery Sat, Apr 11 on your first order
50+ bought in past month
Loading...
Open Ear Wireless Earbuds, Sports Bluetooth Headphones with Real Time Translation, 80Hrs Playtime with LED Power Display, Noise Canceling Headset, IP55 Waterproof Earphones for Workout/Running (Black)

Open Ear Wireless Earbuds, Sports Bluetooth Headphones with Real Time Translation, 80Hrs Playtime with LED Power Display, Noise Canceling Headset, IP55 Waterproof Earphones for Workout/Running (Black)

(109)
$79.99
FREE delivery Sat, Apr 11
1K+ bought in past month
Loading...
Wireless Earbuds, Sports Bluetooth Headphones, 80Hrs Playtime Ear Buds with LED Power Display, Noise Canceling Headset, IPX7 Waterproof Earphones for Workout/Running Z(Black)

Wireless Earbuds, Sports Bluetooth Headphones, 80Hrs Playtime Ear Buds with LED Power Display, Noise Canceling Headset, IPX7 Waterproof Earphones for Workout/Running Z(Black)

(3)
$29.99
FREE delivery May 1 - 22
Loading...
Monster Wireless Earbuds Open Ear AC311, Bluetooth 5.4 Open Ear Headphones, Up to 30 Hours Playtimes Bluetooth Ear Earphones with Stereo Sound, Touch Control and IPX5 Waterproof Open Ear Buds

Monster Wireless Earbuds Open Ear AC311, Bluetooth 5.4 Open Ear Headphones, Up to 30 Hours Playtimes Bluetooth Ear Earphones with Stereo Sound, Touch Control and IPX5 Waterproof Open Ear Buds

(2)
$89.99
FREE delivery Fri, Apr 3
Loading...
Brita Stainless Steel Premium Filtering Water Bottle, BPA-Free, Reusable, Insulated, Replaces 300 Plastic Water Bottles, Filter Lasts 2 Months or 40 Gallons, Includes 1 Filter, Carbon - 20 oz.

Brita Stainless Steel Premium Filtering Water Bottle, BPA-Free, Reusable, Insulated, Replaces 300 Plastic Water Bottles, Filter Lasts 2 Months or 40 Gallons, Includes 1 Filter, Carbon - 20 oz.

(2,652)
$81.37$76.36
FREE delivery Sep 29 - Oct 2
Loading...
Simple Modern Filtered Water Bottle | Insulated Stainless-Steel Carbon Filter Travel Water Bottles | Reusable for Clean Drinking Water On The Go | 24oz, Sea Glass Sage

Simple Modern Filtered Water Bottle | Insulated Stainless-Steel Carbon Filter Travel Water Bottles | Reusable for Clean Drinking Water On The Go | 24oz, Sea Glass Sage

(26)
$30.13
FREE delivery Tue, Sep 23 on your first order
Loading...
FITVII Health & Fitness Tracker (Answer/Make Calls), Smart Watch with 24/7 Heart Rate and Blood Pressure, Sleep Tracking Monitor, 120+ Sport Mode Activity Tracker

FITVII Health & Fitness Tracker (Answer/Make Calls), Smart Watch with 24/7 Heart Rate and Blood Pressure, Sleep Tracking Monitor, 120+ Sport Mode Activity Tracker

(198)
$59.99
FREE delivery Sun, Aug 10
100+ bought in past month
Loading...
AYATAHA AYATAHA Smart Watch for Kids, Smartwatch Fitness Tracker for Boys Girls, Children's Activity Watch 37 Sports Modes SMS Notification, HD Full Touchscreen IP67 Waterproof, Blue

AYATAHA AYATAHA Smart Watch for Kids, Smartwatch Fitness Tracker for Boys Girls, Children's Activity Watch 37 Sports Modes SMS Notification, HD Full Touchscreen IP67 Waterproof, Blue

(55)
$41.99
PrimeFREE delivery Sat, Jun 14
Loading...
Iaret Iaret Smart Watch for Women, 1.83" HD Fitness Tracker with 4 Bands, Answer/Make Calls, Heart Rate/Sleep/SpO2/Step Tracking, 100+ Sport Modes, Android/iPhone Compatible Gift (Rose Gold)

Iaret Iaret Smart Watch for Women, 1.83" HD Fitness Tracker with 4 Bands, Answer/Make Calls, Heart Rate/Sleep/SpO2/Step Tracking, 100+ Sport Modes, Android/iPhone Compatible Gift (Rose Gold)

(42)
$59.99
FREE delivery Thu, Jun 19
100+ bought in past month
Loading...
Smart Watch for Men Women 1.8" Fitness Tracker, Bluetooth Call, DIY Dial, Heart Rate Sleep Blood Oxygen Monitor, 100+ Sports Modes, IP68 Waterproof Smartwatch for Android iPhone, Alexa Built-in

Smart Watch for Men Women 1.8" Fitness Tracker, Bluetooth Call, DIY Dial, Heart Rate Sleep Blood Oxygen Monitor, 100+ Sports Modes, IP68 Waterproof Smartwatch for Android iPhone, Alexa Built-in

(980)
$39.99
FREE delivery Sun, Sep 21
300+ bought in past month
Loading...
Hand Warmers 2 Pack, 14000mAh Rechargeable Hand Warmers, Electric Hand Warmer Reusable, Portable Power Bank USB Hand Warmers 4 Levels 8 Heating, Gifts for Raynauds Ski Golf Camping

Hand Warmers 2 Pack, 14000mAh Rechargeable Hand Warmers, Electric Hand Warmer Reusable, Portable Power Bank USB Hand Warmers 4 Levels 8 Heating, Gifts for Raynauds Ski Golf Camping

(683)
$74.08$59.47
FREE delivery Jun 13 - 18
Loading...
Hand Warmers Rechargeable, 10000mAh Electric Heated Gloves Power Bank Portable Graphene Handwarmers Pouch with 3 Levels & Double-Sided Heating for Hunting Camping Golf Xmas Gifts for Women Men Kids

Hand Warmers Rechargeable, 10000mAh Electric Heated Gloves Power Bank Portable Graphene Handwarmers Pouch with 3 Levels & Double-Sided Heating for Hunting Camping Golf Xmas Gifts for Women Men Kids

(651)
$44.99
PrimeFREE delivery Sun, Jun 15
Loading...
2Pack Rechargeable Hand Warmer, 8000mAh Electric Hand Warmer Power Bank, Portable USB-C Hand Warmer for Pocket, Reusable Hand Warmer Up to 8 hrs Each, Warm Gift for Men Women, for Hunting, Camping
Amazon's Choice

2Pack Rechargeable Hand Warmer, 8000mAh Electric Hand Warmer Power Bank, Portable USB-C Hand Warmer for Pocket, Reusable Hand Warmer Up to 8 hrs Each, Warm Gift for Men Women, for Hunting, Camping

(1,128)
$15.99
FREE delivery Sat, Jun 14 on your first order
Loading...
GTOCE Portable Charger,40000mAh Power Bank with 22.5W Fast Charging LED Digital Display Battery Pack with 6 Outputs 2 Inputs, Type C Powerbank Portable Charger for iPhone 16 pro Samsung AirPods,Black

GTOCE Portable Charger,40000mAh Power Bank with 22.5W Fast Charging LED Digital Display Battery Pack with 6 Outputs 2 Inputs, Type C Powerbank Portable Charger for iPhone 16 pro Samsung AirPods,Black

(334)
$42.99
FREE delivery Thu, Oct 16
1K+ bought in past month
Loading...
Monster Sleep Ear200, Wireless in-Ear Headphones, Bluetooth 6.0 Sleep Headphones, with ANC Active Noise Cancellation Designed for Side Sleepers, 30 Hours of bass Stereo Sound.

Monster Sleep Ear200, Wireless in-Ear Headphones, Bluetooth 6.0 Sleep Headphones, with ANC Active Noise Cancellation Designed for Side Sleepers, 30 Hours of bass Stereo Sound.

(10)
$39.99
FREE delivery Tue, Mar 24
Loading...
Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, White

Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, White

(4)
$39.99
FREE delivery Mon, Mar 2
Loading...
Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, Black

Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, Black

(15)
$39.99
FREE delivery Mon, Feb 23
Loading...
Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, Black

Monster Sleep Ear100 Ear Buds, Sleep Earbuds with Stereo Sound, Design for Side Sleeper, 32H Playtime, Bluetooth 6.0, ENC Noise Cancelling, IPX6 Waterproof Mini Headphones, Black

(6)
$39.99
FREE delivery Sat, Dec 27
Loading...
Hydroponics Growing System Indoor Garden - Herb Garden with Grow Light, 15 Pods Stainless Steel Indoor Garden Kit, Auto Timer, Gardening Gift for All Ages

Hydroponics Growing System Indoor Garden - Herb Garden with Grow Light, 15 Pods Stainless Steel Indoor Garden Kit, Auto Timer, Gardening Gift for All Ages

(24)
$206.57$200.61
FREE delivery Jun 13 - 17
Loading...
Umbra Triflora Hanging Planter for Window, Indoor Herb Garden, Set of 5, White/Black

Umbra Triflora Hanging Planter for Window, Indoor Herb Garden, Set of 5, White/Black

(7,808)
$71.52
PrimeFREE delivery Sat, Jun 14
Loading...
Large Hydroponics Growing System 14 Pods, Indoor Herb Garden with LED Grow Light, 5L Water Tank, Hydroponic Grow Kit with 3 Auto-Timers, Rotatable Light Panel and Child Lock for Home School Gardening

Large Hydroponics Growing System 14 Pods, Indoor Herb Garden with LED Grow Light, 5L Water Tank, Hydroponic Grow Kit with 3 Auto-Timers, Rotatable Light Panel and Child Lock for Home School Gardening

(119)
$167.81
FREE delivery Jun 16 - 20
Loading...
Hanging Planter Hanging Plant Holder, 6 Inch 4 Indoor Plant Pots, Wall/Window Plant Hanger Indoor Herb Garden

Hanging Planter Hanging Plant Holder, 6 Inch 4 Indoor Plant Pots, Wall/Window Plant Hanger Indoor Herb Garden

(269)
$35.99$28.90
PrimeFREE delivery Sat, Jun 14
Loading...
slopehill Multi Hair Stylers & Hair Straightener - 2 in 1 Wet to Dry Air Straightener and Hair Dryer Combo with High Speed Air + Rapid Heat-Up + Customizable Temperature(Pink)

slopehill Multi Hair Stylers & Hair Straightener - 2 in 1 Wet to Dry Air Straightener and Hair Dryer Combo with High Speed Air + Rapid Heat-Up + Customizable Temperature(Pink)

(177)
$139.99
Prime
Loading...
Hi.FANCY Portable Laptop Stand with Dual Cooling Fans for 14-17inch Laptops, Grey, 23.5 x 25.9 x 0.95cm

Hi.FANCY Portable Laptop Stand with Dual Cooling Fans for 14-17inch Laptops, Grey, 23.5 x 25.9 x 0.95cm

(0)
$36.99
FREE delivery Aug 18 - 28
Loading...
Laptop Stand for Desk, Adjustable Laptop Riser ABS+Silicone Foldable Portable Laptop Holder, Ventilated Cooling Notebook Stand for 10-15.6” Laptops,Tablet-Black

Laptop Stand for Desk, Adjustable Laptop Riser ABS+Silicone Foldable Portable Laptop Holder, Ventilated Cooling Notebook Stand for 10-15.6” Laptops,Tablet-Black

(11,679)
$14.99
FREE delivery Sat, Jun 14 on your first order
500+ bought in past month
Loading...
JETech 5 in 1 Case for Samsung Galaxy S25 Ultra 5G with 2-Pack Each Tempered Glass Screen Protector and Camera Lens Protector, Non-Yellowing Shockproof Bumper Phone Cover (Clear)

JETech 5 in 1 Case for Samsung Galaxy S25 Ultra 5G with 2-Pack Each Tempered Glass Screen Protector and Camera Lens Protector, Non-Yellowing Shockproof Bumper Phone Cover (Clear)

(197)
$15.99
FREE delivery Sat, Jun 14 on your first order
100+ bought in past month
Loading...
TAURI for iPhone 17 Pro Max Case 6.9" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard

TAURI for iPhone 17 Pro Max Case 6.9" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard

(0)
$10.76
FREE delivery Thu, Oct 16 on your first order
2K+ bought in past month
Loading...
TAURI for iPhone 17 Pro Case 6.3" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard
Best Seller

TAURI for iPhone 17 Pro Case 6.3" with 1-Pack Screen Protector, Camera Lens Full Protection, Military-Grade Protection, Shockproof Transparent Back Bumper Phone Cover - Clear Global Recycled Standard

(61,696)
$10.76
Prime
2K+ bought in past month
Loading...
JOINPAYA 1Set Rechargeable Hand Warmer Hand Heater for Winter Heating Levels Compact

JOINPAYA 1Set Rechargeable Hand Warmer Hand Heater for Winter Heating Levels Compact

(0)
$9.29
FREE delivery Jun 20 - Jul 4
Loading...
Shakven Rechargeable Hand Warmer | Cute Comfortable Portable Hand Warmers,Ergonomic Adjustable Energy-Efficient Small Heater for Travel, Outdoor, Winter

Shakven Rechargeable Hand Warmer | Cute Comfortable Portable Hand Warmers,Ergonomic Adjustable Energy-Efficient Small Heater for Travel, Outdoor, Winter

(0)
$26.93
FREE delivery Jun 19 - Jul 2
Loading...
OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

(50)
$39.99
PrimeFREE delivery Sat, Jun 14
Loading...
OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

OCOOPA IP45 Waterproof Hand Warmer Rechargeable, Up to 15hrs Heat,10000mAh Durable Quick Charge Electric Hand Heater, PD Compatible, 3 Levels for Outdoors, Heavy Duty, H01-PD PRO

(649)
$39.99
PrimeFREE delivery Sat, Jun 14