Training AI Without Writing A Reward Function, with Reward Modelling

Robert Miles AI Safety December 13, 2019
Video Thumbnail
Robert Miles AI Safety  Logo

Robert Miles AI Safety

View Channel

About

Videos about Artificial Intelligence Safety Research, for everyone. AI is leaping forward right now, it's only a matter of time before we develop true Artificial General Intelligence, and there are a lot of different ways that this could go badly wrong for us. Putting aside the science fiction, this channel is about AI Safety research - humanity's best attempt to foresee the problems AI might pose and work out ways to ensure that our AI developments are safe and beneficial.

You May Also Like

Essential Drone Accessories Kit

AI-recommended products based on this video

Loading...
SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

(3)
$44.99
FREE delivery Thu, Jun 19
Loading...
NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

(24)
$25.99
FREE delivery Thu, Jun 19 on your first order
Loading...
SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

(85)
$38.24
FREE delivery Thu, Jun 19
Loading...
NAFYRE N11 PRO GPS Drone with Camera for Adults 4K UHD, 90 Min Long Flight Time, Long Control Range, Auto Return, Follow Me, Brushless Motor, 5G FPV RC Quadcopter for Beginners

NAFYRE N11 PRO GPS Drone with Camera for Adults 4K UHD, 90 Min Long Flight Time, Long Control Range, Auto Return, Follow Me, Brushless Motor, 5G FPV RC Quadcopter for Beginners

(108)
$149.98
FREE delivery Wed, Aug 20
100+ bought in past month
Loading...
Frizzlife M3005 Replacement Filter Cartridge Set (4 Pack) for SK99,SP99,SK99 New and SP99 New Under Sink Water Filter System

Frizzlife M3005 Replacement Filter Cartridge Set (4 Pack) for SK99,SP99,SK99 New and SP99 New Under Sink Water Filter System

(1,648)
$69.99
FREE delivery Tue, Sep 23
200+ bought in past month
Loading...
Amztabler Small Standing Desk Adjustable Height, Mobile Stand Up Desk with Wheels, 32 Inch Portable Rolling Desks for Walking Pad Treadmill White1

Amztabler Small Standing Desk Adjustable Height, Mobile Stand Up Desk with Wheels, 32 Inch Portable Rolling Desks for Walking Pad Treadmill White1

(1,495)
$89.99
FREE delivery Thu, Jun 26
400+ bought in past month
Loading...
(1 Pack) Slim Jaro Keto Capsules – SlimJaro Pills Health Overall Wellness, All - Natural Extra Strength, SlimJaro Keto Capsule Reviews, 60 Capsules

(1 Pack) Slim Jaro Keto Capsules – SlimJaro Pills Health Overall Wellness, All - Natural Extra Strength, SlimJaro Keto Capsule Reviews, 60 Capsules

(0)
$39.95
FREE delivery Jun 19 - Jul 2
Loading...
Dark Purple Braiding Hair Pre Stretched Yaki Straight 2 Packs 90g/Pack Extra Long Hair Extensions Crochet Braids 26 Inch/66 CM

Dark Purple Braiding Hair Pre Stretched Yaki Straight 2 Packs 90g/Pack Extra Long Hair Extensions Crochet Braids 26 Inch/66 CM

(9)
$23.39
FREE delivery Thu, Nov 6 on your first order
600+ bought in past month
Loading...
KOOTION 128GB Micro SD Card 2 Pack Micro SDXC UHS-I High Speed up to 90MB/s TF Card 128GB Card Memory U3,A1,V30, Full HD Video for Drone/Smartphone/Camera/Dash Cam/PC/Tablet

KOOTION 128GB Micro SD Card 2 Pack Micro SDXC UHS-I High Speed up to 90MB/s TF Card 128GB Card Memory U3,A1,V30, Full HD Video for Drone/Smartphone/Camera/Dash Cam/PC/Tablet

(1,370)
$20.89
FREE delivery Sun, Aug 10 on your first order
300+ bought in past month
Loading...
SanDisk 128GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXD-128G-GN4IN
Best Seller

SanDisk 128GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXD-128G-GN4IN

(71,074)
$29.99$26.61
FREE delivery Sun, Aug 10 on your first order
4K+ bought in past month
Loading...
KOOTION 5-Pack 128GB Micro SD Card Class 10 Micro-SDXC Memory Card UHS-I, High Speed Flash TF Card for Security Camera/Smartphone/Drone/Dash Cam/Tablet/PC, C10, U1, 128GB 5Pack

KOOTION 5-Pack 128GB Micro SD Card Class 10 Micro-SDXC Memory Card UHS-I, High Speed Flash TF Card for Security Camera/Smartphone/Drone/Dash Cam/Tablet/PC, C10, U1, 128GB 5Pack

(6,435)
$45.75
FREE delivery Sun, Aug 10
100+ bought in past month
Loading...
Lexar 128GB Micro SD Card, microSDXC UHS-I Flash Memory Card with Adapter - Up to 100MB/s, A1, U3, Class10, V30, High Speed TF Card

Lexar 128GB Micro SD Card, microSDXC UHS-I Flash Memory Card with Adapter - Up to 100MB/s, A1, U3, Class10, V30, High Speed TF Card

(26,884)
$18.99
FREE delivery Wed, Aug 20 on your first order
5K+ bought in past month
Loading...
daydayup Hestia Goods Switch Case and Tempered Glass Screen Protector for Nintendo Switch - Deluxe Hard Shell Travel Carrying Case, Pouch Case for Nintendo Switch Console & Accessories, Streak Red

daydayup Hestia Goods Switch Case and Tempered Glass Screen Protector for Nintendo Switch - Deluxe Hard Shell Travel Carrying Case, Pouch Case for Nintendo Switch Console & Accessories, Streak Red

(6,078)
$18.59
FREE delivery Sun, Jun 15 on your first order
100+ bought in past month
Loading...
Daydayup Switch Carrying Case Compatible with Nintendo Switch/Switch OLED, with 20 Games Cartridges Protective Hard Shell Travel Carrying Case Pouch for Console & Accessories, Black
Amazon's Choice

Daydayup Switch Carrying Case Compatible with Nintendo Switch/Switch OLED, with 20 Games Cartridges Protective Hard Shell Travel Carrying Case Pouch for Console & Accessories, Black

(33,370)
$19.99
FREE delivery Sun, Jun 15 on your first order
300+ bought in past month
Loading...
Switch Carrying Case for Nintendo Switch 2 (2025), Hard Shell Travel Carry Case with Pockets for Accessories and Games, Protective Travel Bag for Switch Holds 10 Game Cartridge Black

Switch Carrying Case for Nintendo Switch 2 (2025), Hard Shell Travel Carry Case with Pockets for Accessories and Games, Protective Travel Bag for Switch Holds 10 Game Cartridge Black

(32)
$34.99
FREE delivery Sun, Jun 15 on your first order
Loading...
Carrying Case for Nintendo Switch,Travel Carry Cover Hard Shell Storage for Leaf Crossing NS Console and Accessories,Slim Protective Portable Travel Pouch Bag with 10 Game Card Slots for Girls Boys

Carrying Case for Nintendo Switch,Travel Carry Cover Hard Shell Storage for Leaf Crossing NS Console and Accessories,Slim Protective Portable Travel Pouch Bag with 10 Game Card Slots for Girls Boys

(5,125)
$18.99
FREE delivery Sun, Jun 15 on your first order
Loading...
Long Range Super Endurance Foldable Drone with Camera for Beginners–36+ min Flight Time, WiFi FPV Quadcopter with 2K HD Camera, Brushless Motor, Auto Hover, Follow Me (2 Batteries)

Long Range Super Endurance Foldable Drone with Camera for Beginners–36+ min Flight Time, WiFi FPV Quadcopter with 2K HD Camera, Brushless Motor, Auto Hover, Follow Me (2 Batteries)

(206)
$88.98
FREE delivery Sun, Nov 30
1K+ bought in past month
Loading...
Super Enduring Brushless Motor Drone with Camera for Beginners, CHUBORY A68 WiFi FPV Quadcopter with 2K HD Camera, Auto Hover, 3D Flips, Headless Mode, Trajectory Flight

Super Enduring Brushless Motor Drone with Camera for Beginners, CHUBORY A68 WiFi FPV Quadcopter with 2K HD Camera, Auto Hover, 3D Flips, Headless Mode, Trajectory Flight

(1,063)
$89.99
FREE delivery Wed, Aug 20
Loading...
Brushless Super Endurance Foldable Drone for Beginners 35+ mins Flight Time Drone with 90° Wide-Angle 2K HD Camera, Follow me, Dual Cameras, Auto Hover and Trajectory Flight(3 Batteries)

Brushless Super Endurance Foldable Drone for Beginners 35+ mins Flight Time Drone with 90° Wide-Angle 2K HD Camera, Follow me, Dual Cameras, Auto Hover and Trajectory Flight(3 Batteries)

(0)
$199.99
PrimeFREE delivery Sun, Jun 15
Loading...
Memory Card Reader, BENFEI 4in1 USB 3.0 and USB-C to SD Micro SD MS CF Card Reader Adapter, 4 Cards Simultaneously Read and Write, Compatible with iPhone 15 Series, MacBook Pro/Air 2023, and More
Best Seller

Memory Card Reader, BENFEI 4in1 USB 3.0 and USB-C to SD Micro SD MS CF Card Reader Adapter, 4 Cards Simultaneously Read and Write, Compatible with iPhone 15 Series, MacBook Pro/Air 2023, and More

(28,840)
$13.99
FREE delivery Sun, Aug 10 on your first order
5K+ bought in past month
Loading...
Brushless Super Endurance Foldable Drone for Beginners 35+ mins Flight Time Drone with 90° Wide-Angle 2K HD Camera, Follow me, Dual Cameras, Auto Hover and Trajectory Flight(3 Batteries)

Brushless Super Endurance Foldable Drone for Beginners 35+ mins Flight Time Drone with 90° Wide-Angle 2K HD Camera, Follow me, Dual Cameras, Auto Hover and Trajectory Flight(3 Batteries)

(0)
$199.99
PrimeFREE delivery Sun, Jun 15
Loading...
Super Enduring Brushless Motor Drone with Camera for Beginners, CHUBORY A68 WiFi FPV Quadcopter with 2K HD Camera, Auto Hover, 3D Flips, Headless Mode, Trajectory Flight

Super Enduring Brushless Motor Drone with Camera for Beginners, CHUBORY A68 WiFi FPV Quadcopter with 2K HD Camera, Auto Hover, 3D Flips, Headless Mode, Trajectory Flight

(1,063)
$89.99
FREE delivery Wed, Aug 20
Loading...
FERIETELF Drone with Camera - T26 RC Drones for Adults with 1080P HD Live Video, FPV Drone with 24mins Flight/Altitude Hold/Headless Mode/Gravity Sensor for Kids Beginners

FERIETELF Drone with Camera - T26 RC Drones for Adults with 1080P HD Live Video, FPV Drone with 24mins Flight/Altitude Hold/Headless Mode/Gravity Sensor for Kids Beginners

(13)
$99.99
PrimeFREE delivery Sat, Jun 14
Loading...
NAFYRE N11 PRO GPS Drone with Camera for Adults 4K UHD, 90 Min Long Flight Time, Long Control Range, Auto Return, Follow Me, Brushless Motor, 5G FPV RC Quadcopter for Beginners

NAFYRE N11 PRO GPS Drone with Camera for Adults 4K UHD, 90 Min Long Flight Time, Long Control Range, Auto Return, Follow Me, Brushless Motor, 5G FPV RC Quadcopter for Beginners

(108)
$149.98
FREE delivery Wed, Aug 20
100+ bought in past month