Supercharge Your Scraper With ASYNC (here's how)

John Watson Rooney May 21, 2023
Video Thumbnail

About

No channel description available.

Video Description

Check out ScrapingBee for youself here: https://www.scrapingbee.com/?utm_source=youtube&utm_medium=link&utm_campaign=jwrooney Async can make your code way more efficient by allowing it to do extra work inbetween waiting for requests and responses. In this video I will show you how to implement async into a web scraper and drastically reduce the time taken to scrape 1000 pages of data. https://github.com/jhnwr/youtube/tree/main/synctoasync original code video: https://youtu.be/iRR-kv-3u_c # Scraper API https://www.scrapingbee.com/?fpr=jhnwr # Patreon: https://www.patreon.com/johnwatsonrooney # Donations: https://www.paypal.com/donate/?hosted_button_id=7HNSFPRR9N63Y # Hosting: Digital Ocean: https://m.do.co/c/c7c90f161ff6 # Gear I use: https://www.amazon.co.uk/shop/johnwatsonrooney

Essential Drone Accessories

AI-recommended products based on this video

Loading...
SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

(3)
$44.99
FREE delivery Thu, Jun 19
Loading...
NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

(24)
$25.99
FREE delivery Thu, Jun 19 on your first order
Loading...
SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

(85)
$38.24
FREE delivery Thu, Jun 19
Loading...
SanDisk 64GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXU-064G-GN4IN

SanDisk 64GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXU-064G-GN4IN

(71,074)
$21.99$16.59
FREE delivery Sun, Aug 10 on your first order
500+ bought in past month
Loading...
SanDisk 128GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXD-128G-GN4IN
Best Seller

SanDisk 128GB Extreme PRO SDXC UHS-I Memory Card - C10, U3, V30, 4K UHD, SD Card - SDSDXXD-128G-GN4IN

(71,074)
$29.99$26.61
FREE delivery Sun, Aug 10 on your first order
4K+ bought in past month
Loading...
Kids Makeup Kit Girls Toys,Washable Makeup Kit Real Cosmetic,Princess Little Girls Makeup Set Kids Toys for 3 4 5 6 7+ Year Old Girls Christmas Birthday Gifts

Kids Makeup Kit Girls Toys,Washable Makeup Kit Real Cosmetic,Princess Little Girls Makeup Set Kids Toys for 3 4 5 6 7+ Year Old Girls Christmas Birthday Gifts

(494)
$25.99
FREE delivery Sat, Jun 14 on your first order
400+ bought in past month
Loading...
3 4 5 Year Old Girl Gifts, Exssary Kids Knife Set for Real Cooking Toys for 3 4 5 6-8 Year Old Girls Montessori Toddler Kitchen Tools Cutting Board Knives Birthday Gift Girls Toys Age 4-6 7-10 Pink

3 4 5 Year Old Girl Gifts, Exssary Kids Knife Set for Real Cooking Toys for 3 4 5 6-8 Year Old Girls Montessori Toddler Kitchen Tools Cutting Board Knives Birthday Gift Girls Toys Age 4-6 7-10 Pink

(68)
$23.79
FREE delivery Sat, Jun 14 on your first order
100+ bought in past month
Loading...
Zilink Dance Costume Garment Bags 40 inch Clothes Bags with Zipper Pockets and Handles, Hanging Garment Bag for Dance Competition, Travel, Set of 3

Zilink Dance Costume Garment Bags 40 inch Clothes Bags with Zipper Pockets and Handles, Hanging Garment Bag for Dance Competition, Travel, Set of 3

(413)
$36.79
PrimeFREE delivery Sat, Jun 14
Loading...
AMVR Lens Protector Set Compatible with Meta/Oculus Quest 3 Accessories,Glasses Spacer for Quest 3 Lenses,Soft Silicone Rings Protect Prescription Glasses

AMVR Lens Protector Set Compatible with Meta/Oculus Quest 3 Accessories,Glasses Spacer for Quest 3 Lenses,Soft Silicone Rings Protect Prescription Glasses

(316)
$37.99
FREE delivery Tue, Jun 17
Loading...
SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

SmallRig ZV-E1 Camera Baseplate for Sony ZV-E1, Built-in Cold Shoe Mount and QR Plate (for Arca) Quick Switch Between Tripod and Stabilizer for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro - 4314

(3)
$44.99
FREE delivery Thu, Jun 19
Loading...
NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

NEEWER a6700 L Plate Compatible with Sony Alpha 6700, Quick Switch Aluminum Extendable Side Plate & Anti Twist Baseplate Compatible with Arca Swiss QR System DJI RS 2 RSC 2 RS 3 Pro Gimbals, CA048

(24)
$25.99
FREE delivery Thu, Jun 19 on your first order
Loading...
SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

SmallRig Baseplate for Sony Alpha 6700, Bottom Mount Plate Built-in Quick Release Plate for Arca, Supporting Quick Switch Between Tripod and Stabilizer (for DJI RS 2 / RSC 2 / RS 3 / RS 3 Pro) - 4338

(85)
$38.24
FREE delivery Thu, Jun 19