How I Scrape multiple pages on Amazon with Python, Requests & BeautifulSoup

Video Description

In this video I will demonstrate one of the ways to deal with the pagination when scraping the amazon website. We check to see if the next button is availabe then collect the url from it, and using our functions, move to scrape the next page. this works well as we can let it run and collect all the pages without having to add a number to the url each time. This method would also work for other websites that have a similar style of pagination code: https://github.com/jhnwr/amazon-pagination Digital Ocean (Affiliate Link) - https://m.do.co/c/c7c90f161ff6 ------------------------------------- Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases ------------------------------------- Sound like me: microphone https://amzn.to/36TbaAW mic arm https://amzn.to/33NJI5v audio interface https://amzn.to/2FlnfU0 ------------------------------------- Video like me: webcam https://amzn.to/2SJHopS camera https://amzn.to/3iVIJol lights https://amzn.to/2GN7INg ------------------------------------- PC Stuff: case: https://amzn.to/3dEz6Jw psu: https://amzn.to/3kc7SfB cpu: https://amzn.to/2ILxGSh mobo: https://amzn.to/3lWmxw4 ram: https://amzn.to/31muxPc gfx card https://amzn.to/2SKYraW 27" monitor https://amzn.to/2GAH4r9 24" monitor (vertical) https://amzn.to/3jIFamt dual monitor arm https://amzn.to/3lyFS6s mouse https://amzn.to/2SH1ssK keyboard https://amzn.to/2SKrjQA