Web Scraping NEWS Articles with Python

Video Description

How I go about web scraping new articles, in this case from Google news. The page is of course dynamically loaded but we can use requests_html to render the page for us and allow us access to the elements and their data. I run through a short example of how this works and point out some pitfalls along the way. Code: https://github.com/jhnwr/webscrapenewsarticles ------------------------------------- twitter https://twitter.com/jhnwr code editor https://code.visualstudio.com/ WSL2 (linux on windows) https://docs.microsoft.com/en-us/windows/wsl/install-win10 ------------------------------------- Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases mouse https://amzn.to/2SH1ssK 27" monitor https://amzn.to/2GAH4r9 24" monitor (vertical) https://amzn.to/3jIFamt dual monitor arm https://amzn.to/3lyFS6s microphone https://amzn.to/36TbaAW mic arm https://amzn.to/33NJI5v audio interface https://amzn.to/2FlnfU0 keyboard https://amzn.to/2SKrjQA lights https://amzn.to/2GN7INg webcam https://amzn.to/2SJHopS camera https://amzn.to/3iVIJol gfx card https://amzn.to/2SKYraW ssd https://amzn.to/3lAjMAy