Unlimited private web-scraping for AI Agents | AnythingLLM

Video Description

Hey everyone, Today we release [AnythingLLM Desktop 1.8.3](https://anythingllm.com/desktop), which includes our new **Authenticated Web Scraper** tool. Now, your AI agents are not just limited to the **public** internet. They can now also access authenticated, paywalled, or password-protected content that you can already access in a normal browser. Scraping the "private web" often has the most contextually personalized and relevant information for agents. Short of custom solutions and a ton of code, there is no simple way to do this until AnythingLLM Authenticated Web Scraping! Now, the internet is truly an untapped source of AI knowledge, but even a step further by being able to use the internet as you do. AnythingLLM Desktop Download: https://anythingllm.com/desktop AnythingLLM Github: https://github.com/Mintplex-Labs/anything-llm AnythingLLM Mobile Beta: https://anythingllm.com/mobile. **Chapters** 0:00 Introduction of AnythingLLM 0:36 Web Scraping + AI tools as of today 1:50 The big issue with Web Scraping today 2:00 About AnythingLLM Authenticate Web Scraping 3:28 Let's just run an example with my LinkedIn account 7:00 Authenticated Web Scraping works EVERYWHERE! 7:41 Conclusions and the future of AnythingLLM Desktop