web-scraper

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

🔥 Supercharge your AI agents with data from the web and beyond. A web data API to search, scrape, and access more sources.

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust