Category · 95 repos
Browser Automation & Scraping
Scrapers, crawlers, headless browsers and agents that use the web for you. Ranked by star velocity over the last 24 hours.
Showing 1–50 of 95
Write HTML. Render video. Built for agents.
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
🔥 Supercharge your AI agents with data from the web and beyond. A web data API to search, scrape, and access more sources.
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
Browser automation toolkit for QA, monitoring and internal workflows
Agents that use the browser.
Weighs the soul of incoming HTTP requests to stop AI crawlers
Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!
Official TestSprite CLI — AI-powered automated testing from your terminal
A Claude Code skill to make motion design videos in pure code: HTML + Playwright + ffmpeg. No After Effects, no Remotion license.
Open-source dots for the web: an AI agent with its own browser, one that does not get blocked.
Python API for JMComic | Provides a Python API to access 禁漫天堂, and supports both web and mobile | 禁漫天堂 GitHub Actions downloader 🚀
Open-source, self-hosted AI agent workspace and alternative to OpenAI Dots, Meta Muse, Grok Bot, Instinct, Manus Cue, Claude Cowork, and ChatGPT agent. MIT-licensed; includes chat, connectors, approvals, and optional computer use. Early prototype.
JavaScript in-page GUI agent. Control web interfaces with natural language.
The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
5–10x faster browser operations: Jev clicks, Codex thinks and verifies. Built at EZCollegeApp.
🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.
Let AI agents use your real, logged-in browser without interrupting your work. CLI + extension for browser automation across any shell-capable AI agent.
Make Any Website into CLI & Use your logged-in browser by AI agent.
MCP Server for Computer Use in Windows
Python scraper based on AI
Chromium in your terminal. Vimium navigation, real tabs, Kitty and sixel graphics, and Mouse keys. Linux and macOS.
Kernel-level antidetect browser with the Playwright API you already write. Python + Node SDKs, MCP-ready, unlimited local profiles. Linux x64 + arm64, macOS Intel + Apple Silicon, Windows x64.
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
Next generation e2e testing framework for web and mobile apps.
Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.
Fast, robust Google Flights scraper (API) for Python. (Probably)
Scrape Medium Articles (Including member only stories)
Android in docker solution with noVNC supported, video recording, mcp server and AI-agent
Open-source AI coworkers that each get a computer of their own: a browser, files and tools, with every action decided before it happens and recorded after. Bring any AG-UI agent.
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.
📺 Bilibili site-wide video information crawler.
Captcha solver extension for humans, available for Chrome, Edge and Firefox
A selenium mcp and http workflow client.
TestDino Playwright Skill: AI-powered guides for Playwright best practices, made by testdino.com.
Debloat and harden Brave Browser on Linux, macOS, and Windows using Chromium enterprise policies. Curses TUI on Linux/macOS, native GUI on Windows. 79 policies, 6 presets, zero dependencies.
Library to scrape and clean web pages to create massive datasets.
Stack blocks visually to build complex browser workflows and execute them via API
Forex Factory economic calendar scraper with rule-based pre-event alerts using selenium, sends to Discord, Telegram, and webhooks.
A Chrome sidebar extension that lets DeepSeek Harness control your browser directly, with no vision capabilities required.
Python web scrapers. Current collection: NetEase Cloud Music song scraper, Bilibili video scraper, Zhihu Q&A scraper, wallpaper scraper, xvideos video scraper, audiobook scraper, Weibo scraper, Anjuke information scraper + data visualization, Bilibili video-cover extractor, IP proxy-pool wrapper, large-scale Zhihu user scraper + data analysis, and GitHub user scraper.
Videodl: A lightweight video downloader written in pure Python, prioritizing high-definition, watermark-free downloads. Supports Douyin, Kuaishou, Xiaohongshu, Bilibili, TikTok, YouTube, FIFA+, Youku, Tencent Video, iQIYI, 1905.com, LeTV, Mango TV, Migu, PPTV, Sohu, Facebook, Twitter, Sina Weibo, Toutiao, NetEase Open Courses, 全民K歌, CCTV, Kugou Music MV, Xinpianchang, Zhihu, Baidu Tieba, TED…
Crawlers for Xiaohongshu notes and comments; Douyin videos and comments; Kuaishou videos and comments; Bilibili videos and comments; Weibo posts; Baidu Tieba posts and comments/replies; and Zhihu questions, articles, and comments.
This is a python API which allows you to get the transcript/subtitles for a given YouTube video. It also works for automatically generated subtitles and it does not require an API key nor a headless browser, like other selenium based solutions do!
Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
Not a chatbot. Not a coding assistant. A digital operator that controls your entire PC — 219 tools, screen perception, HID control, browser automation, Office suite, AI media. One sentence in, finished work out.
Selenium WebDriver automation framework built with Java, TestNG, and Page Object Model (POM) for testing the Swag Labs web application.
An agentic playbook for pre-filling the Bangladesh NBR e-Return (etaxnbr.gov.bd) using Opencode (but anything will work) + Playwright MCP: an AI agent walks the return wizard, patches your draft against your own data files, and stops at Save draft — you review, pay, and submit yourself.
Cloudflare Workers proxy IP pool with human-like crawler control.
Local-first CLI for agent skills, browser automation, knowledge bases, external CLIs, and terminal AI chat.