crawlProject
A collection of Python scraping projects, from the basics to JS reverse engineering, covering fundamentals, automation, advanced topics and CAPTCHAs. Cases span major sites (xhs, douyin, weibo, ins, boss, job, jd...), teaching scraping, anti-scraping, automation and CAPTCHA know-how.
Translated from Chinese · show originalhide original
python爬虫项目合集，从基础到js逆向，包含基础篇、自动化篇、进阶篇以及验证码篇。案例涵盖各大网站(xhs douyin weibo ins boss job，jd...)，你将会学到有关爬虫以及反爬虫、自动化和验证码的各方面知识
- playwright
- python
- python-crawler
- reverse-engineering
- captcha
- ddddocr
- javascript
- Stars
- 1,800
- Forks
- 344
- + today
- +1
- Created
- 3y
Ranking data as of October 21, 2026 (UTC).
Star History
Today, hour by hour
Overview
A collection of Python scraping projects, from the basics to JS reverse engineering, covering fundamentals, automation, advanced topics and CAPTCHAs. Cases span major sites (xhs, douyin, weibo, ins, boss, job, jd...), teaching scraping, anti-scraping, automation and CAPTCHA know-how. It ranks #3378 on GitTiger, gaining +1 star on October 21, 2026 (UTC).
The project is written in JavaScript and has 344 forks. It was created 3y ago.
git clone https://github.com/xishandong/crawlProject.git
cd crawlProject
# see README for setup