祀梦 07248ff4ee feat(crawl): browser-like headers, HTTP/2, curl_cffi TLS fingerprint fallback ...

- get_headers(url): Referer, Sec-Fetch-*, sec-ch-ua, API vs HTML Accept
- httpx AsyncClient/ sync Client with optional HTTP/2 (h2 extra)
- On 403/429/503/520-523/525/567 or request errors, retry via curl_cffi chrome124 impersonate
- POST: Origin, Referer, Content-Type for form posts
- kuaidaili/ip3366: forward get_headers(url=...)

Made-with: Cursor

2026-04-05 14:40:36 +08:00

..

__init__.py

feat: fpw plugins, validation/crawl perf, WS stats, test DB isolation

2026-04-05 13:39:19 +08:00

base.py

feat(crawl): browser-like headers, HTTP/2, curl_cffi TLS fingerprint fallback

2026-04-05 14:40:36 +08:00

fate0.py

fix: 修复爬虫网络层、验证队列卡死及 API 500 错误

2026-04-04 19:27:36 +08:00

fpw_checkerproxy.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

fpw_freeproxylists.py

fix(crawl): throttle concurrent CrawlJobs and relax fpw/proxyscrape HTTP

2026-04-05 13:48:41 +08:00

fpw_gatherproxy.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

fpw_hidemy.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

fpw_premproxy.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

fpw_proxy_list_download.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

fpw_proxynova.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

fpw_socks_ssl_proxy.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

fpw_spys_one.py

fix(plugins): fpw parsers for JSON API, mirrors, and looser HTML

2026-04-05 14:16:03 +08:00

ip89.py

fix: 全面修复代码问题并优化架构

2026-04-04 21:03:43 +08:00

ip3366.py

feat(crawl): browser-like headers, HTTP/2, curl_cffi TLS fingerprint fallback

2026-04-05 14:40:36 +08:00

kuaidaili.py

feat(crawl): browser-like headers, HTTP/2, curl_cffi TLS fingerprint fallback

2026-04-05 14:40:36 +08:00

proxylist_download.py

fix: 全面修复代码问题并优化架构

2026-04-04 21:03:43 +08:00

proxyscrape.py

fix(crawl): throttle concurrent CrawlJobs and relax fpw/proxyscrape HTTP

2026-04-05 13:48:41 +08:00

speedx.py

fix: 全面修复代码问题并优化架构

2026-04-04 21:03:43 +08:00

yundaili.py

fix: 全面修复代码问题并优化架构

2026-04-04 21:03:43 +08:00