祀梦 07248ff4ee feat(crawl): browser-like headers, HTTP/2, curl_cffi TLS fingerprint fallback ...

- get_headers(url): Referer, Sec-Fetch-*, sec-ch-ua, API vs HTML Accept
- httpx AsyncClient/ sync Client with optional HTTP/2 (h2 extra)
- On 403/429/503/520-523/525/567 or request errors, retry via curl_cffi chrome124 impersonate
- POST: Origin, Referer, Content-Type for form posts
- kuaidaili/ip3366: forward get_headers(url=...)

Made-with: Cursor

2026-04-05 14:40:36 +08:00

..

api

refactor(crawl): parallel plugins via JobExecutor; per-plugin throttle

2026-04-05 14:08:26 +08:00

core

refactor(crawl): parallel plugins via JobExecutor; per-plugin throttle

2026-04-05 14:08:26 +08:00

models

feat: fpw plugins, validation/crawl perf, WS stats, test DB isolation

2026-04-05 13:39:19 +08:00

plugins

feat(crawl): browser-like headers, HTTP/2, curl_cffi TLS fingerprint fallback

2026-04-05 14:40:36 +08:00

repositories

feat: fpw plugins, validation/crawl perf, WS stats, test DB isolation

2026-04-05 13:39:19 +08:00

services

feat: fpw plugins, validation/crawl perf, WS stats, test DB isolation

2026-04-05 13:39:19 +08:00