祀梦 a26ae50051 refactor(crawl): parallel plugins via JobExecutor; per-plugin throttle ...

- Remove global crawl_slot gate; all CrawlJobs share only executor semaphore
- max_concurrent_jobs = max(24, n_plugins+8) for crawl-all + aggregator headroom
- BaseHTTPPlugin max_concurrency 3->2; fpw multi-URL plugins 4->2
- fetch_all: short random delay before each request to ease single-host pressure

Made-with: Cursor

2026-04-05 14:08:26 +08:00

..

api

refactor(crawl): parallel plugins via JobExecutor; per-plugin throttle

2026-04-05 14:08:26 +08:00

core

refactor(crawl): parallel plugins via JobExecutor; per-plugin throttle

2026-04-05 14:08:26 +08:00

models

feat: fpw plugins, validation/crawl perf, WS stats, test DB isolation

2026-04-05 13:39:19 +08:00

plugins

refactor(crawl): parallel plugins via JobExecutor; per-plugin throttle

2026-04-05 14:08:26 +08:00

repositories

feat: fpw plugins, validation/crawl perf, WS stats, test DB isolation

2026-04-05 13:39:19 +08:00

services

feat: fpw plugins, validation/crawl perf, WS stats, test DB isolation

2026-04-05 13:39:19 +08:00