cf.bstatic.com (images + CSS CDN) was consuming 1.5 GB per scrape run. Added route interception to abort image, stylesheet, font, and media resources, plus pure tracking domains. The DOM extraction only reads HTML attributes — no visual resources are needed. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| api | ||
| jobs | ||
| services | ||
| auth.py | ||
| database.py | ||
| Dockerfile | ||
| main.py | ||
| migrate_direct_data.py | ||
| requirements.txt | ||
| scheduler.py | ||
| schema.sql | ||