Medium and low priority tiers were generating full static date ranges (150 and 185 dates) every day. With a queue limit of 200, high (31) + medium (150) consumed the entire budget, leaving only ~19 slots for low priority — causing the observed ~6 month cap. Medium now selects the 60 oldest-scraped (or never-scraped) dates from the days 31-180 window; low selects the 30 oldest from days 181-365. Per-run budget drops from ~365 to ~121 dates, and coverage naturally cycles through the full year: medium every ~2-3 days, low every ~6-7 days. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| api | ||
| jobs | ||
| services | ||
| auth.py | ||
| database.py | ||
| Dockerfile | ||
| main.py | ||
| migrate_direct_data.py | ||
| requirements.txt | ||
| scheduler.py | ||
| schema.sql | ||