rates/backend/services
jtricerolph 312a14b80f Add live progress tracking to scrape history
Backend: atomic += increments to hotels_found, rates_scraped,
dates_completed, dates_failed after each date in both worker types
(search-results and hotel-page). Safe for concurrent workers because
PostgreSQL evaluates x = x + delta atomically per statement.
If the container is killed mid-run, the counts already reflect what
was done rather than zeroing out.

Frontend: new Progress column showing X/Y (NN%) of dates completed;
highlighted in gold while the batch is running. scrape-history query
auto-refetches every 5s whenever a running entry is present.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-07-15 09:09:46 +00:00
..
direct_profiles Add fetch_category_names to Eviivo, QBook and Mews profiles 2026-07-10 13:00:19 +00:00
scraper_backends Use text-search approach for rate conditions (breakfast/cancel/payment) 2026-07-14 18:10:00 +00:00
__init__.py
booking_scraper.py Add live progress tracking to scrape history 2026-07-15 09:09:46 +00:00
central_settings.py
direct_scraper.py
newbook_rates_client.py
proxy.py Block images via Chrome flag, not route interception; restore DataImpulse URL auth 2026-07-10 09:14:36 +00:00