rates/backend/services/scraper_backends
jtricerolph b44e688b3e Retry page load timeouts: treat as blocks, bump max retries to 4
DataImpulse endpoints are intermittently broken — some return EOF after
CONNECT immediately, others work fine. DNS round-robins between them so
the same request can fail 3× then succeed on the 4th. Timeouts were
returning blocked=False and silently failing with no retry. Now treated
as retryable blocks (with context rotation) so a fresh endpoint is tried.
Max retries 2→4 (5 total attempts) to give enough chances to land a
working DataImpulse endpoint.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-07-10 02:19:16 +00:00
..
__init__.py Add hotel-page scraper backend with full room/rate plan extraction 2026-07-09 23:08:03 +00:00
base.py Add hotel-page scraper backend with full room/rate plan extraction 2026-07-09 23:08:03 +00:00
playwright_hotel_page.py Retry page load timeouts: treat as blocks, bump max retries to 4 2026-07-10 02:19:16 +00:00
playwright_local.py Fix page.content() blocking ~2 minutes after goto timeout on Cloudflare hits 2026-07-09 21:34:37 +00:00