rates/backend/services/scraper_backends
jtricerolph 7b4bb72f15 Add Referer header to search URL navigation
A direct hit to searchresults.en-gb.html with no Referer causes Cloudflare
to hold the response body open (never sending HTML), so domcontentloaded
never fires. Setting referer=HOMEPAGE makes the request look like the user
searched from the homepage, which resolves the stall.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-07-09 17:50:45 +00:00
..
__init__.py Add Rate Monitor app — Booking.com + direct booking engine competitor rates 2026-07-05 12:06:30 +00:00
base.py Use pasted Booking.com search URL to pin scrape destination 2026-07-05 22:00:28 +00:00
playwright_local.py Add Referer header to search URL navigation 2026-07-09 17:50:45 +00:00