A direct hit to searchresults.en-gb.html with no Referer causes Cloudflare to hold the response body open (never sending HTML), so domcontentloaded never fires. Setting referer=HOMEPAGE makes the request look like the user searched from the homepage, which resolves the stall. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| direct_profiles | ||
| scraper_backends | ||
| __init__.py | ||
| booking_scraper.py | ||
| central_settings.py | ||
| direct_scraper.py | ||
| newbook_rates_client.py | ||
| proxy.py | ||