hotel-manage-stack/rates
1
0
Fork 0
Code Issues 3 Pull requests Projects Releases Packages Wiki Activity Actions

Revert Firefox: root cause was broken DataImpulse nodes not fingerprinting

Browse source 
DataImpulse has two broken gateway nodes (.89, .97) and one working (.105).
Production DNS round-robin consistently landed on broken nodes. Fix is to
pin the proxy host to 67.213.121.105 in system_config. Revert to Chromium.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
jtricerolph 2026-07-10 09:54:50 +00:00
parent 12037dc3f7
commit ef7c4790ca
2 changed files with 10 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

2
backend/Dockerfile
View file

@ -14,7 +14,7 @@ COPY requirements.txt .
RUN pip install --no-cache-dir -r requirements.txt
# Playwright + Chromium for Booking.com scraper
RUN playwright install chromium firefox --with-deps
RUN playwright install chromium --with-deps
COPY . .

15
backend/services/scraper_backends/playwright_hotel_page.py
View file

@ -220,13 +220,16 @@ class PlaywrightHotelPageBackend(ScraperBackend):
if not self._pw:
self._pw = await async_playwright().start()
if not self._browser:
self._browser = await self._pw.firefox.launch(
self._browser = await self._pw.chromium.launch(
headless=True,
firefox_user_prefs={
# Block images — saves ~75% of proxy bandwidth from cf.bstatic.com.
# Firefox pref equivalent of Chrome's --blink-settings=imagesEnabled=false.
'permissions.default.image': 2,
},
args=[
'--no-sandbox',
'--disable-dev-shm-usage',
'--disable-blink-features=AutomationControlled',
'--disable-infobars',
'--disable-extensions',
'--blink-settings=imagesEnabled=false',
],
)
async def _get_context(self) -> BrowserContext: