3 commits

Author	SHA1	Message	Date
jtricerolph	3c4bc633fe	Revert to headed Chrome + Xvfb; add shm_size 256m to fix Xvfb in Docker ... Headless mode gets blocked by Cloudflare on the search endpoint. Headed mode with Xvfb works on dev (Unraid). The missing piece on Proxmox LXC was insufficient /dev/shm (Docker default 64 MB); setting shm_size: 256m gives Xvfb enough shared memory to start. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-07-09 17:36:27 +00:00
jtricerolph	11b995739c	Add residential proxy support to Booking.com scraper ... - Route through DataImpulse residential proxy when BOOKING_PROXY_* env vars are set (empty = direct connection, unchanged behaviour) - Sticky one IP per session via DataImpulse sessid; rotate_session() burns the IP for a fresh one - Rotate-on-block: retry a date on a new IP when the page is challenged or page 1 renders zero hotels (up to 3 IPs; single attempt sans proxy) - Persistent, pre-warmed context across dates so cache stays hot (~5 MB first page, ~0.3 MB per date after) instead of per-date cold loads - Block images/media/fonts and third-party ad/consent/analytics hosts to cut bandwidth; never touch the anti-bot challenge (awswaf) - Faster inter-page pacing now that a burned IP is cheap Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>	2026-07-05 20:30:15 +00:00
jtricerolph	e05054172f	Add Rate Monitor app — Booking.com + direct booking engine competitor rates ... Combines Booking.com Playwright scraper (from forecasting), direct booking engine scraper (ported from laptop-archive/guestline-monitor), and Newbook own-hotel rates into one focused tool. Four views: Bookability, Market View (with price index badges + direct rate sub-rows), Direct Rates (per-competitor room breakdown, min-stay flags, hotel config/discovery), Rate Analysis (advance purchase curve, DOW chart, rate timeline, comparison table). Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-07-05 12:06:30 +00:00