hotel-manage-stack/rates
1
0
Fork 0
Code Issues 3 Pull requests Projects Releases Packages Wiki Activity Actions

Restrict hotel-page scraper to own + competitor tiers only

Browse source 
Market-tier hotels were auto-discovered from search results and don't
need room-level rate tracking — scraping all 25+ of them per date was
unnecessary. Only 'own' and 'competitor' hotels are now scraped.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
jtricerolph 2026-07-10 00:03:17 +00:00
parent e472ba65c4
commit 30583c59a4
1 changed files with 6 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

8
backend/services/booking_scraper.py
View file

@ -295,12 +295,16 @@ def cleanup_stale_batches(db: Session, max_age_minutes: int = 60):
def get_active_hotels(db: Session) -> List[Dict[str, Any]]: def get_active_hotels(db: Session) -> List[Dict[str, Any]]:
"""Return all active hotels that have a booking_com_url (needed for hotel-page scraping).""" """Return own + competitor hotels with a booking_com_url (for hotel-page scraping).
Market-tier hotels are excluded — they were auto-discovered from search results and
are not hotels we specifically want to track at rate-plan level."""
rows = db.execute( rows = db.execute(
text(""" text("""
SELECT id, booking_com_id, name, booking_com_url SELECT id, booking_com_id, name, booking_com_url
FROM booking_com_hotels FROM booking_com_hotels
WHERE is_active = TRUE AND booking_com_url IS NOT NULL WHERE is_active = TRUE
AND booking_com_url IS NOT NULL
AND tier IN ('own', 'competitor')
ORDER BY display_order, id ORDER BY display_order, id
""") """)
).fetchall() ).fetchall()