FP-Scraper

Scrapes FP TOP 10 catalogs, resolves titles to TMDB IDs, and writes one JSON file per region.

Usage

Install the project:

python -m pip install .

Scrape the global page:

python -m flixpatrol_scraper --region global --output global.json

Scrape one region:

python -m flixpatrol_scraper --region united-states --output united-states.json

Scrape multiple regions:

python -m flixpatrol_scraper --region global,united-states,brazil --output exports

Scrape all supported regions:

python -m flixpatrol_scraper --all-regions --output exports

Scrape all supported regions except regions known to have no or low catalog coverage:

python -m flixpatrol_scraper --all-regions-slim --output exports

Resolve TMDB IDs while scraping:

python -m flixpatrol_scraper --all-regions --output exports --resolve-tmdb --tmdb-api-key YOUR_TMDB_API_KEY

GitHub Actions

The repo includes a scheduled workflow in .github/workflows/update-catalogs.yml.

It:

• runs once per day at 15:30 UTC
• can also be triggered manually with workflow_dispatch
• scrapes --all-regions-slim
• resolves TMDB IDs
• writes outputs into catalogs/
• commits and pushes updated catalog files back to the repository

Required GitHub secrets:

• TMDB_API_KEY, or
• TMDB_ACCESS_TOKEN