Skip to content

Repository files navigation

Awesome Web Scraping

Awesome Web Scraping - Curated list of scraping tools, APIs, and frameworks

What belongs in this list

A curated map of libraries, APIs, MCP servers, and operating practices relevant to local-market research and lead-list enrichment. Entries should help a reader make a concrete implementation choice—not inflate a directory.

Evaluation criteria

Criterion What to look for
Data fit Does it produce the fields and sources your workflow needs?
Maintenance Is the project active, documented, and transparent about limitations?
Integration Does it support the runtime, API model, or MCP client you use?
Governance Can you operate it responsibly with source, retention, and review controls?

Related projects

Explore these closely related implementation paths:

  • awesome-google-maps — Awesome Google Maps - Curated tools for Google Maps data extraction and local SEO
  • awesome-lead-generation — Awesome Lead Generation - Curated B2B lead gen tools, APIs, and data sources
  • amazon-product-api — Amazon Product API - Real-time product, pricing, and review data via REST API
  • best-amazon-scraper — Best Amazon Scraper - Extract product data, prices, reviews, and BSR via API
  • best-google-maps-scraper — Best Google Maps Scraper - Extract business data, reviews, ratings & contact info via API
  • best-instagram-scraper — Best Instagram Scraper - Extract posts, profiles, stories, and hashtag data via API

License

CC BY 4.0.