web-content-extraction

Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, multi-strategy article extraction, and web scraping.

WCXB: Web Content Extraction Benchmark — 2,008 pages, 7 page types, 1,613 domains. The largest open benchmark for web content extraction, boilerplate removal, and main content detection.

Python tool for advanced web scraping and site mirroring. It downloads entire websites, including HTML, CSS, JS, images, and other assets, while preserving site structure and updating links for of…

MCP server that reads web pages, including JavaScript-rendered ones, and returns clean Markdown for LLMs (Python, FastMCP, Crawl4AI)

An Android web browser and text-to-speech reader built with Java and WebView, featuring JavaScript-based content extraction, background audio playback, multi-tab browsing, browsing history, and SQLite persistence.

🌐 BeautifulSoup: Effortlessly scrape and parse web data with this powerful Python library! Perfect for developers needing quick and reliable HTML/XML data extraction. Start saving time on your projects today! [MIRROR][UNOFFICIAL]

Website Content API by CaptureKit: Extract metadata, links, HTML & Markdown from any page. Python, TypeScript, cURL, PHP, C#, Go, Java, Ruby examples.