Turn any docs site into a Claude Code / Codex agent skill (SKILL.md), llms.txt, llms-full.txt and AGENTS.md. Web scraping CLI for AI agents, coding agents and RAG. Built on Spicrawl.
-
Updated
Oct 30, 2026 - JavaScript
Turn any docs site into a Claude Code / Codex agent skill (SKILL.md), llms.txt, llms-full.txt and AGENTS.md. Web scraping CLI for AI agents, coding agents and RAG. Built on Spicrawl.
MCP server for web scraping: scrape any URL to Markdown or JSON for Claude, Cursor and AI agents, with JavaScript rendering, batch scraping and data extraction
Price tracker and stock monitor for any online store: reads JSON-LD/OpenGraph, alerts on price drops and restocks via Discord/Slack. CLI, GitHub Actions or Claude Code / Codex agent skill. Built on Spicrawl.
LangChain.js document loader and agent tool for Spicrawl: load web pages as Markdown for RAG and agents (TypeScript)
Website change detection CLI: watch any page, get a diff and Discord/Slack alerts. Runs from cron, GitHub Actions or as a Claude Code / Codex agent skill for AI agents. Web scraping via Spicrawl.
LangChain document loader and agent tool for Spicrawl: load web pages as Markdown for RAG and agents (Python)
n8n node for web scraping: scrape websites to Markdown, HTML or JSON, extract data with CSS selectors, batch-scrape URLs and use it as an AI Agent tool. Spicrawl community node.
To associate your repository with the spicrawl topic, visit your repo's landing page and select "manage topics."