Skip to content
appsgit

CRW Web Scraper

CRW Web Scraper is an MCP server that adds web browsing tools to AI assistants such as Claude Desktop, Claude Code and Cursor. Open-source web scraper for AI agents with scrape, crawl, and map tools. It has 1,178 GitHub stars, is released under the AGPL-3.0 license and runs locally with docker run -i --rm ghcr.io/fastcrw/crw:latest.

github.com/fastcrw/crw (opens in a new tab)

Data as of from the GitHub API and the official MCP registry; description from the project's repository. Report an error

Install CRW Web Scraper

Generated from the server's MCP registry entry. Replace your-value with your own values.

Claude Desktop

claude_desktop_config.json
{
  "mcpServers": {
    "crw-web-scraper": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/fastcrw/crw:latest"
      ]
    }
  }
}

Settings > Developer > Edit Config. macOS: ~/Library/Application Support/Claude/, Windows: %APPDATA%\Claude\. Restart Claude Desktop afterwards.

Claude Code

claude mcp add --transport stdio crw-web-scraper -- docker run -i --rm ghcr.io/fastcrw/crw:latest

Cursor

.cursor/mcp.json
{
  "mcpServers": {
    "crw-web-scraper": {
      "type": "stdio",
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/fastcrw/crw:latest"
      ]
    }
  }
}

Project file; use ~/.cursor/mcp.json to enable it in every project.

VS Code

.vscode/mcp.json
{
  "servers": {
    "crw-web-scraper": {
      "type": "stdio",
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/fastcrw/crw:latest"
      ]
    }
  }
}

Config formats checked against the official docs on Oct 7, 2026: modelcontextprotocol.io (opens in a new tab), code.claude.com (opens in a new tab), cursor.com (opens in a new tab), code.visualstudio.com (opens in a new tab).

About CRW Web Scraper

Turn URLs into clean markdown or structured JSON with one engine for search, scrape, map, crawl, and extract. Run it locally as a small Rust binary or use the managed API.

  • ai
  • ai-agents
  • crawler
  • data-extraction
  • docker
  • html-to-markdown
  • llm
  • markdown
  • mcp
  • rust

FAQ

CRW Web Scraper FAQ

Still curious? Email info@appsgit.com.

How do I install the CRW Web Scraper MCP server?

Add the command docker run -i --rm ghcr.io/fastcrw/crw:latest to your MCP client: put it in claude_desktop_config.json for Claude Desktop, run claude mcp add for Claude Code, or add it to .cursor/mcp.json (Cursor) or .vscode/mcp.json (VS Code). The snippets on this page are ready to paste.

Is CRW Web Scraper free?

The server is open source under the AGPL-3.0 license, so running it is free. It does not declare any required API key.

Is CRW Web Scraper actively maintained?

The most recent commit was on Oct 21, 2026. The latest release is v0.39.0, published Oct 21, 2026. appsgit only lists MCP servers with a commit in the last six months.