Skip to content
appsgit

CRW Web Scraper

CRW Web Scraper is an MCP server that adds web browsing tools to AI assistants such as Claude Desktop, Claude Code and Cursor. Open-source web scraper for AI agents with scrape, crawl, and map tools. It has 1,105 GitHub stars, is released under the AGPL-3.0 license and runs locally with docker run -i --rm ghcr.io/fastcrw/crw:latest.

github.com/fastcrw/crw (opens in a new tab)

View on GitHub (opens in a new tab)Website (opens in a new tab)

Install CRW Web Scraper

Generated from the server's MCP registry entry. Replace your-value with your own values.

Claude Desktop

claude_desktop_config.json
{
  "mcpServers": {
    "crw-web-scraper": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/fastcrw/crw:latest"
      ]
    }
  }
}

Settings > Developer > Edit Config. macOS: ~/Library/Application Support/Claude/, Windows: %APPDATA%\Claude\. Restart Claude Desktop afterwards.

Claude Code

claude mcp add --transport stdio crw-web-scraper -- docker run -i --rm ghcr.io/fastcrw/crw:latest

Cursor

.cursor/mcp.json
{
  "mcpServers": {
    "crw-web-scraper": {
      "type": "stdio",
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/fastcrw/crw:latest"
      ]
    }
  }
}

Project file; use ~/.cursor/mcp.json to enable it in every project.

VS Code

.vscode/mcp.json
{
  "servers": {
    "crw-web-scraper": {
      "type": "stdio",
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "ghcr.io/fastcrw/crw:latest"
      ]
    }
  }
}

Config formats checked against the official docs on Oct 7, 2026: modelcontextprotocol.io (opens in a new tab), code.claude.com (opens in a new tab), cursor.com (opens in a new tab), code.visualstudio.com (opens in a new tab).

About CRW Web Scraper

Turn URLs into clean markdown or structured JSON with one engine for search, scrape, map, crawl, and extract. Run it locally as a small Rust binary or use the managed API.

  • ai
  • ai-agents
  • crawler
  • data-extraction
  • docker
  • html-to-markdown
  • llm
  • markdown
  • mcp
  • rust

Similar MCP servers

More web & browsing MCP servers

All Web & browsing

FAQ

CRW Web Scraper FAQ

Still curious? Email info@appsgit.com.

What is CRW Web Scraper?

CRW Web Scraper is an MCP server that adds web browsing tools to AI assistants such as Claude Desktop, Claude Code and Cursor. Open-source web scraper for AI agents with scrape, crawl, and map tools. It has 1,105 GitHub stars, is released under the AGPL-3.0 license and runs locally with docker run -i --rm ghcr.io/fastcrw/crw:latest. The source code is at github.com/fastcrw/crw.

How do I install the CRW Web Scraper MCP server?

Add the command docker run -i --rm ghcr.io/fastcrw/crw:latest to your MCP client: put it in claude_desktop_config.json for Claude Desktop, run claude mcp add for Claude Code, or add it to .cursor/mcp.json (Cursor) or .vscode/mcp.json (VS Code). The snippets on this page are ready to paste.

Is CRW Web Scraper free?

The server is open source under the AGPL-3.0 license, so running it is free. It does not declare any required API key.

Is CRW Web Scraper actively maintained?

The most recent commit was on Oct 6, 2026. The latest release is v0.37.2, published Sep 30, 2026. appsgit only lists MCP servers with a commit in the last six months and re-checks every server daily.