MCP Server for Web Scraping — Connect Claude, Codex, Cursor, Gemini & More
Give your AI assistant direct access to 80+ web scraping and data extraction APIs via the Model Context Protocol (MCP). Search Google, scrape reviews, fetch product data, and more — all from Claude Desktop, Claude Code, Codex, OpenCode, Gemini CLI, Cursor, VS Code, or Windsurf.
What is MCP?
The Model Context Protocol (MCP) is an open standard that allows AI assistants to connect to external tools and data sources. With Scrappa's MCP server, your AI can:
Supported Clients
Claude Desktop
Anthropic's official desktop app
Claude Code
Terminal-based AI coding assistant
Codex
OpenAI coding agent in the CLI and IDE
OpenCode
Open-source terminal AI coding agent
Gemini CLI
Google's command-line AI assistant
Cursor
AI-powered code editor
VS Code
GitHub Copilot Agent mode
Windsurf
AI-powered code editor
Prerequisites
Get Your API Key
Sign up at scrappa.co and get your API key from the dashboard.
Install Node.js for Bridge-Based Clients
Node.js 18+ is only needed for clients that use mcp-remote: Claude Desktop, Cursor, VS Code, and Windsurf. Codex, OpenCode, and Gemini CLI connect through native remote MCP configuration.
Quick Install
Using Claude Code or Gemini CLI? Run the matching command:
Claude Code
claude mcp add scrappa --transport http https://scrappa.co/mcp -H 'X-API-KEY: YOUR_SCRAPPA_API_KEY'
Gemini CLI
gemini mcp add --transport http --header 'X-API-KEY: YOUR_SCRAPPA_API_KEY' scrappa https://scrappa.co/mcp
Done! Restart your AI client and start using Scrappa tools.
Using a different tool? See the detailed instructions below.
Detailed Installation
Choose your AI tool and follow the installation instructions.
Add the following to your Claude Desktop configuration file:
macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
Windows: %APPDATA%\Claude\claude_desktop_config.json
{
"mcpServers": {
"scrappa": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://scrappa.co/mcp", "--header", "X-API-KEY: YOUR_SCRAPPA_API_KEY"]
}
}
}
Run this single command in your terminal:
claude mcp add scrappa --transport http https://scrappa.co/mcp -H 'X-API-KEY: YOUR_SCRAPPA_API_KEY'
That's it! Restart Claude Code and you're ready to go.
Or add it to your project's .mcp.json file:
{
"mcpServers": {
"scrappa": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://scrappa.co/mcp", "--header", "X-API-KEY: YOUR_SCRAPPA_API_KEY"]
}
}
}
Add to your Codex configuration file:
File: ~/.codex/config.toml
[mcp_servers.scrappa]
url = "https://scrappa.co/mcp"
http_headers = { "X-API-KEY" = "YOUR_SCRAPPA_API_KEY" }
Add to your OpenCode configuration file:
File: opencode.json in your project root, or ~/.config/opencode/opencode.json for global setup.
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"scrappa": {
"type": "remote",
"url": "https://scrappa.co/mcp",
"enabled": true,
"oauth": false,
"headers": {
"X-API-KEY": "YOUR_SCRAPPA_API_KEY"
}
}
}
}
Run this command in your terminal:
gemini mcp add --transport http --header 'X-API-KEY: YOUR_SCRAPPA_API_KEY' scrappa https://scrappa.co/mcp
Or add it to ~/.gemini/settings.json:
{
"mcpServers": {
"scrappa": {
"httpUrl": "https://scrappa.co/mcp",
"headers": {
"X-API-KEY": "YOUR_SCRAPPA_API_KEY"
}
}
}
}
Add to your Cursor MCP configuration:
File: ~/.cursor/mcp.json
{
"mcpServers": {
"scrappa": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://scrappa.co/mcp", "--header", "X-API-KEY: YOUR_SCRAPPA_API_KEY"]
}
}
}
Add to your VS Code settings (settings.json):
{
"mcp": {
"servers": {
"scrappa": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://scrappa.co/mcp", "--header", "X-API-KEY: YOUR_SCRAPPA_API_KEY"]
}
}
}
}
Add to your Windsurf MCP configuration file:
File: ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"scrappa": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://scrappa.co/mcp", "--header", "X-API-KEY: YOUR_SCRAPPA_API_KEY"]
}
}
}
Available Tools
The Scrappa MCP server provides the following tools to your AI assistant:
G Google
google-translate-api
- Translate text
google-images
- Search images
YT YouTube
youtube-search
- Search videos
youtube-video
- Get video details
youtube-channel
- Channel profile
youtube-comments
- Fetch comments
youtube-transcript
- Transcript segments
youtube-related
- Related videos
youtube-chapters
- Video chapters
youtube-trending
- Trending videos
youtube-suggestions
- Search suggestions
youtube-channel-videos
- Channel uploads
youtube-channel-playlists
- Channel playlists
youtube-channel-community
- Community posts
Usage Examples
Once configured, just ask your AI assistant naturally. Here are some example prompts:
Get Your API Key
Sign up for a free Scrappa account to get your API key and start using the MCP integration with your AI assistant.
Get Started FreeRelated resources
Pair the MCP setup guide with the main docs, pricing overview, server comparison, and full API reference while you evaluate production use.
Homepage
Return to the main product overview and marketing entry points.
Quick start docs
Start with account setup, first requests, and core documentation.
Pricing
Check credits, savings, and alternative-page comparisons before rollout.
Best MCP servers
Compare Scrappa with Firecrawl, Apify, Bright Data, and other web scraping MCP options.
API reference
Open the full reference and OpenAPI docs for endpoint-level detail.
Frequently Asked Questions
What is an MCP server and how does it work with AI clients?
MCP (Model Context Protocol) is an open standard that lets AI assistants connect to external tools and data sources. Scrappa's MCP server exposes 80+ web scraping APIs as tools that Claude, Codex, OpenCode, Gemini CLI, Cursor, VS Code, and Windsurf can call directly during conversations.
Which AI clients support Scrappa's MCP server?
Scrappa's MCP server works with Claude Desktop, Claude Code, Codex, OpenCode, Gemini CLI, Cursor, VS Code with GitHub Copilot, and Windsurf. Any client that supports the Model Context Protocol can connect to Scrappa.
Do I need to install anything to use Scrappa through MCP?
Claude Code and Gemini CLI can add Scrappa with one command. Claude Desktop, Cursor, VS Code, and Windsurf use JSON settings, Codex uses TOML, and OpenCode uses opencode.json. Node.js 18+ is required only for clients that use the mcp-remote bridge.
How many APIs are available through the MCP server?
Scrappa provides 80+ API endpoints across Google Maps, Google Search, YouTube, LinkedIn, Trustpilot, Google Flights, Google Hotels, Indeed, Brave Search, and more. All endpoints are automatically available as MCP tools.
Can I use Scrappa's MCP server for free?
You can sign up for a free Scrappa account to get an API key. The MCP server uses the same API credits as the REST API. Check the pricing page for available plans and free tier limits.
Need Help?
Check out our authentication docs for more details on API keys, or visit the API playground to test endpoints directly.