scrapegraph-mcp

Overview

ScrapeGraph MCP server is a production-ready implementation of the Model Context Protocol that connects language models with the ScrapeGraph AI API. It enables AI assistants to perform complex web scraping tasks, extracting structured data from websites, crawling multiple pages, and generating schemas from natural language prompts. The server offers both local and remote deployment options, with comprehensive integration guides for Claude Desktop and Cursor.

Try asking AI

After installing, here are 3 things you can ask your AI assistant:

• scrape

  Scrape content from web pages with various output formats

  Try:Convert https://example.com to markdownTry:Extract all product prices from this e-commerce pageTry:Get me all the links from this website
• extract

  Extract specific information from a website using AI

  Try:Extract all product prices from this e-commerce pageTry:Get me all the contact information from this business websiteTry:Extract the main headlines from this news article
• search

  Search the web with customizable parameters

  Try:Search for recent AI research papers and summarize themTry:Research the latest developments in quantum computingTry:Find the top 5 restaurants in Paris with the highest ratings
• crawl_start

  Start an async multi-page crawl

  Try:Start crawling all product pages on this e-commerce siteTry:Begin crawling this documentation site to extract all API endpointsTry:Initiate a crawl of all blog posts on this technology site
• crawl_get_status

  Check the status of a running crawl job

  Try:Check the status of my website crawlTry:How is the crawling of the e-commerce site going?Try:Is my data extraction job complete?
• crawl_stop

  Stop a running crawl job

  Try:Stop the current website crawlTry:Pause the crawling processTry:Abort the data extraction job
• crawl_resume

  Resume a paused crawl job

  Try:Resume the website crawl from where it left offTry:Continue the paused data extraction jobTry:Restart the crawling process
• schema

  Generate or augment a JSON Schema from a prompt

  Try:Generate a schema for product information extractionTry:Create a JSON schema for capturing restaurant reviewsTry:Augment this schema with additional fields for news articles
• credits

  Check remaining API credits

  Try:How many credits do I have left?Try:Check my account creditsTry:Show my remaining API credits
• history

  View historical usage of API services

  Try:Show me my scraping historyTry:Get my recent API usageTry:List all the extractions I've done this month
• monitor_create

  Create a scheduled monitoring job

  Try:Create a monitor to track price changes on this e-commerce siteTry:Set up a monitor to check for updates on this blogTry:Create a scheduled job to extract stock prices every day
• monitor_list

  List all monitoring jobs

  Try:Show me all my monitoring jobsTry:List my scheduled scraping tasksTry:What monitors do I have active?

Comparable tools

Installation

npx -y @smithery/cli install @ScrapeGraphAI/scrapegraph-mcp --client claude

{
    "mcpServers": {
        "@ScrapeGraphAI-scrapegraph-mcp": {
            "command": "npx",
            "args": [
                "-y",
                "@smithery/cli@latest",
                "run",
                "@ScrapeGraphAI/scrapegraph-mcp",
                "--config",
                "\"{\\\"scrapegraphApiKey\\\":\\\"YOUR-SGAI-API-KEY\\\"}\""
            ]
        }
    }
}

{
  "mcpServers": {
    "scrapegraph-mcp": {
      "command": "npx",
      "args": [
        "mcp-remote@0.1.25",
        "https://scrapegraph-mcp.onrender.com/mcp",
        "--header",
        "X-API-Key:YOUR_API_KEY"
      ]
    }
  }
}

Compare scrapegraph-mcp with