Web Scraping
Crawlers, scrapers, structured extraction from web pages.
100 MCP servers in this category
- #01fetchOfficial★ 85,74876
An MCP server that fetches web content and converts HTML to markdown, allowing LLMs to read web pages.
- #02akshare-one-mcp★ 17275
MCP server providing comprehensive Chinese stock market data through akshare-one API.
- #03chrome-devtools-mcp★ 39,75765
Chrome DevTools MCP server lets AI coding agents control and inspect live Chrome browsers through the MCP protocol.
- #04Scrapling★ 50,34662
Web scraping framework with adaptive parsing and anti-bot capabilities, now integrated as an MCP server.
- #05gpt-researcher★ 27,10061
An autonomous research agent that conducts deep research using any LLM providers with MCP server integration for specialized data sources.
- #06firecrawl-mcp-server★ 6,31760
Official Firecrawl MCP Server brings web scraping, search, and page interaction capabilities to MCP-compatible AI agents.
- #07fastapi_mcp★ 11,86360
FastAPI-MCP exposes FastAPI endpoints as MCP tools with built-in authentication.
- #08xiaohongshu-mcp★ 13,61659
MCP server for automating Xiaohongshu operations including content posting, commenting, and user interaction.
- #09XHS-Downloader★ 11,17259
XHS-Downloader is a MCP server for downloading content from XiaoHongShu (RedNote) platform with API and MCP capabilities.
- #10exa-mcp-server★ 4,43659
MCP server for Exa web search and web crawling capabilities with support for multiple AI clients.
- #11brightdata-mcp★ 2,36657
A powerful MCP server providing real-time web access without blocking for AI agents.
- #12design-extract★ 2,64057
A comprehensive MCP server that extracts design systems from websites, generating tokens, components, and multi-platform outputs.
- #13linkedin-mcp-server★ 1,90056
MCP server providing LinkedIn API access through browser automation for profiles, companies, jobs, and messaging.
- #14ENScan_GO★ 4,39256
ENScan_GO is a Chinese enterprise information gathering tool that supports MCP server functionality.
- #15apify-mcp-server★ 1,22355
Apify MCP server enables AI agents to extract web data using thousands of pre-built scrapers and automation tools.
- #16mcp-gsc★ 84355
MCP server connecting Google Search Console to AI assistants for SEO analysis through natural language conversations.
- #17webclaw★ 1,15555
A Rust-based fast local-first web content extraction tool with MCP server for AI agents.
- #18stealth-browser-mcp★ 64354
Stealth Browser MCP provides undetectable browser automation with antibypass capabilities for MCP-compatible AI agents.
- #19MCP★ 68054
Jina AI Remote MCP server provides web search, content reading, and AI tools with URL filtering capabilities.
- #20mcp★ 45953
Token-efficient MCP server for Cloudflare API with 2500 endpoints accessible via Code Mode.
- #21redd-archiver★ 33352
A PostgreSQL-backed archive generator that creates browsable HTML archives from link aggregator platforms with MCP server integration.
- #22mcp★ 6,51051
Browser MCP enables AI applications to control your browser locally for automation tasks.
- #23flyto-core★ 27051
An MCP server for AI agent automation with 412 modules, execution tracing, replay functionality, and built-in recipes.
- #24XActions★ 26551
XActions is a comprehensive X/Twitter automation toolkit with MCP server integration for AI agents.
- #25google-surf-mcp★ 16950
A robust Google search MCP server combining search, content extraction, and academic paper analysis without API keys.
- #26kindly-web-search-mcp-server★ 32550
Web search MCP server with robust content retrieval for AI coding tools and agents.
- #27firefox-devtools-mcp★ 16250
Mozilla's MCP server for automating Firefox DevTools via WebDriver BiDi, enabling AI assistants to control and inspect browser functionality.
- #28charlotte★ 14250
Token-efficient browser MCP server that provides structured web access to AI agents.
- #29mcp-screenshot-website-fast★ 10650
MCP server for fast webpage screenshots optimized for AI vision workflows with automatic tiling.
- #30web3-research-mcp★ 15349
A local MCP server for comprehensive cryptocurrency research across multiple sources.
- #31browser-use-mcp-server★ 82249
MCP server enabling AI agents to control web browsers with browser-use.
- #32web-scout-mcp★ 12849
A robust MCP server providing web search and content extraction capabilities through DuckDuckGo integration.
- #33RivalSearchMCP★ 8949
RivalSearchMCP is a comprehensive research MCP server offering deterministic search across 5 web engines, 9 social platforms, academic databases, news sources, and document analysis.
- #34safari-mcp★ 6349
Native Safari browser automation for AI agents with 80 tools via AppleScript, zero overhead, and lower CPU usage than Chrome DevTools.
- #35facebook-ads-library-mcp★ 22549
Facebook Ads Library MCP server for querying and analyzing advertising campaigns with batch processing and video analysis capabilities.
- #36apitap★ 8348
ApiTap turns any website into an API through MCP server with pre-mapped endpoints and traffic capture.
- #37youtube-connector-mcp★ 7148
MCP server for YouTube that enables AI assistants to search videos, channels, playlists, and transcripts.
- #38Kagi-Session2API-MCP★ 13448
Free Kagi Search MCP server using session tokens instead of paid API, works with multiple MCP clients.
- #39web-agent-protocol★ 49748
Web Agent Protocol (WAP) records browser interactions and converts them into MCP servers for web automation replay.
- #40hanzi-browse★ 16148
MCP server that enables AI agents to browse local websites with site-specific playbooks for complex interactions.
- #41oxylabs-mcp★ 9548
Oxylabs MCP server enables AI models to scrape and interact with the real-world web.
- #42powhttp-mcp★ 7148
MCP server enabling AI assistants to analyze HTTP traffic captured by powhttp with advanced debugging capabilities.
- #43scrapegraph-mcp★ 7248
ScrapeGraph MCP server provides AI-powered web scraping tools including extract, search, crawl, schema generation, and monitoring capabilities.
- #44mcp-read-website-fast★ 14648
A fast, token-efficient MCP server that converts websites to clean Markdown for AI agents.
- #45reddit-mcp★ 28548
MCP server providing access to Reddit data through PRAW API, with both read-only and authenticated functionality.
- #46agentql-mcp★ 17048
AgentQL MCP server enables structured web data extraction via a single tool with clear configuration across multiple MCP clients.
- #47RedNote-MCP★ 1,05347
RedNote MCP server provides programmatic access to XiaoHongShu content through search and URL fetching.
- #48puppeteer-mcp-claude★ 3847
Browser automation MCP server for Claude using Puppeteer to control web pages, capture screenshots, and interact with websites.
- #49rust-docs-mcp★ 12447
A comprehensive MCP server providing Rust crate documentation, source code analysis, dependency trees, and module structure for AI agents.
- #50parallel-browser-mcp★ 9947
An MCP server enabling parallel browser automation across multiple cloud providers with session-based control.
- #51tradingview-chart-mcp★ 9347
MCP server that captures TradingView chart images via Selenium with browser pooling for concurrent performance.
- #52reddit-research-mcp★ 11347
Reddit research MCP server providing competitive analysis, customer discovery and market insights with semantic search.
- #53comet-mcp★ 15547
MCP server connecting Claude Code to Perplexity Comet browser for intelligent web browsing and research.
- #54mcp-rest-api★ 9547
TypeScript MCP server for testing REST APIs through MCP clients like Cline.
- #55crw★ 8847
Fast, lightweight Firecrawl alternative in Rust with MCP server for AI agents. Web scraper, crawler & search API.
- #56camofox-mcp★ 6147
Anti-detection browser MCP server with 47 automation tools for web interactions without blocking.
- #57mcp-graphql★ 38547
MCP server enabling LLMs to interact with GraphQL APIs through schema introspection and query execution.
- #58one-search-mcp★ 11447
OneSearch MCP Server provides web search, scraping, and content extraction with multiple search providers and local browser automation.
- #59google-researcher-mcp★ 3546
MCP server providing Google search, web scraping, and document parsing with advanced filtering capabilities.
- #60x-twitter-scraper★ 8246
MCP server with 2 tools for Twitter/X data extraction and API interaction via 100+ endpoints.
- #61mcp-design-system-extractor★ 6446
MCP server that extracts HTML, styles and component metadata from Storybook design systems to help with development.
- #62DrissionPageMCP★ 21446
A browser automation MCP server using DrissionPage and FastMCP for AI-controlled web operations.
- #63crawl4ai-mcp-server★ 8546
A lightweight MCP server exposing Crawl4AI web scraping tools for AI agents with Docker support.
- #64token-enhancer★ 6446
MCP server that strips web pages to clean text, reducing token usage by 86-99%.
- #65open-browser-use★ 8346
Platform-neutral browser automation MCP server for AI agents with CLI and SDK support.
- #66cortex-scout★ 6546
Unified web extraction and stateful automation engine for AI agents with MCP integration.
- #67mcp-link★ 60545
MCP Link automatically converts any OpenAPI V3 API into a fully-functional MCP server.
- #68kernel-mcp-server★ 3045
Kernel MCP server provides secure cloud-browser automation and app management through MCP protocol.
- #69google-search★ 59545
Playwright-based Google search tool with MCP server integration that bypasses anti-bot detection.
- #70crawlbase-mcp★ 5545
Crawlbase MCP Server connects AI agents to live web data through structured scraping, JavaScript rendering, and anti-bot protection.
- #71mcp-browser-agent★ 3845
An MCP server providing Claude with autonomous browser automation capabilities including DOM manipulation, JavaScript execution, and API requests.
- #72sample-agentic-ai-web★ 5045
Amazon Bedrock web automation assistant with MCP server for browser automation and vision capabilities.
- #73mcp-llms-txt-explorer★ 7445
MCP server for discovering and analyzing websites with llms.txt files.
- #74opencode-browser★ 4645
MCP server plugin for OpenCode that enables browser automation through Browser MCP integration.
- #75mcp-server-weibo★ 4545
A robust MCP server providing Weibo social media data access with automatic authentication and both HTTP and stdio interfaces.
- #76plasmate★ 2145
Plasmate is a browser engine for agents that converts HTML to a compact Semantic Object Model (SOM) via MCP.
- #77html-to-markdown-mcp★ 2445
MCP server that converts HTML to Markdown using Turndown.js with SSRF protection.
- #78decipher-research-agent★ 15145
AI-powered research assistant that uses MCP server to create interactive notebooks from web sources.
- #79webmcp-bridge★ 2544
A bridge that connects local MCP clients to browser WebMCP tools through Playwright, supporting both native and injected adapters.
- #80mcp-reddit★ 40044
MCP server for fetching and analyzing Reddit content with support for different post types.
- #81cdpilot★ 2544
Zero-dependency browser automation CLI with MCP server for AI agents, offering 70+ commands and stealth mode.
- #82WEBGhosting-MCP★ 2944
Intelligent stealth browser MCP server with anti-fingerprinting for AI agents to browse the web undetected.
- #83linkup-mcp-server★ 2844
Linkup MCP server provides web search and page fetching capabilities with real-time data and flexible depth options.
- #84extract-llms-docs★ 3044
An MCP server that extracts llms.txt documentation from websites for AI agents.
- #85mcp-expose-abilities★ 2544
WordPress MCP server with 61+ core abilities and 12+ add-ons for content, SEO, and site management via AI agents.
- #86real-browser-mcp★ 2043
MCP server + Chrome extension enabling AI agents to control real browser sessions with existing logins and cookies.
- #87mcp-wayback-machine★ 2443
MCP server for Internet Archive's Wayback Machine with CDX search, snapshot retrieval, comparison and optional authentication.
- #88astro-mcp★ 5843
MCP server providing Astro project insights, runtime info, documentation search, and integration data.
- #89BrowseAI-Dev★ 1743
BrowseAI Dev provides an evidence-backed web search MCP server with citations and confidence scores to reduce AI hallucinations.
- #90mcp-twikit★ 23343
MCP server for Twitter integration with search, timeline, and sentiment analysis capabilities.
- #91builtwith-api★ 2043
A robust MCP server that exposes 13 BuiltWith API tools for web technology analysis via LLM agents.
- #92trading-mcp★ 7143
Trading MCP server providing stock screening, fundamental analysis, insider trading, social sentiment, and news analysis.
- #93puppeteer-mcp-server★ 1942
Self-hosted Puppeteer MCP server with browser automation tools, supporting multiple transports and API key authentication.
- #94webfetch-mcp★ 2641
An MCP server providing real-time web access with tunable search and clean content extraction for local AI models.
- #95izan.io★ 2941
Chrome extension that turns any browser into an MCP server for AI automation.
- #96mcp-aoai-web-browsing★ 3341
MCP server with Playwright browser automation via FastMCP, supporting both Azure and OpenAI APIs.
- #97mcp-webresearch★ 29741
MCP server enabling Claude to perform web research with Google search, page extraction, and screenshot capture capabilities.
- #98mcp-server-any-openapi★ 8240
An MCP server enabling Claude to discover and call any API endpoint through semantic search of OpenAPI specifications.
- #99Custom-MCP-Server★ 7540
An MCP server providing scraping tools for LinkedIn, Facebook, Instagram, and Google search.
- #100scraperapi-mcp★ 439
ScraperAPI MCP server enables LLMs to retrieve and process web scraping requests using ScraperAPI.