mcp-llms-txt-explorer

Overview

The MCP LLMS.txt Explorer is a specialized Model Context Protocol server designed to help users discover and analyze websites that implement the llms.txt standard. It provides both resources and tools to check websites for llms.txt files, parse their contents, and access structured data about compliant websites. The server offers functionality to verify the presence of llms.txt files on given domains and list known compliant websites with filtering capabilities.

Try asking AI

After installing, here are 5 things you can ask your AI assistant:

• check_website

  Check if a website has llms.txt files

  Try:Check if example.com has llms.txt filesTry:Verify if my website has llms.txt
• list_websites

  List known websites with llms.txt files

  Try:List websites with llms-full.txtTry:Show me all websites with llms.txt files

Comparable tools

Installation

npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude

git clone https://github.com/thedaviddias/mcp-llms-txt-explorer.git
cd mcp-llms-txt-explorer

pnpm install

pnpm run build

{
  "mcpServers": {
    "llms-txt-explorer": {
      "command": "npx",
      "args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"]
    }
  }
}

FAQ

What is the llms.txt standard?

The llms.txt standard is a text-based protocol that allows AI systems to discover and interact with websites that provide model access or information.

How do I debug this MCP server?

Use the MCP Inspector by running 'pnpm run inspector' which provides a browser-based debugging interface.

Compare mcp-llms-txt-explorer with