extract-llms-docs

Overview

llm.energy is a comprehensive web application and MCP server that fetches, parses, and organizes documentation from websites implementing the llms.txt and install.md standards. It transforms raw documentation into structured, agent-ready formats optimized for large language models, AI assistants, and developer tooling. The project provides both a web interface and MCP server capabilities.

Try asking AI

After installing, here are 5 things you can ask your AI assistant:

• extract_docs

  Extract documentation from a URL with llms.txt support

  Try:Extract documentation from docs.anthropic.comTry:Get documentation from docs.stripe.comTry:Fetch documentation from a URL with llms.txt
• validate_url

  Check if a URL has llms.txt available

  Try:Check if docs.example.com has llms.txtTry:Validate if this site supports llms.txt: docs.openai.comTry:Verify llms.txt support for this URL
• verify_llms_txt

  Verify llms.txt exists and get file info

  Try:Verify llms.txt exists for docs.example.comTry:Check llms.txt file info for this siteTry:Get details about the llms.txt file
• discover_documentation_urls

  Find documentation URLs for a domain

  Try:Find documentation URLs for example.comTry:Discover documentation links on this siteTry:Get documentation URLs from a domain
• list_sites

  Get directory of known llms.txt-enabled sites

  Try:List all sites with llms.txt supportTry:Show me the directory of llms.txt-enabled websitesTry:Get known sites with llms.txt
• search_sites

  Search the site directory by category or keyword

  Try:Search for AI documentation sitesTry:Find sites related to payment APIsTry:Search sites by category: chatbots

Comparable tools

Installation

{
  "mcpServers": {
    "llm-energy": {
      "command": "npx",
      "args": ["-y", "@llm-energy/mcp-server"]
    }
  }
}

# Clone the repository
git clone https://github.com/nirholas/extract-llms-docs.git
cd extract-llms-docs

# Install dependencies
pnpm install

# Start development server
pnpm dev

FAQ

What is llms.txt?

llms.txt is a machine-readable documentation format designed specifically for AI systems. It allows AI agents to easily understand and consume documentation from websites.

What file formats can be exported?

The application supports exporting documentation in Markdown, JSON, YAML, or as a ZIP archive containing all sections.

Compare extract-llms-docs with