token-enhancer

Overview

Token Enhancer is a local proxy service that sits between an AI agent and the web, stripping HTML and other noise from pages before they enter the context window. It offers significant token reductions (86-99% as shown in examples like Yahoo Finance) without requiring API keys or external LLM services. The project provides three main modes of operation: as a standalone proxy, as an MCP server with automatic tool discovery, and as a LangChain tool.

Try asking AI

After installing, here are 6 things you can ask your AI assistant:

• fetch_clean

  Fetch a URL and return clean text with HTML noise removed.

  Try:Fetch and clean the content from https://finance.yahoo.com/quote/AAPL/Try:Get clean text from this Wikipedia page: https://en.wikipedia.org/wiki/Artificial_intelligenceTry:Clean up this Hacker News article: https://news.ycombinator.com/item?id=123456
• fetch_clean_batch

  Fetch multiple URLs at once and return clean text for each.

  Try:Clean content from these three URLs: https://example.com, https://test.com, https://demo.comTry:Fetch and clean multiple GitHub repository pagesTry:Process several news articles to remove HTML noise
• refine_prompt

  Clean up a prompt by removing filler words while preserving important information.

  Try:Refine this prompt for better clarity: I was wondering if maybe you could help me with...Try:Clean up my question while keeping key information intactTry:Optimize this prompt by removing hedging language

Comparable tools

Installation

pip install xelektron-token-enhancer

{
  "mcpServers": {
    "token-enhancer": {
      "command": "python3",
      "args": ["-m", "mcp_server"],
      "env": {
        "REQUESTS_CA_BUNDLE": "/etc/ssl/certs/ca-certificates.crt"
      }
    }
  }
}

FAQ

Does this service require any external API keys?

No, Token Enhancer is a local proxy that works without requiring any external API keys or LLM services.

Which AI clients are compatible with this MCP server?

The README specifically mentions Claude Desktop, Cursor, and OpenClaw as compatible MCP clients.

What's the approximate token reduction I can expect?

According to the documentation, token reduction ranges from 86-99% depending on the source website, with examples showing Yahoo Finance at 99.6%, Wikipedia at 87.4%, Hacker News at 90.1%, and GitHub at 95.9%.

Compare token-enhancer with