xiaozhi-esp32-server

Overview

xiaozhi-esp32-server is a comprehensive backend service designed for ESP32 device management and control. It implements the Model Context Protocol (MCP) as one of its communication methods, allowing seamless integration with MCP clients. The server supports multiple protocols including MQTT+UDP, Websocket, and MCP endpoints, enabling real-time device communication and control. It features voice recognition capabilities, voiceprint identification, and a knowledge base system, making it suitable for building intelligent IoT ecosystems. The project is actively maintained with regular updates and comprehensive documentation.

Try asking AI

After installing, here are 5 things you can ask your AI assistant:

• mqtt_control

  Send control commands to ESP32 devices via MQTT protocol

  Try:Turn on the bedroom lightTry:Set the thermostat to 22 degreesTry:Start the coffee machine
• voice_command

  Process voice commands from users and convert to actionable tasks

  Try:What's the weather like today?Try:Set a reminder for 5pmTry:Play some relaxing music
• device_status

  Query the current status of connected ESP32 devices

  Try:Is the air purifier running?Try:What's the current room temperature?Try:Check if the door is locked
• voiceprint_identify

  Identify users based on their voice patterns for personalized interaction

  Try:Who just spoke?Try:Recognize me by my voiceTry:Check if this is John speaking
• knowledge_query

  Retrieve information from the integrated knowledge base

  Try:What's the recipe for lasagna?Try:Explain quantum computing simplyTry:Find information about local attractions
• mcp_command

  Execute MCP protocol commands for device communication

  Try:Send MCP command to device 5Try:Configure smart home settings via MCPTry:Query device capabilities using MCP
• multimodal_analysis

  Process visual information from camera-equipped devices

  Try:What's in this photo?Try:Read the text on this documentTry:Identify the object in front of me
• memory_recall

  Retrieve past conversation history and context for personalized responses

  Try:What did we talk about last time?Try:Remember my preferences for musicTry:Recall our previous discussion about travel plans
• intent_recognition

  Identify user intent behind their requests for appropriate action

  Try:What is the user trying to accomplish?Try:Classify this requestTry:Determine the appropriate action for this command
• text_to_speech

  Convert text to speech for audio responses to users

  Try:Say 'Hello, how can I help you?'Try:Announce that dinner is readyTry:Play this message: 'The meeting has been moved to 3pm'
• schedule_task

  Schedule automated tasks or reminders for future execution

  Try:Remind me to water plants at 6pmTry:Set a timer for 30 minutesTry:Schedule the lights to turn on at sunset
• websocket_communicate

  Communicate with devices via WebSocket protocol for real-time interaction

  Try:Send real-time sensor dataTry:Stream audio to deviceTry:Receive live updates from smart home system

Note: Tools were inferred from feature descriptions and video demonstrations mentioned in the README. While the README mentions MCP protocol support and various capabilities, it doesn't provide explicit tool names or signatures. The tool names ar

Comparable tools

Installation

{
  "mcpServers": {
    "xiaozhi-esp32": {
      "command": "node",
      "args": ["/path/to/xiaozhi-esp32-server/server.js"]
    }
  }
}

FAQ

What MCP protocols does this server support?

The server supports client MCP protocol, server MCP protocol, MCP access point protocol, and custom tool functions.

What hardware requirements are needed?

For minimal setup with FunASR: 2 cores, 4GB RAM. For full API usage: 2 cores, 2GB RAM. For full module installation: 4 cores, 8GB with FunASR or 2 cores, 4GB with all APIs.

Compare xiaozhi-esp32-server with