automation-mcp

Overview

Automation MCP provides comprehensive desktop automation capabilities for macOS through the Model Context Protocol. It enables AI assistants to control mouse movements and clicks, simulate keyboard input, take screenshots and analyze screen content, and manage windows with a rich set of tools. The server supports both HTTP and stdio transport methods, making it versatile for different integration scenarios.

Try asking AI

After installing, here are 5 things you can ask your AI assistant:

• mouseClick

  Click at coordinates with left/right/middle button

  Try:Click at position (100, 200)Try:Right-click at current mouse position
• mouseMove

  Move cursor to position

  Try:Move mouse to coordinates (500, 300)Try:Move cursor to center of screen
• type

  Type text or press key combinations

  Try:Type 'Hello World'Try:Press Command+C to copy
• screenshot

  Capture full screen, regions, or specific windows

  Try:Take a screenshot of the entire screenTry:Capture screenshot of region (100, 100, 500, 500)
• getWindows

  List all open windows

  Try:Show me all open windowsTry:List all applications with open windows
• getActiveWindow

  Get current active window

  Try:Which window is currently active?Try:Get information about the frontmost window
• windowControl

  Focus, move, resize, minimize windows

  Try:Minimize the current windowTry:Resize window to 800x600
• screenInfo

  Get screen dimensions

  Try:What are my screen dimensions?Try:Get information about all displays
• colorAt

  Get color of any pixel

  Try:What color is the pixel at (200, 300)?Try:Get the color at current mouse position
• waitForImage

  Wait for images to appear (template matching)

  Try:Wait for the 'submit' button to appearTry:Wait for image matching template.png
• systemCommand

  Common shortcuts (copy, paste, undo, save, etc.)

  Try:Copy the selected textTry:Save the current document
• screenHighlight

  Highlight screen regions visually

  Try:Highlight the area around (100, 200) with a red boxTry:Draw attention to region (300, 400) with green highlight

Comparable tools

Installation

{
  "mcpServers": {
    "automation": {
      "command": "bun",
      "args": ["run", "/path/to/automation-mcp/index.ts", "--stdio"]
    }
  }
}

FAQ

What permissions are required for automation-mcp to work?

Automation-mcp requires macOS Accessibility permissions for mouse/keyboard control and Screen Recording permissions for screenshot functionality. These must be granted in System Settings → Privacy & Security.

Can I use automation-mcp with Windows or Linux?

No, automation-mcp is specifically designed for macOS and only works on Apple's operating system.

Compare automation-mcp with