Beta Release

Proxmox noVNC Console Bridge for Agentic AI

MCP server that exposes Proxmox VM consoles via noVNC so agentic AI models can drive boot-to-desktop workflows through the Proxmox API.

Get Started View on GitHub
20+
Tools Available
100%
No VM Agents
Beta
Active Development

Quick Installation

Get up and running in minutes

1

Clone Repository

git clone https://github.com/Andreansx/VibeConsole-MCP.git
cd VibeConsole-MCP
2

Install Dependencies

npm install
3

Build TypeScript

npm run build
4

Configure Environment

cp .env.example .env
# Edit .env with your Proxmox credentials

Requirements

  • Node.js 20+
  • Proxmox VE 8.0+
  • Proxmox user with VM.Console, VM.Audit, and VM.PowerMgmt permissions
  • Network access to Proxmox API (port 8006)

Powerful Features

Everything you need to control VMs through AI agents

Console Access

Connect to VM consoles via noVNC through Proxmox API with full keyboard and mouse control

AI Agent Control

Send keyboard input and capture real JPEG/PNG screenshots for AI agent interaction

Grid Overlay System

Add coordinate grids to screenshots for spatial awareness and grid-based clicking

Enhanced OCR

Get text with precise bounding boxes, grid cell locations, and regex search support

Smart Clicking

Click at grid references (e.g., "K9") or find and click text via OCR automatically

Boot Monitoring

Wait for boot stages, detect system state, and monitor VM lifecycle events

VM Management

Start, stop, reboot VMs and manage snapshots directly from the agent

High-Quality Screenshots

Proper RFB protocol parsing with Sharp library for crystal-clear screen captures

Available Tools

connect_to_vm Establish WebSocket connection
send_keys Send keyboard input
send_mouse Mouse pointer events
read_screen Capture screenshots
click_grid Click at grid reference
click_text Find and click text
find_text OCR text search
wait_for_boot Monitor boot progress
wait_for_text Wait for text on screen
start_vm Start virtual machine
shutdown_vm Shutdown or stop VM
reboot_vm Reboot VM

MCP Server Configuration

Configure for Claude Desktop, Cursor, or any MCP client

Example MCP Configuration

JSON 
{
  "mcpServers": {
    "vibeconsole": {
      "command": "node",
      "args": ["/path/to/VibeConsole-MCP/dist/index.js"],
      "env": {
        "PROXMOX_HOST": "pve",
        "PROXMOX_PORT": "8006",
        "PROXMOX_TOKEN": "vibeconsole@pve!mcp-token",
        "PROXMOX_SECRET": "your-token-secret",
        "DEFAULT_NODE": "pve",
        "DEFAULT_VMID": "108"
      }
    }
  }
}