Claude × TouchDesigner MCP | Controlling Real-Time Visuals with AI

What Can You Do with Claude and TouchDesigner Integration?

As of 2026, there are three main integration approaches available.

1. TouchDesigner MCP Server — A bridge that allows Claude to create and delete nodes in TD projects and execute Python scripts within TD
2. VIBE-CONTROLLER — A tool that generates HTML Canvas UIs from natural language instructions alone and reloads them into TD
3. Claude Code Skill "TouchDesigner Guide" — A skill set that runs Claude Code as a TD-dedicated assistant

All of these significantly lower the cost of operating TD, eliminating everyday friction such as "I can't remember the node name" or "writing Python scripts from scratch is a hassle."

Method 1: TouchDesigner MCP Server — AI Directly Operates the Project

touchdesigner-mcp is a server that uses MCP (Model Context Protocol) to allow Claude to read and write to running TD projects. Built with TypeScript/Python under the MIT license, version 1.4.9 was available as of June 2026.

Key Tools Provided

• Node creation, deletion, and method calls — Add operators with a single instruction to Claude
• Python script execution — Run arbitrary code within TD's Python context
• Parameter and error retrieval — Load network state into Claude and delegate debugging
• Documentation reference — Claude automatically references help for TD Python modules

This means you can simply say "create a noise texture and connect it to the output," and Claude will generate the corresponding nodes and wire them up.

TouchDesigner MCP Installation Steps

Follow the docs/installation.md in the official repository (https://github.com/8beeeaaat/touchdesigner-mcp).

Prerequisites

• TouchDesigner (latest version recommended)
• Node.js 18.x or later (for the NPM method)

Setup

1. Download touchdesigner-mcp-td.zip from the GitHub releases page and extract it
2. Import mcp_webserver_base.tox into your TD project (preserve the folder structure)
3. Launch TD in that state

Connecting to Claude (Choose from 3 Methods)

Method A: MCP Bundle (for Claude Desktop — simplest)

1. Simply double-click the .mcpb file to register it with Claude Desktop

Method B: NPM Package (for Claude Code)

1. Add the following to claude_desktop_config.json

{
  "mcpServers": {
    "touchdesigner-mcp": {
      "command": "npx",
      "args": ["-y", "touchdesigner-mcp-server"]
    }
  }
}

Method C: Docker Container

1. Clone the repository and run docker-compose up -d
2. Choose HTTP transport or stdio passthrough

Verification

Confirm that the "touchdesigner-mcp server" appears in Claude. If it does, Claude is ready to accept instructions for your running TD project.

Method 2: VIBE-CONTROLLER — Auto-Generate UI from a Single Sketch

VIBE-CONTROLLER is a tool that deploys HTML Canvas-based controllers within TD using nothing but natural language descriptions.

Basic Usage

1. When you think "I want more knobs" during a VJ set, describe the changes to Claude Code in text
2. Claude automatically generates the corresponding HTML code
3. Reload in TD and the new UI is reflected instantly

"Generate UI from a hand-drawn sketch" is also possible. Simply upload a photo to the /sketch-to-interface skill within Claude Code, and even a napkin-level doodle sketch gets converted into a functional controller.

Differences Between Basic and Pro Versions

VIBE-CONTROLLER comes with a dedicated CLAUDE.md, designed so that Claude receives instructions while already understanding the UI structure of the project, reducing generation errors caused by incorrect context.

Method 3: Claude Code Skill "TouchDesigner Guide"

The MCP marketplace (mcpmarket.com) offers a Claude Code-dedicated skill called "TouchDesigner Guide." Applying this skill makes Claude operate with an understanding of TD-specific constraints.

Problems the Skill Solves

When using a standard LLM with TD, it frequently generates non-existent operator names or produces parameter settings that conflict with actual TD specifications. This skill enforces the use of a custom utility called op.TDAPI, improving the accuracy of node creation, network layout, and parameter configuration.

It is effective when you want to create a state where you can "instruct Claude without hesitation" — such as rewriting TD in real time during a live performance session.

Real-World Use Cases

Real-Time Modifications During VJ Performances

During a performance, there is no time to manually find nodes and change parameters when you feel "I want this effect to be more intense." Simply typing instructions — not speaking — to Claude with MCP connected applies changes to the running TD project.

Debugging Interactive Installations

When sensor input mapping is not working properly, you can have Claude read the error logs and handle Python script fixes. You can complete the work without switching back and forth between TD and Claude Code.

Accelerating Prototyping

With a single instruction like "add a new layer to this generative art pattern," Claude proposes a node configuration and implements it within TD. This speeds up the pace of idea validation.

Current Limitations and Caveats

• TD-side connection required — If mcp_webserver_base.tox is not always included in the project, the connection will drop
• Impact on complex networks — When Claude generates nodes in large TD projects, it is recommended to verify the impact on existing network structures in advance
• Script execution permissions — Since Python scripts can be executed directly within TD, it is better to keep Claude's instructions clearly scoped to prevent unintended operations
• English instructions are more stable — At present, instructions to the MCP server tend to produce more accurate results in English

Summary

The integration of Claude and TouchDesigner is maturing across three layers: the MCP server, VIBE-CONTROLLER, and Claude Code skills. An environment is taking shape that cuts the time spent manually wiring nodes, allowing creators to focus on the creative decisions of "how to present visuals."

The fastest way to get started is to download touchdesigner-mcp-td.zip and incorporate mcp_webserver_base.tox into your project. Using the .mcpb file for Claude Desktop, the setup is literally complete with a single double-click.

Reference URLs

• TouchDesigner MCP Repository: https://github.com/8beeeaaat/touchdesigner-mcp
• Installation Guide: https://github.com/8beeeaaat/touchdesigner-mcp/blob/main/docs/installation.md
• VIBE-CONTROLLER: https://derivative.ca/community-post/asset/vibe-controller-touchdesigner-build-any-ui-claude-code/74272