Tongyi-MAI/OpenGCUA

选用指南

AI 根据 README 整理 · 2026/10/20 20:56:49

使用方式

通过命令行启动终端代理或浏览器演示工作室，也可使用原生 macOS 菜单栏应用。终端代理支持交互式 TUI 和纯文本模式。

查看 README 依据

in [Setup, configuration, and troubleshooting](QUICKSTART.md). Grant **CuaDriver.app** access in **System Settings → Privacy & Security → Accessibility** and **Screen Recording**, quit and reopen CuaDriver, then verify the installation: ```bash .venv/bin/mu doctor macos ``` Start either the terminal agent or the browser demo studio. The terminal command automatically uses the visual interface when stdin/stdout are an interactive terminal; pipes and `TERM=dumb` keep the compatible plain-text interface. ```bash # Persistent visual terminal conversation. Type /exit or press Ctrl-D to stop.

.venv/bin/python packages/harness/runtime/mac_agent.py # Force the original line-oriented output (also useful for scripts and logs). .venv/bin/python packages/harness/runtime/mac_agent.py --ui plain # Or start the demo studio at http://127.0.0.1:8800. bash packages/harness/runtime/start_demo.sh ``` The visual terminal keeps an input box available while the agent works. Press Enter to queue a message for after the current turn, or Alt/Option+Enter for a newline. `/queue` shows pending messages; after Ctrl-C aborts a turn, `/queue send` resumes the paused queue or `/queue clear`

installation and wheel builds, see the [SDK guide](packages/sdk/README.md#install). The standalone [native macOS app](packages/macos/README.md) is a separate distribution path with its runtime bundled. The terminal TUI receives new features more frequently and may change faster. The macOS app is the stability-focused version, with a more conservative update cadence. ## Native macOS app [OpenGCUA for macOS](packages/macos/README.md) implements the menu bar assistant: enter a task, collapse into a floating control panel, reply to questions, and

部署要求

需要 macOS 14+、uv、Python 3.11–3.14（推荐 3.12）、Rust/Cargo 1.89+ 和 Xcode Command Line Tools。预构建的 SDK wheels 不需要 Rust。

查看 README 依据

This is the shortest path from a clean clone to an interactive agent. It requires macOS 14+, [uv](https://docs.astral.sh/uv/), Python 3.11–3.14, Rust/Cargo 1.89+, and Xcode Command Line Tools. Python 3.12 is recommended. Prebuilt SDK wheels do not require Rust. ```bash git clone https://github.com/Tongyi-MAI/OpenGCUA.git cd OpenGCUA uv venv --python 3.12 source .venv/bin/activate uv pip install -e ./packages/sdk -e ./packages/harness/runtime # Install the native driver app. Its daemon is included in the app bundle. .venv/bin/mu setup macos .venv/bin/mu doctor macos

已知限制

macOS 真实设备 harness 和跨设备 SDK 为初步版本；原生 macOS 应用目前是本地开发构建，尚未完成公开发布验证。

查看 README 依据

trajectories, efficiency optimization, and evaluation. **What we open in this version:** - 🧠 **[OSWorld integration example](packages/harness/examples/osworld/)** with reference screenshot-action and code-action agents for integrating the OpenGCUA design. - 📜 **Evaluation trajectories** of the 8 frontier models, including GPT-6 Astra, Claude Opus 5, and Gemini 3.8 Flash. - 💻 **[macOS real-device harness](packages/harness/)** (preliminary), a menu-bar app that runs the agent on your own Mac.

review saved results. SwiftUI + AppKit, with Python, the SDK and signed CuaDriver bundled inside the app; no browser or separately installed runtime is required. Apple Silicon / macOS 14+, currently a local development build. See the app guide for building, packaging and the remaining public-release validation. Version tags can automatically build the DMG and Python SDK downloads through GitHub Actions. <a name="sdk"></a> ## 🔌 Cross-Device SDK The Cross-Device SDK is the interface the model programs against. It binds every operation to an explicit