ComputerUseAgent/AutoCua

选用指南

AI 根据 README 整理 · 2026/11/1 09:17:14

适用场景

适用于需要自动化操作桌面应用、浏览器、iOS/Android 设备等场景，例如网页搜索、购物、数据整理等。

查看 README 依据

**Full capabilities:** **[agent_capabilities.md](https://github.com/AutoCua/AutoCua/blob/main/agent_capabilities.md)** https://github.com/user-attachments/assets/03a9a5ab-5049-4911-b725-63792d1b6253 | | Windows | Linux | macOS | |:--|:--:|:--:|:--:| | **Computer use** — any desktop app, with real mouse and keyboard input | ✓ | ✓ | ✓ | | **Browser skills** — Chrome, Firefox, Edge, Brave and Opera | ✓ | ✓ | ✓ | | **Shell use** — a coding agent in a real terminal | ✓ | ✓ | ✓ | | **Web use** — your own Chrome, driven through the AutoCua extension | ✓ | ✓ | ✓ |

| **Mobile use** — an iOS Simulator, or your iPhone or iPad, over USB, or Wi-Fi in the app | — | — | ✓ | | **Mobile use** — an Android emulator, or your Android phone, over USB, or Wi-Fi in the app | ✓ | ✓ | ✓ | </div> --- ## Web agent: fast mode 6.1 seconds for a flight search. Agent mode: web. https://github.com/user-attachments/assets/8cc797d5-5556-40a9-bbfc-5d6aa8880fb8 ## Web agent: quality mode Under a minute for three tasks in one run: an iPhone 18 Pro into the Apple bag, a case into the Amazon basket, and a Google Sheet of Meta's five-year financials. Agent mode: web.

https://github.com/user-attachments/assets/82bf6163-55c9-4cc4-95e7-9c6466f2a25d ## iOS agent: iPhone use A paired iPhone, driven over the USB cable, or Wi-Fi in the app. Agent mode: mobile use, iOS. https://github.com/user-attachments/assets/3c22eb45-d939-4742-9053-22ecc75b416f --- ## Pick a surface One string decides what the agent drives. Everything else stays the same. ```python from AutoCua.agent_launcher import run_agent run_agent(mode="web use", provider="openrouter", model="gemini-3.8-flash", task="Open wikipedia.org and summarise today's featured article.") ```

目标用户

面向需要自动化操作计算机和移动设备的开发者和高级用户。

查看 README 依据

<div align="center"> <img src="AutoCua/logo/autocua-bots.png" alt="AutoCua" width="820"/> <h1>AutoCua</h1> <h3>Automatic Computer Use Agent.<br/>Mac, Windows, Linux, real phone, simulator, any browser.<br/>A multi-agent harness engine.</h3> [](https://pypi.org/project/AutoCua/) [](https://pypi.org/project/AutoCua/)

使用方式

通过 Python 脚本调用 run_agent 函数，或使用命令行直接运行 coder 和 minions 模块。

查看 README 依据

https://github.com/user-attachments/assets/82bf6163-55c9-4cc4-95e7-9c6466f2a25d ## iOS agent: iPhone use A paired iPhone, driven over the USB cable, or Wi-Fi in the app. Agent mode: mobile use, iOS. https://github.com/user-attachments/assets/3c22eb45-d939-4742-9053-22ecc75b416f --- ## Pick a surface One string decides what the agent drives. Everything else stays the same. ```python from AutoCua.agent_launcher import run_agent run_agent(mode="web use", provider="openrouter", model="gemini-3.8-flash", task="Open wikipedia.org and summarise today's featured article.") ```

or 15,000 characters, with `shell` keeping a 50-line tail, `view` capped at 2,000 lines and `grep` at 8 MB, so one wide search or noisy build log can never blow up the conversation. Run either directly. They start in their own workspace, so point them at an absolute path when the work is in an existing project: ```bash python -m AutoCua.mac.agent.coder --task "refactor the auth module in /Users/me/projects/api" --provider anthropic --model claude-sonnet-5

部署要求

需要 Python 3.10 或更高版本。Linux 需要 GNOME 桌面（Wayland 测试通过），并安装 AT-SPI、GTK 等系统包。macOS 需要 Apple Silicon 或 Intel。

查看 README 依据

<div align="center"> <img src="AutoCua/logo/autocua-bots.png" alt="AutoCua" width="820"/> <h1>AutoCua</h1> <h3>Automatic Computer Use Agent.<br/>Mac, Windows, Linux, real phone, simulator, any browser.<br/>A multi-agent harness engine.</h3> [](https://pypi.org/project/AutoCua/) [](https://pypi.org/project/AutoCua/)

> Shipping it inside the wheel would make this project its distributor to every person who runs > `pip install`, which that licence does not allow for free. You receive it from its author. > See [THIRD_PARTY_NOTICES.md](https://github.com/AutoCua/AutoCua/blob/main/THIRD_PARTY_NOTICES.md). ### Linux, from pip The Linux wheel is built for x86_64 and needs a GNOME desktop (tested on Ubuntu with Wayland; X11 is not tested yet). The agent reads and drives the desktop through AT-SPI, GTK and the XDG RemoteDesktop portal. Those bindings come from your distro, not from pip, so install them once:

[](https://github.com/AutoCua/AutoCua/blob/main/README.md#the-browser-agent) [](https://github.com/AutoCua/AutoCua/blob/main/README.md#providers-and-models) <table><tr><td> ```bash pip install AutoCua ``` </td></tr></table> _{Windows 10 and 11 · Linux with GNOME · macOS on Apple Silicon or Intel}

已知限制

Linux 上 X11 尚未测试；Windows 上 UAC 提示需要手动安装 Interception 驱动，否则任务在遇到提权提示时会停止。

查看 README 依据

### Answering UAC prompts on Windows Windows' user-mode `SendInput` cannot deliver input to the UAC secure desktop, so an elevation prompt can only be answered from kernel mode. That is the one thing the [Interception](https://github.com/oblitum/Interception) driver does here. `pip install` cannot set it up, and no packaging trick changes that: a wheel is unpacked and never executed, pip does not run elevated, and the driver binds its input slots only when it loads **at boot**. Without it **every mode still works** — you simply lose UAC handling, and a

> Shipping it inside the wheel would make this project its distributor to every person who runs > `pip install`, which that licence does not allow for free. You receive it from its author. > See [THIRD_PARTY_NOTICES.md](https://github.com/AutoCua/AutoCua/blob/main/THIRD_PARTY_NOTICES.md). ### Linux, from pip The Linux wheel is built for x86_64 and needs a GNOME desktop (tested on Ubuntu with Wayland; X11 is not tested yet). The agent reads and drives the desktop through AT-SPI, GTK and the XDG RemoteDesktop portal. Those bindings come from your distro, not from pip, so install them once: