nace-ai/kapitsa

选用指南

AI 根据 README 整理 · 2026/10/23 01:56:46

使用方式

通过命令行使用，可启动 opencode、Claude Code、Codex 或 pi，或提供本地 API 服务。

查看 README 依据

Kapitsa is an inference engine for Apple silicon that runs Qwen, Nemotron and Recursive's Flint models locally, built for coding agents. It starts opencode, Claude Code, Codex or pi on a local model, and serves OpenAI and Anthropic APIs. [Quickstart](#quickstart) · [CLI](#cli) · [Benchmarks](#benchmarks) · [Models](#models) · [How KFlash works](docs/kflash.md) · [Docs](docs/usage.md) ## 🔥 What's new

kapitsa serve # chat + OpenAI/Anthropic APIs at http://127.0.0.1:8000 kapitsa claude # Claude Code on Kapitsa kapitsa doctor # this Mac's GPU and memory, and which models fit it kapitsa bench # benchmark this Mac, share it with the community kapitsa bench compare # the same test against the other engines installed here kapitsa pull 27b # download a model without starting it kapitsa list # downloaded models and their size kapitsa rm 27b # delete a downloaded model

部署要求

需要 Apple Silicon Mac（M1 或更新）和 macOS 14 Sonoma 或更高版本。

查看 README 依据

- [2026/10] 📊 **`kapitsa bench compare`: see it on your own Mac.** The same test against every engine installed here, in one command. ## Quickstart **Requirements:** a Mac with Apple silicon (M1 or newer) and macOS 14 Sonoma or later. ```bash brew install nace-ai/tap/kapitsa # or: curl -fsSL https://raw.githubusercontent.com/nace-ai/kapitsa/main/install.sh | bash ``` ```bash kapitsa opencode --model 35b # also: claude, codex, pi ``` _{On a 16-24 GB Mac use `--model 9b`, or `4b` for the quickest replies.} ## CLI ```bash

已知限制

部分模型需要特定内存大小，例如 16 GB Mac 上使用 4B 和 9B 模型，32 GB 以上才能运行 27B 等大型模型。

查看 README 依据

| **Nemotron Nano 9B v2** · `nano-9b`<br>_{hybrid Mamba-2 · NVFP4, 7.9 GB} | 🟩 **25**<br>_{no spec} | — | — | — | — | 18 | 14<br>_{Q4_K_M} | — | </details> <sub>Other precisions: `--model 35b:6bit` is five times closer to bf16 than the 4-bit default ([KL](docs/benchmarks.md#quality-qwen36-35b-a3b-against-bf16-2026-10-19)). All but Lightning, Dory, the two Nemotron Nanos, Flint and the 35B's `16gb` read images. Memory: 16 GB for the 4B and 9B models, 32 GB

for the 27B, 35B, Lightning, Bolt and Flint, 96 GB for Super-VL, 128 GB for Flash-Next. On a 16 or 24 GB Mac, `35b` takes its `16gb` variant: unsloth's 2-bit GGUF, downloaded and imported in one step ([how](docs/usage.md#gguf-files)). [Every model's variants and draft models](docs/usage.md#models-and-downloads)</sub> ## How it works <picture> <source media="(max-width: 600px)" srcset="docs/assets/how-it-works-narrow.svg"> <source media="(prefers-color-scheme: dark)" srcset="docs/assets/how-it-works-dark.svg">