ollaya-dev/ollaya

选用指南

AI 根据 README 整理 · 2026/10/16 21:17:02

使用方式

通过命令行使用，支持 serve、run、pull 等命令，也提供 HTTP API 和 MCP 服务。

查看 README 依据

- **One binary.** `ollaya serve` runs the daemon; `ollaya run`, `pull`, `list`, `ps`, `show`, `rm`, `cp`, `stop` and `create` work the way they do in Ollama. If the daemon isn't running, the CLI starts it. - **TypeSafe-compatible.** `POST /v1/systemone`, `/v1/decisions` and `GET /v1/models` are wire-identical to TypeSafe. The official SDK works unchanged when you set `TYPESAFE_BASE_URL=http://localhost:11435`. - **Native API.** `/api/decide` adds routing information and timings. `/api/pull` streams NDJSON progress, and there are `/api/tags`, `/api/show`, `/api/ps` and more. See

[docs/api.md](docs/api.md). - **Weights come from their authors.** Ollaya publishes only small ONNX graphs, about 3 MB each. These graphs read the original weight files (usually `model.safetensors`) from the author's Hugging Face repository, pinned to a commit and verified by sha256. Models whose authors publish GGUF files (`winnow`, `jevk5`, `jeb`) run that file itself on llama.cpp. Ollaya never re-hosts weights. - **For agents.** `ollaya mcp` serves the models to Claude Code, Claude Desktop, Cursor and other MCP clients (`claude mcp add ollaya -- ollaya mcp`), and the

部署要求

支持 Linux、macOS（Apple silicon）和 Windows，需要 glibc ≥ 2.38（Linux）或特定驱动版本（NVIDIA GPU）。

查看 README 依据

measurements are at [ollaya.dev/results](https://ollaya.dev/results). <p align="center"> <a href="https://ollaya.dev/results#speed"><img src="https://ollaya.dev/data/results/speed.svg" alt="Median latency of five-question requests for every model on each GPU and CPU we measured" width="760"></a> </p> ## Install - **Linux** (x86_64 or arm64, glibc ≥ 2.38, e.g. Ubuntu 24.04+): `curl -fsSL https://ollaya.dev/install.sh | sh`. When an NVIDIA GPU is present (driver R525+), the installer adds the CUDA runtime: CUDA 13 for R580+, CUDA 12 for older drivers.

- **macOS** (Apple silicon): the same command. - **Windows** (x64): `irm https://ollaya.dev/install.ps1 | iex` in PowerShell. When an NVIDIA GPU is present (driver R527+), the installer adds the CUDA runtime, as on Linux. - **Desktop app** for macOS, Windows and Linux: start and stop the server, download models and run them in one window. On macOS it lives in the menu bar. Get it from [ollaya.dev/download](https://ollaya.dev/download). - **Docker:** `docker run -d --gpus=all -p 11435:11435 ghcr.io/ollaya-dev/ollaya:cuda`

已知限制

模型各有其许可证，部分模型（如 d1）对大型组织的商业使用有限制。

查看 README 依据

DeepMind; the Cygnet recipe is MIT), `snap` (logitlab, on MiniCPM5 by OpenBMB; snap's prompt is MIT), `decima` (A. M. Madani, on mmBERT-base by JHU CLSP and multilingual-e5-small by intfloat, both MIT) and `nli:modernbert-large` are Apache-2.0, and `nli:deberta-v3-large` (Moritz Laurer) is MIT. `arbiter`'s LoRA adapter and head (Codekins Pvt Ltd, Zyot Lab) are Apache-2.0; its base model, Gemma 3 4B IT by Google DeepMind, is under the Gemma Terms of Use. `d1` (Liquid AI) is under the LFM Open License v1.0: commercial use by an organization with US$10 million or more in annual revenue is not