SinapisAI/collective-model-intelligence

选用指南

AI 根据 README 整理 · 2026/10/17 02:46:04

使用方式

通过命令行运行示例，支持文本、多模态和中文场景，可复现报告中的预测运行。

查看 README 依据

RobustRouteBench contains **35,278 instances** across General Text (63 candidate models), Multimodal (45), and Chinese (10). Final report scoring retains **18,982 requests** after excluding development source groups and linked variants. Use **Python 3.10+**. The examples need no model API key. ```sh git clone https://github.com/SinapisAI/collective-model-intelligence.git cd collective-model-intelligence python -m venv .venv source .venv/bin/activate python -m pip install -e '.[data,orbit]' python examples/quickstart.py --scenario text # train and evaluate on validation ```

Other scenarios: `--scenario multimodal` or `--scenario chinese`. Replay the **65 prediction runs across 13 methods** with the report's split exclusions and nominal-budget nAUC: ```sh python -m examples.reproduce_report --mode replay --output runs/report-replay ``` [Dataset and protocol](benchmark/README.md) · [Reproduction guide](docs/reproducibility.md) · [Comparison methods](methods/README.md) ## Citation and license ```bibtex @techreport{sinapisai2026collectivemodelintelligence, title = {Toward Collective Model Intelligence:

部署要求

需要 Python 3.10 或更高版本，示例无需模型 API 密钥。

查看 README 依据

RobustRouteBench contains **35,278 instances** across General Text (63 candidate models), Multimodal (45), and Chinese (10). Final report scoring retains **18,982 requests** after excluding development source groups and linked variants. Use **Python 3.10+**. The examples need no model API key. ```sh git clone https://github.com/SinapisAI/collective-model-intelligence.git cd collective-model-intelligence python -m venv .venv source .venv/bin/activate python -m pip install -e '.[data,orbit]' python examples/quickstart.py --scenario text # train and evaluate on validation ```