blendi-remade/prompt2rig

选用指南

AI 根据 README 整理 · 2026/10/23 06:56:17

使用方式

通过命令行启动服务器和 HQ worker，在浏览器中使用界面生成动画，支持导出 GLB 文件。

查看 README 依据

<p align="center"><img src="docs/media/app.png" alt="The prompt2rig app: the generated clip with its pose overlay on the left, Michelle mid side kick on the stage, the take list along the bottom." width="100%"></p> ## Quick start **Needs:** Node 18+ and a [fal](https://fal.ai) API key. For the HQ pass: Windows, an NVIDIA GPU, [`uv`](https://docs.astral.sh/uv/) and `ffmpeg` on PATH. ```bash git clone https://github.com/blendi-remade/prompt2rig && cd prompt2rig cp .env.example .env # add your FAL_KEY

node server.mjs # → http://localhost:5177 (the live preview works now) ``` **HQ pass (recommended):** ```powershell hq\setup.ps1 # venv, CUDA PyTorch, GVHMR + ~5 GB of checkpoints ``` Download **SMPL-X v1.1 (NPZ)** from [smpl-x.is.tue.mpg.de](https://smpl-x.is.tue.mpg.de/) (free registration) and put `SMPLX_NEUTRAL.npz` in `hq/body_models/smplx/`. **Finger tracking (optional):** WiLoR needs the MANO hand model. Register at [mano.is.tue.mpg.de](https://mano.is.tue.mpg.de), download *Models & Code* (`mano_v1_2.zip`), then: ```powershell

hq\.venv\Scripts\python hq\setup_hands.py $HOME\Downloads\mano_v1_2.zip # WiLoR weights + MANO ``` Without MANO, fingers fall back to MediaPipe Hands (rougher depth). Then start the worker next to the web server: ```powershell hq\.venv\Scripts\python hq\worker.py # → 127.0.0.1:5178, loads once and stays warm ``` ## Using it - **Generate** from a prompt or a preset. Every clip starts from the same flux-made *performer* (one person, full body, plain backdrop, static camera), which is the input pose estimation likes best.

部署要求

需要 Node 18+ 和 fal API 密钥；HQ 模式需要 Windows、NVIDIA GPU、uv 和 ffmpeg，并需下载 SMPL-X 模型（免费注册）和可选的 MANO 手部模型。

查看 README 依据

<p align="center"><img src="docs/media/app.png" alt="The prompt2rig app: the generated clip with its pose overlay on the left, Michelle mid side kick on the stage, the take list along the bottom." width="100%"></p> ## Quick start **Needs:** Node 18+ and a [fal](https://fal.ai) API key. For the HQ pass: Windows, an NVIDIA GPU, [`uv`](https://docs.astral.sh/uv/) and `ffmpeg` on PATH. ```bash git clone https://github.com/blendi-remade/prompt2rig && cd prompt2rig cp .env.example .env # add your FAL_KEY

node server.mjs # → http://localhost:5177 (the live preview works now) ``` **HQ pass (recommended):** ```powershell hq\setup.ps1 # venv, CUDA PyTorch, GVHMR + ~5 GB of checkpoints ``` Download **SMPL-X v1.1 (NPZ)** from [smpl-x.is.tue.mpg.de](https://smpl-x.is.tue.mpg.de/) (free registration) and put `SMPLX_NEUTRAL.npz` in `hq/body_models/smplx/`. **Finger tracking (optional):** WiLoR needs the MANO hand model. Register at [mano.is.tue.mpg.de](https://mano.is.tue.mpg.de), download *Models & Code* (`mano_v1_2.zip`), then: ```powershell

已知限制

HQ 路径（GVHMR、SMPL-X、WiLoR、MANO）仅限研究/非商业用途，商业使用需替换或获得许可；翻转、旋转、地面动作或手臂交叉等动作可能难以准确估计。

查看 README 依据

celebrations, clear hand shapes. Flips, spins, floor work and crossed or hidden arms confuse any single-camera pose estimator; the presets and the prompt template steer away from them. ## Renders and recordings **Blender.** Turn a saved take into a studio clip (cyclorama, three-point light, slow camera arc), headless: ```powershell & "C:\Program Files\Blender Foundation\Blender 5.2\blender.exe" -b -P tools/render_blender.py -- takes/<take>.glb --side-by-side ``` It writes `renders/<take>.mp4` (1080×1920, or `--res 1920x1080`) and, with `--side-by-side`, the source clip next to the render.

| Geist Pixel · Instrument Sans · Sometype Mono | SIL OFL 1.1 (bundled in `public/brand/fonts`) | ✅ | | Mixamo characters | Adobe Mixamo terms (loaded from the three.js CDN, not redistributed) | ✅ in your own projects | | FLUX 3 Max, H3 Max Turbo, FLUX.1 schnell | fal and model-provider terms | per those terms | In short: the web app, the live preview and video generation are commercially usable; the **HQ path (GVHMR, SMPL-X, WiLoR, MANO) is research / non-commercial**, so a commercial product would need to replace or license those pieces. Tested on Windows 11 with an RTX 4090.