VAST-AI-Research/EdenLive

选用指南

AI 根据 README 整理 · 2026/10/20 04:06:23

使用方式

支持离线推理和实时服务两种模式，通过命令行运行，实时服务使用 WebRTC 流式传输视频。

查看 README 依据

**Bidirectional inference**: all frames are denoised jointly. ```bash torchrun --nproc_per_node=2 -m edenlive.scripts.infer \ --config edenlive/configs/wan21_14b_480p_bidir.yaml \ runtime.sequence_parallel.size=2 ``` ```bash python -m edenlive.scripts.infer \ --config edenlive/configs/wan22_5b_720p_bidir.yaml ``` **Few-step inference**: chunk-autoregressive sampling, 4 steps per chunk. ```bash torchrun --nproc_per_node=2 -m edenlive.scripts.infer \ --config edenlive/configs/wan21_14b_480p_few_step.yaml \ runtime.sequence_parallel.size=2 ``` ```bash

python -m edenlive.scripts.infer \ --config edenlive/configs/wan22_5b_720p_few_step.yaml ``` **Real-time service**: uses game frames as input and streams video over WebRTC. Configure the weight directory, service addresses, ports, and GPU count in [`realtime/deploy.conf`](realtime/deploy.conf). 5B uses one GPU by default. Set `NPROC` for multi-GPU inference. Set `TURN_HOST` (the relay address reachable by the browser), `TURN_IFACE` (the relay interface), and `TURN_SECRET` (your own password) in `realtime/deploy.conf`. To run existing games, execute on the GPU host: ```bash cd realtime

部署要求

需要 Linux x86-64 系统、NVIDIA GPU 至少 80 GB 显存（CUDA 13 驱动）、Python 3.10 环境，以及约 210 GB 的模型权重存储空间。

查看 README 依据

- [x] **Real-time streaming inference code**. - [x] **[`game-prototype-turbo`](realtime/skills/game-prototype-turbo/) skill that turns a text prompt into a coarse playable game.** - [x] **A frontend to try the full prompt-to-game pipeline.** ## Installation One Python environment runs both the offline inference in `edenlive/` and the real-time service in `realtime/`. | | Verified version | | --- | --- | | OS / GPU | Linux x86-64, NVIDIA GPUs with 80 GB (CUDA 13 driver) | | Python | 3.10 |

attention and requires SM90, BF16, `flash-attn-4==4.0.0b31`, and `nvidia-cutlass-dsl==4.7.1`. Use `--no-deps` when installing kernels into an existing environment to preserve PyTorch. See [`docs/zh/wan22-fa4.md`](docs/zh/wan22-fa4.md). ## Model weights ```bash hf download VAST-AI/EdenLive --local-dir ./models/EdenLive ``` Everything loads from one directory, `models/EdenLive` under the repository root by default (about 210 GB in total). ``` models/EdenLive/ dit-14b/ diffusion_pytorch_model.safetensors, config.json 14B few-step (chunk-AR) DiT

已知限制

工作台（workbench）因使用 FLUX 模型，仅限非商业用途，且需内容过滤；模型权重并非全部 Apache 2.0 许可。

查看 README 依据

apt-get install coturn # First-time installation bash turn_server.sh # Start TURN first bash start.sh 14b # Model service; or use 5b ``` The workbench — a game library, a chat that builds new games from a text description, and a play window — needs all four services. Its first-frame renderer (the FLUX worker) runs FLUX.2 \[klein\] 9B under the FLUX Non-Commercial License, so the workbench is **for non-commercial use only**, and that license requires content filtering on the images it generates (see [License](#license)). Playing registered games with `start.sh` does not load FLUX.

| Component | License | | --- | --- | | `dit-*`, `vae-*`, `umt5/`, `scheduler-*`, `decoder-*` | Apache 2.0 | | `clip/` (LAION CLIP ViT-H/14 / OpenCLIP) | [MIT](https://huggingface.co/laion/CLIP-ViT-H-14-laion2B-s32B-b79K) | | `vision-encoder/` (DINOv3 and derivatives) | [DINOv3 License](https://github.com/facebookresearch/dinov3/blob/main/LICENSE.md) | | `flux-c2f/` (FLUX.2 \[klein\] 9B plus our LoRA; workbench first frame only) | [FLUX Non-Commercial License](https://huggingface.co/black-forest-labs/FLUX.2-klein-9B/blob/main/LICENSE.md) — non-commercial, non-production use only |