mrsarac/ff-tracking

选用指南

AI 根据 README 整理 · 2026/10/17 09:36:19

使用方式

通过命令行运行render.sh脚本生成视频，也可使用fframes CLI工具进行预览、提取帧等操作。

查看 README 依据

render pipeline, see [Windows setup](docs/WINDOWS.md). The macOS instructions follow. Requirements: macOS with Apple silicon (Skia on Metal), Rust, ffmpeg, Python 3 with `numpy` and `scipy`. The README images also need Pillow and `img2webp`. ```bash git clone https://github.com/mrsarac/ff-tracking && cd ff-tracking tools/render.sh # → out/tracking.mp4 ``` `render.sh` builds the workspace, exports the tracks, renders pass 1, synthesizes the sound and renders pass 2. It takes about 40 s on an M3 Pro, plus the first build.

Every pass is an fframes CLI, so the usual tools work on each of them: ```bash target/release/lens strip all -n 12 # contact sheet of the final video target/release/lens frame 81 -o frames # one full-size frame target/release/lens preview # real-time window with sound target/release/lens audio analyze # loudness, true peak LENS_STAGE=1 target/release/lens frame 81 # stop the shader after a step (0-3), as in the image above python3 -I tools/readme_media.py # rebuild the images in this README ``` ## Slab score

部署要求

需要macOS（Apple silicon，Skia on Metal）、Rust、ffmpeg、Python 3（含numpy和scipy）。Windows支持Vulkan，但需参考Windows setup文档。

查看 README 依据

[Slab](https://github.com/nooga/slab): a darker, heavier piece at 120 BPM, so every cut lands on a beat. It reads the same `out/tracks.json`, plus `out/camera.json` from the `camera` binary, so the mix follows the lens. The tracked box pans the lock blips and keystrokes, the screen's slide pans the pad, riser and glitches, each zoom push opens the bass filter, and the red lock frames tear the bass. See [Slab score](#slab-score). ## Quick start macOS uses Metal; Windows uses Vulkan. For Windows requirements and the PowerShell

render pipeline, see [Windows setup](docs/WINDOWS.md). The macOS instructions follow. Requirements: macOS with Apple silicon (Skia on Metal), Rust, ffmpeg, Python 3 with `numpy` and `scipy`. The README images also need Pillow and `img2webp`. ```bash git clone https://github.com/mrsarac/ff-tracking && cd ff-tracking tools/render.sh # → out/tracking.mp4 ``` `render.sh` builds the workspace, exports the tracks, renders pass 1, synthesizes the sound and renders pass 2. It takes about 40 s on an M3 Pro, plus the first build.

已知限制

README提到shader无法采样同一帧的SVG子树，因此需要两遍渲染；另外，Slab score需要外部Slab工具才能重新渲染。

查看 README 依据

`.image("iChannel0", &frame.get_synced_video_frame(..)?.into_image())`. That is what makes the two-pass camera possible. - `flat` is a reserved word in SkSL (a GLSL ES interpolation qualifier), so name helpers something else. - At the `Video` level, never return `Svgr::empty()`; return a root `<svg>`. An empty root is an error, and late in a Skia render it surfaces only after the encoders drain ([fframes#209](https://github.com/dmtrKovalenko/fframes/issues/209)). - The two passes exist because a shader can't yet sample an SVG subtree of the same frame.

`tools/score.sh` is `render.sh` with the Slab score in place of `sfx.py`: ```bash tools/score.sh # uses the committed render, score/score.wav SLAB=/path/to/slab tools/score.sh # renders the score again from Rust SLAB=/path/to/slab SCORE_IMPL=python tools/score.sh # original Python reference ``` Rendering needs a [Slab](https://github.com/nooga/slab) checkout built with `zig build -Doptimize=ReleaseFast`. The Rust `score` crate uses the MIT-licensed [slabkit-rs](https://github.com/nooga/slabkit-rs) library to write the project