joeblau/subvox

选用指南

AI 根据 README 整理 · 2026/10/31 14:16:24

使用方式

可通过命令行构建和运行，或打开Xcode项目运行。

查看 README 依据

# Subvox A macOS prototype that tests whether AirPods Pro head-motion data (`CMHeadphoneMotionManager`) carries enough information to turn **silently mouthed words into text**. It doesn't use a language model. It's a small-vocabulary template recognizer plus a statistical test that tells you whether the signal is real. ## Build & run ```sh brew install xcodegen # once xcodegen generate open Subvox.xcodeproj # ⌘R ``` Or from the command line: ```sh xcodebuild -project Subvox.xcodeproj -scheme Subvox -derivedDataPath build -allowProvisioningUpdates build

部署要求

需要macOS 14+，以及支持头部追踪的AirPods Pro或其他耳机，并连接为Mac的音频输出。首次启动需授予Motion权限。

查看 README 依据

open build/Build/Products/Debug/Subvox.app xcodebuild -project Subvox.xcodeproj -scheme Subvox -derivedDataPath build test ``` Requires macOS 14+, AirPods Pro or another headphone that supports head tracking, connected as the Mac's audio output. On first launch, grant **Motion**. The mic and speech prompts only appear when you start the mic. ## Screens | Screen | What it does | |---|---| | **Sensors** | Live plots of user acceleration, rotation rate and attitude, the measured sample rate, a mic input picker and level meter, and a recorder for experiment sessions. |

已知限制

耳机运动数据经过处理且速率较低（约25Hz），语音检测加速度计和内麦克风未暴露。模板是用户和会话特定的，重新佩戴AirPods可能改变信号。

查看 README 依据

- `meta.json`: condition, prompt, and the audio start offset for aligning audio with motion. Suggested runs: the same 5-word script under **Normal speech**, **Whisper** and **Silent mouthing**, 10 reps each. Then, in Train, compare the Evaluate results across feature sets. The training set lives at `~/Library/Application Support/Subvox/dataset.json`. ## Known limits - Headphone motion is processed and low-rate (roughly 25 Hz on AirPods). The speech-detecting accelerometer and the inward mic are not exposed. Expect jaw and head movement, not vocal vibration.

- Templates are user- and session-specific. Re-seating the AirPods can shift the signal. - Choosing AirPods as the mic input switches them to the Bluetooth headset (HFP) profile.