Skip to content

Local models install and run on a Mac, Windows or Linux with nothing installed first - #188

Merged
shinyobjectz merged 1 commit into
mainfrom
local-models
Nov 19, 2026
Merged

shinyobjectz merged 1 commit into
mainfrom
local-models

Conversation

@shinyobjectz

Copy link
Copy Markdown
Owner

Every local model (SAO, TokenSynth, matchmove, splat, goo) used to install through a sh script that needed uv already installed (brew install uv), and the engine ran .venv/bin/python, so none of them could install or run on Windows, and a Mac without Homebrew couldn't install any. SAO, matchmove and splat also called an installed ffmpeg/ffprobe at run time, and TokenSynth needed git.

Install

  • Each model's setup is now tools/<model>/setup.py (standard library only, on tools/local_setup.py). raea runs it through uv on any OS (raea_io_assets::run_setup), and uv brings its own Python.
  • raea finds uv on the PATH, or else fetches its own pinned 0.12.24 once into ~/.cache/raea-tools/uv (where tools/ensure.sh already puts it), checked against its SHA-256 and moved into place whole.
  • setup.sh is now a thin wrapper for running a setup by hand on a Mac or Linux. With no uv anywhere on an Apple-silicon Mac, it calls ensure.sh uv.

Run

  • SAO writes its WAV with Python's wave module (the same samples). Off a Mac it runs on ONNX Runtime, with CUDA where nvidia-smi finds a GPU; RAEA_SAO_CUDA=0|1 overrides that.
  • matchmove and splat read footage through PyAV, whose wheels carry FFmpeg's own libraries. Checked against the ffmpeg commands they replace on a 720p clip: full-size frames are identical; area-scaled frames differ by 0.54 levels on average.
  • splat fetches Brush v0.3.0's release build for macOS arm64, Linux x86_64 or Windows x86_64, each checked against its SHA-256.
  • goo runs Taichi on Metal on a Mac, else on its best GPU (CUDA, Vulkan) or the CPU, and reports the backend it actually ran on.
  • TokenSynth fetches its code as GitHub's archive at a pinned commit, so no git is needed. coremltools is installed only on a Mac.
  • The engine runs .venv\Scripts\python.exe and brush_app.exe on Windows.

tools/release.sh now ships tools/local_setup.py.

Tested

  • Mac, with only /usr/bin:/bin:/usr/sbin:/sbin on the PATH (no Homebrew, no uv, no ffmpeg):
    • raea sao fetched raea's uv, installed SAO and made a 16-bit stereo WAV;
    • raea track installed matchmove and solved a clip;
    • tools/matchmove/setup.sh alone, with no uv anywhere, installed through ensure.sh uv;
    • goo's test_run.py still bakes on Metal.
  • Windows (RTX 4070 box), using the box's own uv 0.9.9: raea's uv bootstrap steps (curl.exe, SHA-256, tar.exe on the zip) work. SAO, matchmove, splat and goo installs and runs are in progress; results will follow in a comment.
  • Gates: size, dupes, layers, names, one-version, no-void, taxonomy, rask check and cargo shear all pass.

🤖 Generated with Claude Code

…installed first

Each local model's setup is now tools/<model>/setup.py (standard library only, on tools/local_setup.py), run by uv
on any OS as raea runs it: uv on the PATH, else raea's own uv 0.12.24 fetched once into ~/.cache/raea-tools/uv (where
tools/ensure.sh puts it) and checked against its SHA-256. The setup.sh beside each is a wrapper for a Mac or Linux.
Until now each setup was a sh script needing uv already installed (brew install uv), so Windows had no way to
install any local model.

- SAO: Core ML on a Mac, ONNX Runtime elsewhere (CUDA where nvidia-smi finds a GPU; RAEA_SAO_CUDA=0|1); its WAV is
  written by Python's wave module, not an installed ffmpeg (same samples)
- matchmove, splat: footage read through PyAV, whose wheels carry FFmpeg's libraries (no ffmpeg/ffprobe needed);
  splat fetches Brush v0.3.0's release build for macOS arm64, Linux x86_64 or Windows x86_64, each SHA-256 checked
- goo: Taichi on Metal on a Mac, else its best GPU (CUDA, Vulkan) or the CPU; the backend is reported as run
- TokenSynth: its code as GitHub's archive at a pinned commit (no git); coremltools only on a Mac
- the engine runs .venv\Scripts\python.exe on Windows (venv_python), Brush's brush_app.exe
- tools/release.sh ships tools/local_setup.py
@shinyobjectz
shinyobjectz merged commit 56de5f1 into main Nov 19, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant