Repository navigation
Fingerprint: the plan and its spec (FP0-FP13) - #121
Closed
shinyobjectz wants to merge 1 commit into
Closed
shinyobjectz wants to merge 1 commit into
shinyobjectz wants to merge 1 commit into
Conversation
…l heads over frozen on-device encoders (SigLIP 2, CLAP, YAMNet on ort; SigLIP on MLX once MX5 lands), trained from notes, marks, approvals and reference profiles, shared as evidence. FP0a-g hold the 11-12 measurements; FP1-FP13 are the build, with earshot (MIT) as the reference design
Owner
Author
|
The plan and spec landed on main as e2c5104, and FP1-FP13 are built on main for 0.1.2. Where things ended up differently from this plan:
Each decision is written in docs/fingerprint.feature. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fingerprint is a person's or a team's sense of good work, learned on their own device. It is a taxonomy of axes (soft picture, dead motion, noise under the voice, a cut that drags) with one small head per axis over frozen encoders that run on consumer hardware, a person's weighting over the axes, reference profiles, and the evidence ledger the heads learn from. Teams share evidence, never media, and each machine retrains in milliseconds.
This PR is docs only:
docs/fingerprint.md: the one plan. It covers the stack (what runs at score time and what's only for training), how it trains, the CLI, teams, keeping agents honest, earshot as the reference design, the measurements, the build order with confidence, and the decisions taken by default.docs/fingerprint.feature: the rask tasks. FP0a-g are done (the 11-12 measurements). FP1-FP13 are the build, with plan tables, andtools/rask.shparses them.What the measurements say
Stack
All encoders run in Rust on ort (raea-sys-ml): SigLIP 2, CLAP and YAMNet. SigLIP 2 moves to MLX on the Mac once mlx.feature MX5 lands. EmbeddingGemma 2 serves scripts, boards and stills through the Library's rows. EdgeTAM and Depth Anything 3 serve footage-only checks.
earshot (github.com/Leonxlnx/earshot, MIT) is the reference for these methods, not for code:
Not in the repo
The spike is Python in a scratch venv under
~/films/fingerprint-spike, and it stays out by design (bash, not Python, for repo scripts). Client footage and the golden references' media aren't in git either.