Repository navigation
Move MEMS-Nav preprocessing and data paper to jbrodovsky/mems-nav-dataset - #421
Open
jbrodovsky wants to merge 1 commit into
Open
jbrodovsky wants to merge 1 commit into
jbrodovsky wants to merge 1 commit into
Conversation
The MEMS-Nav recordings get their own Zenodo record and their own repository, jbrodovsky/mems-nav-dataset, whose `memsnav` package now owns raw -> processed. analysis depends on it by git tag. - `analyze preprocess` is gone; `memsnav preprocess` builds the real arm in data/input_real (byte-identical to the frozen copy on all 27 trajectories), and the new `analyze synthesize` builds the synthetic data/input from it (byte-identical to the one-step `--synthetic` on all 27; synthetic.json differs only in its generator name and trajectory order) - `just preprocess` runs both steps, so data/input_real is now reproducible instead of frozen; `just fetch-data` / `fetch-processed` download from Zenodo and `just dataset-benchmark` stages the release's benchmark/ - papers/mems_nav_data moved to that repository's paper/ - docs and config comments follow; integration_tests.rs's dataset link fixed Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
4 tasks
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The MEMS-Nav dataset now lives in its own repository,
jbrodovsky/mems-nav-dataset. The data itself goes on Zenodo (record not yet created).
That repository's
memsnavpackage now owns fetching, raw → processed, and release packaging.analysisdepends on it, pinned to the git tagv0.1.0.analyze preprocessis removed.memsnav preprocessbuilds the real arm,data/input_real.analyze synthesizebuilds the syntheticdata/inputfrom the real arm. It replaces onlygrav_*/mag_*, using the samesynthesize_geophysical.just preprocessruns both steps.data/input_realis now rebuilt fromdata/rawinstead of being a frozen copy;cleanstill leaves it alone.fetch-dataandfetch-processeddownload from Zenodo throughmemsnav fetch. They work once the record exists.dataset-benchmarkstages the release'sbenchmark/directory fromdata/output_real2.papers/mems_nav_datamoved to the dataset repo'spaper/. There it builds from the release layout instead of importinganom_combined's scripts.integration_tests.rs.The old dataset repository has been renamed to
mems-nav-dataset-legacyand archived.Verification
memsnav preprocessondata/rawreproduces all 27 frozendata/input_realCSVs byte for byte.segments.jsonmatches as a set; it is now sorted by recording.analyze synthesizeoverdata/input_realreproduces all 27data/inputCSVs byte for byte.synthetic.jsonis identical except for itsgeneratorstring and trajectory order.memsnav packagebuilds 32 archives (8.4 GB). Fetchingprocessedandmapsback out of them gives 109 files identical todata/input_real.uv run ruff check,ruff format --checkandpytestpass (69).cargo clippy -p strapdown-core --tests -D warningsis clean.Follow-ups (after the Zenodo record is published)
memsnavpin tov1.0.0, whose manifest carries the record.papers/anom_combined/references.bib(mems-nav-dataset) and insections/09-availability.tex.🤖 Generated with Claude Code