Repository navigation
Description
Goal
Deliver v0.3.0 cloud native integration so multiple machines can build Layers, Branches, and private Workspaces against shared LayerFS history, preserving CAS/CDC/COW identities and the v0.2 automatic Branch reconciliation contract.
Roadmap
Canonical planning document: docs/roadmap/0.3/README.md (initialized locally alongside this issue; pending commit/push).
Scope and acceptance checklist
- Select the smallest viable topology: evaluate an authoritative SQLite service with Litestream replication against immutable object storage with transactional metadata. Record the choice and evidence; both implementations are not required.
- Define remote SDK/CLI operations, workspace ownership, authentication, tenant access, cancellation, reconnect, and resource limits.
- Implement bounded local write buffers, background batched admission, safe duplicate uploads, verified local caching, and bounded missing-object fetches.
- Define local acceptance, local persistence, shared publication, remote replication, and fsync/Commit acknowledgements explicitly.
- Publish complete roots atomically with conditional Branch/LayerStack advancement; preserve v0.2 automatic clean reconciliation, structured conflicts, and exact-candidate validation.
- Prove idempotent publication after lost replies, protection against garbage-collection races, supported partition behavior, and fencing if failover is supported.
- Evaluate Litestream compatibility: current Store uses MEMORY journaling, synchronous OFF, EXCLUSIVE locking, and rejects WAL. Specify migration, locking/checkpoint changes, and durable synchronization; benchmark the changed contract.
- Pin dependencies and provide reproducible local S3-compatible tests without AWS, using an isolated endpoint such as MinIO.
- Exercise two isolated workers, identical/distinct chunk uploads, independent and shared Branches, competing Add, endpoint outage/catch-up, and interrupted uploads.
- Restore into an empty environment without original DB/WAL/cache access; verify roots, IDs, history, bytes, and integrity after writer loss before/after replicated acknowledgement.
- Measure cold/warm reads, concurrent startup, Commit backlog, p50/p95/p99, request count, transferred/replicated bytes, lag, CPU/RSS, and storage/request costs.
- Qualify the selected path on AWS with recorded topology, IAM, versions, acknowledgement boundaries, and measured behavior; local emulation does not establish AWS performance/durability.
- Freeze public contracts, migrations, recovery instructions, applicable regressions, source identity, and release evidence together.
Completion proof
Two machines build and publish shared history through public operations. An acknowledged remotely durable result remains readable after its originating worker disappears. Concurrent operations never silently overwrite accepted history or expose incomplete roots. Recovery, resource bounds, and performance claims are backed by retained evidence.
Boundaries
Litestream is an evaluation candidate, not a preselected backend. It replicates SQLite pages and does not merge independently writable Store copies; its optional VFS write mode assumes one writer. Do not replace v0.2 concurrent-Workspace reconciliation with one Workspace per Branch or manual stale-head rebasing. Active-active multi-region metadata, general CRDT semantics, and speculative sharding/packing are outside the initial scope.
Activity
yifanxuaaa commentedon Oct 15, 2026
Closing as not planned: the owner discarded the v0.2.0 and v0.3.0 plans on 2026-10-15. After the v0.1.7 release the next release is 1.0.0 (plan); the 0.2 roadmap is archived. Open a 1.0.0 issue if this work is still needed.
docs: Add comprehensive implementation checklist
docs(gc): add decision ownership table; point README at the upstream PR
feat(gc): implement 2.0 logical removal and store compaction (#41)
feat(gc): report, API/MCP, acceptance and docs (#50-#52)
feat(gc): report, API/MCP, acceptance and docs (#50-#52)
feat(gc): report, API/MCP, acceptance and docs (#50-#52)
feat(gc): acceptance matrix, docs and CI (#52)
feat(gc): report/status, API/SDK/CLI, qualification (layerfs-project#…
merge layerfs_v2_0_0 e7d99bc: #712 monitoring over the GC branch
fixup(#52): regenerate the T12.3a report from the merged test sources
fixup(#51/#52): keep the frozen spec byte-identical to ed14ed53b; rec…
docs(#52): round-4 matrix/receipts/CI fixes
merge fixr4-52: docs(#52): round-4 matrix/receipts/CI fixes
docs(#52): round-5 — seven gc_op columns, receipt vintage in §13/AC-5…