Skip to content

feat(ai): add an opt-in local model runtime and model manager #76

Open
2 of 5 issues completed
Open

Description

@McanKul

Implement the production local inference layer after the runtime decision is recorded.

Depends on the local-runtime research issue.

Scope

  • AI remains optional; the normal PDF tools work without a model.
  • Show model size and minimum memory before setup.
  • Support explicit verified download and local-file import where the chosen runtime allows it.
  • Verify checksums before loading and provide a complete remove action.
  • Report unsupported hardware and out-of-memory conditions clearly.
  • Allow model loading and inference to be cancelled safely.
  • Never switch to a remote API automatically.

Acceptance criteria

  • A small health check can run fully offline after setup.
  • Model state survives restart without duplicating files.
  • Resource limits and model paths are covered by tests.
  • Privacy behavior is documented in the app and repository.

Activity

  1. added
    enhancementNew feature or request
    area: aiOptional on-device AI and document intelligence
    on Aug 30, 2026
  2. McanKul commented on Aug 30, 2026

    @McanKul
    OwnerAuthor

    Branching note: PRs for this parent and sub-issues #81–#85 should target epic/local-ai-runtime, not development. The epic branch will move to development only after the complete runtime slice passes CI and review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: aiOptional on-device AI and document intelligenceenhancementNew feature or requestpriority: highHigh-priority roadmap worktarget: local-ai-runtimeOpen the pull request against epic/local-ai-runtime

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions