Skip to content

research(ai): choose a local inference runtime and baseline model #75

Open
1 of 1 issue completed

Description

@McanKul

Before shipping AI features, choose a runtime and model setup that preserves the offline-first promise and remains supportable across desktop platforms.

Questions to answer

  • Which embeddable runtimes fit the Rust/Tauri stack and their licenses?
  • What CPU, RAM, disk, and startup costs should users expect?
  • What works on Apple Silicon, Windows x64, and Linux without requiring a separate server?
  • Can models be imported locally as well as downloaded explicitly?
  • How will artifacts be versioned, checksummed, removed, and upgraded?
  • How do we prove there is no silent cloud fallback or background upload?

Deliverable

Add a short architecture decision record with a small benchmark table, a throwaway prototype, and a recommended baseline. This issue does not add a production AI feature.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: aiOptional on-device AI and document intelligencehelp wantedExtra attention is neededpriority: highHigh-priority roadmap workspikeTime-boxed technical investigationtarget: local-ai-runtimeOpen the pull request against epic/local-ai-runtime

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions