Skip to content

Build

Local AI

Add on-device inference after the base application works.

Verified 25 September 2026

QVAC-backed inference is optional in the preview. A local model avoids sending prompts to a hosted inference provider, but it still requires compatible hardware, disk space, and an initial model download.

  • Keep model initialization in the worker, never the renderer.
  • Report download, loading, ready, and error states separately.
  • Use mock inference for deterministic UI and protocol tests; label it as mock.
  • After a successful model install, test local inference without internet access.
  • Do not publish a universal RAM or download-size claim until the chosen model is pinned and measured.
Public issue reporting will be linked here after the repository and support route are anonymously accessible.