Skip to content

Build the model vault, runtime selection, fallback, and compatibility diagnostics #62

Description

@KSemenenko

Problem

Operators need one product surface for local-model inventory, runtime selection, fallback behavior, and compatibility insight.

Scope

  • Track model import, metadata, hashing, license provenance, runtime selection, fallback, and compatibility diagnostics
  • Cover how the vault informs session composition
  • Keep the surface usable for many local models

Out of scope

  • Cloud model hosting workflows
  • Provider toolchain installation for external CLIs

Implementation notes

  • Make the model vault the canonical local-model inventory
  • Keep fallback and compatibility explicit to the operator
  • Align the issue with LLamaSharp and ONNX Runtime planning

Definition of Done

  • The issue defines the model-vault responsibilities and minimum diagnostics
  • Later implementation can wire local runtimes into a single product surface

Verification

  • Review the issue against the feature spec and local-runtime abstraction issue

Dependencies

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions