Repository navigation

Reuse MLX's prompt cache after an edit and survive exact cache hits (stacked on #868) - #876

Open

senadaruc wants to merge 12 commits into

FuJacob:mainfrom

senadaruc:perf/mlx-prompt-cache

Open

Reuse MLX's prompt cache after an edit and survive exact cache hits (stacked on #868)#876
senadaruc wants to merge 12 commits into
FuJacob:mainfrom
senadaruc:perf/mlx-prompt-cache

Commits on Oct 14, 2026
- Add MLX as an engine choice with its settings, values and pure rules
  
  senadaruc
  and
  claude
  committed
  fc0b698
- Run mlx_lm.server as a managed loopback child process and route MLX suggestions to it
  
  senadaruc
  and
  claude
  committed
  1a27a04
- Wire MLX into the app, Settings and the menu bar, and count its server in resource usage
  
  senadaruc
  and
  claude
  committed
  94e0ef2
- Document the MLX engine
  
  senadaruc
  and
  claude
  committed
  96c3f9e
- Regenerate the Xcode project with XcodeGen
  
  senadaruc
  and
  claude
  committed
  e20d353
- Satisfy strict SwiftLint
  
  senadaruc
  and
  claude
  committed
  82e6aa7
- Stop a broken MLX server even when Cotabby quits right after the report
  
  senadaruc
  and
  claude
  committed
  3c992bc
- Count an MLX model as downloaded only when its refs/main snapshot is complete
  
  senadaruc
  and
  claude
  committed
  82bf9fb
- Show a custom MLX model's download progress, Cancel and failure
  
  senadaruc
  and
  claude
  committed
  4147c3b
- Reject Hugging Face dataset and Space links as MLX model ids
  
  senadaruc
  and
  claude
  committed
  e595546
Commits on Oct 18, 2026
- Let the MLX server reuse its prompt cache after an edit
  senadaruc
  committed
  9ae6e81
- Keep the MLX server alive on an exact prompt-cache hit
  senadaruc
  committed
  6feec96