Zero-setup ML inference for Flutter using Rust engines (Candle, Linfa)
-
Updated
Jul 12, 2025 - Dart
#
inferernce
Here are 3 public repositories matching this topic...
C++23 inference engine for Qwen3-4B on Apple Silicon. 125.77 tok/s (1.62x llama-cli). OpenAI-compatible streaming server. No Python, no llama.cpp, no Ollama.
-
Updated
May 21, 2026 - C++
Docker image building tool for llama.cpp on DGX Spark(GB10)
-
Updated
Aug 26, 2026 - Shell
Add this topic to your repo
To associate your repository with the inferernce topic, visit your repo's landing page and select "manage topics."