NVFP4 LLM inference tuned for consumer Blackwell GPUs. Auto-detects your GPU, downloads the model, serves an OpenAI-compatible API — benchmarked and quality-certified.
-
Updated
Aug 24, 2026 - Shell
#
agentic-inference
Here are 3 public repositories matching this topic...
Beyond token-by-token agents. JevSpawn enables parallel action exploration through adaptive action spaces, without additional training.
structured-prediction efficient-inference action-space constrained-decoding training-free llm-agents agentic-inference jev jevspawn
-
Updated
Oct 2, 2026 - Python
Inductive Latent Context Persistence (ILCP) for Agentic AI. This infrastructure persists, routes, and reuses LLM latent context across multi-agent DAGs. By eliminating redundant prefix-prefill compute and optimizing bare-metal VRAM allocation, ILCP drastically lowers tail-latency for parallel agent inference in compute-constrained setups.
-
Updated
Jun 19, 2026 - Python
Add this topic to your repo
To associate your repository with the agentic-inference topic, visit your repo's landing page and select "manage topics."