ModelFlux: OpenAI-compatible model traffic router with health-aware key-pool scheduling and failover
-
Updated
Jul 5, 2026 - TypeScript
ModelFlux: OpenAI-compatible model traffic router with health-aware key-pool scheduling and failover
A serverless, OpenAI-compatible LLM API gateway for Cloudflare Workers — a new-api / one-api alternative that runs on the free tier (Workers + D1, no server).
🏊 Hard fork of new-api with integrated Key Pool Management — first-class menu for upstream LLM key lifecycle: accounts, automation recipes, billing, alerts.
High-resilience multi-LLM orchestration engine featuring AES-256 encrypted key pool leasing, multi-provider cascading failovers, ID3-stripped TTS synthesis, and real-time telemetry.
Stdlib-only Python CLI coding agent — 12 AI providers, agentic tool loop, SQLite sessions, MCP support
To associate your repository with the key-pool topic, visit your repo's landing page and select "manage topics."