Skip to content

feat(k8s): make LiteLLM's URL prefix configurable via SERVER_ROOT_PATH #95

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jcschaff merged 1 commit into from
Aug 12, 2026
Merged

feat(k8s): make LiteLLM's URL prefix configurable via SERVER_ROOT_PATH #95

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions kustomize/config/vcell-ai-local/litellm.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,3 +14,6 @@ LOCAL_LLM_API_BASE=http://ollama:11434

# Langfuse tracing callback (host only; keys are secret)
LANGFUSE_HOST=https://cloud.langfuse.com

# SERVER_ROOT_PATH: set this only if the proxy is exposed under a URL prefix
# (dev serves it at /kartik). Local reaches it directly, so leave it unset.
9 changes: 9 additions & 0 deletions kustomize/config/vcell-ai-rke-dev/litellm.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,3 +14,12 @@ LOCAL_LLM_API_BASE=http://ollama:11434

# Langfuse tracing callback (host only; keys are secret)
LANGFUSE_HOST=https://cloud.langfuse.com

# This proxy is exposed through the shared host at /kartik (see the dev
# ingress). Tell LiteLLM so it builds prefix-aware URLs -- without this its
# admin UI redirects to an absolute /ui/, which escapes the prefix and lands on
# the Next.js frontend instead. Passed to FastAPI as root_path, which is the
# "reverse proxy strips the prefix" contract, so it matches the ingress
# rewrite-target and does NOT change route matching: the backend's in-cluster
# calls to http://litellm:4000/v1/... keep working unprefixed.
SERVER_ROOT_PATH=/kartik
4 changes: 4 additions & 0 deletions kustomize/config/vcell-ai-rke/litellm.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,3 +14,7 @@ LOCAL_LLM_API_BASE=http://ollama:11434

# Langfuse tracing callback (host only; keys are secret)
LANGFUSE_HOST=https://cloud.langfuse.com

# SERVER_ROOT_PATH: set this only if the proxy is exposed under a URL prefix
# (dev serves it at /kartik). Prod does not expose LiteLLM through the ingress,
# so leave it unset -- it defaults to "" and the UI/redirects stay at the root.
Loading