Skip to content

docs: install CPU PyTorch first on machines without an NVIDIA GPU - #1443

Open
silentoplayz wants to merge 1 commit into
open-webui:mainfrom
silentoplayz:docs/pip-cpu-torch
Open

silentoplayz wants to merge 1 commit into
open-webui:mainfrom
silentoplayz:docs/pip-cpu-torch

Conversation

@silentoplayz

Copy link
Copy Markdown
Collaborator

Summary

On Linux x86_64, pip install open-webui pulls in the default PyTorch build from PyPI, which depends on the NVIDIA CUDA libraries whatever GPU the machine has. On AMD or CPU-only machines those libraries are downloaded and never used (reported in open-webui/open-webui#29490).

This adds a short tip under the Python version note on the Quick Start page, so it shows once above every Python install tab (pip, venv, uv, Conda): install the CPU build of PyTorch first in the same environment, or the ROCm build for GPU acceleration on AMD.

Related issue or discussion

open-webui/open-webui#29490

Checklist

  • I have reviewed the relevant documentation and matched the existing style.
  • This PR meets Open WebUI's contribution standards: it is accurate, relevant to users, narrowly scoped, maintainable, and not promotional content, advertising, lead generation, SEO placement, or a request to list a product, service, provider, integration, gateway, tool, or company primarily for visibility.
  • I understand that PRs that do not meet these standards may be closed without review and will not be merged. Repeated, low-quality, off-topic, promotional, or intentionally misleading submissions may result in the contributor being blocked from future participation in Open WebUI repositories.

Notes for reviewers

Checked in clean Python 3.11 and 3.12 containers with uv pip install --dry-run open-webui (0.11.4): the default resolve adds torch==2.14.0 and 18 nvidia-* and cuda-* packages. With torch 2.14.1+cpu installed first from the CPU index, the same dry run adds none and keeps the CPU build.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant