feat(gallery): add Qwen3.8 uncensored variants - #11705
feat(gallery): add Qwen3.8 uncensored variants#11705localai-org-maint-bot wants to merge 1 commit into
Conversation
Add the Q4_K_M and Q8_0 GGUF builds with the shared vision projector. Both builds enable their integrated MTP head for speculative decoding. Assisted-by: Codex:gpt-5 [Hugging Face API] Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
7f888a7 to
cb860a3
Compare
|
Review pass. Blocking: the mmproj URL 404s. Both the The model GGUFs themselves resolve and their checksums verify. Also worth deciding before either lands: this PR and #11847 ship the same weights from the same repo under different gallery names. |
cb860a3 to
34e91bb
Compare
|
The vision projector this entry references does not exist in the source repo. Both variants declare: uri: huggingface://JonathanColetti/Qwen3.8-27B-Uncensored-GGUF/Qwen3.8-27B-Uncensored-vision-f16.ggufbut so the download 404s and the vision variants cannot install. The two model files are fine — |
What changed
Why
This Apache-2.0 repository is one of the most popular current GGUF models on Hugging Face. It retains Qwen3.8-27B vision and tool-use support while reducing refusal behavior.
Verification
go run ./.github/ci/modelslist.go ./gallery/index.yamlgo test ./core/gallery -ginkgo.focus="gallery/index.yaml variant invariants"git diff --checkx-linked-etagand Hugging Face LFS object IDsThe full
go test ./core/galleryrun reached 373 passing specs. Four unrelated specs failed because this environment blocks their external GitHub/backend URLs; the focused gallery invariant suite passes.