Experimental Triton dequantization - #331

Closed

blepping wants to merge 8 commits into

city96:mainfrom

blepping:feat_triton_dequant

Commits on Sep 7, 2025

Experimental Triton support for Q8_0 and Q4_K
blepping
committed
640b53b

Commits on Sep 8, 2025

Add Q6_K Triton kernel
blepping
committed
ce4c9b2
Add Q5_K Triton kernel
blepping
committed
2ac36d4
Actually enable the Q5_K kernel
blepping
committed
a5d5f6d
Triton dequant code cleanups
blepping
committed
6704e34

Commits on Sep 9, 2025

Use static_range in Triton kernels
blepping
committed
a7dd75f
Refactor Q4_K Triton kernel a bit to reduce code duplication
blepping
committed
f11b617

Commits on Sep 11, 2025

Refactor/cleanup Triton support
blepping
committed
26ffedb