kv-cache: per-layer KV types, measured bit allocation - #5

Merged

Pascal-SAPUI5 merged 2 commits into

feat/per-layer-kv-types

Aug 10, 2026

Commits on Aug 10, 2026

kv-cache: per-layer KV types via LLAMA_KV_TYPE_PER_LAYER

Pascal-SAPUI5
and
claude
committed
1166e5d
docs: K and V are equally sensitive under TurboQuant

Pascal-SAPUI5
and
claude
committed
44772ce