Skip to content

fix: place each MoE expert-cache pack on the GPU that runs its layer - #16

Open
thecodacus wants to merge 3 commits into
perffrom
perf-multigpu-cache
Open

fix: place each MoE expert-cache pack on the GPU that runs its layer#16
thecodacus wants to merge 3 commits into
perffrom
perf-multigpu-cache

docs: restructure README around a quick start for the fork

f201e55
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar