Skip to content

Allow serving llama models with tensor parallel - #592

Draft
Jackmin801 wants to merge 1 commit into
bigscience-workshop:mainfrom
Jackmin801:llama-tp
Draft

Allow serving llama models with tensor parallel#592
Jackmin801 wants to merge 1 commit into
bigscience-workshop:mainfrom
Jackmin801:llama-tp

hangs in line 320 of slicer_wrapper.py of tensor_parallel package doi…

cad787f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs