7B模型的vllm推理支持 #77

Open

opened

on Nov 15, 2024

你好，请问目前7b模型有办法使用vllm进行推理吗，如果不行的话目前有什么障碍

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests