Skip to content

Add SGLang and TRT-LLM configs for GreenNode runners #1

Description

@aistackdev

We only run vLLM today. Add SGLang and TRT-LLM equivalents so we can compare engines.

Hardware

  • 1× H100, 2× H100, 1× RTX 5090

Configs to add (in .github/configs/nvidia-master.yaml)

  • gptoss-fp4-h100-1x-sglang
  • dsr1qwen3-bf16-rtx5090-1x-sglang
  • dsr1qwen3-fp8-rtx5090-1x-sglang
  • TRT-LLM variants (check Blackwell consumer support first for 5090)

Each needs: config block + benchmark script + framework-appropriate image.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions