Issues

Where is the Vidur-Bench?
microsoft/vidur#81 · opened on Aug 17, 2026
1
[Feature] Disaggregated prefill/decode scheduler for P/D ratio optimization
microsoft/vidur#79 · opened on Jun 11, 2026
1
Support simulation of MoE model and Expert Parallelism
microsoft/vidur#75 · opened on Oct 23, 2025
1
In a multi-round conversation, what does the trace of the n-th round represent？
microsoft/vidur#73 · opened on Oct 20, 2025
Potential Issue Regarding Profiling
microsoft/vidur#72 · opened on Oct 20, 2025
Support for speculative decoding?
microsoft/vidur#69 · opened on Aug 6, 2025
Questions on CPU Overheads & KV Cache Aware Routing
microsoft/vidur#63 · opened on Jul 24, 2025
Current vidur backend support
microsoft/vidur#60 · opened on Jul 4, 2025
2
Support Dynamic Replica Adjustment at Runtime Without Service Interruption
microsoft/vidur#55 · opened on Jun 20, 2025
1
Regarding the calculation of the duration in the profiling phase
microsoft/vidur#53 · opened on Apr 12, 2025
Adapting Vidur to vLLM and Profiling CPU Overhead
microsoft/vidur#51 · opened on Mar 14, 2025
5
ImportError: cannot import name 'pos_encoding_ops' from 'sarathi' (/app/software1/vidur/sarathi/__init__.py)
microsoft/vidur#50 · opened on Feb 14, 2025
hello; how to fix this error; errno: 97 - Address family not supported by protocol
microsoft/vidur#49 · opened on Feb 14, 2025
Regarding the judgment condition for TFFTViolationLowMemoryCase
microsoft/vidur#47 · opened on Dec 16, 2024
Clarifications on All_Gather Handling in Profiling Communication Operators
microsoft/vidur#46 · opened on Nov 25, 2024
2
Adding new model
microsoft/vidur#32 · opened on Sep 2, 2024
5
About Splitwise branch
microsoft/vidur#21 · opened on Jul 19, 2024
3
Support simulation of 4090 cards
microsoft/vidur#8 · opened on May 10, 2024
7