feat: add data parallel rank to KVEventBatch by PeaBrane · Pull Request #18925 · vllm-project/vllm (original) (raw)
Bot added the v1 label
PeaBrane marked this pull request as ready for review
ONLY add when PR is ready to merge/full CI is needed
label
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: Yan Ru Pei yanrpei@gmail.com
Signed-off-by: alec-flowers aflowers@nvidia.com
Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: Yan Ru Pei yanrpei@gmail.com
Signed-off-by: alec-flowers aflowers@nvidia.com
Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: Yan Ru Pei yanrpei@gmail.com
Signed-off-by: alec-flowers aflowers@nvidia.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: alec-flowers aflowers@nvidia.com
Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: alec-flowers aflowers@nvidia.com
Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: alec-flowers aflowers@nvidia.com
Signed-off-by: alec-flowers aflowers@nvidia.com
Signed-off-by: PeaBrane yanrpei@gmail.com
Signed-off-by: Nick Hill nhill@redhat.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})