[BugFix] Make DP work with connector-delayed new requests by njhill · Pull Request #18559 · vllm-project/vllm (original) (raw)
Signed-off-by: Nick Hill nhill@redhat.com
Bot added the v1 label
Signed-off-by: Nick Hill nhill@redhat.com
Signed-off-by: Nick Hill nhill@redhat.com
njhill marked this pull request as ready for review
Signed-off-by: Nick Hill nhill@redhat.com
Co-authored-by: Will Eaton weaton@redhat.com Signed-off-by: Nick Hill nhill@redhat.com
tlrmchlsmth added the ready
ONLY add when PR is ready to merge/full CI is needed
label
Signed-off-by: Nick Hill nhill@redhat.com
Conflicts:
vllm/forward_context.py
Signed-off-by: Nick Hill nhill@redhat.com
njhill deleted the fix-dp-with-delayed-req branch
amitm02 pushed a commit to amitm02/vllm that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: Will Eaton weaton@redhat.com Signed-off-by: amit amit.man@gmail.com
amitm02 pushed a commit to amitm02/vllm that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: Will Eaton weaton@redhat.com Signed-off-by: amit amit.man@gmail.com
hidva mentioned this pull request
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: Will Eaton weaton@redhat.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})