[BugFix] Make DP work with connector-delayed new requests by njhill · Pull Request #18559 · vllm-project/vllm (original) (raw)

@njhill

Signed-off-by: Nick Hill nhill@redhat.com

@mergify Bot added the v1 label

May 22, 2025

@njhill

Signed-off-by: Nick Hill nhill@redhat.com

@njhill

Signed-off-by: Nick Hill nhill@redhat.com

@njhill njhill marked this pull request as ready for review

May 27, 2025 21:40

@njhill @wseaton

Signed-off-by: Nick Hill nhill@redhat.com

Co-authored-by: Will Eaton weaton@redhat.com Signed-off-by: Nick Hill nhill@redhat.com

simon-mo

@tlrmchlsmth tlrmchlsmth added the ready

ONLY add when PR is ready to merge/full CI is needed

label

May 28, 2025

tlrmchlsmth

@njhill

Signed-off-by: Nick Hill nhill@redhat.com

@njhill

@njhill

Conflicts:

vllm/forward_context.py

tlrmchlsmth

@njhill

Signed-off-by: Nick Hill nhill@redhat.com

@njhill

@njhill njhill deleted the fix-dp-with-delayed-req branch

May 29, 2025 22:11

amitm02 pushed a commit to amitm02/vllm that referenced this pull request

Jun 1, 2025

…ct#18559)

Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: Will Eaton weaton@redhat.com Signed-off-by: amit amit.man@gmail.com

amitm02 pushed a commit to amitm02/vllm that referenced this pull request

Jun 1, 2025

…ct#18559)

Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: Will Eaton weaton@redhat.com Signed-off-by: amit amit.man@gmail.com

@hidva hidva mentioned this pull request

Jun 9, 2025

0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request

May 19, 2026

@njhill @wseaton

…ct#18559)

Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: Will Eaton weaton@redhat.com

This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters

[ Show hidden characters]({{ revealButtonHref }})