[V1][Frontend] Improve Shutdown And Logs by robertgshaw2-redhat · Pull Request #11737 · vllm-project/vllm (original) (raw)
added 3 commits
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com
… handle properly
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com
rshaw@neuralmagic.com added 2 commits
rshaw@neuralmagic.com added 3 commits
[Frontend] Improve API Server Error Messages [Frontend] Improve API Server Error Logs
[Frontend] Improve API Server Error Logs [V1][Frontend] Improve Error Handling Shutdown And Logs
rshaw@neuralmagic.com added 7 commits
Signed-off-by: Nick Hill nhill@redhat.com
ONLY add when PR is ready to merge/full CI is needed
label
Signed-off-by: Andrew Feldman afeldman@neuralmagic.com
Signed-off-by: Nick Hill nhill@redhat.com
lionelvillard pushed a commit to lionelvillard/vllm that referenced this pull request
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Signed-off-by: Andrew Feldman afeldman@neuralmagic.com Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Co-authored-by: Cyrus Leung cyrus.tl.leung@gmail.com Co-authored-by: Russell Bryant rbryant@redhat.com Co-authored-by: Andrew Feldman afeldman@neuralmagic.com Co-authored-by: afeldman-nm 156691304+afeldman-nm@users.noreply.github.com Co-authored-by: Nick Hill nhill@redhat.com
yangw-dev pushed a commit to yangw-dev/vllm that referenced this pull request
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Signed-off-by: Andrew Feldman afeldman@neuralmagic.com Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Co-authored-by: Cyrus Leung cyrus.tl.leung@gmail.com Co-authored-by: Russell Bryant rbryant@redhat.com Co-authored-by: Andrew Feldman afeldman@neuralmagic.com Co-authored-by: afeldman-nm 156691304+afeldman-nm@users.noreply.github.com Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: Yang Wang elainewy@meta.com
jikunshang pushed a commit to jikunshang/vllm that referenced this pull request
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Signed-off-by: Andrew Feldman afeldman@neuralmagic.com Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Co-authored-by: Cyrus Leung cyrus.tl.leung@gmail.com Co-authored-by: Russell Bryant rbryant@redhat.com Co-authored-by: Andrew Feldman afeldman@neuralmagic.com Co-authored-by: afeldman-nm 156691304+afeldman-nm@users.noreply.github.com Co-authored-by: Nick Hill nhill@redhat.com
lk-chen pushed a commit to lk-chen/vllm that referenced this pull request
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Signed-off-by: Andrew Feldman afeldman@neuralmagic.com Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Co-authored-by: Cyrus Leung cyrus.tl.leung@gmail.com Co-authored-by: Russell Bryant rbryant@redhat.com Co-authored-by: Andrew Feldman afeldman@neuralmagic.com Co-authored-by: afeldman-nm 156691304+afeldman-nm@users.noreply.github.com Co-authored-by: Nick Hill nhill@redhat.com
adobrzyn pushed a commit to HabanaAI/vllm-fork that referenced this pull request
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Signed-off-by: Andrew Feldman afeldman@neuralmagic.com Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Co-authored-by: Cyrus Leung cyrus.tl.leung@gmail.com Co-authored-by: Russell Bryant rbryant@redhat.com Co-authored-by: Andrew Feldman afeldman@neuralmagic.com Co-authored-by: afeldman-nm 156691304+afeldman-nm@users.noreply.github.com Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: Agata Dobrzyniewicz adobrzyniewicz@habana.ai
RichardoMrMu pushed a commit to RichardoMrMu/vllm that referenced this pull request
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Signed-off-by: Andrew Feldman afeldman@neuralmagic.com Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Co-authored-by: Cyrus Leung cyrus.tl.leung@gmail.com Co-authored-by: Russell Bryant rbryant@redhat.com Co-authored-by: Andrew Feldman afeldman@neuralmagic.com Co-authored-by: afeldman-nm 156691304+afeldman-nm@users.noreply.github.com Co-authored-by: Nick Hill nhill@redhat.com Signed-off-by: Mu Huai tianbowen.tbw@antgroup.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Signed-off-by: Andrew Feldman afeldman@neuralmagic.com Signed-off-by: Nick Hill nhill@redhat.com Co-authored-by: rshaw@neuralmagic.com rshaw@neuralmagic.com Co-authored-by: Cyrus Leung cyrus.tl.leung@gmail.com Co-authored-by: Russell Bryant rbryant@redhat.com Co-authored-by: Andrew Feldman afeldman@neuralmagic.com Co-authored-by: afeldman-nm 156691304+afeldman-nm@users.noreply.github.com Co-authored-by: Nick Hill nhill@redhat.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})