[Ray] Improve documentation on batch inference by richardliaw · Pull Request #16609 · vllm-project/vllm (original) (raw)
Signed-off-by: Richard Liaw rliaw@berkeley.edu
Signed-off-by: Richard Liaw rliaw@berkeley.edu
ONLY add when PR is ready to merge/full CI is needed
label
auto-merge was automatically disabled
Head branch was pushed to by a user without write access
Signed-off-by: Richard Liaw rliaw@berkeley.edu
Signed-off-by: Richard Liaw rliaw@berkeley.edu
Signed-off-by: Richard Liaw rliaw@berkeley.edu
Signed-off-by: Richard Liaw rliaw@berkeley.edu
lionelvillard pushed a commit to lionelvillard/vllm that referenced this pull request
Signed-off-by: Richard Liaw rliaw@berkeley.edu
yangw-dev pushed a commit to yangw-dev/vllm that referenced this pull request
Signed-off-by: Richard Liaw rliaw@berkeley.edu Signed-off-by: Yang Wang elainewy@meta.com
jikunshang pushed a commit to jikunshang/vllm that referenced this pull request
Signed-off-by: Richard Liaw rliaw@berkeley.edu
lk-chen pushed a commit to lk-chen/vllm that referenced this pull request
Signed-off-by: Richard Liaw rliaw@berkeley.edu
adobrzyn pushed a commit to HabanaAI/vllm-fork that referenced this pull request
Signed-off-by: Richard Liaw rliaw@berkeley.edu Signed-off-by: Agata Dobrzyniewicz adobrzyniewicz@habana.ai
RichardoMrMu pushed a commit to RichardoMrMu/vllm that referenced this pull request
Signed-off-by: Richard Liaw rliaw@berkeley.edu Signed-off-by: Mu Huai tianbowen.tbw@antgroup.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: Richard Liaw rliaw@berkeley.edu
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})