Improve configs - TokenizerPoolConfig + DeviceConfig by hmellor · Pull Request #16603 · vllm-project/vllm (original) (raw)
added 4 commits
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
…y` handling
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
lionelvillard pushed a commit to lionelvillard/vllm that referenced this pull request
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
yangw-dev pushed a commit to yangw-dev/vllm that referenced this pull request
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com Signed-off-by: Yang Wang elainewy@meta.com
This was referenced
Apr 22, 2025
jikunshang pushed a commit to jikunshang/vllm that referenced this pull request
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
lk-chen pushed a commit to lk-chen/vllm that referenced this pull request
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
adobrzyn pushed a commit to HabanaAI/vllm-fork that referenced this pull request
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com Signed-off-by: Agata Dobrzyniewicz adobrzyniewicz@habana.ai
RichardoMrMu pushed a commit to RichardoMrMu/vllm that referenced this pull request
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com Signed-off-by: Mu Huai tianbowen.tbw@antgroup.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: Harry Mellor 19981378+hmellor@users.noreply.github.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})