[Misc] Validate stop_token_ids contents by njhill · Pull Request #17268 · vllm-project/vllm (original) (raw)
Ensure stop_token_ids only contains ints to avoid errors within the engine.
Signed-off-by: Nick Hill nhill@redhat.com
1 task
jikunshang pushed a commit to jikunshang/vllm that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com
lk-chen pushed a commit to lk-chen/vllm that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com
adobrzyn pushed a commit to HabanaAI/vllm-fork that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com Signed-off-by: Agata Dobrzyniewicz adobrzyniewicz@habana.ai
RichardoMrMu pushed a commit to RichardoMrMu/vllm that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com Signed-off-by: Mu Huai tianbowen.tbw@antgroup.com
zzzyq pushed a commit to zzzyq/vllm that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com Signed-off-by: Yuqi Zhang yuqizhang@google.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: Nick Hill nhill@redhat.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})