[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (2) by RonaldBXu · Pull Request #18781 · vllm-project/vllm (original) (raw)
and others added 9 commits
Signed-off-by: Ronald Xu ronaldxu@amazon.com
Signed-off-by: Ronald Xu ronaldxu@amazon.com
Signed-off-by: Ronald Xu ronaldxu@amazon.com
Signed-off-by: Ronald Xu ronaldxu@amazon.com
Signed-off-by: Ronald Xu ronaldxu@amazon.com
gshtras added a commit to ROCm/vllm that referenced this pull request
…ft_model_config.hf_config.model_type will get overwritten to the main model type
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
amitm02 pushed a commit to amitm02/vllm that referenced this pull request
…(2) (vllm-project#18781)
Signed-off-by: Ronald Xu ronaldxu@amazon.com Signed-off-by: amit amit.man@gmail.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})