[Bugfix][Model] Attempt to fix eagle in V0. by gshtras · Pull Request #18978 · vllm-project/vllm (original) (raw)
…ft_model_config.hf_config.model_type will get overwritten to the main model type
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
… eagle config values to be derived
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
ONLY add when PR is ready to merge/full CI is needed
label
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
mmontuori pushed a commit to mmontuori/vllm that referenced this pull request
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: Gregory Shtrasberg Gregory.Shtrasberg@amd.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})