[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B by benchislett · Pull Request #19033 · vllm-project/vllm (original) (raw)
added 5 commits
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
…edding-init
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
WoosukKwon added the ready
ONLY add when PR is ready to merge/full CI is needed
label
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
leo-li-opus pushed a commit to leo-li-opus/vllm that referenced this pull request
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: Benjamin Chislett benjamin.chislett@centml.ai
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})