add support for --fully-sharded-loras in fused_moe by gnovack · Pull Request #28761 · vllm-project/vllm (original) (raw)
Signed-off-by: gnovack gnovack@amazon.com
[](/apps/gemini-code-assist)
[](/apps/chatgpt-codex-connector)
Signed-off-by: gnovack gnovack@amazon.com
ONLY add when PR is ready to merge/full CI is needed
label
devpatelio pushed a commit to SumanthRH/vllm that referenced this pull request
Signed-off-by: gnovack gnovack@amazon.com Co-authored-by: Jee Jee Li pandaleefree@gmail.com
kitaekatt pushed a commit to kitaekatt/vllm that referenced this pull request
Signed-off-by: gnovack gnovack@amazon.com Co-authored-by: Jee Jee Li pandaleefree@gmail.com
mystous pushed a commit to mystous/vllm_hybrid that referenced this pull request
Signed-off-by: gnovack gnovack@amazon.com Co-authored-by: Jee Jee Li pandaleefree@gmail.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
Signed-off-by: gnovack gnovack@amazon.com Co-authored-by: Jee Jee Li pandaleefree@gmail.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
Signed-off-by: gnovack gnovack@amazon.com Co-authored-by: Jee Jee Li pandaleefree@gmail.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: gnovack gnovack@amazon.com Co-authored-by: Jee Jee Li pandaleefree@gmail.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})