[V1] Use FlashInfer by default on Blackwell GPUs by mgoin · Pull Request #19118 · vllm-project/vllm (original) (raw)
Signed-off-by: mgoin mgoin64@gmail.com
[](/apps/gemini-code-assist)
[](/apps/gemini-code-assist)
Signed-off-by: mgoin mgoin64@gmail.com
Signed-off-by: mgoin mgoin64@gmail.com
Signed-off-by: mgoin mgoin64@gmail.com
mgoin changed the title
Use FlashInfer by default on Blackwell GPUs [V1] Use FlashInfer by default on Blackwell GPUs
mgoin mentioned this pull request
leo-li-opus pushed a commit to leo-li-opus/vllm that referenced this pull request
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})