[Misc][Tools][Benchmark] Add benchmark_serving supports for llama.cpp. by Duyi-Wang · Pull Request #18692 · vllm-project/vllm (original) (raw)
Signed-off-by: Duyi-Wang duyi.wang@intel.com
approved these changes May 29, 2025
ONLY add when PR is ready to merge/full CI is needed
label
amitm02 pushed a commit to amitm02/vllm that referenced this pull request
Signed-off-by: Duyi-Wang duyi.wang@intel.com Signed-off-by: amit amit.man@gmail.com
amitm02 pushed a commit to amitm02/vllm that referenced this pull request
Signed-off-by: Duyi-Wang duyi.wang@intel.com Signed-off-by: amit amit.man@gmail.com
Duyi-Wang deleted the benchmark_llama.cpp_backend branch
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})