[Perf] These changes enhance the NUMA functionality of vllm for systems with more than one NUMA nodes per socket by skaraban3807 · Pull Request #25559 · vllm-project/vllm (original) (raw)
[![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4)
…stems having multi-node per sockets.
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
- These changes enhances the safety checks in NUMA moduleSigned-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
Change-Id: Ie3a26ccadf35bf2ff50859c2609280b79330026b
ywang96 pushed a commit to ywang96/vllm that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
RunkaiTao pushed a commit to RunkaiTao/vllm that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com Signed-off-by: Runkai Tao rt572@physics.rutgers.edu
devpatelio pushed a commit to SumanthRH/vllm that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
kitaekatt pushed a commit to kitaekatt/vllm that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
mystous pushed a commit to mystous/vllm_hybrid that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
…ms with more than one NUMA nodes per socket (vllm-project#25559)
Signed-off-by: Siddappa Karabannavar siddappa.karabannavar@amd.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})