[BugFix] DPMetadata raises assert error for dense model by River12 · Pull Request #32739 · vllm-project/vllm (original) (raw)
[![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4)
DPMetadata fails to support non-MoE model DPMetadata raise assert error for dense model
DPMetadata raise assert error for dense model DPMetadata raises assert error for dense model
Summary: Signed-off-by: Dezhan Tu dztu@meta.com
If running dense model with DP enabled, the line assert parallel_config.is_moe_model is not False raises unexpected error. This PR solved this issue by adding vllm_config.parallel_config.is_moe_model is not False before DPMetadata.make
Test Plan: Test dense model with DP2
Reviewed By: wushidonguc
Differential Revision: D91081326
DPMetadata raises assert error for dense model [BugFix] DPMetadata raises assert error for dense model
ONLY add when PR is ready to merge/full CI is needed
label
Something isn't working
label
PiratePai pushed a commit to PiratePai/epd_shm that referenced this pull request
Co-authored-by: Dezhan Tu dztu@meta.com Signed-off-by: Pai 416932041@qq.com
PiratePai pushed a commit to PiratePai/epd_shm that referenced this pull request
Co-authored-by: Dezhan Tu dztu@meta.com Signed-off-by: Pai 416932041@qq.com
gameofdimension pushed a commit to gameofdimension/vllm that referenced this pull request
Co-authored-by: Dezhan Tu dztu@meta.com Signed-off-by: felix01.yu felix01.yu@vipshop.com
mystous pushed a commit to mystous/vllm_hybrid that referenced this pull request
Co-authored-by: Dezhan Tu dztu@meta.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
Co-authored-by: Dezhan Tu dztu@meta.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
Co-authored-by: Dezhan Tu dztu@meta.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Co-authored-by: Dezhan Tu dztu@meta.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})