[Model] Use mm_position to compute mrope positions for Qwen3-Omni by Etelis · Pull Request #33010 · vllm-project/vllm (original) (raw)
Optimizes M-RoPE position calculation by using mm_position.offset directly from MultiModalFeatureSpec instead of token-by-token searching.
Changes:
- Add helper methods for modular position computation
- Refactor get_mrope_input_positions to use mm_position.offset
- Replace torch operations with numpy for efficiency
- Remove unused get_llm_pos_ids_for_vision import
Part of vllm-project#32656
Signed-off-by: Itay Etelis itay.etelis@ibm.com
[![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4)
Signed-off-by: Itay Etelis itay.etelis@ibm.com
Signed-off-by: Itay Etelis itay.etelis@ibm.com
apd10 pushed a commit to apd10/vllm that referenced this pull request
Signed-off-by: Itay Etelis itay.etelis@ibm.com Co-authored-by: Itay Etelis itay.etelis@ibm.com
mystous pushed a commit to mystous/vllm_hybrid that referenced this pull request
Signed-off-by: Itay Etelis itay.etelis@ibm.com Co-authored-by: Itay Etelis itay.etelis@ibm.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
Signed-off-by: Itay Etelis itay.etelis@ibm.com Co-authored-by: Itay Etelis itay.etelis@ibm.com
my-other-github-account pushed a commit to my-other-github-account/vllm that referenced this pull request
Signed-off-by: Itay Etelis itay.etelis@ibm.com Co-authored-by: Itay Etelis itay.etelis@ibm.com
0826joyce pushed a commit to 0826joyce/vllm-serving-optimization that referenced this pull request
Signed-off-by: Itay Etelis itay.etelis@ibm.com Co-authored-by: Itay Etelis itay.etelis@ibm.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})