Checklist / 检查清单
Bug Description / Bug 描述
使用镜像modelscope-registry.cn-hangzhou.cr.aliyuncs.com/modelscope-repo/modelscope:ubuntu22.04-cuda12.8.1-py311-torch2.10.0-vllm0.17.1-modelscope1.34.0-swift4.0.3里的vllm部署qwen3.5的时候报以下错误:
[rank0]: File "/usr/local/lib/python3.11/site-packages/transformers/configuration_utils.py", line 714, in from_dict [rank0]: config = cls(**config_dict) [rank0]: ^^^^^^^^^^^^^^^^^^ [rank0]: File "/usr/local/lib/python3.11/site-packages/vllm/transformers_utils/configs/qwen3_5.py", line 180, in init [rank0]: self.text_config = self.sub_configs"text_config" [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "/usr/local/lib/python3.11/site-packages/vllm/transformers_utils/configs/qwen3_5.py", line 109, in init [rank0]: super().init(**kwargs) [rank0]: File "/usr/local/lib/python3.11/site-packages/transformers/configuration_utils.py", line 219, in init [rank0]: kwargs = self.convert_rope_params_to_dict( [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "/usr/local/lib/python3.11/site-packages/transformers/modeling_rope_utils.py", line 651, in convert_rope_params_to_dict [rank0]: ignore_keys_at_rope_validation = ignore_keys_at_rope_validation | {"partial_rotary_factor"} [rank0]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~ [rank0]: TypeError: unsupported operand type(s) for |: 'list' and 'set'
How to Reproduce / 如何复现
在镜像modelscope-registry.cn-hangzhou.cr.aliyuncs.com/modelscope-repo/modelscope:ubuntu22.04-cuda12.8.1-py311-torch2.10.0-vllm0.17.1-modelscope1.34.0-swift4.0.3中使用vllm部署qwen3.5
Additional Information / 补充信息
No response
Checklist / 检查清单
Bug Description / Bug 描述
使用镜像modelscope-registry.cn-hangzhou.cr.aliyuncs.com/modelscope-repo/modelscope:ubuntu22.04-cuda12.8.1-py311-torch2.10.0-vllm0.17.1-modelscope1.34.0-swift4.0.3里的vllm部署qwen3.5的时候报以下错误:
[rank0]: File "/usr/local/lib/python3.11/site-packages/transformers/configuration_utils.py", line 714, in from_dict [rank0]: config = cls(**config_dict) [rank0]: ^^^^^^^^^^^^^^^^^^ [rank0]: File "/usr/local/lib/python3.11/site-packages/vllm/transformers_utils/configs/qwen3_5.py", line 180, in init [rank0]: self.text_config = self.sub_configs"text_config" [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "/usr/local/lib/python3.11/site-packages/vllm/transformers_utils/configs/qwen3_5.py", line 109, in init [rank0]: super().init(**kwargs) [rank0]: File "/usr/local/lib/python3.11/site-packages/transformers/configuration_utils.py", line 219, in init [rank0]: kwargs = self.convert_rope_params_to_dict( [rank0]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [rank0]: File "/usr/local/lib/python3.11/site-packages/transformers/modeling_rope_utils.py", line 651, in convert_rope_params_to_dict [rank0]: ignore_keys_at_rope_validation = ignore_keys_at_rope_validation | {"partial_rotary_factor"} [rank0]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~ [rank0]: TypeError: unsupported operand type(s) for |: 'list' and 'set'
How to Reproduce / 如何复现
在镜像modelscope-registry.cn-hangzhou.cr.aliyuncs.com/modelscope-repo/modelscope:ubuntu22.04-cuda12.8.1-py311-torch2.10.0-vllm0.17.1-modelscope1.34.0-swift4.0.3中使用vllm部署qwen3.5
Additional Information / 补充信息
No response