Mengqing Cao 7a325b2e2d [Bugfix][Model] Fix fusedmoe and make modelrunner_v1 compatible with latest vllm (#867) ...

### What this PR does / why we need it?
this PR fix CI failure broken by vllm.
1. add moe_config for fused_moe
2. adjust the change for kv cache group from vllm. currently vllm-ascend
doesn't support this feature. this is just a quick fix for backward
compatibility

fix: #872

---------

Signed-off-by: MengqingCao <cmq0113@163.com>

2025-05-16 12:14:55 +08:00

..

__init__.py

[MISC] Clean up torch_npu (#688)

2025-04-29 18:03:38 +08:00

activation.py

Optimize qwen2_vl and qwen2_5_vl (#701)

2025-04-30 14:22:38 +08:00

attention.py

[Bugfix] Fix output tensor shape in vanilla_chunked_prefill and update import paths for model_loader (#773)

2025-05-08 14:19:26 +08:00

cache.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00

common_fused_moe.py

[Attention][Kernel]moe support for llama4 and mllama4 (#740)

2025-05-13 19:12:40 +08:00

fused_moe.py

[Bugfix][Model] Fix fusedmoe and make modelrunner_v1 compatible with latest vllm (#867)

2025-05-16 12:14:55 +08:00

layernorm.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

rotary_embedding.py

[Bugfix] Correct method call for _set_cos_sin_cache (#774)

2025-05-09 12:55:57 +08:00

vocab_parallel_embedding.py

port deepseekv2 and mtp to main branch (#429)

2025-04-19 17:38:18 +08:00