yiz-liu 5a1689fc64 [Fix] Fix update_aclgraph_sizes when running MoE models (#913) ...

### What this PR does / why we need it?
Fix update_aclgraph_sizes when running MoE models.

---------

Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>

2025-05-30 15:17:11 +08:00

..

attention

[1/N][UT][v1 MTP] add basic v1 mtp features (#890)

2025-05-30 08:59:58 +08:00

compilation

[aclgraph] implentment NPUPiecewiseBackend to enable aclgraph (#836)

2025-05-29 11:58:26 +08:00

core

[Feature] Impl v1 disaggregated prefill in ascend scheduler (#852)

2025-05-23 10:15:29 +08:00

device_allocator

[bugfix] Improve log level and info for custom ops build (#937)

2025-05-23 10:05:57 +08:00

distributed

[Fix] Fix update_aclgraph_sizes when running MoE models (#913)

2025-05-30 15:17:11 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

bugfix for qwen2_5_vl (#805)

2025-05-29 17:20:39 +08:00

ops

[1/N][UT][v1 MTP] add basic v1 mtp features (#890)

2025-05-30 08:59:58 +08:00

patch

[CI] upgrade to vllm 0.9.0 (#959)

2025-05-28 21:18:41 +08:00

quantization

[Perf] Refactor tensor disposal logic to reduce memory usage (#966)

2025-05-29 11:48:26 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[Fix] Fix update_aclgraph_sizes when running MoE models (#913)

2025-05-30 15:17:11 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

envs.py

[Bugfix] Fix the method of importing environment variables in DeepSee… (#817)

2025-05-13 12:52:30 +08:00

platform.py

[Fix] Fix update_aclgraph_sizes when running MoE models (#913)

2025-05-30 15:17:11 +08:00

utils.py

[Fix] Fix update_aclgraph_sizes when running MoE models (#913)

2025-05-30 15:17:11 +08:00