whx f286265791 [BugFix] Address PrefillCacheHit state to fix prefix cache accuracy bug (#1498) ...

When use AscendScheduler with prefix-cache enabled and chunk-prefill
disabled, there will be accuray problem because there is no branch in
mla_v1 to process this scenario. This PR fixes it.

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-06-30 16:51:20 +08:00

..

attention

[BugFix] Address PrefillCacheHit state to fix prefix cache accuracy bug (#1498)

2025-06-30 16:51:20 +08:00

compilation

[CI] Upgrade vllm to 0.9.1 (#1165)

2025-06-11 16:33:11 +08:00

core

[Scheduler][MTP] Add support for speculative decoding in AsecendScheduler. (#943)

2025-06-11 20:55:44 +08:00

device_allocator

[Build] Add build info (#1386)

2025-06-27 09:14:43 +08:00

distributed

[bugfix] some bugs maybe fail to run (#896)

2025-06-03 11:07:33 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

support pangumoe w8a8c8 and docs (#1477)

2025-06-28 18:51:07 +08:00

multistream

[perf]: support dual-batch overlap(dbo) for deepseek (#941)

2025-06-07 16:46:58 +08:00

ops

[PERF]support MERRouter (#1421)

2025-06-28 16:14:49 +08:00

patch

[BugFix]Fix bugs when initializing communication groups with dp on 300I Duo (#1478)

2025-06-28 16:07:52 +08:00

pool

[V1][ModelRunner] Support pooling model for v1 engine (#1359)

2025-06-30 16:31:12 +08:00

quantization

support pangumoe w8a8c8 and docs (#1477)

2025-06-28 18:51:07 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[V1][ModelRunner] Support pooling model for v1 engine (#1359)

2025-06-30 16:31:12 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

ascend_config.py

[CI] Add unit test framework (#1201)

2025-06-16 18:32:28 +08:00

envs.py

support fused_moe_allgather_ep (#1335)

2025-06-23 22:03:38 +08:00

platform.py

support pangumoe w8a8c8 and docs (#1477)

2025-06-28 18:51:07 +08:00

utils.py

[Build] Add build info (#1386)

2025-06-27 09:14:43 +08:00