whx cd2f14a1b3 [MTP][V1] Adapt mtp with graph mode in v1. (#1023) ...

Adapts deepseek mtp with torch air graph mode in v1.

---------

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-06-09 22:21:42 +08:00

..

attention

[MTP][V1] Adapt mtp with graph mode in v1. (#1023)

2025-06-09 22:21:42 +08:00

compilation

[Build] Move numba/quart to requirments and update DS baseline and sync graph typo fix (#1121)

2025-06-08 22:33:37 +08:00

core

[Misc] fix initialize_kv_cache (#1102)

2025-06-06 16:46:23 +08:00

device_allocator

[bugfix] Improve log level and info for custom ops build (#937)

2025-05-23 10:05:57 +08:00

distributed

[bugfix] some bugs maybe fail to run (#896)

2025-06-03 11:07:33 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

[bugfix] fix deeepseek accuracy (#1118)

2025-06-07 21:11:36 +08:00

multistream

[perf]: support dual-batch overlap(dbo) for deepseek (#941)

2025-06-07 16:46:58 +08:00

ops

Add static EPLB (#1116)

2025-06-09 19:28:11 +08:00

patch

[Patch] Remove spec_decode.metrics patch (#1016)

2025-06-09 15:05:11 +08:00

quantization

Add static EPLB (#1116)

2025-06-09 19:28:11 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[MTP][V1] Adapt mtp with graph mode in v1. (#1023)

2025-06-09 22:21:42 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

ascend_config.py

Add static EPLB (#1116)

2025-06-09 19:28:11 +08:00

envs.py

[Bugfix] Set ACL_OP_INIT_MODE env var default to 0 (#1123)

2025-06-09 14:07:37 +08:00

platform.py

[BugFix] Fix data parallel (#940)

2025-06-09 14:08:18 +08:00

utils.py

[ModelRunner]Add profile execute duration observation (#1013)

2025-06-06 09:29:34 +08:00