Li Wang a2552e10e4 [Worker][V1] Support sleep mode for v1 (#1084) ...

### What this PR does / why we need it?
 Support sleep mode for v1

Signed-off-by: wangli <wangli858794774@gmail.com>

2025-06-06 21:54:02 +08:00

..

attention

[Bugfix][DP] Add with_prefill_across_dp to AscendMetadata to fix dp (#1094)

2025-06-06 19:20:33 +08:00

compilation

[aclgraph] implentment NPUPiecewiseBackend to enable aclgraph (#836)

2025-05-29 11:58:26 +08:00

core

[Misc] fix initialize_kv_cache (#1102)

2025-06-06 16:46:23 +08:00

device_allocator

[bugfix] Improve log level and info for custom ops build (#937)

2025-05-23 10:05:57 +08:00

distributed

[bugfix] some bugs maybe fail to run (#896)

2025-06-03 11:07:33 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

[perf]Support MOE Multi-stream in Deepseek (#947)

2025-06-05 23:39:38 +08:00

ops

[Kernel] Remove cumsum in groupedmatmul (#987)

2025-06-06 19:17:27 +08:00

patch

optimize the funtion of computing topk and topp in sampler. (#970)

2025-06-05 16:42:18 +08:00

quantization

[perf]Support MOE Multi-stream in Deepseek (#947)

2025-06-05 23:39:38 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[Worker][V1] Support sleep mode for v1 (#1084)

2025-06-06 21:54:02 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

ascend_config.py

[BugFix] Fix ascend config check (#1092)

2025-06-06 18:54:37 +08:00

envs.py

[Misc] Add ACL_OP_INIT_MODE env var and set default to 1 (#597)

2025-06-06 20:22:51 +08:00

platform.py

[Worker][V1] Support sleep mode for v1 (#1084)

2025-06-06 21:54:02 +08:00

utils.py

[ModelRunner]Add profile execute duration observation (#1013)

2025-06-06 09:29:34 +08:00