realliujiaxu 723d460894 [Bugfix] fix kv nz accuracy bug (#2988) ...

when `enable_kv_nz` is true, output of Deepseek R1 is invalid.

- vLLM version: v0.10.2
- vLLM main:
2b85697031

Signed-off-by: realliujiaxu <realliujiaxu@163.com>

2025-09-17 21:10:25 +08:00

..

attention

[Bugfix] fix kv nz accuracy bug (#2988)

2025-09-17 21:10:25 +08:00

compilation

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

core

main add ascend scheduler support multimodal (#2844)

2025-09-14 09:38:51 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

fix mooncake connector adxl hostname usage (#2824)

2025-09-13 14:38:48 +08:00

eplb

Dynamic Expert Load Balance with Zero-like-overhead (#2956)

2025-09-17 10:36:43 +08:00

lora

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

models

[main] addrmsnorm + quant fusion optim in Dense Models (#2772)

2025-09-16 22:31:38 +08:00

multistream

[Quickfix] update CachedRequestState as NewRequestData changed (#2367)

2025-08-15 07:35:27 +08:00

ops

Dynamic Expert Load Balance with Zero-like-overhead (#2956)

2025-09-17 10:36:43 +08:00

patch

[refactor] refactor deepseek-related files (#2849)

2025-09-16 14:13:07 +08:00

quantization

Dynamic Expert Load Balance with Zero-like-overhead (#2956)

2025-09-17 10:36:43 +08:00

sample

[main] add pd transfer for ascend scheduler (#2753)

2025-09-10 08:46:39 +08:00

spec_decode

[Main] [Refactor] Enable MoECommMethod in Eager Mode (#2791)

2025-09-16 11:06:00 +08:00

torchair

[Bugfix] fix kv nz accuracy bug (#2988)

2025-09-17 21:10:25 +08:00

worker

Dynamic Expert Load Balance with Zero-like-overhead (#2956)

2025-09-17 10:36:43 +08:00

__init__.py

Bump torch version to 2.7.1 (#1562)

2025-08-05 08:43:24 +08:00

ascend_config.py

Add an option of enable frozen parameter (#2869)

2025-09-17 12:00:44 +08:00

ascend_forward_context.py

[main] addrmsnorm + quant fusion optim in Dense Models (#2772)

2025-09-16 22:31:38 +08:00

envs.py

[Ops] Fix bug in register_custom_ops without forward_context (#2883)

2025-09-12 16:58:08 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

[Feat][Graph] Support DeepSeek with ACL Graph (#2707)

2025-09-16 17:50:17 +08:00

utils.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00