Mengqing Cao a0c3e9ba50 [Bugfix] Adjust inputbatch to be compatible with latest vllm (#945) ...

Adjust inputbatch to be compatible with latest vllm, as kvcache group
feature has been redo in https://github.com/vllm-project/vllm/pull/18593

---------

Signed-off-by: MengqingCao <cmq0113@163.com>

2025-05-26 10:33:28 +08:00

..

attention

[Bugfix] Adjust inputbatch to be compatible with latest vllm (#945)

2025-05-26 10:33:28 +08:00

core

[Feature] Impl v1 disaggregated prefill in ascend scheduler (#852)

2025-05-23 10:15:29 +08:00

device_allocator

[bugfix] Improve log level and info for custom ops build (#937)

2025-05-23 10:05:57 +08:00

distributed

[BugFix]add all2all when dp_size > 1 && downgrade npu_dequant_swiglu_quant (#819)

2025-05-15 09:19:55 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

[Feature] Add CustomQwen3MoeForCausalLM model (#925)

2025-05-23 15:50:48 +08:00

ops

[BugFix] Fix accuracy bugs for unquantized deepseekv3 models (#897)

2025-05-24 14:29:36 +08:00

patch

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

quantization

[BugFix] Fix accuracy bugs for unquantized deepseekv3 models (#897)

2025-05-24 14:29:36 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[Bugfix] Adjust inputbatch to be compatible with latest vllm (#945)

2025-05-26 10:33:28 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

envs.py

[Bugfix] Fix the method of importing environment variables in DeepSee… (#817)

2025-05-13 12:52:30 +08:00

platform.py

[V1] Revert the default value of enable_chunked_prefill in additional… (#935)

2025-05-23 10:06:50 +08:00

utils.py

enable online serving quantization (#877)

2025-05-17 17:36:04 +08:00