curryliu ca8007f584 [Feature] Enable inference support for Deepseekr1-w8a8-MTP (#1994) ...

Support the inference of the Deepseekr1-w8a8-mtp model with
statically-quantized shared_head in MTP layers.

- vLLM version: v0.9.2
- vLLM main:
6eca337ce0

Signed-off-by: curryliu <120010041@link.cuhk.edu.cn>

2025-07-29 18:51:57 +08:00

..

__init__.py

[main] Use AddRmsNormQuant ops in the custom model to optimize Qwen3's performance (#1806)

2025-07-22 19:03:13 +08:00

deepseek_dbo.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979)

2025-07-28 14:06:20 +08:00

deepseek_mtp.py

[Feature] Enable inference support for Deepseekr1-w8a8-MTP (#1994)

2025-07-29 18:51:57 +08:00

deepseek_v2.py

[Feature] Enable inference support for Deepseekr1-w8a8-MTP (#1994)

2025-07-29 18:51:57 +08:00

deepseek_v3.py

Move deepseek_v3 from deepseek_v2.py (#1793)

2025-07-19 11:37:03 +08:00

pangu_moe.py

[Misc] Fix logger bug (#2024)

2025-07-28 15:59:09 +08:00

qwen2_5_vl_without_padding.py

[Bug] Fix duplicate 'torch.' prefix in qwen-vl (#1986)

2025-07-24 20:16:00 +08:00

qwen2_5_vl.py

[Bug] Fix duplicate 'torch.' prefix in qwen-vl (#1986)

2025-07-24 20:16:00 +08:00

qwen2_vl.py

[Bug] Fix duplicate 'torch.' prefix in qwen-vl (#1986)

2025-07-24 20:16:00 +08:00

qwen3_moe.py

[Feature] Add CustomQwen3MoeForCausalLM model (#925)

2025-05-23 15:50:48 +08:00

qwen3.py

[main] Use AddRmsNormQuant ops in the custom model to optimize Qwen3's performance (#1806)

2025-07-22 19:03:13 +08:00