whx b6a7f07c70 [Perf][MoE] Improve MoE multistream parallel performace. (#1891) ...

This PR designs the shared expert multi-stream parallelism of
w8a8-dynamic-quantized MoE stage in more detail to achieve better
performance.

- vLLM version: v0.10.0
- vLLM main:
2cc571199b

Signed-off-by: whx-sjtu <2952154980@qq.com>

2025-07-29 23:53:19 +08:00

..

__init__.py

[Core] Cherry pick from 0.7.1 to keep the main code newest (#127)

2025-02-21 17:07:37 +08:00

func_wrapper.py

[quantization] Support w8a8 quantization (#580)

2025-04-20 18:14:05 +08:00

quant_config.py

[Feature] Enable inference support for Deepseekr1-w8a8-MTP (#1994)

2025-07-29 18:51:57 +08:00

quantizer.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979)

2025-07-28 14:06:20 +08:00

w8a8_dynamic.py

[Perf][MoE] Improve MoE multistream parallel performace. (#1891)

2025-07-29 23:53:19 +08:00

w8a8.py

[main] Use AddRmsNormQuant ops in the custom model to optimize Qwen3's performance (#1806)

2025-07-22 19:03:13 +08:00