Mengqing Cao 344228a5da [deepseek][bugfix] support deepseek quant (#469) ...

- support deepseek quant
  - add w8a8_dynamic quant
see #391

Signed-off-by: MengqingCao <cmq0113@163.com>
Co-authored-by: zzzzwwjj <1183291235@qq.com>

2025-04-07 10:56:12 +08:00

..

attention

[Core] Make V1 work and enable V1 engine test (#389)

2025-03-28 19:34:23 +08:00

models

[deepseek][bugfix] support deepseek quant (#469)

2025-04-07 10:56:12 +08:00

ops

[Feature] Implement EP-compatible fused_moe (#121)

2025-03-11 21:08:02 +08:00

quantization

[deepseek][bugfix] support deepseek quant (#469)

2025-04-07 10:56:12 +08:00

worker

[ModelRunner][V1] Optimize V1 attention mask (#442)

2025-04-02 10:33:53 +08:00

__init__.py

register qwen2_vl to rewrite qwen2_vl forwad (#241)

2025-03-07 15:41:47 +08:00

communicator.py

[Dist] Set device as rank (#202)

2025-03-03 09:23:13 +08:00

envs.py

[core] Support custom ascendc kernels in vllm-ascend (#233)

2025-04-03 14:52:34 +08:00

platform.py

[Bugfix]Lazy import vllm config (#462)

2025-04-03 16:03:08 +08:00

utils.py

support multistep decode (#299)

2025-03-11 19:20:06 +08:00