Tony 4c9d78a035 support multistep decode (#299) ...

Add multi step scheduler support for vllm-ascend

Signed-off-by: new-TonyWang <wangtonyyu222@gmail.com>

2025-03-11 19:20:06 +08:00

..

models

register qwen2_vl to rewrite qwen2_vl forwad (#241)

2025-03-07 15:41:47 +08:00

ops

[Fix] Remove npu_group_topk before CANN version update (#242)

2025-03-06 09:02:46 +08:00

quantization

[Feature] Modify description and api for ascend quantization (#243)

2025-03-06 15:17:25 +08:00

worker

support multistep decode (#299)

2025-03-11 19:20:06 +08:00

__init__.py

register qwen2_vl to rewrite qwen2_vl forwad (#241)

2025-03-07 15:41:47 +08:00

attention.py

support multistep decode (#299)

2025-03-11 19:20:06 +08:00

communicator.py

[Dist] Set device as rank (#202)

2025-03-03 09:23:13 +08:00

platform.py

support multistep decode (#299)

2025-03-11 19:20:06 +08:00

utils.py

support multistep decode (#299)

2025-03-11 19:20:06 +08:00