Tony 4c9d78a035 support multistep decode (#299) ...

Add multi step scheduler support for vllm-ascend

Signed-off-by: new-TonyWang <wangtonyyu222@gmail.com>

2025-03-11 19:20:06 +08:00

..

__init__.py

[Core] Support pooling (#229)

2025-03-04 15:59:34 +08:00

model_runner.py

[Platform][Model Runner] Add hash of request_ids; Change blocksize back to 128. (#293)

2025-03-11 18:50:28 +08:00

multi_step_runner.py

support multistep decode (#299)

2025-03-11 19:20:06 +08:00

multi_step_worker.py

support multistep decode (#299)

2025-03-11 19:20:06 +08:00

pooling_model_runner.py

[Core] Support pooling (#229)

2025-03-04 15:59:34 +08:00

worker.py

[Performance] Change the shape of kv_cache to avoid view of k_cache and v_cache. (#204)

2025-03-05 10:51:07 +08:00