wangxiyuan f762ee89cc [Communicator] Add monkey patch (#30) ...

Some PR for plugin support is not merged by vllm yet. This PR add monkey
patch to vllm-ascend to make vllm-ascend work with vllm directly.

This patch code should be removed once the related function is supported
by vllm originally.

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>

2025-02-11 19:15:35 +08:00

..

ops

[Core] Init vllm-ascend (#3)

2025-02-05 10:53:12 +08:00

patch

[Communicator] Add monkey patch (#30)

2025-02-11 19:15:35 +08:00

__init__.py

[Core] Init vllm-ascend (#3)

2025-02-05 10:53:12 +08:00

attention.py

[attn] fix device of tensors in attention (#25)

2025-02-10 19:20:29 +08:00

communicator.py

[Communicator] Add monkey patch (#30)

2025-02-11 19:15:35 +08:00

model_runner.py

bugfix for mrope (#14)

2025-02-07 16:46:24 +08:00

platform.py

[Communicator] Add monkey patch (#30)

2025-02-11 19:15:35 +08:00

utils.py

[Worker] Register mindie_turbo while initializing NPUWorker (#13)

2025-02-07 16:47:17 +08:00

worker.py

[Worker] Register mindie_turbo while initializing NPUWorker (#13)

2025-02-07 16:47:17 +08:00