[Bugfix] add compilation/__init__.py to fix import error (#1152)

1. Add `__init__.py` for vllm_ascend/compilation to make sure it's a
python module
2. Fix model runner bug to keep the same with vllm
3. Add release note for 0.9.0rc2

---------

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
This commit is contained in:
wangxiyuan
2025-06-10 17:14:25 +08:00
committed by GitHub
parent e68e81f2ce
commit b75cb788dd
7 changed files with 23 additions and 10 deletions

View File

@@ -54,7 +54,7 @@ outputs = model.generate("Hello, how are you?")
online example:
```shell
vllm serve Qwen/Qwen2-7B-Instruct --additional-config='{"torchair_graph_config": {"enable": True}}'
vllm serve Qwen/Qwen2-7B-Instruct --additional-config='{"torchair_graph_config": {"enable": true}}'
```
You can find more detail about additional config [here](./additional_config.md)