d96da1f00c
### What this PR does / why we need it? Fix word spelling in DOC. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? No. Signed-off-by: paulyu12 <507435917@qq.com>
569 B
569 B
LoRA Adapters
Like vLLM, vllm-ascend supports LoRA as well. The usage and more details can be found in vLLM official document.
You can also refer to this to find which models support LoRA in vLLM.
Tips
If you fail to run vllm-ascend with LoRA, you may follow this instruction to disable graph mode and try again.