eb921d2b6f
Fix url 404 error in doc
- vLLM version: v0.9.2
- vLLM main:
9ad0a4588b
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
589 B
589 B
LoRA Adapters Guide
Like vLLM, vllm-ascend supports LoRA as well. The usage and more details can be found in vLLM official document.
You can also refer to this to find which models support LoRA in vLLM.
Tips
If you fail to run vllm-ascend with LoRA, you may follow this instruction to disable graph mode and try again.