3d1e6a5929
Add user doc index to make the user guide more clear
- vLLM version: v0.9.1
- vLLM main:
49e8c7ea25
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
575 B
575 B
LoRA Adapters Guide
Like vLLM, vllm-ascend supports LoRA as well. The usage and more details can be found in vLLM official document.
You can also refer to this to find which models support LoRA in vLLM.
Tips
If you fail to run vllm-ascend with LoRA, you may follow this instruction to disable graph mode and try again.