c3c8c9317c
### What this PR does / why we need it? Add LoRA user guide to DOC. The content refers to [LoRA Adapters](https://docs.vllm.ai/en/latest/features/lora.html). ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? No --------- Signed-off-by: paulyu12 <507435917@qq.com>
568 B
568 B
LoRA Adapters
Like vLLM, vllm-scend supports LoRA as well. The usage and more details can be found in vLLM official document.
You can also refer to this to find which models support LoRA in vLLM.
Tips
If you fail to run vllm-ascend with LoRA, you may follow this instruction to disable graph mode and try again.