EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[Doc] Update tutorials for single_npu_audio and single_npu_multimodal (#2252)

Browse Source 
### What this PR does / why we need it?
Update tutorials for single_npu_audio and single_npu_multimodal

- vLLM version: v0.10.0
- vLLM main:
6b47ef24de

Signed-off-by: hfadzxy <starmoon_zhang@163.com>
This commit is contained in:
zhangxinyuehfad
2025-08-07 14:08:14 +08:00
committed by GitHub
parent 205eff2b12
commit dbba3cabb0
2 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docs/source/tutorials/single_npu_audio.md
View File

@@ -54,6 +54,7 @@ from vllm import LLM, SamplingParams
from vllm.assets.audio import AudioAsset from vllm.assets.audio import AudioAsset
from vllm.utils import FlexibleArgumentParser from vllm.utils import FlexibleArgumentParser
# If network issues prevent AudioAsset from fetching remote audio files, retry or check your network.
audio_assets = [AudioAsset("mary_had_lamb"), AudioAsset("winning_call")] audio_assets = [AudioAsset("mary_had_lamb"), AudioAsset("winning_call")]
question_per_audio_count = { question_per_audio_count = {
1: "What is recited in the audio?", 1: "What is recited in the audio?",

2
docs/source/tutorials/single_npu_multimodal.md
View File

@@ -43,7 +43,7 @@ export PYTORCH_NPU_ALLOC_CONF=max_split_size_mb:256
Run the following script to execute offline inference on a single NPU: Run the following script to execute offline inference on a single NPU:
```bash ```bash
pip install torchvision==0.20.1 qwen_vl_utils --extra-index-url https://download.pytorch.org/whl/cpu/ pip install qwen_vl_utils --extra-index-url https://download.pytorch.org/whl/cpu/
``` ```
```python ```python