[MISC] set default model to qwen in example (#87)

- Set default model to Qwen2.5-0.5B-Instruct in example
- Remove Ultravox 0.3 because it is not tested currently

Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
Mengqing Cao
2025-02-18 17:09:59 +08:00
committed by GitHub
parent 8ea8523744
commit c18fb09b55
3 changed files with 4 additions and 31 deletions

View File

@@ -29,7 +29,7 @@ prompts = [
# Create a sampling params object.
sampling_params = SamplingParams(max_tokens=100, temperature=0.0)
# Create an LLM.
llm = LLM(model="facebook/opt-125m")
llm = LLM(model="Qwen/Qwen2.5-0.5B-Instruct")
# Generate texts from the prompts.
outputs = llm.generate(prompts, sampling_params)