[MISC] set default model to qwen in example (#87)
- Set default model to Qwen2.5-0.5B-Instruct in example - Remove Ultravox 0.3 because it is not tested currently Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
@@ -30,9 +30,9 @@ prompts = [
|
||||
sampling_params = SamplingParams(max_tokens=100, temperature=0.0)
|
||||
# Create an LLM.
|
||||
llm = LLM(
|
||||
model="facebook/opt-125m",
|
||||
model="Qwen/Qwen2.5-0.5B-Instruct",
|
||||
tensor_parallel_size=2,
|
||||
distributed_executor_backend="ray",
|
||||
distributed_executor_backend="mp",
|
||||
trust_remote_code=True,
|
||||
)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user