Format code (#118)

This commit is contained in:
Lianmin Zheng
2024-01-29 17:08:12 -08:00
committed by GitHub
parent 6b0af2853c
commit 4ea92f8307
6 changed files with 6 additions and 1 deletions

View File

@@ -324,7 +324,7 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
- Mixtral
- LLaVA
- `python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.5-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --port 30000`
- Qwen
- Qwen / Qwen 2
- AWQ quantization
## Benchmark And Performance