Update README.md
This commit is contained in:
committed by
system
parent
cae60a05d1
commit
c3d2619969
@@ -48,7 +48,7 @@ Jan-v1 is optimized for direct integration with the [Jan App](https://jan.ai/).
|
||||
|
||||
**Using vLLM:**
|
||||
```bash
|
||||
vllm serve Menlo/Jan-v1 \
|
||||
vllm serve janhq/Jan-v1-4B \
|
||||
--host 0.0.0.0 \
|
||||
--port 1234 \
|
||||
--enable-auto-tool-choice \
|
||||
@@ -59,7 +59,9 @@ vllm serve Menlo/Jan-v1 \
|
||||
```bash
|
||||
llama-server --model jan-v1.gguf \
|
||||
--host 0.0.0.0 \
|
||||
--port 1234
|
||||
--port 1234 \
|
||||
--jinja \
|
||||
--no-context-shift
|
||||
```
|
||||
|
||||
### Recommended Parameters
|
||||
|
||||
Reference in New Issue
Block a user