janhq/Jan-v1-4B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
nguyen hoang thuan
2025-08-12 04:30:37 +00:00
committed by system
parent cae60a05d1
commit c3d2619969
1 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@@ -48,7 +48,7 @@ Jan-v1 is optimized for direct integration with the [Jan App](https://jan.ai/).
**Using vLLM:** **Using vLLM:**
```bash ```bash
vllm serve Menlo/Jan-v1 \ vllm serve janhq/Jan-v1-4B \
--host 0.0.0.0 \ --host 0.0.0.0 \
--port 1234 \ --port 1234 \
--enable-auto-tool-choice \ --enable-auto-tool-choice \
@@ -59,7 +59,9 @@ vllm serve Menlo/Jan-v1 \
```bash ```bash
llama-server --model jan-v1.gguf \ llama-server --model jan-v1.gguf \
--host 0.0.0.0 \ --host 0.0.0.0 \
--port 1234 --port 1234 \
--jinja \
--no-context-shift
``` ```
### Recommended Parameters ### Recommended Parameters