Qwen/Qwen2.5-1.5B-Instruct-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Cherrytest
2024-09-18 16:05:16 +00:00
parent 630d021161
commit c84862b9bc
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@@ -40,14 +40,14 @@ Check out our [llama.cpp documentation](https://qwen.readthedocs.io/en/latest/ru
We advise you to clone [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and install it following the official guide. We follow the latest version of llama.cpp.
In the following demonstration, we assume that you are running commands under the repository `llama.cpp`.
Since cloning the entire repo may be inefficient, you can manually download the GGUF file that you need or use `huggingface-cli`:
Since cloning the entire repo may be inefficient, you can manually download the GGUF file that you need or use `modelscope`:
1. Install
```shell
pip install -U huggingface_hub
pip install -U modelscope
```
2. Download:
```shell
huggingface-cli download Qwen/Qwen2.5-1.5B-Instruct-GGUF qwen2.5-1.5b-instruct-q5_k_m.gguf --local-dir . --local-dir-use-symlinks False
modelscope download --model=qwen/Qwen2.5-1.5B-Instruct-GGUF --local_dir . qwen2.5-1.5b-instruct-q5_k_m.gguf
```
For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode: