second-state/Qwen2.5-3B-Instruct-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
ai-modelscope
2025-02-06 06:13:56 +08:00
parent ecc42d906f
commit 789a67c7d8
44 changed files with 59 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -84,4 +84,4 @@ tags:
| [Qwen2.5-3B-Instruct-Q8_0.gguf](https://huggingface.co/second-state/Qwen2.5-3B-Instruct-GGUF/blob/main/Qwen2.5-3B-Instruct-Q8_0.gguf) | Q8_0 | 8 | 1.65 GB| very large, extremely low quality loss - not recommended |
| [Qwen2.5-3B-Instruct-f16.gguf](https://huggingface.co/second-state/Qwen2.5-3B-Instruct-GGUF/blob/main/Qwen2.5-3B-Instruct-f16.gguf) | f16 | 16 | 3.09 GB| |
*Quantized with llama.cpp b3751*
*Quantized with llama.cpp b4466*