mradermacher/Qwen3_Chat_CatGirl_8B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen3_Chat_CatGirl_8B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-10 09:43:17 +08:00
commit f0e9853293
14 changed files with 154 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.f16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3_Chat_CatGirl_8B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen3_Chat_CatGirl_8B.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:25f7d760fc9a55264016feb364b108bf1b697de9d7149d28786dee1934883c67
size 4593296576

3
Qwen3_Chat_CatGirl_8B.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a6ba65b980aa3f4f6902d6b4cc9b5447908211081a5a2f43800c86ed43d29f3
size 3281732800

3
Qwen3_Chat_CatGirl_8B.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6d487cb212a27147fcc245e88401c8061ed10972e25f953306ab673a225e987
size 4431393984

3
Qwen3_Chat_CatGirl_8B.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f17ee00c8eeeda346bf2384cd1b57a8829a2f95214026e8ad6dd13940ef3fbac
size 4124161216

3
Qwen3_Chat_CatGirl_8B.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55f0abbcaa8b59b210039644043ae6fe685a7e07e2a79503dfffed1657e25f74
size 3769611456

3
Qwen3_Chat_CatGirl_8B.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81d6a7c6e7513aca0ac77045abb81d8dce4ee0e2e622d60f069e690a823c9a18
size 5027783872

3
Qwen3_Chat_CatGirl_8B.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:811de9434635387e92dc9a06c5be93e17057d9245250375ddd8ae7e12a6b42d8
size 4802012352

3
Qwen3_Chat_CatGirl_8B.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6cb39dbf2f91fa96eb636439ad9afbf68db6795012d927ee99e4372f2c4c2ba6
size 5851112640

3
Qwen3_Chat_CatGirl_8B.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:82eefc7181cea3e92c10355cd65b4c5deb028bfbee8d4c10213c4ceedd1a561b
size 5720761536

3
Qwen3_Chat_CatGirl_8B.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e4a1bfad9f87905d93076fb6386565c7a7c177524d1f5953adbf4c030d8bf8d
size 6725899456

3
Qwen3_Chat_CatGirl_8B.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:179d892825eafa4da4a98963333fe22a61662b2c5578306105de1a0ee206b1fc
size 8709518528

3
Qwen3_Chat_CatGirl_8B.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d62f3225b503928a46fb8224d54c8812fda423c53d89e68c4d6e454b387fbbf4
size 16388043968

71
README.md Normal file
View File

@@ -0,0 +1,71 @@
---
base_model: Songwufeng/Qwen3_Chat_CatGirl_8B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
<!-- ### quants: x-f16 Q4_K_S Q2_K Q8_0 Q6_K Q3_K_M Q3_K_S Q3_K_L Q4_K_M Q5_K_S Q5_K_M IQ4_XS -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
static quants of https://huggingface.co/Songwufeng/Qwen3_Chat_CatGirl_8B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3_Chat_CatGirl_8B-GGUF).***
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q2_K.gguf) | Q2_K | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q3_K_S.gguf) | Q3_K_S | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q3_K_M.gguf) | Q3_K_M | 4.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q3_K_L.gguf) | Q3_K_L | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.IQ4_XS.gguf) | IQ4_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q4_K_S.gguf) | Q4_K_S | 4.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q4_K_M.gguf) | Q4_K_M | 5.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q5_K_S.gguf) | Q5_K_S | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q5_K_M.gguf) | Q5_K_M | 6.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q6_K.gguf) | Q6_K | 6.8 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.Q8_0.gguf) | Q8_0 | 8.8 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3_Chat_CatGirl_8B-GGUF/resolve/main/Qwen3_Chat_CatGirl_8B.f16.gguf) | f16 | 16.5 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->