mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-10 21:57:21 +08:00
commit 2d315b08aa
27 changed files with 232 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a89b234a4a6adcccb5f0f5836a4a4f33090774d0ab576d72d83b3776db29cc0e
size 850028064

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a74aaa8ee50488339f9b3cc477673e4c32a88639757dc40ff2f3acc856b462b9
size 791094816

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e01a43109780d78294048772ea4956e4b23b157ff92d0ea88ed50508404e6cd9
size 1140516384

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d236da9c0786f063f2b193547de151fcea41d9b1753be2fc6034cc1f26f97f1
size 1061938720

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75b25080d3eec9eda524d52afcae350851fcf1df6bb98f2d5e5efd04f438e4d4
size 1031546400

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39561d824b485f7ef9576492f852094ab7749fd2e43bb6e1b190cf2f7aaa5b5f
size 948250144

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f27ca37dd3356178f5368ba26c3b758442c5c9e984fbcc4b5b89559460bd300e
size 1488895520

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6bb624f69ffb930ffb8ab9c08126808d37f2a8571fcd0c2e59566f22be38e610
size 1456864800

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12f9c56b860c7cd97ae4f9ee7d6296536a4b017b4bed6b88e3b1c9c3e3078202
size 1391836704

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af960f1d84fbe129e502f741b97a991f1075910dd4e12ce8e53791e0345727c8
size 1282827808

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b55b551418a4b2944effa5a91e63d56889b95cb5b2515179454590b10c838d5
size 1825209888

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a555a5296eab6978efb423432f2f3e64da05e1a161e8aeb273e507cb5c80603e
size 1739095584

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d9c5dff2442c9c08072b9b4d105c5f23aa4e0952c698b3cb58a33e0c6fc4a50
size 1274756640

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:013ac5f96ccf0510b7fc88892299a03f53beac72ead08e5dab3d8ac1d7045c85
size 1198128672

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c37eea45900eabfb3dde4e4c7d23249738b9316452e461329a96d33c92f40270
size 1707392544

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:258e2171e6d6ea964d346226da172461b4d3faa407332b13b56b96b4b63e80e6
size 1590476320

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9103610f22dd8d0e913f090e7017f383bc84506d95ed9d625d09944e2223084
size 1454358048

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4fed34de43f7b0a628182d480b19c4244a63ef5d699e2293901f97eae1b303c
size 1828486688

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da646a901117fe3edc46c8788cc3dabf78581f545f87e215cfac1d940b7a1924
size 1996258848

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32cb0dc28d1c1d4379345a14600e53687ec7e5a02275b77419a4919bb8ff5724
size 1929903648

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2623ab83073e12050b1a4f91ab7a1c612059dbf5bc66a623f9c2729b6c454940
size 1834384928

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f71a23d72cf02c769f4a26afc88cb03a0c2152914037445cd16310dde22f92e5
size 2224815648

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:afbedf88a0ffff257805aaa261d68569fc802d02de0cd8f5fd1ce023cc8f24d5
size 2169667104

3
Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d6d7abce4acae6df9d4b4695e9b11a41756d6eb84820c4d36af989e9ce35a4b
size 2538159648

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
base_model: kxdw2580/Qwen2.5-3B-Instruct-Catgirl-v2
datasets:
- kxdw2580/catgirl-dataset
language:
- zho
- eng
- fra
- spa
- por
- deu
- ita
- rus
- jpn
- kor
- vie
- tha
- ara
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- llama-factory
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/kxdw2580/Qwen2.5-3B-Instruct-Catgirl-v2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-3B-Instruct-Catgirl-v2-i1-GGUF/resolve/main/Qwen2.5-3B-Instruct-Catgirl-v2.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf0c4444c08e2dc4ee9ca518bdecb517df91fa20e177d279b5ec10bfd18265d6
size 3362977