mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-17 08:18:09 +08:00
commit 99e37e7aef
27 changed files with 224 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef5c35acfb426c4bff9329c8cf94e7d758b11716c12538eb0c9216d48317ada6
size 3872310208

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dc445a1c967cf84007429fc32ae903003ca9f7e50ae159ab9539b075c0361d3
size 3607995328

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:023030716856e1d1e1fb112194a92e3ae3ef0c48474272ca63a5c32ec5cbcb55
size 5356147648

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c9656ac4fc3e58a02ed00c3a50794004c2f6f0da25899f5d755cf4af74b43356
size 5003727808

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f50768e77ae8295449a680fb200a5e34128e6c22b41f55a2e2e7e6452b08d21e
size 4704576448

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dbabc22225a8f63d3cf06ed576cf263ae357d397dbe6056b84789bf2debe44e8
size 4312835008

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4b32abb7ff314f8fb09e1fe270c4dc7d07f1a71e9b11ddb4412688d59e50722
size 6916539328

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24e983e30b4cd6e01084a8459c0231550fb862a304b11702829bf977524e4ab2
size 6693020608

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62aad01fe57fd90f49660805e34c55f1c90ff4d913fc42ac5248893cd06b5277
size 6383363008

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aeb1344d5525bdd9b28be03a2bc4273eeea1e58240303745a3182ab47f90d316
size 5946708928

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32a482fffdc57914f4b759bed1af8bcc23e8a5c0142de626c9fb2491982d37ab
size 8549184448

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d597f0b8a346648f1f7c671379aa1ca6a5adbda22f8a4688b043b088a0484040
size 8119841728

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1342fae1ba0d334fd6d42dd273ebc5602b05eb6546644bb010c34ad65b15262
size 5770499008

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:806e45837fb7e06327c5e9a049b36ec3fb1c8cb044b39e904c50c638801da138
size 5397189568

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05bdef5c1d0d66bec0fd69a417c71cada6eba88db14f205d03a0460a4f38afe6
size 7924769728

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b82191b2e188718363f853636497b318e44e4b2614f2107a8672ad519b4f1c48
size 7339205568

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33496de8d0f5abf1ab24f52b4b67d3f74e8f4d74323084dac7b18e44361c653f
size 6659597248

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15d79c07df06585f1400497a554e167793e079d79f0754133f98e8199f0a723f
size 8544269248

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55b8d519b56ede1b90e3446f22ce57e164cbcf22a73b35a6bd559ef2425f3562
size 9392141248

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1b9508ffaece9c2c78b6f39adf2c31d3c9551f79bcba9c11ef6b842a2fb0e84
size 8988111808

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a2fcc5a4b837b2f5e4674f86fbf9306a403f520e21b5456c60f067eeb5ab1d2
size 8573432768

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49c24851faf6d47840d7d422cc1a07592371f2b8e050b74cbf928112ad298f86
size 10508874688

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e43e24f405fa71f47f83fa864391733a347ddc758ede0ce034fda5868102276c
size 10266555328

3
Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5a489295b1a764e2dee0e8a31de92317b2eb3a4d7137cc21dba0de763be3481
size 12124685248

89
README.md Normal file
View File

@@ -0,0 +1,89 @@
---
base_model: huihui-ai/Qwen2.5-14B-Instruct-abliterated-SFT
datasets:
- huihui-ai/Guilherme34_uncensor
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- abliterated
- uncensored
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/huihui-ai/Qwen2.5-14B-Instruct-abliterated-SFT
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-SFT-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated-SFT.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a961435a8c849fdb03958770da0f948bd53c8df353408d58561d2767dd74aeb8
size 8563597