mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-17 02:36:10 +08:00
commit 82d4f9a9ca
27 changed files with 216 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9de6b92ed65b9a6af733f9de26b62a70df9c6f25061b6815b7cae04262167ca
size 3872309920

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dc912352c4e3c6d7bc97bd9e0b7361515aaf3f0491b1e86cabf3a35fd4478d5
size 3607995040

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d69714ec9deee504893fabb60ac353de0c7e5b023d934bad4585b99963ec9b4
size 5356147360

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:714dac122e79827c610d4259034bac919579f5cc1de5cc56293841c5992c5a21
size 5003727520

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0caaa7bb02f3b512244d0a3b0123e79b068cf3ccbb27f344d93c43f3cf04f47
size 4704576160

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29d1f30e79b9242d1cd75756414fa4a93bb6a46089de9589b6d04e66d53c35ad
size 4312834720

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdae960da97da4cb146b84de472313f1cf16911f267b67fb80da0b867df5309b
size 6916539040

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f67719132cb4e3c21dfa2ccba21dabefa7dc834c8e5cb6d770807a5e630b903
size 6693020320

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12167040ec192bce0869e8bcbd27e57d31d8eebe701ec60814d6a015901da1d9
size 6383362720

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f606471635f62e3d84ff8e817987d47c93d1d8d6a817c3640f4f2051b0b6812
size 5946708640

3
Qwen2.5-14B-Instruct-abliterated.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8bbdb708374dd56699b11567f0f9e3c33491604c53505158ebb76f661a5e4f09
size 8119841440

3
Qwen2.5-14B-Instruct-abliterated.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:574c7c823ab4147b807ed9380f638106f50f0715f2054ca9974221ad72135948
size 5770498720

3
Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7236643117a7bd853925f9e46ec27e7f00672d2814d00f2036705ae21cce1037
size 7924769440

3
Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6742e4bb9be9bfc6d2158b3b78b32a0e505f2a42c4fddd753117c5f5863fa117
size 7339205280

3
Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a4206d527334901b049b3114788d61bbac397a63471c24c46668bb74ea92cd6
size 6659596960

3
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f06ff21a24e6fb64dac34ae5207b9099f1bf6eca659898d4a3256e08c7b409e
size 8544268960

3
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef962107f4e751cf29d7466b472ac717be4ef7cb727a9a065c6a98be2115743a
size 8517726880

3
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a4b111f408f5ff20402233b0aa671929a8cc5a653f2928a2ee0463f2deaf7d1
size 8517726880

3
Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9adddfff547917236bb4b549623262cbc95fffd61113ceec59b0174117afbb2c
size 8517726880

3
Qwen2.5-14B-Instruct-abliterated.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3586ed07453ac8f990a095260c9b3dffe8982e64039445374027d656672c543
size 8988111520

3
Qwen2.5-14B-Instruct-abliterated.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59ae109c68c7e647634a7b1289c5147afa396a4d53dee586e0299e6de6c2f791
size 8573432480

3
Qwen2.5-14B-Instruct-abliterated.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a592f913d2ff8011cc690c64ac5115c3f0159d58b42e6a422b3a178949aeaec4
size 10508874400

3
Qwen2.5-14B-Instruct-abliterated.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8b395f5759c63b0de666e2c3bbec750f62ea80558b03b1ed792c8ae8e883a82
size 10266555040

3
Qwen2.5-14B-Instruct-abliterated.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:681f1d079e00b921566e155e889f5e7a5722cbf39c8908dc2bcacbda66721664
size 12124684960

81
README.md Normal file
View File

@@ -0,0 +1,81 @@
---
base_model: huihui-ai/Qwen2.5-14B-Instruct-abliterated
language:
- en
library_name: transformers
license: apache-2.0
license_link: https://huggingface.co/huihui-ai/Qwen2.5-14B-Instruct-abliterated/blob/main/LICENSE
quantized_by: mradermacher
tags:
- chat
- abliterated
- uncensored
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/huihui-ai/Qwen2.5-14B-Instruct-abliterated
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 8.6 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 8.6 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 8.6 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF/resolve/main/Qwen2.5-14B-Instruct-abliterated.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17387c1d1524d39bd488b8b460cdebdd67da5e0379944b8dbfd4ae9178b9e81e
size 8563597