mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-09 22:17:17 +08:00
commit a9f0bba00d
27 changed files with 212 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a5fd42ffbd05dcff3e19496aa9bd7187a23e113d8df36f4e6a1174813a48fbc
size 541037536

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f64c9bd51bc8df46a617e73f3e09397b0db7a5a5de6ef42cf4500af5c6aceee2
size 513103840

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5d3b1f51cd78fdf160a25859144789fbc581be2d7cefb3042b1dfbd7c4e6f50
size 701332960

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3cc574f25050c9a52b46eae1e95aeba7c5dd2eca02bbbf6a7ee53921838b27d1
size 664088032

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:658b94a24f2508747bc21e2fba357f0aad9b7072de72a3089c18ea9c00dc6329
size 626903008

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8f5197556ca5f8bd192014832ee142c6794f44181b778de4614d4306693554f
size 587593696

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b5bb5ac4d730ddc62b462881ebf9ddfe4e4d2e6ceb6ae6e2b606eb04d67cc01
size 876942304

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f4b2853b7327a7a5a5dbf100f810f1bd42ce2dd18fa838d52feb78cec26610a
size 862685152

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8acbe5f79caa5f679deaa15a249dad9f64e9fa2db2d3c8d64b2ee98488f9f911
size 831977440

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1b1f76d8bff83cba7940ccc8c82d24e56c76333c2e15d7a64210f139c2c8bad
size 769070560

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c703538f1bb5ba1fd250eaa2d5f6d937dfdb95d756aad178404f7f3c59bcea58
size 1067604448

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7b703c1752fd81f51c0dc5f903fa53fe27c3f32d77b7d867160bd80a5fe4e28
size 1019711968

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c507255d60c6a6054985d75164765d7097709d633e46f8c49fdba4d3568ff7a
size 752881120

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ec4e14692dffaf55374eb53080a921fa67f355f5c0e346340f7f691e95daa39
size 716711392

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d6f005d8a90c8147a68250d254b8b3013c03ddf8866c4ba8f557d13abba6f1c
size 980441056

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:530f472dd001817487f21bc451b66b86cfa459c0b53abe101a3310f9126f4706
size 924456928

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7e62e655097ef4524e8e4182d19b43cccfc4caea19076cfe1d7ca7497725537
size 861222880

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aadb723f0d961c98386baa36eaa8b023c764784af3e27f6ae824b1534547c6a2
size 1068808672

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a0cfab42ac1758aeb2fcd5a54ac285967b3631b7cbba669c384a1e7119cb0fb
size 1162701280

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f6547aa9139824752b84d4fe34d57b9321e50ca35d59ba17cd015957ce0d480
size 1117321696

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03896acd2192dcb561a81d8c1119278b26bcf9428711e713e69d62e95b3daf5c
size 1071585760

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8c374180b313fcd07c07f9edcde05a54386dc5c1097e5d275befbc268366739
size 1285495264

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca68baa2a51bd80fdf202c3e89328447a358f28463fdde9ea813fc25033f1219
size 1259174368

3
DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dbbcfd0a6589cdfff15a9f4d5cc5a76711a907ddfe498e1d74c3838e5bff289e
size 1464179680

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: stepenZEN/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- Distill
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/stepenZEN/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF/resolve/main/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95c856c6d731c99c260d834447a11e931c821310ec9f80ae4675adbb0fc9ad8a
size 2042201