mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-07 21:20:11 +08:00
commit c9a9969812
27 changed files with 231 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Suri-Qwen-3.1-4B-Uncensored.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

96
README.md Normal file
View File

@@ -0,0 +1,96 @@
---
base_model: SpaceTimee/Suri-Qwen-3.1-4B-Uncensored
datasets:
- NobodyExistsOnTheInternet/ToxicQAFinal
- Orion-zhen/dpo-toxic-zh
- unalignment/toxic-dpo-v0.2
language:
- zh
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- suri
- qwen
- 4B
- uncensored
- unaligned
- text-generation-inference
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/SpaceTimee/Suri-Qwen-3.1-4B-Uncensored
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Suri-Qwen-3.1-4B-Uncensored-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Suri-Qwen-3.1-4B-Uncensored-i1-GGUF/resolve/main/Suri-Qwen-3.1-4B-Uncensored.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1ebc02855c6a7201797558dad88836e13806cd9ee9314684e0a5885aadca37c
size 1127019424

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95b2acab3acd8159f367fd5f49f40fae174e37100f341853f67b943bcdac2df7
size 1055257504

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:061d9fd9290777ba383d373c910fa4bea6818565cc7e5f7ea071e7dbac8122cf
size 1512985504

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:afe52ed8f4fb8a23d084f3e2364086c280a37410a27018a82774b61e960c59de
size 1417302944

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5101360c064d49a67a8d2e4f36c545bbdded532f0bcc2cbefaeba1a5d2999f33
size 1354101664

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:723b510568a6bcba4faa6fc4791ae36629a24a9f5c3c5d1aac893a165e43f125
size 1246622624

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2333d093c18c76e71ca432d52f69b1ee3d08011976ba7702ebb3373a334b1878
size 1962897824

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc2f3962c8cd5b22485001538c15360f702db6f764c5173dc51239c89e2eabe5
size 1899532704

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:012853a900be14e1ad9c2617cff3cdea1f04586be0bddbc2b93998bbd76002b6
size 1814376864

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5406a7335cd4d7b062212ef3e6e7b63b925ae5d0e5818009dc3544084377231
size 1670189984

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00852ced33fc71c9ce6c9530ba591e88cf5ba9579686347aae64c5b6a1595d44
size 2381345184

3
Suri-Qwen-3.1-4B-Uncensored.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd64ec5dd45bd620466a7ec5646c1d479cf5f7b35eb460e3f16a028923d1f0d2
size 2270753184

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9215c3f70f988dc8e051611b9143145dca748c076ef2ffa542e644906190051c
size 1669501344

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba5538eb85e26338413b4f629e132e8997fc4affd3fcf725df60018d2569ebbc
size 1563455904

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0afef3eabca23ce05e490ca6d90d7afba954269ced6034c8fa2280df974c63ff
size 2239787424

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8e1202da48ee24ceb27185b6fbafcac778536d5a0f6a253a2c4bb5575bf85e7
size 2075619744

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b509b724bf1b63e74245084cb24944d37dbf68d0bca8d2f42aecd23feefea4c1
size 1886998944

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:844ddc572e17029113ccb3e02be10c3c935ba73905af148d5729460d6c0acdb6
size 2375774624

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d75a761d462ca81abe0b7df6bf4f03fd570a9d99a0871ed9b4dd86609ee9f7db
size 2596630944

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af69438f5f4c95f48de44a28c4c8d7059d9213c4a28801b759987507935674e3
size 2497282464

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1aa8f76d690845fd25f05437748afcf84f721ff12e5048fc57d2e1ee08908309
size 2383311264

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6883385252cebb5f8f5d544fc5c9e8bc72c3e867e4f4e94cfbad95e9caeaa2f2
size 2889515424

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b617ed84e3a26c64d6a7aeb0594169aa242f0bc5d17f6a1365d0a85dd637e2ec
size 2823713184

3
Suri-Qwen-3.1-4B-Uncensored.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c7f0ce3b59690e6965d74f84bba818f558e17769d6bff64d4a30ca0debb61ba
size 3306262944

3
Suri-Qwen-3.1-4B-Uncensored.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2a233032d5e066a188ad9845e3ed8970a5963b5fd4fdf6f0b63efbe838b5ef7
size 3872640