mradermacher/Question_Builder_Abliterated-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Question_Builder_Abliterated-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-06 03:54:16 +08:00
commit fc19fa3831
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Question_Builder_Abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Question_Builder_Abliterated.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21ddeee6c831aa66c271345e0f5a2dddc5b05b809d089590c15a7e0aa2c5a08c
size 2161972704

3
Question_Builder_Abliterated.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41acaede795ca800300fed3081f2594be061482c16f6a67506fadaa5edec6da8
size 2019628512

3
Question_Builder_Abliterated.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc5e52cee2026d20f6df09a36685264d8302d8b1d92d67eca08b718cfcaba089
size 2948281824

3
Question_Builder_Abliterated.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c135828a47758db0fbcfc6a377b2d26840e1a4e8863dc8602a9f15ac4661622a
size 2758489568

3
Question_Builder_Abliterated.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:898875691262f1234af6c4ba2edba77a7e5e93157b2419073416f4e9c7d46ee1
size 2605782496

3
Question_Builder_Abliterated.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2194178f312db632413e2d092a914dad0c2f61502c4c00aeede9ea9443ce3db
size 2399213024

3
Question_Builder_Abliterated.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:050fe30d60330e19d153575136f660a92755a751e3b8ccd1f25950dcac03b462
size 3784824288

3
Question_Builder_Abliterated.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10e9b9dfb0ebf39fe3b5646c7e6e225e1c94e2169bad5fe687b2d964974bbe7e
size 3682325984

3
Question_Builder_Abliterated.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f95e072cf00f46813905a2b74dfa36bb81f11b52c25ad9da33a76ec421c2186
size 3518748128

3
Question_Builder_Abliterated.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:870eaa908c5063a1738e10c1db41f0aaf944b77a59ac39a95e0b94aeced67c3e
size 3274913248

3
Question_Builder_Abliterated.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc16f5a05bcaebbce0cbb142c50be42cd71e42e8fb107ac288fff78e5a30b3e3
size 4677989856

3
Question_Builder_Abliterated.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48cc455c82cf01d79465df10b4f8a04333bb0fc1b67fed143497d0c99e3ebe47
size 4447663584

3
Question_Builder_Abliterated.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91113383887e0f36043798e8750d0913600b33a53b8b1176f87e9e7a9f9617b8
size 3179132384

3
Question_Builder_Abliterated.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7502dbcc2a33e9226c60f2811ec824ba2507981ae977b8292363463d794b290b
size 2988815840

3
Question_Builder_Abliterated.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d194c54f55a61a71bca0af16cc4a3b6bba898044e187b8e46e7073bf0b321585
size 4321957344

3
Question_Builder_Abliterated.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95d206290fdf4645241cb2335bd07f0899908d49be5826f3cead976d3efa88f9
size 4018918880

3
Question_Builder_Abliterated.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf3c017cc91c47c25c87492d77287e3afe6c04cd864d4133fd1c2d8dff456abd
size 3664500192

3
Question_Builder_Abliterated.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d86e44d68598fe9c1a5f56b292a39dad3f4724df1742858ffe19d4fe7a17ba6c
size 4675892704

3
Question_Builder_Abliterated.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58adf8e46301c12eef64a4e7fdf88a42949a6bbe9e69c686efb9919b8816c993
size 5130253792

3
Question_Builder_Abliterated.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6eb9d19fad433c83d416ce35f3ac81d0241dba08f6f6241a7492317f6a243f12
size 4920735200

3
Question_Builder_Abliterated.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b892ffd720c8ef230a78e989a305b6d6abfa40aa06418c214847a026efb5037
size 4692669920

3
Question_Builder_Abliterated.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc22b148cee02519fd01bd77002e6a5966a8af82c01220ecead16bc56a229b03
size 5732988384

3
Question_Builder_Abliterated.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a62287dbf745837c0685cef57eb72c96d0eaf8a47e2cedf55631413690206bf1
size 5599294944

3
Question_Builder_Abliterated.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdc3cbd2e46c8e7a4ffd85dc7420bdd0cbb3a66be7fa24ec1ea5c8ae17cda216
size 6596007392

3
Question_Builder_Abliterated.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a049b7c107b9d6ce79a6e1dc181d993adc9880d0e7290970335d85e2e1eb0c8
size 5015200

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: SicariusSicariiStuff/Question_Builder_Abliterated
language:
- en
library_name: transformers
license: llama3.1
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/SicariusSicariiStuff/Question_Builder_Abliterated
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Question_Builder_Abliterated-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Question_Builder_Abliterated-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Question_Builder_Abliterated-i1-GGUF/resolve/main/Question_Builder_Abliterated.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->