初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NSFW_PREDATOR-3.2-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ1_M.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:497a48d4767889f24545016993f9899985c84bc17a12a225c063f8e3fd643583
|
||||
size 499795424
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ1_S.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:263128ba63126833c7e14230cd7207325a04b7c06e9a3208fcd6db0aae9570bc
|
||||
size 479741408
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_M.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8dfdf2f9e1801497b1ca81343c287e0bece7f7fabb18208ffe92c1fe9f5c4c3a
|
||||
size 628315616
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_S.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:13c0ab6e867cb35896d3ed6b4c56bb3364e4a275eb549ff73684a2a45a5e2665
|
||||
size 601576928
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_XS.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f196672be03fadf0e52cbdc3aafdeb5eeeda6e013ddccf06e4785dc16ede757d
|
||||
size 562054624
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_XXS.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b1987ef60e4e3211845bd4508b33b5d25a8c822fedf3789c847923e6ee459d87
|
||||
size 533218784
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_M.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d2999332c71cb507b0e543879603e98403bc66ff0f4b0765fee39e885b18e7ac
|
||||
size 770156000
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_S.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:78d5d36c0a448e8cb59c6bafa769b502db915f95a45eb033302d12eb84db4012
|
||||
size 756786656
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_XS.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:86df409d88293ee339229d4a6de1ce31ae368563c1b79961cc49299527e2d135
|
||||
size 733980128
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_XXS.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3061910d87b453a076977e27806fe7a66b0960e003bd31b09f53df102e219c52
|
||||
size 674977248
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ4_NL.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7aedc774430375a668ade5fc285b3d4478eb57388d9fec753a0a0a71bf7b148f
|
||||
size 920778208
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-IQ4_XS.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:80235fbcaa4da51df41ee566d8701e767f6c2565fef5e525fcd48fb3c6f9aa7e
|
||||
size 882685408
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q2_K.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:250c8d9f8d3a57f8cec59882ab00b9e1bb55a19fc9448780e0f05500cbeaa626
|
||||
size 667063776
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q2_K_S.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7167766062f829693c0bc9035bdb45ffad89ad00050f0546f8abd46626864aa8
|
||||
size 640849376
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q3_K_L.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3adc5e88368224345f938b1fa093c3c2ddecbf66cb227ad60727280fddf722f1
|
||||
size 845391328
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q3_K_M.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e4b8e725c72978fdd927cfd86936beb1070fa003e012fa72bdd24b54395d89ca
|
||||
size 803710432
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q3_K_S.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e1ea61f1078b09f34d71a42f2ba5acc20a181d1485372eae6d70ab8bee2667ce
|
||||
size 754558432
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q4_0.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9ceb7639ab4b9126667237f5c7efd071f8ba09b0644fe9ae85ac22319182997a
|
||||
size 920778208
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q4_1.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2ef360fe2b6bff15cd5eb7b019c90ea8b399c09a717a7ed794b03c79e1d164db
|
||||
size 995915232
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q4_K_M.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c99473610c80698d4bd64a8d01816f2b8fafda768a8ab02974105cedf25faea8
|
||||
size 955446752
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q4_K_S.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5a873bda0aec212f05d0be33b994b27a1c7c17419940fa166746e8315f9c8b6e
|
||||
size 923399648
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q5_K_M.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:51c6fc0211197e5943db5dc885b508ad257608e2bcfc0d6be67edd1fd0e3378f
|
||||
size 1092089312
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q5_K_S.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:198f7a03a388830672000c7fa02031ae1ab7299380d19cf1914fadfeb9b6bcb2
|
||||
size 1073149408
|
||||
3
NSFW_PREDATOR-3.2-1B.i1-Q6_K.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:474fb9ae4bee6e6f643810ebdf92e33deb5e871bfa1ab9ce96f4d2433b9204f8
|
||||
size 1237272032
|
||||
3
NSFW_PREDATOR-3.2-1B.imatrix.gguf
Normal file
3
NSFW_PREDATOR-3.2-1B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dff604a4467da13284f07f7301f902cc559432c7a0ea0d526948feb6ffa20a3c
|
||||
size 1328000
|
||||
88
README.md
Normal file
88
README.md
Normal file
@@ -0,0 +1,88 @@
|
||||
---
|
||||
base_model: Novaciano/NSFW_PREDATOR-3.2-1B
|
||||
language:
|
||||
- en
|
||||
- es
|
||||
library_name: transformers
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||
<!-- ### quants_skip: -->
|
||||
<!-- ### skip_mmproj: -->
|
||||
weighted/imatrix quants of https://huggingface.co/Novaciano/NSFW_PREDATOR-3.2-1B
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#NSFW_PREDATOR-3.2-1B-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NSFW_PREDATOR-3.2-1B-i1-GGUF/resolve/main/NSFW_PREDATOR-3.2-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.3 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user