初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/NEXUS-Coder-Abliterated-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NEXUS-Coder-Abliterated.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ1_M.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e65422181e5a79214892de2fb14e2d24301e1f6f42c3b74ca6b076ecdfce231b
|
||||
size 464461888
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ1_S.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:53fded5b1e7a11140e9a894fe6b422059db0ae2be2bc2d83f3fc318d2e6f23fc
|
||||
size 436528192
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ2_M.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a9319b833107f1486d67ea3f8bc3db1e2c9f2c05333738a11856f59390c67f4f
|
||||
size 601055296
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ2_S.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:463342b1002e980ff85ff086c06dbc6145799ae964897e04b760b6ad8cd0b5d9
|
||||
size 563810368
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9449e3cad74c121577e47585de2767704a23127e6322726295793c5422d0d610
|
||||
size 550327360
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:99d63f7e0a9d59517fcf021c2850b91fefba6faa23addd90703954deba9bb3a7
|
||||
size 511018048
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ3_M.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8e485279aced5499c3d9e3940065405ed69778c8599e427a87e94e9e70806c33
|
||||
size 776664640
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ3_S.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e7977937a04b3abb6336cc545e8e2963988ef5048082734f58cf7f429b41e341
|
||||
size 762407488
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9e502866e5a5a3d0d4bdbc6f8a23e18d8cfbbdbb7e12f74e4d0c20de1684213d
|
||||
size 731699776
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4371f59e3375d9d59ef1c5dfd9cdc7e3790e52173503a86d3c24a6cd9cd4208b
|
||||
size 668792896
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a695bce14241515bdc20ec9cc8a1b4f2f0b1cb6813222e7db0fc56295b9efddc
|
||||
size 936331840
|
||||
3
NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4c1b643573621163267ed212246aa89008207a3c322e8ac98d86cc36e0d7b181
|
||||
size 895732288
|
||||
3
NEXUS-Coder-Abliterated.i1-Q2_K.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c8ce618709f73a7e95fa2f6823b097861e351984f78e094e07bea082da6e8f9d
|
||||
size 676305472
|
||||
3
NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6ca78fc61066eacfbb4313a597f6bc700c28dec9e5074fe4d538e04b54886213
|
||||
size 640135744
|
||||
3
NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:83076918c1673c3c8fb409e26fa03095d64a5e891fee4722e8716d3ea3741d9c
|
||||
size 880163392
|
||||
3
NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:addd4e6bb820de4d1203f9d9f37c6a6f1dbcaa2555302323569be1541730ee80
|
||||
size 824179264
|
||||
3
NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:87b429ff01459d0d98b443442a5ba2124f4612fae12d7433c135389ab50e45d9
|
||||
size 760945216
|
||||
3
NEXUS-Coder-Abliterated.i1-Q4_0.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7bb2f83c188ba7061d8cb036d2ac1b9b2a5803dbbd57a987f6174658f160f544
|
||||
size 937536064
|
||||
3
NEXUS-Coder-Abliterated.i1-Q4_1.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f1fbdfc1031a3ebfd1b6ebf9f9440f7f53a7877885c6a8382bdcf9c2f9d9ceb9
|
||||
size 1016842816
|
||||
3
NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ec15fa1748294bac0a8a6a2598d36cf86e10415625db43b4182570dd6792442f
|
||||
size 986049088
|
||||
3
NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3f6cb31f2b08e44c90beb80c60e8b9d4f503c9bf390a914671d3a34059233be8
|
||||
size 940313152
|
||||
3
NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fab4f54bb7f3f73bc8320ed57030e5af34aa76762586aba686f83277dc7d9a5a
|
||||
size 1125050944
|
||||
3
NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:45fd23d4ffeb0b2d66bfcc71f6925e999a4b0afb30b26b0cf1d25208a4d0a5bf
|
||||
size 1098730048
|
||||
3
NEXUS-Coder-Abliterated.i1-Q6_K.gguf
Normal file
3
NEXUS-Coder-Abliterated.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bec763469dabe91dacbe8faff0dadbcc2586022763b7965f59da78e7bc0fe679
|
||||
size 1272740416
|
||||
3
NEXUS-Coder-Abliterated.imatrix.gguf
Normal file
3
NEXUS-Coder-Abliterated.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:08a3cb6e6e152b0d911cc1620cb4e200296b098b3130d70c896cbb5e5521b567
|
||||
size 2065888
|
||||
88
README.md
Normal file
88
README.md
Normal file
@@ -0,0 +1,88 @@
|
||||
---
|
||||
base_model: usermma/NEXUS-Coder-Abliterated
|
||||
language: en
|
||||
library_name: transformers
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- obliteratus
|
||||
- abliteration
|
||||
- uncensored
|
||||
- obliterate
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||
<!-- ### quants_skip: -->
|
||||
<!-- ### skip_mmproj: -->
|
||||
weighted/imatrix quants of https://huggingface.co/usermma/NEXUS-Coder-Abliterated
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#NEXUS-Coder-Abliterated-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NEXUS-Coder-Abliterated-i1-GGUF/resolve/main/NEXUS-Coder-Abliterated.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user