初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Omega-Darker-v1-R1-4B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ1_M.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3e27c81445de78161e83f4c0efe1e54836577efdbb90bc621db95cf2ea22e708
|
||||||
|
size 1199571360
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ1_S.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d82dc2f9fccebf5f2ba1b2fbe91c6eb9899c178d5175457994434c9af827935a
|
||||||
|
size 1133093280
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ2_M.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:eea17df957fc9160e09fb2ee5ef9be1dcb9f70c0383672ae0d64ba849afde756
|
||||||
|
size 1537982880
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ2_S.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8ce350b04829a422fde5765d425267a05896269a73a970707edcd4287c17a481
|
||||||
|
size 1449345440
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ2_XS.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dec53622df3930f8561fc94520eb5e95b0095a1dc107f5221cc5edda2c56809c
|
||||||
|
size 1404576160
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ2_XXS.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8b33c3e5fb1b6ab7cb7de7d4dfcc04c51e9e7d98f66a69b46b697a9c2129a04c
|
||||||
|
size 1310368160
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ3_M.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bee700854d6029aa9e6677cd0745afe7d08f3838d92a812539f63a12c4faf717
|
||||||
|
size 1986803360
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ3_S.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:22d06b8cb6273ce8a09f362dfc05211a849c46b544523fb0b88ce569bf25995a
|
||||||
|
size 1937364640
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ3_XS.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d9139204ae400299fd8be741386df687d947685e70251c9d4f81f3e69743282a
|
||||||
|
size 1863390880
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ3_XXS.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:efb475a97ba79221a749c50b6eead76f2a8736e893824eefb092bfc9dd835328
|
||||||
|
size 1689452960
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ4_NL.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1f7c16b94e71e0fd412f3f86e34ac5e7ad91b9d1c5ac8b69d45d627cf5492b8c
|
||||||
|
size 2363512480
|
||||||
3
Omega-Darker-v1-R1-4B.i1-IQ4_XS.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:313a730a129c6e77184f1abd8db18381aa8e26a1108060ca5ed277d9b1182b6f
|
||||||
|
size 2263242400
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q2_K.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c79d1a2f2199fe56850da128679a3231d5b0fea5db9868991cbf5762db68cbd3
|
||||||
|
size 1729164960
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q2_K_S.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e32c5af051fc3065cfd51fd761d3b3bc22529b59e7f068ec805ee9656cb6ae46
|
||||||
|
size 1636062880
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q3_K_L.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:db97de02094b80cc84a5085a53a69913deca5a33299ad2114a3b494aad534160
|
||||||
|
size 2236085920
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q3_K_M.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3888e7d471ff582b57a83cdb9be64f1bf5c4c49bdd029edc105ff64e56e61119
|
||||||
|
size 2098460320
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q3_K_S.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5d35bd13e8b421b2f272ab19c35f5d97d1f7915f7b99f8d2339b6ac64dbc1ef3
|
||||||
|
size 1937364640
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q4_0.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4110a85534cd52b01f8a3ef33dbf7da832400a1bfe35b3688c8e4416ee9e7ee6
|
||||||
|
size 2370066080
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q4_1.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:be98beec3830e58c4886fa636068bde31f46dcaa7f97808929d3d32c912c757f
|
||||||
|
size 2564052640
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q4_K_M.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4011956153a544f17c44966c45a935033e179f9073149ac6aa70e359e683668c
|
||||||
|
size 2489894560
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q4_K_S.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b7ccc34371d0eb6c30b6bc1ce2459563d21e9044ce99cec54bdef915d463424c
|
||||||
|
size 2377930400
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q5_K_M.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:51cfa4e57708ff2e2317ff7dac5c0daf1e4ee84cddcc0ad347aff461a6b8960d
|
||||||
|
size 2829698720
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q5_K_S.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ed46ea80be5516020550f5c545997dcb04091a7f7594a542afcccff84ae5a667
|
||||||
|
size 2764592800
|
||||||
3
Omega-Darker-v1-R1-4B.i1-Q6_K.gguf
Normal file
3
Omega-Darker-v1-R1-4B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:92861f19042bc645fe6e1f07484ce4f1000b8d0b8a3ab932de5b2336204e1ae9
|
||||||
|
size 3190740640
|
||||||
3
Omega-Darker-v1-R1-4B.imatrix.gguf
Normal file
3
Omega-Darker-v1-R1-4B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fc70eaf6d403cb4140397cf1f92b91bcce0405be8a9ef0003833a06b5e83106d
|
||||||
|
size 3448608
|
||||||
96
README.md
Normal file
96
README.md
Normal file
@@ -0,0 +1,96 @@
|
|||||||
|
---
|
||||||
|
base_model: ReadyArt/Omega-Darker-v1-R1-4B
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
license: gemma
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- nsfw
|
||||||
|
- explicit
|
||||||
|
- roleplay
|
||||||
|
- unaligned
|
||||||
|
- ERP
|
||||||
|
- Erotic
|
||||||
|
- Horror
|
||||||
|
- Violence
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||||
|
<!-- ### quants_skip: -->
|
||||||
|
<!-- ### skip_mmproj: -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/ReadyArt/Omega-Darker-v1-R1-4B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Omega-Darker-v1-R1-4B-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-GGUF
|
||||||
|
|
||||||
|
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-GGUF).**
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Omega-Darker-v1-R1-4B-i1-GGUF/resolve/main/Omega-Darker-v1-R1-4B.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user