初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_M.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4d9178b30b8f5fb35c6ea44e76d0758b93dd278e69af95f42984603b149f824a
|
||||
size 3121790208
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_S.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0c957f623073a522fe329d3a5114baaf5f3d96b29ee91a19b1b8c6e4f214334a
|
||||
size 2894413056
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_M.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0accd879f63735838ba00edb0ed9c5601e114433c0772fce50a2a6064cea6ab7
|
||||
size 4343291136
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_S.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:72a7c715a4e7997dc719770e7f1e2c0a18d9c8b54932406d38ba8a1b0489e1af
|
||||
size 4040121600
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XS.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:402c855b2655ce3aa745a8967456b9f3ef81bc9341ca0ef2f2edce39a313df3d
|
||||
size 3830660352
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XXS.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:17ec3799a51c515faf513f62ad6fa62a4243fd03b8183bdb6e0e9148043a9604
|
||||
size 3500752128
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_M.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1441c495a2a2a07213fac1597577eea0fa73dbf3291bfdd63381142ba4f27b14
|
||||
size 5634587904
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_S.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:02c686b04dc8cdb08e18c02e85c26994eabb37b588872cf8d6b367980451dd47
|
||||
size 5474155776
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XS.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fc4093062bc8b6f143c825ba65ded41f17b5857eb3bb9980ab8808e46e238504
|
||||
size 5214829824
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XXS.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f4c0977b5cf9054fcb44775caefb64bcb696e7e9a2eba463383139c6324d4202
|
||||
size 4866268416
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ4_XS.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f599bbf25fdd095499b580ca01894c32a51d6cc174f6d928c18a9622e6753279
|
||||
size 6662233344
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q2_K.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1065d57b36ae6718fef2b11654f831f99c34860d868552727e423d56bd0f61f1
|
||||
size 4703870208
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_L.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a416bebae7ccb2583480ad06c259295e37ac5e251e83745a721af2a0ef2333e4
|
||||
size 6493568256
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_M.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e57662a758cf4781ce8fcf37d928c2dc7db5ccb349b2262b8b1c918453ef2342
|
||||
size 6008601856
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_S.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f5ab7fc8e6d24590f6b045713eb974211a7d1a23a0241620220ca1d298a56953
|
||||
size 5445745920
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a5248a37a21a14485237a8976816f7094a222c1004555fd72766f950dac9180f
|
||||
size 7014849792
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_4.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_4.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:04e85ab1674093b58299d2691d585052fffaa15e7368375db52f932fdac19bd0
|
||||
size 6992829696
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_8.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_8.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5b1122ba71265b2b7ba62b784e7737f50f545f6cf2b0374fe361139899751d9b
|
||||
size 6992829696
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_8_8.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_8_8.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b1fbc7fc88553268e21aa10656568b5a243850f9176c212e061f74fd972ed3cd
|
||||
size 6992829696
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_M.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2d680d74edc5961a0510dfa8383668cab2f99fe0bc5a2250870af8dd050877f5
|
||||
size 7398333696
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_S.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ebc0e6d84127721a008fb07ee40412a04da5bca2d8643c36da08ae1f4964f9a8
|
||||
size 7038967040
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_M.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bc71c5980e4485d0bc117d430959c86c26cf138279bbb80ce7ee8e68613e4805
|
||||
size 8657804544
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_S.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3273c759be7851885a73ad4259bb05025fe9ec52f80a102ffb9be8509c831407
|
||||
size 8448908544
|
||||
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q6_K.gguf
Normal file
3
L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:328f5a18db2df574eb84b88055ad11b9c98c5de4369ad5e177d38174f98d5192
|
||||
size 9995992320
|
||||
79
README.md
Normal file
79
README.md
Normal file
@@ -0,0 +1,79 @@
|
||||
---
|
||||
base_model: DavidAU/L3-DARKER-PLANET-Broken-Land-12.15B
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
- llama-3
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/DavidAU/L3-DARKER-PLANET-Broken-Land-12.15B
|
||||
|
||||
<!-- provided-files -->
|
||||
static quants are available at https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.2 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q2_K.gguf) | i1-Q2_K | 4.8 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.5 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.6 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.1 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.6 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 7.1 | fast on arm, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 7.1 | fast on arm+i8mm, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 7.1 | fast on arm+sve, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_0.gguf) | i1-Q4_0 | 7.1 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.1 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.5 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/L3-DARKER-PLANET-Broken-Land-12.15B-i1-GGUF/resolve/main/L3-DARKER-PLANET-Broken-Land-12.15B.i1-Q6_K.gguf) | i1-Q6_K | 10.1 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:70e752e18dae36be29c874daa317cede71d08646587c743c720ac46ee6501b73
|
||||
size 7949896
|
||||
Reference in New Issue
Block a user