mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-20 00:39:56 +08:00
commit 03d5cc86b8
27 changed files with 229 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
logos16v2-stablelm2-1.6b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: LumenSyntax/logos16v2-stablelm2-1.6b
datasets:
- LumenSyntax/instrument-trap-benchmark
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- epistemological-safety
- ai-safety
- truth-verification
- instrument-trap
- logos
- cross-family-replication
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/LumenSyntax/logos16v2-stablelm2-1.6b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#logos16v2-stablelm2-1.6b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q4_0.gguf) | i1-Q4_0 | 1.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.1 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/logos16v2-stablelm2-1.6b-i1-GGUF/resolve/main/logos16v2-stablelm2-1.6b.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
logos16v2-stablelm2-1.6b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b16f9ba181efc41a8f3143c5ba9acd0a1bac16c14f8ccdc3b93cc33e7722217a
size 502159168

3
logos16v2-stablelm2-1.6b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86119fd41fd28bdc823143737c1619d0b94ea63d7ca8a0b230fafd805bac5231
size 478787392

3
logos16v2-stablelm2-1.6b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da9da4fc7504f1548f6a635b1e17527d95c666f8a115bb071eb48bee47a8add6
size 655349568

3
logos16v2-stablelm2-1.6b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:085b8c46c1b064e13c57976ad9e3168fa71a5c77b21993938304fb990ad377a6
size 624187200

3
logos16v2-stablelm2-1.6b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:407305c42eee7ec3193871540b018aa163a5a354f9b8f723ead22a432602c32f
size 575420224

3
logos16v2-stablelm2-1.6b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84fa1a2af9cd092ee932d97edb49c62d29d1529ce1acab5f1a312a3f4dd3eeb4
size 541112128

3
logos16v2-stablelm2-1.6b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c798d7ca1f9d3ecd3f41bec91ef5480e2123841c81f2107352e10f4cfca7683b
size 823048000

3
logos16v2-stablelm2-1.6b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76b3c687f968f4d9ef7de9af5d1bedfa227831785fb2d156b24180b5e8234928
size 791713600

3
logos16v2-stablelm2-1.6b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53017984bb68cee52240c552f34d661262b66d4388d1d1db4285a73645a273cd
size 762812224

3
logos16v2-stablelm2-1.6b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:212be20ae5d80268a57d395d2adee33ab0a58a361882f33edc5a71f26898b10e
size 698750784

3
logos16v2-stablelm2-1.6b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f6433308845691970ceee63b01e7d9c01f4200beb11b047e1ab5bcd65bf62d0
size 982783808

3
logos16v2-stablelm2-1.6b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:381b35cbf1c256d722433903ec7b1d204a1e866fc5293a70ecf8dc3a918c4c6a
size 937826112

3
logos16v2-stablelm2-1.6b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb7a9aba4f0c213bf474967d6a0e85bfcd7d3be8979b01e3357cc098b00fc1ba
size 694163264

3
logos16v2-stablelm2-1.6b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33446da64dfda772b2f1cc89e041938f62eccd825a4d1d62eec241cf0e0588e6
size 653711168

3
logos16v2-stablelm2-1.6b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf580f55e846881052c9147849f2ff84504562d40e1ea53eaf2a698a5f742298
size 914986816

3
logos16v2-stablelm2-1.6b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58fd419733b3c689cc0b8445721508cfd15f3374eb43fd695d010e97b312e5d3
size 857708352

3
logos16v2-stablelm2-1.6b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff7c0ba4c9fa6a96b4bf0924b817fb2543ae34fe960a9fcc570bd42f3bf990b8
size 791713600

3
logos16v2-stablelm2-1.6b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c96e2d8e88795330d569c95a9397e64aaaa57b9256171fccb2a864bffcaa34fe
size 984946496

3
logos16v2-stablelm2-1.6b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21dc32a1e072156eaec9a7c7e683937657d09711762de631543fe2192289fe93
size 1072699200

3
logos16v2-stablelm2-1.6b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3f698c649ee65a4fcc8078978b3d4d549454a0dd6014f55fa16b4b4c94e5398
size 1031444288

3
logos16v2-stablelm2-1.6b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bbd6d2e1be9f7a7471bb5a896d2852d17d5600dd2118b14f4925e3fbf643d84
size 989206336

3
logos16v2-stablelm2-1.6b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ace389eaf7da1859b44d870cf165cebe3d4423347ddc0b2bedc3d347532e281
size 1187682112

3
logos16v2-stablelm2-1.6b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4b53fc14a4fcc206ce0d28db08f19704c0385ff6e0104f8d71f760a014f068b
size 1162614592

3
logos16v2-stablelm2-1.6b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2faa01578993ff11de8260f74aa6bac65e8b0a139f46786d8fabb4fc2479c93
size 1353684800

3
logos16v2-stablelm2-1.6b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed70752fa7ee24bd87ec7679982c32538824e8360a06b26294ea5f8a4afcc868
size 1746208