mradermacher/Lumina-Soft-1.2b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Lumina-Soft-1.2b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-09 07:53:15 +08:00
commit 9159410e3e
27 changed files with 228 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lumina-Soft-1.2b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Lumina-Soft-1.2b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:646159a805fa82ca84935565f7130239abcbacdab673859327e538258abf15e0
size 327145024

3
Lumina-Soft-1.2b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e451d5e6c4e9fe065252b5165e6a9a9a40de7e68d46ac8df78c912fbb570e20d
size 304387648

3
Lumina-Soft-1.2b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41a3d036f9048993c71694d688c11a4107a95bcf37255224c04f8880461ef8b4
size 434132544

3
Lumina-Soft-1.2b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:050d38acdcd1f63e35f0aec3e10074077d6671410b4135f0c48d7c34c6b296ac
size 403789376

3
Lumina-Soft-1.2b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d8cf877bfff16fe94c04a99e8bc1728c67412b332867647f17d26539b79a22f
size 396203584

3
Lumina-Soft-1.2b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:197b46fc1fe83f245976b5af9e43da62b4447e24421cbb18607ae218c516e6f5
size 365073984

3
Lumina-Soft-1.2b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4059361ea49a1b2f7887a55a516f47f4c081ad33e2d01712679836c51d826000
size 566793792

3
Lumina-Soft-1.2b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9e614f84a466f4067d8ebf0b4569b4a1d6d20e3d3c43faba7454cca67f18b97
size 558159424

3
Lumina-Soft-1.2b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b231f12fa0d439f5172d47a3288e0fa5d1fa1c3b938f1da8499694af9f58dc8
size 537810496

3
Lumina-Soft-1.2b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bfe6de19bf3080ca703983920aa1730d604fadcd1537f29380b9ae79be690a12
size 490985024

3
Lumina-Soft-1.2b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:946fd9d84df721cba2e2ccb48d9367a7266bbc4be7dee1ca78e9d0788ff10283
size 695752256

3
Lumina-Soft-1.2b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ac55563527974e5c4aef9e5e4c9c66b6f9ed56df6e9e788ded566a5922092ba
size 663377472

3
Lumina-Soft-1.2b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad3727313594e138517d5e3d790d901943e751e0471f34a04e0e5ed2b08cf844
size 483399232

3
Lumina-Soft-1.2b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49b2d0a7cb313c760e04d8416fbd3acef9a86aecd21c3525873e502073ba8e74
size 460805696

3
Lumina-Soft-1.2b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44530a50f755859767e2615ae71965596d89c511d453cf1f9c6d775c5cde8171
size 635475520

3
Lumina-Soft-1.2b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:341f6dbc0d33f012143db71d3222fdf3d959acc64e2c2678c0da94cac686de9f
size 600348224

3
Lumina-Soft-1.2b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c2c042a0696e5828bc360c4d7b3f2eb29cc0929313db3c8fe05b38b4aad66dc
size 558159424

3
Lumina-Soft-1.2b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c1b31a0360af5ae331f4da776223d7e8e93921b93c3966b99baa0f32ee6947a
size 697849408

3
Lumina-Soft-1.2b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:540632a1903ab4a980dd3c279a3643a6baa43711373f3b76a8d8a2597a5e1e2d
size 760501824

3
Lumina-Soft-1.2b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c00f1477c639e7a5d99387d50ff0ca53a2c60e0abbed355e227f2c52672eaf35
size 730895936

3
Lumina-Soft-1.2b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b11bd210433fbc6302b16776aa6f4755cdb6206317e88ea9cba0c51eb95ea97f
size 700470848

3
Lumina-Soft-1.2b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebf971c4103bb076b03f28bdfa6558c221227f552d4a353d7e1f80815a81f3dd
size 843355712

3
Lumina-Soft-1.2b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:231fa865c12dfaeaaecc057aee6c7d4b63b1f8bfac7c5aa51824c524b6599f4b
size 825251392

3
Lumina-Soft-1.2b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2646a53dee4a5d7c1bef2abcabef1d31fb775b90df984fc8ffe1b0dd9dd9878
size 962844224

3
Lumina-Soft-1.2b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:059e580e4c4d2a012ab31662259927d5bf460f5660179489ab43b07d4969ade0
size 1161536

93
README.md Normal file
View File

@@ -0,0 +1,93 @@
---
base_model: Umranz/Lumina-Soft-1.2b
language:
- en
library_name: transformers
license: other
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- lfm
- roleplay
- companion
- persona
- unsloth
- chatml
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Umranz/Lumina-Soft-1.2b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Lumina-Soft-1.2b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Lumina-Soft-1.2b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q2_K.gguf) | i1-Q2_K | 0.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ3_M.gguf) | i1-IQ3_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Lumina-Soft-1.2b-i1-GGUF/resolve/main/Lumina-Soft-1.2b.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->