mradermacher/Lightning-1.7B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Lightning-1.7B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-02 10:36:17 +08:00
commit f0efc38c8a
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Lightning-1.7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Lightning-1.7B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11ed46411865b22ce2ac1ab7144e8d18050049ad0e35f679d18f3b7138e1f099
size 543793632

3
Lightning-1.7B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7c4314775e0ff7fadf4cb3ee20f286fb2302cbd2ec001ed4016c7973359bad2
size 515776992

3
Lightning-1.7B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3a64524c6b5a87bde9de10f052df3af4c7dfe67b65f54d125cbaff1064e6cb6
size 695181792

3
Lightning-1.7B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6ca0a6ce7f78a314feb55d7cc25f3932cd61e3414faea2bae2a7e0d7df14714
size 657826272

3
Lightning-1.7B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc724112024c1914279c4f845e09d6ca1024d8715ba08bef029a23cbcd602d53
size 631513568

3
Lightning-1.7B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e075780db27883654eb805e57d31c45c7f1f38cb5d730bb515c164808791c509
size 590488032

3
Lightning-1.7B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b71a89663dc24779ba860b3d20fbd1bc0fb5258077fae4f1b131782650fb61a0
size 895662560

3
Lightning-1.7B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96bb4af0edfbc57bdeb5fe2d454c2028faea02b56c2ede39ffe26e0775a07088
size 867252704

3
Lightning-1.7B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26d559e08d1bbc3cb0b090d78d240fb76f441ffc39dcce91454a672ab9bc34cd
size 834222560

3
Lightning-1.7B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7777cb2bff78f166f6e5b721456dc98a543da736e8452d17d755a584612b9d5e
size 754360800

3
Lightning-1.7B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d884a61f006eb264359175d8527eb8b6ed37cc9a39aedd6e2d150c041041adf
size 1054423520

3
Lightning-1.7B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d5caba17d3cecc23b026227ba4ba54d362bd418f29feecb2c0e5a9ca24bae66
size 1010383328

3
Lightning-1.7B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a021801ce4d7001487e5c3bcaf2cef2f1a2ca366f7f6dd466b7d6e514d97d1ed
size 777796064

3
Lightning-1.7B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aef3f5355b72e54f881e344331c7f845f1e9f2f70eec5a303da0c7ff1a5f3065
size 732969440

3
Lightning-1.7B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27716698ac654f956143827fdb5e7fe2b3e51c45fdc15f8a5ab6b7cb7cb37d77
size 1003502048

3
Lightning-1.7B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f149c028cacca8b1e07e9d9a6e8d349d9f496d630ddd36f9ce018aaed617e0b
size 939538912

3
Lightning-1.7B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4dfa380698d6dff8352b053fa5abe431827cee34285dd8d327680929c5dd814
size 867252704

3
Lightning-1.7B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2963fd2af96618bf56bcc09ffd054a4839550fc38212b3736f352eff41871438
size 1056782816

3
Lightning-1.7B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db60902918e5d2eea4e7fc52648bc0037c653739f341f6ef3b23f4123955e1b7
size 1142503904

3
Lightning-1.7B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84d84ce1a98460d7927dd88b958bcab6539d6b7982ea640bedd57eb295a2d057
size 1107409376

3
Lightning-1.7B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:601060d58c7b85b02d66eb5afae4f1910201dd60f2880a10ec6eb4d112880cea
size 1060190688

3
Lightning-1.7B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46cb557ea4c35e4b3060d55cc5b782e7e304f4f5edff31fe30106e17c2e9a83e
size 1257880032

3
Lightning-1.7B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5da18366009f9c5f1a448016afb8be6fe4583d0d7fb26e2df6a3a18f9707c8bb
size 1230584288

3
Lightning-1.7B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d78ba0c85db834610a1b619d1f1ccd06a3df842f5afed3de23ea99bc0475c1c7
size 1417755104

3
Lightning-1.7B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f616bd17b9c1b6e5b27832fcb6081e147577f0dc8441b89340c8c2e2050892d1
size 2094560

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: TitleOS/Lightning-1.7B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/TitleOS/Lightning-1.7B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Lightning-1.7B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Lightning-1.7B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Lightning-1.7B-i1-GGUF/resolve/main/Lightning-1.7B.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->