mradermacher/propella-1-0.6b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/propella-1-0.6b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-11 11:56:56 +08:00
commit d2ecf84810
27 changed files with 276 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
propella-1-0.6b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

141
README.md Normal file
View File

@@ -0,0 +1,141 @@
---
base_model: ellamind/propella-1-0.6b
language:
- eng
- spa
- ita
- fra
- deu
- pol
- ukr
- nld
- tha
- jpn
- heb
- ell
- kor
- isl
- dan
- cat
- slk
- rus
- kat
- por
- ben
- fas
- ekk
- fin
- tur
- swe
- ind
- ces
- lit
- slv
- vie
- eus
- bul
- mlt
- lvs
- nob
- hun
- urd
- ron
- glg
- gle
- nno
- ltg
- yue
- cmn
- hrv
- arb
- bos
- mkd
- srp
- hin
- als
- sqi
- est
- nor
- lav
- swa
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/ellamind/propella-1-0.6b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#propella-1-0.6b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/propella-1-0.6b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ3_S.gguf) | i1-IQ3_S | 0.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ3_M.gguf) | i1-IQ3_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q4_0.gguf) | i1-Q4_0 | 0.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q4_1.gguf) | i1-Q4_1 | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/propella-1-0.6b-i1-GGUF/resolve/main/propella-1-0.6b.i1-Q6_K.gguf) | i1-Q6_K | 0.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
propella-1-0.6b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dcb422557f5ebc8cadd4968e7ae0a17317f0c2fb43dbca41c5ac90f7317460b2
size 267099808

3
propella-1-0.6b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5ecce08cd1d44efa7a32f3fac28cb80618d7f03b596b5a60d1989b6b2b25fe4
size 259063456

3
propella-1-0.6b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:883b2867ca9834d3f68a2c757d8499cefc3a541704f966eadfc65b16f64b786a
size 331758240

3
propella-1-0.6b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f1119782b09b56e7186f63d2ede55b03805164f1c4dbcd4428a22ba73897b30
size 321043104

3
propella-1-0.6b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fef2c0ae157cae83f89ee382c45662d2b11d705fedee57a15110089e4452fefa
size 293043872

3
propella-1-0.6b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7341bf5c99320404db922b6902e0597a9ad464c1f395e38b32953c5015f275d
size 280493728

3
propella-1-0.6b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:375ff7696a84c82cb85fea294f4ae5585e1a4382def034c03e83424d13ad66c9
size 402876064

3
propella-1-0.6b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:137573b22897e5bea955ea03011e996794c20c003d315ecd5da8425afa77f0e5
size 389924512

3
propella-1-0.6b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72a5b608f183be2e3f4768a290903ffed26898326a75f860539995b68658193e
size 379602592

3
propella-1-0.6b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0721b2e7517d2d4c5fd5eec77959b643fa678eaf4f189faab1474625f9a3bc30
size 345864864

3
propella-1-0.6b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f33fafa632bc1eeb10d53232782d2ada7492869aa53f7fae41e0d7355725b536
size 469078688

3
propella-1-0.6b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6bf6b44eb1196ade1a035da21935e61d8229e044871d0e71636a54fd49ac32e0
size 450454176

3
propella-1-0.6b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d05eba41c296078b3ce04688fd83652169274c7d85a42252eff1135c197d57a6
size 347286176

3
propella-1-0.6b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b5d79c0909fe9504dee553c6f82979319a016d07cb3c915dc7029e3b7ae6a5c
size 331606688

3
propella-1-0.6b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c92535f3c53990e129e79d99d6bafae26a18084cf8714f408a9907f943b735da
size 435340960

3
propella-1-0.6b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05dc748ce7a4b2b742f83f4fc60767ef01d589a8ddd0dd2ed768d46cb398ab79
size 413976224

3
propella-1-0.6b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a0b7a33ccb9aa1283dca0bc5f0f132547a0933fc558abf783fda97caff6eadd
size 389924512

3
propella-1-0.6b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20afc1622f57e2e6880332327b0e1e3e51651d57b5d346da64722dec752c3424
size 469668512

3
propella-1-0.6b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe7cc94db6176d671b0f36a978ed36ff01b3d5643ab8e90fc6fef553b1e69c95
size 506327712

3
propella-1-0.6b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c2e0a26e49fe0ad500f1f7afb771b50daae8b10cf2ff6b732767fe5b36ac9aa
size 484217504

3
propella-1-0.6b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c9250983c284445ff2c3ff176537d568a247815f73a8a59ad0151f87c544d8b
size 470782624

3
propella-1-0.6b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d392655e6a62e73e81f709842e9e5a49a86d30e9ef423abaced6f2ded511005
size 551375520

3
propella-1-0.6b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a93b99a43f8614be17ded9bccead8dfba26b7da1311ca14b219f80aad4d59705
size 543576736

3
propella-1-0.6b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c31f6a977dd68fc8b52cbddf613e813a140770c7c2ab7eb1cd16719582e836b5
size 622730912

3
propella-1-0.6b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec870e0074b6a163b00c5d0ea179defad125c9c1529a7f9914816940d7c14d2d
size 1177056