mradermacher/zuster_fietje-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/zuster_fietje-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-05 17:45:25 +08:00
commit 0e6eefd3fe
27 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
zuster_fietje.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: ekrombouts/zuster_fietje
datasets:
- ekrombouts/Gardenia_instruct_dataset
- ekrombouts/Olympia_SAMPC_dataset
language:
- nl
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- medical
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/ekrombouts/zuster_fietje
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#zuster_fietje-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/zuster_fietje-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ3_S.gguf) | i1-IQ3_S | 1.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q4_1.gguf) | i1-Q4_1 | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/zuster_fietje-i1-GGUF/resolve/main/zuster_fietje.i1-Q6_K.gguf) | i1-Q6_K | 2.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b04deef04f0a41a67fa926aee7e7beed25a9ba719f5ab70267f67759817bbdf7
size 2955463

3
zuster_fietje.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32aef901894c1ed4b72e0c0dbd95e3bca776036ed70e68fe12ea9236f2e8c461
size 729494496

3
zuster_fietje.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df3a10351b12506d25e12e9a4f048028fd71f74ea81cd431002b7150b5557cc5
size 682800096

3
zuster_fietje.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3443d1304c5f3284e2140f7c4d411624d21bd0d8917d942aab77754b017599b9
size 1012907712

3
zuster_fietje.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e02f398d7746afea05cbbeaffad9083705217fad2c3346224c8b148e098873e3
size 950648512

3
zuster_fietje.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:341a69fd67924018493fcee5b468940da15701611a4b991739d906f30e651518
size 876131296

3
zuster_fietje.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9735e60eb7146f4ce060ec630f27bb40abc200806f0d313c74506a1d09e39b4c
size 807318496

3
zuster_fietje.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ccc5e07c1f2d443a62f86f4e9bb1135df44939523d83ab7dd8282978e03e4a9
size 1317547904

3
zuster_fietje.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dceb04f5ee4fdf53dbb498cf769c1bf4e333cee63aaeb66e8f927f900b7b8e38
size 1247915904

3
zuster_fietje.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06373a6eeb0a4c230502ce69bd2601530cca4813a7e982d6e4b12821240e145c
size 1198763904

3
zuster_fietje.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6230c57b32d792caa13c6e4352135dfa6ebf7abf2bd3528fe7d4bf3655f4f19f
size 1096466112

3
zuster_fietje.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:beed500e51dbdda809fb9c9fedb904ebaba2d3ec30da18d2470996e40a53fef7
size 1599250464

3
zuster_fietje.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6120a4f890300fb7edf173e7a8331a887709e5523af8baacb35ee071c269f83
size 1516583520

3
zuster_fietje.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6bc556420ea81f300080cbd9766dfe0766341de23510dc6199e71637fac2332
size 1107043488

3
zuster_fietje.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fd65a7e2b3f42a2fc110b7f5e6c6c5a146803dd591e488355accf734f2a771d
size 1003824288

3
zuster_fietje.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6251a373bf84782f793e435687050b6e921fed269be343f9cd25aefee695e90
size 1572319104

3
zuster_fietje.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b5ee83ae471e79481a5c96071438831d8078522fe2bef208170e2da22ff7cc3
size 1423224704

3
zuster_fietje.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d49138ca834e9e4e3a590c778be925dd6fc6e555ce6ee2057433ce0bab51e7af
size 1247915904

3
zuster_fietje.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8867ace11c108f396fcf0dcced2151a7ca194ce4d4b5ff840e610d7313da39f
size 1605804064

3
zuster_fietje.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d0eed2b657511c0a5544e47c77f88ae3bfb9ef4c1670ca9ef7c4f0efbbb54c6
size 1764584384

3
zuster_fietje.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a60be0e5aff1f0381c9a8b83daa968450613c6f2e4df0e7fe70abd217a81361
size 1734418464

3
zuster_fietje.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13700b73e51408f7467b47ff0687093e90b23888bfa617ba35aba02b1560e015
size 1615634464

3
zuster_fietje.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c41f6b47ffd900fbd2574128b94188b68b4a8c9e91ed80be772347d6466231d
size 1999550304

3
zuster_fietje.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa8869cb4a3e5f6defb0908cd6bb70d6cbdd36918179a112288b84068e9e2724
size 1929918304

3
zuster_fietje.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d0f819229bccb821a8c6ee8535d2f37743b335eced50ab5cf3d963f261b4866
size 2281252896