mradermacher/fietje-2-instruct-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/fietje-2-instruct-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-12 23:53:16 +08:00
commit 17a1002b3b
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
fietje-2-instruct.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: BramVanroy/fietje-2-instruct
datasets:
- BramVanroy/ultrachat_200k_dutch
- BramVanroy/no_robots_dutch
- BramVanroy/belebele_dutch
language:
- nl
library_name: transformers
license: mit
quantized_by: mradermacher
tags:
- trl
- fietje
- alignment-handbook
- sft
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/BramVanroy/fietje-2-instruct
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/fietje-2-instruct-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ3_S.gguf) | i1-IQ3_S | 1.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 1.7 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 1.7 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 1.7 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/fietje-2-instruct-i1-GGUF/resolve/main/fietje-2-instruct.i1-Q6_K.gguf) | i1-Q6_K | 2.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
fietje-2-instruct.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38ffd0c5d59f83c24ba7787d4b35d1c3d7d1775ce78767f17de528f8eaa66ad1
size 729494272

3
fietje-2-instruct.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75fea25e47ddd504e411175c9a54e0dbd0f6a3e1b63f5e3c5f17248f43a5ad67
size 682799872

3
fietje-2-instruct.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b53d690e516a529244609c3ac16b634a6dab8997b78f6b33a0377ef7726406f2
size 1012907488

3
fietje-2-instruct.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a724176a082a001a1c8510fcc0aabaa109224f831469af67153936c1af5fa7b
size 950648288

3
fietje-2-instruct.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54e342f776e261ecf353becd57b6917f6cdd7c9caed7ac39692c201fb773f4ff
size 876131072

3
fietje-2-instruct.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b46482df75ff75c5fbf1c5f042abb38dd3fd68cf476a20aa27daa869282e3ece
size 807318272

3
fietje-2-instruct.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:526bbf08225b08653a40a94f17c14abd40ebb91ca1bad1f023b3f4fecfc60077
size 1317547680

3
fietje-2-instruct.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc0c882e1d5936a8e98842812862e5971b440d47b82824f98582fcd0d5b43a2f
size 1247915680

3
fietje-2-instruct.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c61ca4625787e08f5beb63908eead214df43cd9d5c16b152553bdfc8702d22f
size 1198763680

3
fietje-2-instruct.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a70209ff7796a6dd0c71a907d47df8143404a8ae79ae1a191b9a241b1f209fd4
size 1096465888

3
fietje-2-instruct.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94fedb88a886278f6dd9251cbd1d109e06b37ad8ac77da1a7d97f880b8bf21f0
size 1516583296

3
fietje-2-instruct.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d6f0ef8ce121aa60f7355e9b5a4a98c7ad6fbd2918f916d0f0aaadc99d60327
size 1107043264

3
fietje-2-instruct.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aec5cd42ceff26f1a67259742232e913cf08ea15277dc9184d9b1929cff9a3ea
size 1572318880

3
fietje-2-instruct.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95091490bea50699b4cd577d3acfd1d666986271286f60cb138996357beaac9c
size 1423224480

3
fietje-2-instruct.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3aa85388a9d646755af055c0bd363faa295aa5ed856604a61b7f32131d18203a
size 1247915680

3
fietje-2-instruct.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2f815bba91c1cc72519a7726990e518b120619d1b31d446275031df57017dc8
size 1605803840

3
fietje-2-instruct.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb307c38465ecb679b8164e6693e03b09c7bcc45273b40a3b545127af32de550
size 1599250240

3
fietje-2-instruct.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49190ef08f4e847c1b21c077d3a337225244e55c90bdc57470ee99066c3af5b7
size 1599250240

3
fietje-2-instruct.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b98490876ccaeae55e85640f8d30d834dfc57d032f9de25136f3a5eac579f5da
size 1599250240

3
fietje-2-instruct.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dac93d1a291230458aaeb6c9400196a279652c594ed7ee27a071af521ae527b6
size 1734418240

3
fietje-2-instruct.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7efe16619b4541b7c9cc22b78d4f6e3adaaa146167ce2e3b82b955781018202a
size 1615634240

3
fietje-2-instruct.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21a84374ef758e92762031a2a22875efd32a0f36a55c85632ad897323e7617b6
size 1999550080

3
fietje-2-instruct.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49d12ba9c0e35406c398c83da7bc618cede82f0171a1d777306d4f072148b91a
size 1929918080

3
fietje-2-instruct.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:774f96dc16c9c1f5878d0d31ae12614326189e7590f6467acd39f71c0f2d2866
size 2281252672

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87d723e1fc459f70e47a41abe5ac1beb10f87e2c285aacc2cdc0891afafbc4f2
size 2955463