mradermacher/gemma-3-finetune-health-monitor-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-3-finetune-health-monitor-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-13 02:10:59 +08:00
commit 9b23ca075e
27 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-3-finetune-health-monitor.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: Epitech/gemma-3-finetune-health-monitor
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- gemma3_text
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Epitech/gemma-3-finetune-health-monitor
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#gemma-3-finetune-health-monitor-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-3-finetune-health-monitor-i1-GGUF/resolve/main/gemma-3-finetune-health-monitor.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-3-finetune-health-monitor.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c973ec6e95685dab0e013d557a4d0abb15a41ebe3ed8180b04f5e3273bb0b3cc
size 643486528

3
gemma-3-finetune-health-monitor.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17974db12ab130e9458ab3ddcb544b3809d9849c9f43a08612203d43f7601c76
size 639194176

3
gemma-3-finetune-health-monitor.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14cf34418d7b1af61e2dd18f0ce1e768a5722285693c668a7bb7dff34145516f
size 669784384

3
gemma-3-finetune-health-monitor.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd2ce017e4a8c26fbdaee2837e35c0ae6917f087dc8714ea2b17c669f96371bc
size 664061248

3
gemma-3-finetune-health-monitor.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24cf781c8fb73a23ec166ed46964f0d848eafb5ce4ccfe583a6c7155d7184a33
size 657322048

3
gemma-3-finetune-health-monitor.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de8c441adbd1f76a0b582532d3352708c8a797f279fb798abcb9e29f05a00ab7
size 650640448

3
gemma-3-finetune-health-monitor.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38a505e18b08b01c93c565e48e3ee284bf566061bad87e4734c1a08f74cee99c
size 697061440

3
gemma-3-finetune-health-monitor.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:583e2d38b23a755f63fcaf18ca2b6c1250bb95f8bf1b3b53ad35db8b45993ce4
size 689815360

3
gemma-3-finetune-health-monitor.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39948b8ad0be294b5f849b964ea7b68fc434b15e7f46a4a9ddefb1b2771b60c1
size 689815360

3
gemma-3-finetune-health-monitor.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:544704036195eb3564b60190fafe526112f516977acc82e6d1dc4e1be2ce54cd
size 680110912

3
gemma-3-finetune-health-monitor.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6d4ba1cb7a903b8dd7191a2023873944c13a2b591072c60862d190fc4bd23d0
size 721864000

3
gemma-3-finetune-health-monitor.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4cb42a0bfec91d8f5391f654b258e4b4ae14137111f8cef7b08bbddac0e8fc6
size 714435904

3
gemma-3-finetune-health-monitor.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4d2cad2cc9afdcf65e7e50db25947c9b5a5faeaf19c4b54db4cdab4eb1f95c9
size 689815360

3
gemma-3-finetune-health-monitor.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e81f4014aef5db9ae1c22c6a1f3f35d0ac9bb2e92503cc8fe089a5d53010c3b
size 671272768

3
gemma-3-finetune-health-monitor.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1f37cb3b967fe4f8dc09a912df5da0ae90ce3f1fb9053f7864308fdb016d00a
size 751576384

3
gemma-3-finetune-health-monitor.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c26b1e75ddb58ebcb03346058cce33a3218a85aff3ec701435827e2ff72e573
size 722416960

3
gemma-3-finetune-health-monitor.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6ce2f3fff67e3de47cd98d733731e991e4139ab8f8ce7ae52cda30cb2c7e3a5
size 688856896

3
gemma-3-finetune-health-monitor.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ecb665a4779a089ed9a672203333ecb6bbd0cfe9e9d9635532b17207e83818c
size 721919296

3
gemma-3-finetune-health-monitor.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8a777195173c30cb42dfe0bee655eb1bd844381418ebae14e655f37cd3b1b71
size 764036416

3
gemma-3-finetune-health-monitor.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be5df014b0b1cded0faeb5601cd9ec2b29349208521dd047df4e903b8126b3a9
size 806059072

3
gemma-3-finetune-health-monitor.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87ba258fa58f4cfdf7f8394b4406886b85e7eb0672a689e2b120c9e9be454331
size 780993856

3
gemma-3-finetune-health-monitor.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca06412dcd900ddd94900453add8d9910981a519921163c367487bacfb38fc6d
size 851346496

3
gemma-3-finetune-health-monitor.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8914e420e776f733eb8714c8782479a7ac52cbf338005a85365e5f2fe79cbdc1
size 836400448

3
gemma-3-finetune-health-monitor.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:758f174a82d5a8c5a523cfe0fcee4f78aceda8b5d60d47c454aa3d3fd36fb91d
size 1011739456

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:795af981974eb6e89dd50a698cf2eadb7e7e7c8ab6a8dc7b2986a7cf209e46c0
size 1430407