mradermacher/Meditron3-Gemma2-2B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Meditron3-Gemma2-2B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-10 13:23:09 +08:00
commit 641870c0ae
26 changed files with 214 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meditron3-Gemma2-2B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Meditron3-Gemma2-2B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b223d4074edb857fb44187b71c324b8a6bdaa86a55035604829a9f58d2401333
size 873798176

3
Meditron3-Gemma2-2B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43988ab6e74b9be75cae9fee05bc1b5befb5ece3cf2c6cafaa2b622113162e74
size 832160288

3
Meditron3-Gemma2-2B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9b656fb879e485402888a05a354e4c3e73b6752b63c338d5682f57be1c37d86
size 1088014880

3
Meditron3-Gemma2-2B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94e0f48a4144cb43c00c4eb3e2f0fec3f4b70e878bd01f9b0f9d2a94358a3b53
size 1032497696

3
Meditron3-Gemma2-2B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ea242f5fddb34a13968a0f2e5dbe1f01f0244cae234cc8093cc3215a235be01
size 1002545696

3
Meditron3-Gemma2-2B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:478bf0cc317cb3d769fe4b0ee6b96dc657b6f8b6ee08fa235b9c9e365653839b
size 943194656

3
Meditron3-Gemma2-2B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ee5d13da8c80e26758b145d34d6e0066cbaeec41e69f4c877c7bd5e2af682ef
size 1393562144

3
Meditron3-Gemma2-2B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a6a9b8e7b752b63006c2a4d56b9237366295c65f8cfc27b56fe04d5b3bd52b7
size 1360661024

3
Meditron3-Gemma2-2B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab611e6d78c4c0e176b500ab820bb55ac300ed4de674c38fc1047fdadf02c89a
size 1314212384

3
Meditron3-Gemma2-2B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1fa00395f7df1989ad86c4b4d95f14644eef0774907dc437a8fa0e4827d39a9a
size 1181686304

3
Meditron3-Gemma2-2B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b1db539bd11b3bc5a64f0562cd0afbedc48706ff2d36af2f7fd46ebac8a81fc
size 1629510176

3
Meditron3-Gemma2-2B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2f22d530a7639041006ff19bd38cad364f55ee1f4ce2cb1e64b43cb5551723b
size 1566251552

3
Meditron3-Gemma2-2B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae4416dc9ce6c92b77a884bd8e5062d1275d168b769c093600c66ed651368522
size 1229830688

3
Meditron3-Gemma2-2B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2275f9b1281043acbf7f003f7f1a99fd5b242b508e2bf3957a1093eb8936237
size 1170000416

3
Meditron3-Gemma2-2B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:999ac2f69a9ac79628ae9e18c5393d67a78f619b775ebb9aa529f700b49b04c3
size 1550436896

3
Meditron3-Gemma2-2B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd354b0631b9d74650d719fd505e4b7b20d9c6eee952e27cf3d5afe7e33dacfe
size 1461668384

3
Meditron3-Gemma2-2B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6953fa353c9c73ce40c7cdf84d32256d441c4c69caa4ce5a342cdaab2092717a
size 1360661024

3
Meditron3-Gemma2-2B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6ef7b8712e2e0fa73ecae396d71250335a89af27fae6e288222aed13c1daf25
size 1633491488

3
Meditron3-Gemma2-2B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f764e5617dd39921d1d714d1ae0e9f67143f02b760ccefdc78c81e966643bd2
size 1756027424

3
Meditron3-Gemma2-2B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:175bad6ce4f0cafc5ab194a79197776ce89d16a8f3bc43bb0effb4a4267c19b1
size 1708583456

3
Meditron3-Gemma2-2B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:190f492721e474585e7e64e7c2124778b6f7550fcf0bd351a294dcf75e2f35fc
size 1638652448

3
Meditron3-Gemma2-2B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa2762c954f16667b1b159da2a242298c4e09cfdc1792a65b429109bd4a38252
size 1923279392

3
Meditron3-Gemma2-2B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17025b653234c062363fc4ecc53ed2caf8e098a6628ad9eb0fa9643dee5630ca
size 1882544672

3
Meditron3-Gemma2-2B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6c71a0f67eb8173aedf5a98825d8f6a1cb36752e819aaffd8a16b490491cd28
size 2151393824

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: EPFLiGHT/Meditron3-Gemma2-2B
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- medical
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/EPFLiGHT/Meditron3-Gemma2-2B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Meditron3-Gemma2-2B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q4_1.gguf) | i1-Q4_1 | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Meditron3-Gemma2-2B-i1-GGUF/resolve/main/Meditron3-Gemma2-2B.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->