mradermacher/MediPhi-PubMed-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/MediPhi-PubMed-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-26 23:15:18 +08:00
commit 5e941349fd
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MediPhi-PubMed.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
MediPhi-PubMed.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ecb1082333a3216feee76bc96caf3392c23b4f6f8e8f62d910115df5b307aaaa
size 917108160

3
MediPhi-PubMed.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6411a7294a906aee766633096a0203ccfa4488066a041a5e9e1c683547cc1ea8
size 841610688

3
MediPhi-PubMed.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a17c755096983285054783f3054aa2ea435f81300b654c9c414909524ee950d
size 1316395968

3
MediPhi-PubMed.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e67bfde5db4b96ab1e3e2cde1e37ba0886fe6f44d99e6eaaee8a621610daf3a
size 1215732672

3
MediPhi-PubMed.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1028ef8caa8d11001addb2fab99491b890bcd81762970f0dd873092d2cbe5da3
size 1153037760

3
MediPhi-PubMed.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b81c58c743d5464d45f1a2ac90e4b540c3d33f27ea53e71e57ddc8db29e578dc
size 1042937280

3
MediPhi-PubMed.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e44df58b1ff7dfa31d4c370cef293cb6fc7a90e19de0e2ebc054dfbd46f974f6
size 1855601088

3
MediPhi-PubMed.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e94a9ff2c8551e28fef8351957ae16d1d58df5efa66d6385ab27acec02e5e87
size 1681799616

3
MediPhi-PubMed.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67413a055f15f02bc8c8f44bbe6064356b37218765aa0066b139e38a71782cfa
size 1625176512

3
MediPhi-PubMed.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40d4df3a1879ad05cac88bd8b9ecd76e8384a6fa4c7a7cd065673862cf0d5bef
size 1513003968

3
MediPhi-PubMed.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47afb83f5f1ee45332060cb5e4bf67926cfbe606e9640a07e97335371d7056bf
size 2176178112

3
MediPhi-PubMed.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cdfc70d71ad2f2a66c4ea5659fee3a4994f0a42da988295ded3ffcf0d26d55d0
size 2059853760

3
MediPhi-PubMed.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e58792d685c5c671aafe739b8557b0036b8d438c9f9d4e144e37896e7335948
size 1416205248

3
MediPhi-PubMed.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84fe6f1cd05cde415cd0065d7988ee0fea63f875ff1979e32f7813e5bf314388
size 1327338432

3
MediPhi-PubMed.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d32a7b0ab6a83bc6c82ffbd5f47fb3fab0dcda084f6e446c5a139631ad5c6d76
size 2087598528

3
MediPhi-PubMed.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:189bf440ded95b086197f2672b869ed326dd10bc9c8d5eac6b2320ad5578a841
size 1955477952

3
MediPhi-PubMed.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d0dbbe91e844cf44d5fbaf37b20dea21d924bf74a790378d6da4dd2ae306cdf
size 1681799616

3
MediPhi-PubMed.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f90c52f62bc7a4ce156548a1ac98cad4edd1ba56c7dea582665a274d3c8b6e1
size 2182469568

3
MediPhi-PubMed.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf7abe08685ea0c53b783642829e0743caa149850213332f225974f8ee756d84
size 2408826816

3
MediPhi-PubMed.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65798d9657bd86e20f02cc4f7b88b86f0cde7fb1d4a325653ff4b5d5eefeb08c
size 2393233344

3
MediPhi-PubMed.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:491daebc4825cc28cc09c901abbffb4f813f77d8db77ecd74396fed1130c8d77
size 2188761024

3
MediPhi-PubMed.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f5264cccbe81d358f8142382f7d9d4444f157760650d7d9aebd8d32378c99eb
size 2815276992

3
MediPhi-PubMed.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c08bdf39441b6c80bfe7c3d1eee65f6c80697386f45d09c7809dae358fd4f899
size 2641475520

3
MediPhi-PubMed.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f6db322bf6f242edc4b15ff395479ed1acbadcb64f01164eb8da24bb89e5a5f
size 3135854016

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: microsoft/MediPhi-PubMed
datasets:
- ncbi/pubmed
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- merge
- mergekit
- medical
- clinical
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/microsoft/MediPhi-PubMed
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#MediPhi-PubMed-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/MediPhi-PubMed-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ2_S.gguf) | i1-IQ2_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ2_M.gguf) | i1-IQ2_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q2_K.gguf) | i1-Q2_K | 1.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ3_S.gguf) | i1-IQ3_S | 1.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ3_M.gguf) | i1-IQ3_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.2 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.3 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q4_0.gguf) | i1-Q4_0 | 2.3 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.3 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q4_1.gguf) | i1-Q4_1 | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/MediPhi-PubMed-i1-GGUF/resolve/main/MediPhi-PubMed.i1-Q6_K.gguf) | i1-Q6_K | 3.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b734a529c5221d17d856728206bdb8fc9550fc0570af2a19ad773615ca52944
size 2232603