mradermacher/medical-question-answer-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/medical-question-answer-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-13 00:35:01 +08:00
commit 66558ed5f2
27 changed files with 216 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
medical-question-answer.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

81
README.md Normal file
View File

@@ -0,0 +1,81 @@
---
base_model: Babitak18/medical-question-answer
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags: []
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Babitak18/medical-question-answer
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#medical-question-answer-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/medical-question-answer-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ1_S.gguf) | i1-IQ1_S | 0.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ2_S.gguf) | i1-IQ2_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ2_M.gguf) | i1-IQ2_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q2_K.gguf) | i1-Q2_K | 0.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ3_S.gguf) | i1-IQ3_S | 0.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ3_M.gguf) | i1-IQ3_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q4_0.gguf) | i1-Q4_0 | 0.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q4_1.gguf) | i1-Q4_1 | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/medical-question-answer-i1-GGUF/resolve/main/medical-question-answer.i1-Q6_K.gguf) | i1-Q6_K | 0.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6abcb023fb0458978a58925fa62f02aaddc95ba8cd76a561572c1ddc0689afae
size 259687

3
medical-question-answer.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5d034c318b7d027d1cee1fabf9758a552b9451693668d84f1946db2f384ddb1
size 63721504

3
medical-question-answer.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:082e44eee1f4fcc2697701058cc3e2a8d1153b3cfdecd760bf82f3b99c017657
size 61952032

3
medical-question-answer.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c2554d3485bc0a250fde8d37e9b44a705e97abe54814b914e42fe478f1caac6
size 76765408

3
medical-question-answer.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62b06a1282193596269f7333fff804ac1ec29e9680a5f01219fd72721383d372
size 74406112

3
medical-question-answer.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f22487b3811fa6bfb18b5bf6d4e1c272d9f16921f925b9a44449098353d0614f
size 69251104

3
medical-question-answer.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9272a8ad0cb8f2c2ff5775256b5547efff5be82d8ab42fe245864f0fffb1fff9
size 66670624

3
medical-question-answer.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6732aa187d0bac64f9e797013098371893689025bfab5718e78929187568adb2
size 94222624

3
medical-question-answer.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26e6254a7a8effb00b15e5be58491a9bf66b6a72c47281a0b71d406291734453
size 90149152

3
medical-question-answer.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a0c316e17670bad8bc2cec8f0e4a83c1ebe37eb6e95521c4c8e6596ea653a12
size 89153824

3
medical-question-answer.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9032b3807eaec0bec93f0b5de53c5dec4aaa88446d0ebdb81d5fdd0c3078beb
size 81373408

3
medical-question-answer.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5203a52a80e4c4181b9e7a766ca1e9e834091102e87f5f515404b130d6c4f1c7
size 106555744

3
medical-question-answer.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:912dd7678b385d0a1ff65f1cb1ec476b457bed7cf98eb90d910d9c35d3fb38fb
size 102695360

3
medical-question-answer.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a02a29c305a5b3a3675e3793bb10a12c0e63948bd3bacdd0bbdf166400d39b9
size 81197152

3
medical-question-answer.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76c3dea88069fd6901c344e55df4574c4517292a36100a74737230238405a02b
size 78155872

3
medical-question-answer.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:674d1d1c4711f34adf40e8f1c328a79d6f7dce7142a50ecdcb5fdcd8b6a90028
size 102093088

3
medical-question-answer.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ea450246e1252bfb315f73bd68679885fb1a9e5eef70fd9714f4d9270c99993
size 97669408

3
medical-question-answer.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1a5aaf30dbe287704657a8835815d240e5740cd870b2cee64fff34873a5dcb3
size 90149152

3
medical-question-answer.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fca2d1511a7e6f0c54dd625f17aa10c31c0bf4c34db9b3fa0fc6ba79d2bbb736
size 106703200

3
medical-question-answer.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50d0c4063a8c91e850adfff2589f6344d68a2fd44634731222d21c151b74fcf3
size 114276480

3
medical-question-answer.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2477faa5581cc25466488d07f2f1f7653dd51b812cef2c5d94a6844b984923d6
size 112859488

3
medical-question-answer.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e77a290766b290c676574b2d48e9dd6a8f45b3d0c578012c03033d2c2ed10fc2
size 106850656

3
medical-question-answer.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf29893a2bc8d90d12c1af0b8d50198d616688cf3cadd438f0bb93a73b8655a2
size 126697408

3
medical-question-answer.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:373c6837a51738583d1c9430073b2035388ad7dc71490e8068816eb693f3ec9d
size 121997248

3
medical-question-answer.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4a3eb50ccdfbb2ddf604651aa4131543a02bad32b70e037eb80d1b341ce89f8
size 138403840