mradermacher/BiMediX-Bi-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/BiMediX-Bi-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-26 13:42:17 +08:00
commit 2afad42006
25 changed files with 205 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
BiMediX-Bi.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
BiMediX-Bi.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4aee370fe2e3a049d964107703122b9d0077c79954f601576a8b83af0176a9d
size 10847177344

3
BiMediX-Bi.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6cb233490770bd6b2f47404aecb84dbd65735fda66e80498deeec2cc82981be8
size 9821670016

3
BiMediX-Bi.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c7c3b0d6dcb38af1baa264872f89fff87f1a98c481c0345e0025dc4bf7cde00
size 15495195264

3
BiMediX-Bi.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe37be1f85ad96ff831e529dd56e81a009b8fcaecb75d6794085e771abadcddc
size 14127852160

3
BiMediX-Bi.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cabcc7ea9aaa2050bf43b842a23d6f1868f1e880934c203d718bd466f4e75809
size 13923699328

3
BiMediX-Bi.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1370a0fdbb4016dcc95e42cf7eef971539deba01ca616a12055f824749466db0
size 12556356224

3
BiMediX-Bi.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc0f9a3283e73ecf359b940565eb007ae86b8b83f78828116390c73b788f9ec0
size 21430766208

3
BiMediX-Bi.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60f3808572f6aec0b0e99765d82592e611f88035c1e113c968f9bcee6f4e6f6d
size 20432521856

3
BiMediX-Bi.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c4996d1338c871759bc962bc53cdfd4a3fc36c56e823937b5bbd795d65dbaeb
size 19350391424

3
BiMediX-Bi.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8dec5498a89158c9558f9288c37d7319d07cc9d1437a6fefd3cf316c5f24896
size 18242464384

3
BiMediX-Bi.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29fa0e15eab717917a38dcd35040fcb26ba77dd6b5f11b4ab042d43fe8a9865e
size 25080539776

3
BiMediX-Bi.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a58c1bb4ba1c8c4f9162e78cfa75f1b90f3411217ec1cb08607c64f5e76bb1d
size 17311230592

3
BiMediX-Bi.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0107fc46bcce15d85d0d17ce1779779c4ff0f6a745bbef2f5c9ea36b156ad2d1
size 16031967872

3
BiMediX-Bi.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b01d7722243ba88fbf10e34282a9027462da93e07eede98668ead90055896029
size 24169646720

3
BiMediX-Bi.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a97bbd908ed0efe953277d182f0497b6a7e6bffeaedd56af0a5607bee39e3141
size 22546451072

3
BiMediX-Bi.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a4f6c5ebd30f31659e7601446dc752340bb695422fcc3ebbb60ed635a7c56d2
size 20432521856

3
BiMediX-Bi.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1cc4a83670403df91e61b37f6e79a4a6f9b36ac57701858733dc27606c8aed78
size 26561030784

3
BiMediX-Bi.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff520c81ed5c6eb33a5824ac26f26c043b187b152dd103e30cb0d2f991a83d78
size 29337463424

3
BiMediX-Bi.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:339f4572c052cac95c47bbdb7f392bf569c90ccbb6c714e4e0c85f833f12b7ff
size 28448467584

3
BiMediX-Bi.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dbbdf3ccb46be9905513f39ed35fdce0831e2498e4198c59ffc11157692243bf
size 26745580160

3
BiMediX-Bi.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46ec80279f7b7191ca5e3660fc19bb4932ac98fba0e7cf8e7f99ae8c3e063698
size 33229580928

3
BiMediX-Bi.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1072e497e1ab687a13d24b368cf314d6e2ffede0d29cc0e1ead0eeea6581b2c8
size 32231336576

3
BiMediX-Bi.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b46120a566027e5af502b436b637d1e9bb91a3d886b8e6141273872c09c0550
size 38380817024

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: BiMediX/BiMediX-Bi
language:
- en
- ar
library_name: transformers
license: cc-by-nc-sa-4.0
quantized_by: mradermacher
tags:
- medical
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/BiMediX/BiMediX-Bi
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/BiMediX-Bi-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ1_S.gguf) | i1-IQ1_S | 9.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ1_M.gguf) | i1-IQ1_M | 10.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 12.7 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ2_XS.gguf) | i1-IQ2_XS | 14.0 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ2_S.gguf) | i1-IQ2_S | 14.2 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ2_M.gguf) | i1-IQ2_M | 15.6 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q2_K_S.gguf) | i1-Q2_K_S | 16.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q2_K.gguf) | i1-Q2_K | 17.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 18.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ3_XS.gguf) | i1-IQ3_XS | 19.5 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ3_S.gguf) | i1-IQ3_S | 20.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q3_K_S.gguf) | i1-Q3_K_S | 20.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ3_M.gguf) | i1-IQ3_M | 21.5 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q3_K_M.gguf) | i1-Q3_K_M | 22.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q3_K_L.gguf) | i1-Q3_K_L | 24.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-IQ4_XS.gguf) | i1-IQ4_XS | 25.2 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q4_0.gguf) | i1-Q4_0 | 26.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q4_K_S.gguf) | i1-Q4_K_S | 26.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q4_K_M.gguf) | i1-Q4_K_M | 28.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q4_1.gguf) | i1-Q4_1 | 29.4 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q5_K_S.gguf) | i1-Q5_K_S | 32.3 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q5_K_M.gguf) | i1-Q5_K_M | 33.3 | |
| [GGUF](https://huggingface.co/mradermacher/BiMediX-Bi-i1-GGUF/resolve/main/BiMediX-Bi.i1-Q6_K.gguf) | i1-Q6_K | 38.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->