mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-03 22:20:25 +08:00
commit 11813cf579
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0715946b3a4103b7daaf569fbea112915d326f8a82b1111313dd23cf8baebf75
size 1124730592

3
Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52b0c26971bebaf3b0d0587f0f3a15e3b6fc17c5000b87fb4f95aa55fb65295a
size 1026684640

3
Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1399f5b9a0663e7a734bca0fbe07763090ac52b90d7761dd0d7de3aafee0676d
size 1615533792

3
Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e719eecdc8d2fef803da857a4db9580f9d169165750a10761a808f0e233f092f
size 1484805856

3
Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fee082e5c6c6b8ab7f28165358ab025eeeaafdb82086cf7e098bc8e94c89d9d9
size 1426732768

3
Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95b22a9eb9341d66804475a3dc5a7868323724bcbfdd303ef1fb0da8629c01bc
size 1288140512

3
Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fd491322bcabb264e42c9e80d6b6edbead1e5e883bea776c4ac1d2c88b5ada7
size 2136168160

3
Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ce273f4e146b56b2a7f85ef9691ed16d886f302aadbdf86824a6e65500a025f
size 2081785568

3
Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:224af9e4af547e11271ea8ee5a8cd972f8765377278301ff7e4bb6c6c82190fd
size 1973405408

3
Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43e71ec7eb82431b168a60bea7062a644512ad85bc3abcb781739cd574e10021
size 1851897568

3
Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e44a1722a99f90849d540f6065f7591af53ecdc0a78befac29237d7d3997c25d
size 2704398048

3
Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00a55ffae1721b62a84858351822928eb8f0493b1099f83ff7f02f7d8fbda851
size 2558826208

3
Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84cd0e3e733f84092051daf4fc29bbc406ca1481c860bd63e0228042a0a124ed
size 1771615968

3
Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd8aec27b4f6c1d686cdd6a20353c74844bf1d741a3c721ef4f2e57cf89f5556
size 1645663968

3
Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5951f7152e0cf46380e30f2af13244103accc2c98ecac731c56918ca63d1aa5
size 2499331808

3
Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad372c2bb060111e81fe8fd81c3ce3354c0c88a2b5a302afe17aa27edd1015f8
size 2303444704

3
Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6a51086b15d9d7c5ede695b864b1f891b73a69e9e53230f96d439a382abdadc
size 2077607648

3
Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7336a1cce6fb1a007483c87c2e9ec1dd17c1c69101fcb9f0ae9abb128fff8c30
size 2710329056

3
Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0813381f98ae36e8b5203e947f0cb62f9e1e267e7e1740a3b6a527a340265a6e
size 2993575648

3
Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dc5db5c0aad2f6432274c96bd62aeded1bebca7ac09c9220b197c43d106a191
size 2878887648

3
Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b5a5f7c49d10fa553defc4aed488a696cf14bd80f31d6416f248662ccd50f7c
size 2720454368

3
Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be577170afd92faf9e2a03c3c402b619c280739f8e8d09d795afa1429e54bc0d
size 3378599648

3
Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cee4047f9c8fb93e6c55a9b14a8ef34be9236700884104aaf1a8cdb0f1e86af3
size 3286685408

3
Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66b4f711543a853dcebe4364eba1f0d40e98764bf3f82286ff5bf9ead0ea4933
size 3909543648

3
Bielik-4.5B-v3.0-medadapt.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd18efad3946df184028ef477623046cd6a5ba81780f8116252b4c4dd8b7e734
size 5655616

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: jmajkutewicz/Bielik-4.5B-v3.0-medadapt
language:
- pl
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- polish
- medical
- domain-adaptation
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/jmajkutewicz/Bielik-4.5B-v3.0-medadapt
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Bielik-4.5B-v3.0-medadapt-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ1_S.gguf) | i1-IQ1_S | 1.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_S.gguf) | i1-IQ2_S | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ2_M.gguf) | i1-IQ2_M | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q2_K.gguf) | i1-Q2_K | 1.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_S.gguf) | i1-IQ3_S | 2.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ3_M.gguf) | i1-IQ3_M | 2.2 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_0.gguf) | i1-Q4_0 | 2.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_K_M.gguf) | i1-Q4_K_M | 3.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q4_1.gguf) | i1-Q4_1 | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_S.gguf) | i1-Q5_K_S | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/Bielik-4.5B-v3.0-medadapt-i1-GGUF/resolve/main/Bielik-4.5B-v3.0-medadapt.i1-Q6_K.gguf) | i1-Q6_K | 4.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->