mradermacher/bruphin-alpha-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/bruphin-alpha-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-13 01:28:16 +08:00
commit 0944c79a42
27 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
bruphin-alpha.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: nbeerbower/bruphin-alpha
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/nbeerbower/bruphin-alpha
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#bruphin-alpha-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/bruphin-alpha-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ2_S.gguf) | i1-IQ2_S | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ3_S.gguf) | i1-IQ3_S | 3.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ3_M.gguf) | i1-IQ3_M | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q4_0.gguf) | i1-Q4_0 | 4.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q4_1.gguf) | i1-Q4_1 | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/bruphin-alpha-i1-GGUF/resolve/main/bruphin-alpha.i1-Q6_K.gguf) | i1-Q6_K | 6.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
bruphin-alpha.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f73b023542a8560307894637cd47aebccd97da0a60d48d81755b41047dc4477
size 1754447264

3
bruphin-alpha.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58e08b0c2eafa48019beeb183511f1b7066bcf640d5e8f83a97cba5cf4781a51
size 1612103072

3
bruphin-alpha.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f77c6fb1e32484f2cd2303290f18a15eb688f9e450cc39aa7e79a89c6047c16d
size 2500713888

3
bruphin-alpha.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a7c9e76682bd69a4a7b1b695184bd9a5305a3557de4f2cc2723c0b347fdeb5d
size 2310921632

3
bruphin-alpha.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7d7eb8361cf4bb16a632f6dfef205535dea1f7efaf24dc8cfd3a6464141f994
size 2198257056

3
bruphin-alpha.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eabfe84ba039c3178766de75f26b7c15d713222d3a6cdd9fc49bdae06954b85d
size 1991687584

3
bruphin-alpha.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee0932b47839bbd3c0c91a8453f70b0419e0e06f83ea7f54e4f586c0707fe898
size 3284893088

3
bruphin-alpha.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2524118dbaac43292087bde8e506361eaeeda5c739a493b46115aaef2d5106e0
size 3182394784

3
bruphin-alpha.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04139bd2e8ac785b01eb0babb8902c8018aaff63cb53e1c4139436620d38ffed
size 3018816928

3
bruphin-alpha.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69ba4abbed914fd862406e32b4424a52cd65d1fa54d17596d77fe07711dc6fdf
size 2827345312

3
bruphin-alpha.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df83f41b51872b0f730cd0aacc34edf9b8420cdd15bdff7778b913291395ef35
size 4125695392

3
bruphin-alpha.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96f37bef008c688da4c05082a87638efca0847c52f16fb2ba2d4f9352ff3385f
size 3907689888

3
bruphin-alpha.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e4ee47cabee631e9ae9b31ea85a7744eeda5ced3d3e0e740c68f1785bf8b8eb
size 2719243680

3
bruphin-alpha.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36e2fa3c093420f6e3fdfb94cf9c24a582604a6f5fd5cb4e18a60d4be0978282
size 2528927136

3
bruphin-alpha.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0cc4d7fad643da2e2be2667d1a50bac97e8a4735623a307cda69192f396cc1d8
size 3822026144

3
bruphin-alpha.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24bd201ffd35ceffe36ad850e22ce35d3b236c1ac17f1abad466288e12ba9861
size 3518987680

3
bruphin-alpha.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5609551e68b17c3ac1045360e7bd9884176c69dd2ad953b4358e4dd71c1b9c3
size 3164568992

3
bruphin-alpha.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e795975d6cdf46951faaffca77f618717ac4404f7aec63515de47775296a710
size 4123598240

3
bruphin-alpha.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f47ba600e108b49071dcef9ce08c9d33bb3ec78c376cad6a65582d0178058a90
size 4553317792

3
bruphin-alpha.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:431b0da9696407c17f33a99288ea41aab98dc0e3ace80f2d1dbf7b1faa71c88f
size 4368440736

3
bruphin-alpha.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99cd013dee55dcbe9e51b63a9cc0092ad0101d3dd611e3f63ab31ce561e8a432
size 4140375456

3
bruphin-alpha.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e51f1a88adad3cf52e7b248c57aa437a134b4df4b40d9201b31c521a1dd40cf3
size 5131410848

3
bruphin-alpha.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1ad172a24607fbdff08f99d82cafdba2cac75fba53a199004ac1bdf4094ab63
size 4997717408

3
bruphin-alpha.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4dd1d99400a4dc9db6265a91d66eef81d751b86cf4da5fbcf584cce0fbd874b
size 5942066592

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f3322de6218f95d1095b11e60d6f1cc63dba3c6715c3800914c1314767313a1
size 4988157