mradermacher/XBai-o4-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/XBai-o4-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-20 05:15:10 +08:00
commit d4fada6499
26 changed files with 215 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
XBai-o4.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
XBai-o4.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: MetaStoneTec/XBai-o4
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/MetaStoneTec/XBai-o4
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#XBai-o4-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/XBai-o4-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ1_M.gguf) | i1-IQ1_M | 8.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ2_S.gguf) | i1-IQ2_S | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ2_M.gguf) | i1-IQ2_M | 11.5 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ3_M.gguf) | i1-IQ3_M | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q4_K_M.gguf) | i1-Q4_K_M | 19.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.3 | |
| [GGUF](https://huggingface.co/mradermacher/XBai-o4-i1-GGUF/resolve/main/XBai-o4.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
XBai-o4.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94d05e8d7f9389c0eca57fc85ea9ef6913617a0d2fa70b8b1895558c076dcb56
size 7959868608

3
XBai-o4.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf8113ec4c66cf5b288dc9d540eb1674268035399d5035dd3b3aef4b54ef0c57
size 7323841728

3
XBai-o4.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a6c98bc7d231f2c397d11ff12224e6289fd30f86f3bf24927191b4976d50301
size 11362861248

3
XBai-o4.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f14dafcb743cc2cd01f76ca5e8bd819898f9bbf03f818500bd0822fe95ca894f
size 10514825408

3
XBai-o4.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57a64bffe83fc6b00e2b5c233f469de549d711a82512ab98ad30ad59d860513c
size 9951835328

3
XBai-o4.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0719a7540ce23764e8bed6e644a9b5fe494fcea110c448c5f2274f08ef6adfb0
size 9019913408

3
XBai-o4.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5f91ccab11b21513e1019c55d43f98739875b47c7826b17e7e6c956a2a1f939
size 14930083008

3
XBai-o4.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09bf73caab71aacbc0696c022f4b24bbcc652341d4716cda65232d84b308c289
size 14434303168

3
XBai-o4.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a99442056a225fe9a2664ec811fdb7413c34f016b8f9a513d2fde821748a4c7
size 13702921408

3
XBai-o4.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4933b7f1c4b5cc92a577e3a2b700054dcd965de8bd5087bb43a3f6ba1224c2a4
size 12821037248

3
XBai-o4.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b9b0f37602234df246a1926d52cb287aa3009a5b712fce6e9f37b860e3103a1
size 17690495168

3
XBai-o4.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b2b8e73d8226a564654eb2df316ab85bf56713ada1396489810a973e0b743d7
size 12344651968

3
XBai-o4.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52625f847188ac180cb07ce1818786d2cba602eaa30a94ece76e12a1a3fa12d0
size 11465814208

3
XBai-o4.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e53d6119b0e3936aa24c11b519be68ea856c083dfc09d09aaec5379751b9302
size 17330994368

3
XBai-o4.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dec0b16ecb1f8e601f3e3eb9653912af29afba85df40698ae000cbaabb63b84
size 15971777728

3
XBai-o4.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b09954cb73278a232bac0fbf7e43cb8324a3a257a4224caa3764c515b603654
size 14389738688

3
XBai-o4.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7befb6ad492cc8ba1f04b60667415679d7bf69868cfe81579d04d2cbfd62e4b
size 18703087808

3
XBai-o4.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3266452f0b7d264f59370a9d328bc802a57e18c77bcf42b3de176d6c27024bc6
size 20636522688

3
XBai-o4.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a932ee7bb2ad8de2e6e15f520f7ff43b286301d2b8a87e5af2d52a2c18a19673
size 19762149568

3
XBai-o4.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd927d93fb956625ab7292794f594fccf4fba7891dabf48eae1e1423dbb11c52
size 18771245248

3
XBai-o4.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9041f4f574fc5947d357e30165d18d986ad5307c6e37dd779f5f6eac794ad40
size 23214831808

3
XBai-o4.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a7ec7e14f39963c670e7a248e1273f62b1fa14af591808f5600d674963af51e
size 22635493568

3
XBai-o4.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fec435c8aacdc85d3420e269ffa34e7cf2dace8ff4532ce5ce10f8c862dfcbb
size 26883306688

3
XBai-o4.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:168c09b1a3f8c97b698bbd928d6ead8a8e08080530393b0d7800a9655b96b48d
size 15273216