mradermacher/bitnet_b1_58-large-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/bitnet_b1_58-large-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-20 00:59:13 +08:00
commit 6f0fed0945
27 changed files with 211 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
bitnet_b1_58-large.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

76
README.md Normal file
View File

@@ -0,0 +1,76 @@
---
base_model: 1bitLLM/bitnet_b1_58-large
language:
- en
library_name: transformers
license: mit
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/1bitLLM/bitnet_b1_58-large
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/bitnet_b1_58-large-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ3_M.gguf) | i1-IQ3_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q4_1.gguf) | i1-Q4_1 | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/bitnet_b1_58-large-i1-GGUF/resolve/main/bitnet_b1_58-large.i1-Q6_K.gguf) | i1-Q6_K | 0.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
bitnet_b1_58-large.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a8e92afb8a94499693ba37322fa60bef9934074700e56bc2a8936b413949439
size 194481568

3
bitnet_b1_58-large.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4eff859a66ebf59fda6cb54d0f982ddbc72c19d68b380bb5c58aa50e562a7e8
size 181652896

3
bitnet_b1_58-large.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1694e9d760cd09b8751134fdf1335ebbc2e90df21b98cbad7eb8716cc12649a9
size 267472288

3
bitnet_b1_58-large.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca730df23d645e3ca9339c644ded06d47664080591cc6f7b1afb3782967f6ad4
size 250367392

3
bitnet_b1_58-large.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c640c936319738b0d06583a101e2022f558e0f8dee9c9385f4bfd4ea3410df4c
size 234737056

3
bitnet_b1_58-large.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a6d9a6dc2088367ad2ccafdc539167f8a2a5ae55bcdc2f997da2cbde70f62b9
size 215862688

3
bitnet_b1_58-large.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b59b986285379c601db8db72237345c52cdf8d3c1c0fc02343c5006d9109f405
size 351415104

3
bitnet_b1_58-large.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e391b0ebd1c432759791cc4349f7a20fe410886b893f07bb0b3e4e16fae79723
size 333867840

3
bitnet_b1_58-large.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84b825d09d63d7fde0f7d168fae19efac606cc192c176d04b71753ac37af4706
size 317942592

3
bitnet_b1_58-large.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1992295559f0c7e35058c08c193a3645b5de656348e6721b7aa52c19966850c8
size 291065248

3
bitnet_b1_58-large.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2695a55a6ff754ffd16f0b3ab076e730548560cc2966bdc145433fd45e6128c
size 424110912

3
bitnet_b1_58-large.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d84623487ab30353a655be9dedb3c9deb319ef769bd36ac5deeae4332dc5771e
size 402877248

3
bitnet_b1_58-large.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f422cdc0bd9a491d883b6b16ed5f7839f95f2911bd5d9b5ea305ba3069831b6e
size 291695424

3
bitnet_b1_58-large.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa925b2081eafbcceded26387f8435c8e0b9de00641a5cc1b233d80a6313fc63
size 269282112

3
bitnet_b1_58-large.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee84b1f155a4780ec43dd02c343a667337b5b717b8dd408c3d20ef1c151b628e
size 401992512

3
bitnet_b1_58-large.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e2b63db7d4f11acb158d3aa8bf69fa0370d21a79dff0c201d6904b25ffcf94b
size 370338624

3
bitnet_b1_58-large.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00ad223cdeb71baaceee87b0e2d31036f4633dd4004c77a38d3c7a476912ea89
size 333867840

3
bitnet_b1_58-large.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ce1bb8da531a2dc43cfd4e5fe74ca07d608f89ef34aeee179e4a36b25e0d5b2
size 425290560

3
bitnet_b1_58-large.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7333b18ea88eaab94f0693aab5f4033d0cf214c6b5520d1bf43e7925e685002b
size 466578240

3
bitnet_b1_58-large.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc3d653a5d1d71b2edacb323892da04e0c78bd368d6bf26c7fd264d6e04394da
size 450874176

3
bitnet_b1_58-large.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41285f73e9f10ab0b91e8e1d9833331337140ffb452b4c9d361edcd7ed602872
size 427649856

3
bitnet_b1_58-large.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5649a2b630049606afcba2c186014e9dbd9d15fa181d7786ae5737cc9f422844
size 522832704

3
bitnet_b1_58-large.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d9a42440074a8dbe9f4a5e6b57da219e1d61713f0aff6984493bc14e50b609f
size 509045568

3
bitnet_b1_58-large.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f2d1da7465537d3c616101d35e50a10fc65306c0b07f6254777da5b517bdc83
size 599288640

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70898fe6a0b43f4e3ee91cb554634af0c126cfdf3afc24911a1765d68060760f
size 1283509