mradermacher/OLMo-1B-0724-hf-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/OLMo-1B-0724-hf-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-20 10:07:53 +08:00
commit 5931619e5c
24 changed files with 197 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

56
.gitattributes vendored Normal file
View File

@@ -0,0 +1,56 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
OLMo-1B-0724-hf.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

3
OLMo-1B-0724-hf.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61517074ec2ed86ef8866d1c18ff91c8b28740e55ee86ae421a28307b3f1758b
size 354921600

3
OLMo-1B-0724-hf.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4d5ee6065a7e6e2add52e277e1bf801773d07becb46ebbd36fa27e7dd28bcac
size 333687936

3
OLMo-1B-0724-hf.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38406c48f114ef168711fe0b18798d8f426e11aea734bf9c92c58d74b3edad44
size 479155328

3
OLMo-1B-0724-hf.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e15833aa3995a01e74a902af65ef0ce35422f7e7eb066e4e451633066c979797
size 450843776

3
OLMo-1B-0724-hf.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e1e00b5b77565d232c782cf5fb5ef693e1c1fa1aea1f6976602c16bc244c498
size 420719744

3
OLMo-1B-0724-hf.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40f619b6f0be5fe28fc0e2e352dbc10392a5ecc93d8884e6cbe5b8cbffa6a12c
size 390311040

3
OLMo-1B-0724-hf.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f70b25f49c87b692c426c9106f83a588d5a61ea67009a4547491c4a00ba35099
size 614210688

3
OLMo-1B-0724-hf.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b9a65c31a426b4d830d5abd48715e03e9caec431f786557fe42ba729a5a23f0
size 591928448

3
OLMo-1B-0724-hf.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50a0678945151736c5cf6a4b2c5d0c7a95e0b3ae60233c660758ad6a18c4a6eb
size 566762624

3
OLMo-1B-0724-hf.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f29cd3277eb78d24730a9408469511813dbf5138a53fdc73bc04e4cc50223dd
size 522671232

3
OLMo-1B-0724-hf.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5fc0caa7d13c06de061553210f50d9a3b385e05a1e7fb30ad8e3ffc7971b9e0
size 711443584

3
OLMo-1B-0724-hf.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca997630ad2c7c72fda201522cde9bc3e9c066867279cec009321cba785610ca
size 513307776

3
OLMo-1B-0724-hf.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2152b500c785ba01af58acd2ce851fb9f877823406d22b1806540dcf1c09acf8
size 695737472

3
OLMo-1B-0724-hf.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2a4c926a3d8d57733717e78b90ac0cd44a4be06049202325dcc9d3f83e7e1d0
size 648551552

3
OLMo-1B-0724-hf.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df17eeeef0c107fda86bd1622d44ae81ea04a4c35a95701e39f0fb5944927568
size 591928448

3
OLMo-1B-0724-hf.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d15f01d7749cc9c2d8a07bd1b5fd95ba435c6b01a04209d0ed856b7fa072f9a9
size 750314624

3
OLMo-1B-0724-hf.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03205a79b7bad2f839c5c8f140ea05c470c5bdafc41c064ed0d55f4c3ab921c3
size 791471232

3
OLMo-1B-0724-hf.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ada6c963f7110a9671557cbbb23997dcaa0a12eb5157b0cab7afd46e448e2a2
size 754508928

3
OLMo-1B-0724-hf.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11c3b11d445c76ed902d09222cb645d5df9ff56e933f0295bc4069f3a10710a3
size 917595264

3
OLMo-1B-0724-hf.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aae2aacfea109c59c0dedc61b9b4ffb43a8a49ec2e641f773cf6b37a09a438dd
size 895313024

3
OLMo-1B-0724-hf.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64d7904c3731bf764174b8bf56af4e4f60e9f33494ec0baa21cd4fbd248a160f
size 1051602048

75
README.md Normal file
View File

@@ -0,0 +1,75 @@
---
base_model: allenai/OLMo-1B-0724-hf
datasets:
- allenai/dolma
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/allenai/OLMo-1B-0724-hf
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/OLMo-1B-0724-hf-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ1_M.gguf) | i1-IQ1_M | 0.5 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ2_S.gguf) | i1-IQ2_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ2_M.gguf) | i1-IQ2_M | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q2_K.gguf) | i1-Q2_K | 0.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ3_M.gguf) | i1-IQ3_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q4_0.gguf) | i1-Q4_0 | 0.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/OLMo-1B-0724-hf-i1-GGUF/resolve/main/OLMo-1B-0724-hf.i1-Q6_K.gguf) | i1-Q6_K | 1.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17bb49e299f7bb0f3bba46c2205a4273c98109f574bf8ebb4d7628129c9f34f9
size 1314413