mradermacher/OctoThinker-8B-Long-Base-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/OctoThinker-8B-Long-Base-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-05 12:54:17 +08:00
commit 689305dd5b
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
OctoThinker-8B-Long-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
OctoThinker-8B-Long-Base.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:114110d401c8e86afc6c8df387dad36be84eb5381fe8cda9aee9da2d0b0e2b3f
size 2161973248

3
OctoThinker-8B-Long-Base.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6edbc161849cec54431c192655328d2009c350748ae79f140c178ae38658cf53
size 2019629056

3
OctoThinker-8B-Long-Base.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04bf5beebfc83e17be925813e4e6cda154e2b1a86096199ed72d04985da53a64
size 2948282368

3
OctoThinker-8B-Long-Base.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca1f141363850ae06346e0d3575fa20524effaad9d73f75efdc27c9fcde4a1ac
size 2758490112

3
OctoThinker-8B-Long-Base.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0aee7e7d17e8bacdcc07581b2186d7d3ff275d12b298a4efbc7cb4deb4d5502
size 2605783040

3
OctoThinker-8B-Long-Base.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e684d701186ccc62cb77f51ec9cd1eb7ef3c00ff61909f4193ebb95321dcb43
size 2399213568

3
OctoThinker-8B-Long-Base.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1454cb0443b010337ab2a5ea78b9b1963fd182d6a7dd39db3f0a2a9696a9e28c
size 3784824832

3
OctoThinker-8B-Long-Base.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:506584c6cdf2afbb82667389a58f88ad615498fb9b3fcb996bf2fba66ac01d66
size 3682326528

3
OctoThinker-8B-Long-Base.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:784e4a70a7c3c838a9e5a8ce386d9473fe40f95e81b5e16b89dc314dd073ca89
size 3518748672

3
OctoThinker-8B-Long-Base.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de01cc88a26f4edfafe40beb527e80ad12afcbbf49f32ef6f4976e7acacd91a3
size 3274913792

3
OctoThinker-8B-Long-Base.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12ae55b6156d91abc612c247a1a51a941077167b2ca1933f123b9cdc32bf5ef9
size 4677990400

3
OctoThinker-8B-Long-Base.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2de2b8c450655f4511b218580ae87872377cf77a08bbaf71f3d55b295c323bb
size 4447664128

3
OctoThinker-8B-Long-Base.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19e4b7828b22ed7d267c9b2bd32981cd200e30568e8ed6c1eeef4a77548abd2f
size 3179132928

3
OctoThinker-8B-Long-Base.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf82f964f717b8c75587b3c243581180ffccaf5183ae5052e071c892d077dbd5
size 2988816384

3
OctoThinker-8B-Long-Base.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1fdb3d0f292bcd5c34745fdb03d57771995b944de712b78a5a513205b3d67f66
size 4321957888

3
OctoThinker-8B-Long-Base.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b322f5d6bb9a58ad9df19409c6b8566feb0b2ce1f670860a855eec0d22e2abc
size 4018919424

3
OctoThinker-8B-Long-Base.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8dc11f07838fe3fbb4e6162a6fcf739fe1ef907be2685de84038929653afe44c
size 3664500736

3
OctoThinker-8B-Long-Base.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d84246c006445acaa1b8a9d7255409d077a8839c8217bd73c0f6c6f118c2455
size 4675893248

3
OctoThinker-8B-Long-Base.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39cb5b0170412485b5f438e12f78782e46fe7f97cfc43fac645aacad58b50399
size 5130254336

3
OctoThinker-8B-Long-Base.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:630a817039b7719fd46af23ee2954326a4e5b3f338c41cd83c7f51740cd6b594
size 4920735744

3
OctoThinker-8B-Long-Base.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f58ec51eadd6473b875dbe616390e7f66ffbc48036c7e24c5cfd1bb0ef3b81e
size 4692670464

3
OctoThinker-8B-Long-Base.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98d8bc993995f1cab03d5f0fdb42e5ca74404331b8015b8d6a836be155f1dc8a
size 5732988928

3
OctoThinker-8B-Long-Base.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31c216678f799dc9b6da8c3945a40637fd7928f7a837179e1a144e9e093bfc6f
size 5599295488

3
OctoThinker-8B-Long-Base.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc1f21fbb3d4b8018c66525715cd454e896dfadb76e2f6ec8f87aae3eb74246a
size 6596007936

3
OctoThinker-8B-Long-Base.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a36711351908dd7036c6c622615afefa9d7b8ff8956dbcbcff7ee5e2c13891e4
size 5015200

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: OctoThinker/OctoThinker-8B-Long-Base
datasets:
- OctoThinker/MegaMath-Web-Pro-Max
- LLM360/MegaMath
language:
- en
library_name: transformers
license: llama3.2
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/OctoThinker/OctoThinker-8B-Long-Base
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#OctoThinker-8B-Long-Base-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/OctoThinker-8B-Long-Base-i1-GGUF/resolve/main/OctoThinker-8B-Long-Base.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->