mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-31 02:33:16 +08:00
commit 68c76300df
27 changed files with 228 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenThinker-Agent-v1-SFT.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

3
OpenThinker-Agent-v1-SFT.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:102a47bd34f65137e4e14b996b60d694cb817b9612330e6adb71e769e4271947
size 2256148608

3
OpenThinker-Agent-v1-SFT.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f14c02e211cf466657eca5017dca4191202dd962dd2d27cd48d036c4e04a4714
size 2115770496

3
OpenThinker-Agent-v1-SFT.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2374527e40b8e14eb8461f56625993b0bfa0d31837936126f64c1965d8149089
size 3051915392

3
OpenThinker-Agent-v1-SFT.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a57be933e6b63db5467a9aec3a816e6898b30e2325a487ad0997a03efd5e805f
size 2864744576

3
OpenThinker-Agent-v1-SFT.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a82f907f2b604c9e86d3b07477dfbacbfc03d644f29191ad40f3258d4ffed7c
size 2696157312

3
OpenThinker-Agent-v1-SFT.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8fece7f5367e430f93894e213c886b78af5ea8f239e7767f81b63b7d05e19204
size 2490112128

3
OpenThinker-Agent-v1-SFT.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6d12e88603bbae731570c72e4d4234d526844514546fb8e9ef4ad09bdd6471f
size 3896621184

3
OpenThinker-Agent-v1-SFT.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc5a6e92b79c29e9899bd9e0230bb3041b3c550ffd2fac797086a3e247fbaedf
size 3789666432

3
OpenThinker-Agent-v1-SFT.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e670173e8c748fc5150e2c37dff051c9153c0c609bac4923d1987be223deefb0
size 3626875008

3
OpenThinker-Agent-v1-SFT.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36df84c4d346bf2dbc03fa8be2e0974a05e07eeb854b046bdcecbcaa52dd4b7d
size 3369633920

3
OpenThinker-Agent-v1-SFT.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d69c9e8d14fcb237947f87a6c32178cbd6f902c245961da1ef393cfcb39d778f
size 4793624704

3
OpenThinker-Agent-v1-SFT.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bea7657d0f64d763aaa0df1e734161317e16cfe6e84e1fda4cfbeb6f7bd3337
size 4561840256

3
OpenThinker-Agent-v1-SFT.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d3c776abc40feb4ab9e12228e067ea8a4cd70c78aae0fc1802b39ed0ddb3e10
size 3281733760

3
OpenThinker-Agent-v1-SFT.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab0000ab6f8838f7f05e15a65304daa4cf69cca1e7a354f19a523b7b83996162
size 3083552896

3
OpenThinker-Agent-v1-SFT.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a8ae9d718d12760fd34870cffeb02b4547c9b4195989f0fee992dcd11239ad3
size 4431394944

3
OpenThinker-Agent-v1-SFT.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5e99cc3e51e22e678666064479aed9871c4f7a13cd6f0ed43f636ae3596b02a
size 4124162176

3
OpenThinker-Agent-v1-SFT.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b5ba16ec8da5100952ddbb120a8a5862cc0fa84893f1a7d928cecc269cac955
size 3769612416

3
OpenThinker-Agent-v1-SFT.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52dfb3cf3bc8eb0ecb57e3ce52bdfe10f69cbffd83fe4a095a871871b020e1a6
size 4787333248

3
OpenThinker-Agent-v1-SFT.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccdd004b70e1c43c394c38282082138b46b096564a9da1137d32450ef1f05c33
size 5247756416

3
OpenThinker-Agent-v1-SFT.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ea390bb2214d50ddd4ef317a871e7525195b41643afd48a457087e3f658cdc7
size 5027784832

3
OpenThinker-Agent-v1-SFT.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cbeeb7f6f7bba6a1f88f64a5dae28d83a92e84be615527e98f33c60cbc85e186
size 4802013312

3
OpenThinker-Agent-v1-SFT.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:244906c4cd168af0b94bea206fb5666a35deae32f987fd05e2cb43bf2cee254a
size 5851113600

3
OpenThinker-Agent-v1-SFT.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:906fe2e8a9d924d2451cc80c7b8aaf8aa703d7b3c88d498afa86b31d99574335
size 5720762496

3
OpenThinker-Agent-v1-SFT.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccdb463437f4f441d6587cf5333ecffd045fcd9980a5a7f8729c9b8b22cd1b7b
size 6725900416

3
OpenThinker-Agent-v1-SFT.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2a2bfe4240e4c01414a8037ffdf1339db1a1ab58519f953dd6ee43196eccb01
size 5347200

93
README.md Normal file
View File

@@ -0,0 +1,93 @@
---
base_model: open-thoughts/OpenThinker-Agent-v1-SFT
datasets:
- OpenThoughts-Agent-v1-SFT
- OpenThoughts-Agent-v1-RL
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- agents
- terminal
- code
- software-engineering
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/open-thoughts/OpenThinker-Agent-v1-SFT
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#OpenThinker-Agent-v1-SFT-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | |
| [GGUF](https://huggingface.co/mradermacher/OpenThinker-Agent-v1-SFT-i1-GGUF/resolve/main/OpenThinker-Agent-v1-SFT.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->