mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-20 02:47:09 +08:00
commit fe66491e51
26 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
GUI-Owl-1.5-32B-Think.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
GUI-Owl-1.5-32B-Think.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:038a0dbebc5ec06c25835602f36dcda7c42ba289b0f1a2ef06ae68f08de5dd92
size 7959870176

3
GUI-Owl-1.5-32B-Think.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76b79061e1d180d3b19543162435bb92e71cc9d42c3f8c26e837ff4b803bb74c
size 7323843296

3
GUI-Owl-1.5-32B-Think.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:113c5b23ad3a45155d70078d7cb59c4b252a10c6f8fd602a942f16ed9378758f
size 11362862816

3
GUI-Owl-1.5-32B-Think.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9842f1df1bcfba2b607eb1cf4fa1fb33e690b1cdf27553b59a62e68124b48a72
size 10514826976

3
GUI-Owl-1.5-32B-Think.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c6f4bece7d41632c09719097bf2af088ce26b3a9be87bb1cb5e48887bc9ffc9
size 9951836896

3
GUI-Owl-1.5-32B-Think.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7697c641d8ff6a8d24bd5490896ebe417b180d99c4e9a00bb1c8f6c28b49ffb3
size 9019914976

3
GUI-Owl-1.5-32B-Think.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87a97ffd4dc8456a95c6e901a3c0ed5aac2b114041ab641485618ee580c92bf0
size 14930084576

3
GUI-Owl-1.5-32B-Think.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fdb724ddf4582050eb348254019b617c107fc423ee130216913213b0449b629
size 14434304736

3
GUI-Owl-1.5-32B-Think.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d60617243f529d6feb8b0b64b097df3fb1230b677e37dcd679c7588ed0fd3c07
size 13702922976

3
GUI-Owl-1.5-32B-Think.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:896888dce9e383ddf492d3772f9b947e5ad95dabddf0e232183e81d1e88318a1
size 12821038816

3
GUI-Owl-1.5-32B-Think.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a36e39a2a23a435f8f529ad232309eebda0fbebeb3ded6d0d3d19235adac3b5
size 17690496736

3
GUI-Owl-1.5-32B-Think.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:afa39f8d6f6cd6ce900b402bbd83a9cdb40f90ee575a5736b032b088c5aa5718
size 12344653536

3
GUI-Owl-1.5-32B-Think.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53bc8a923a09d42b158a5f824265fc32776968f467c77a3edaea67c4616f0434
size 11465815776

3
GUI-Owl-1.5-32B-Think.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4396422b7018ee34ede7f57e80bf196297286602443601a99cab2c9342668562
size 17330995936

3
GUI-Owl-1.5-32B-Think.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33c906d1aaa14ce6c900c806f7e478bf2a5f298da64b99ae01351cb1ed6fb561
size 15971779296

3
GUI-Owl-1.5-32B-Think.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7ee369f0403de0d24ba7b38173263150794142d4360be74001fbd23c54b5364
size 14389740256

3
GUI-Owl-1.5-32B-Think.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ca069d026905e69dde85938c8dd0e51e182f1ba7feefda58f3db48d2d63010a
size 18703089376

3
GUI-Owl-1.5-32B-Think.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6580ad9e59bb49716e7bb3568d239d9a86e5cd5db6b9f3349cb777a0826a352e
size 20636524256

3
GUI-Owl-1.5-32B-Think.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0bf4ea1f05192b07fcfcd95116a5871bcacc26928546ac1490f58103289f8dc
size 19762151136

3
GUI-Owl-1.5-32B-Think.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8e2dc72ea5ba353b00a33d892f02e27dbc5e0db1a2f44a1f4185510b7f03055
size 18771246816

3
GUI-Owl-1.5-32B-Think.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:643b3e435978215ca452ca64f0a3e0da8dca0703d45798c222ba758fa2840050
size 23214833376

3
GUI-Owl-1.5-32B-Think.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d837c5de0ea67140fc01845f5e4195dfc7b476a2896e22cf38b89ba75832fab6
size 22635495136

3
GUI-Owl-1.5-32B-Think.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b1923a90dc27434e4534ba12b1a1be9c620599a40ef0d3cf73f03d5d427eb75
size 26883308256

3
GUI-Owl-1.5-32B-Think.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65a8209bad6296a2c922db036643a375823869481b934cbebc2d57427cdc4eee
size 15273216

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: mPLUG/GUI-Owl-1.5-32B-Think
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- arxiv:2602.16855
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/mPLUG/GUI-Owl-1.5-32B-Think
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#GUI-Owl-1.5-32B-Think-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ1_S.gguf) | i1-IQ1_S | 7.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ1_M.gguf) | i1-IQ1_M | 8.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ2_XS.gguf) | i1-IQ2_XS | 10.1 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ2_S.gguf) | i1-IQ2_S | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ2_M.gguf) | i1-IQ2_M | 11.5 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q2_K_S.gguf) | i1-Q2_K_S | 11.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q2_K.gguf) | i1-Q2_K | 12.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 12.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ3_XS.gguf) | i1-IQ3_XS | 13.8 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q3_K_S.gguf) | i1-Q3_K_S | 14.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ3_S.gguf) | i1-IQ3_S | 14.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ3_M.gguf) | i1-IQ3_M | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q3_K_M.gguf) | i1-Q3_K_M | 16.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q3_K_L.gguf) | i1-Q3_K_L | 17.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-IQ4_XS.gguf) | i1-IQ4_XS | 17.8 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q4_0.gguf) | i1-Q4_0 | 18.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q4_K_S.gguf) | i1-Q4_K_S | 18.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q4_K_M.gguf) | i1-Q4_K_M | 19.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q4_1.gguf) | i1-Q4_1 | 20.7 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q5_K_S.gguf) | i1-Q5_K_S | 22.7 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q5_K_M.gguf) | i1-Q5_K_M | 23.3 | |
| [GGUF](https://huggingface.co/mradermacher/GUI-Owl-1.5-32B-Think-i1-GGUF/resolve/main/GUI-Owl-1.5-32B-Think.i1-Q6_K.gguf) | i1-Q6_K | 27.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->