mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-28 11:14:17 +08:00
commit 2005fba6df
27 changed files with 211 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

76
README.md Normal file
View File

@@ -0,0 +1,76 @@
---
base_model: G-reen/gpt5o-reflexion-q-agi-llama-3.1-8b
language:
- en
library_name: transformers
license: mit
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/G-reen/gpt5o-reflexion-q-agi-llama-3.1-8b
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf) | i1-IQ1_S | 1.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf) | i1-IQ1_M | 1.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf) | i1-IQ2_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf) | i1-IQ2_M | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf) | i1-Q2_K | 2.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.7 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf) | i1-IQ3_S | 3.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf) | i1-IQ3_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 3.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf) | i1-Q4_0 | 3.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf) | i1-Q4_1 | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf) | i1-Q6_K | 5.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:040e67ae846acc1959ad4bdda00faf9a85bbc1f43a5709e6ac5e36f944241ee9
size 1650972128

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:965e4bccbd41f9ab9e51120cbeb2064d72eb6287b285447272f9d63a6e9e61d7
size 1528583648

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1fcfdc77ae5274cd6ff32af0251bb490d349610f645149760f8fdabb82c366ca
size 2359752160

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3bc27ce5d8ccd982a4cfe57b402a2e1188da3d8cc6fc65c4001ec369a06388f
size 2196567520

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:217ce98c371c83b06be4fcb929a0f6ec1f79cd5429bd570d90f8583754b26731
size 2034914784

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:050ec5cfb1a59c1baa72b39aacf9468cd57dc339d1c0b2aa6727e09d93dcf015
size 1854952928

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6058622dbd66433d5429587ff0264003cd5629180a0b704c024cb7d7ff6c187e
size 3114866144

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:846aa648b468fa1f15b9cb3f01efa3bb2eb2a17f969d08b4373a9c43dbaf0c27
size 2948306400

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f968290f05fc431ce72d9f242eeba7b8ba212310d37246b33174dc0c70cedf20
size 2796525024

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:076c9edcfef6195c6bacf5c80f1ab2b91ff625e903b6e668428bacb5394c58a1
size 2585392608

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7e2a12d98cb33d636d3a677ffb5217e7b93f1511522a248a1bbda378b4ee6d3
size 3825808864

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:672d69f209f5fa8574ca42d824676cedadb8c3496370efe32c54091a48a68fa9
size 3619337696

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e5843c744e91ddb81c19f49a95baa5bee96e058a3078e53d5da42c6a0d704ba
size 2532865504

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c58ba58584642b06be3070e1a6a4291de092d7053df07843b41f2ceb022a4131
size 2319545824

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:371c9d0d41f8a11616cbc1ef64d717f4b51bb84c767647e23f0a7f745b7f5e7d
size 3597112800

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9226296c97ad19e204ed1217e62aee705dd72753b95cf927c9c2026bec64b771
size 3298006496

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5408bfdfcd31b84a7568199d03886dc5fb2991e8042f3e7e2dceb4f58c961739
size 2948306400

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:787bd45e6cfaf8abe14a18c3f6361b697c4803b98ed43469685274c2d44e5bed
size 3837081056

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee586299627eea2871398d4e979eac5f98e8688b663be0d04d8fff9270d75dc4
size 4238751200

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0df28db86b86fb55da0c55f15763b1df5b6faafa974b58773a8ff4dd49dfbc5
size 4081006048

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1d01a0a6f8b06f2648d25450a1665b204eaecea306d72953c720a31e3d4dbb9
size 3856741856

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b204bd207ac2cf21af98c398ecd2a44bb4be9ccb45662bb10314dccaf2087e8
size 4783158752

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fbf8a86fe8e2cf7470d8b1fc741ec8403d6e0e80e199719ec47b79d682cb874
size 4651693536

3
gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa6b16143ffe7a4b3778b23e95a2d96f50d14e2c93c5f53db42d88b84373c9c0
size 5529196000

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f397119f3a978bb3ac0211d706a48e448e4709e5ce06564a62c046a729324ab
size 4562173