commit 2005fba6df58d7d45405efb416b5aa708e79aac7 Author: ModelHub XC Date: Mon Sep 28 11:14:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..13cb41d --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..ef1bc0b --- /dev/null +++ b/README.md @@ -0,0 +1,76 @@ +--- +base_model: G-reen/gpt5o-reflexion-q-agi-llama-3.1-8b +language: +- en +library_name: transformers +license: mit +quantized_by: mradermacher +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/G-reen/gpt5o-reflexion-q-agi-llama-3.1-8b + + +static quants are available at https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf) | i1-IQ1_S | 1.6 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf) | i1-IQ1_M | 1.8 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf) | i1-IQ2_S | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf) | i1-IQ2_M | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf) | i1-Q2_K | 2.6 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.7 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf) | i1-IQ3_S | 3.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf) | i1-IQ3_M | 3.2 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.4 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 3.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf) | i1-Q4_0 | 3.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf) | i1-Q4_1 | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.8 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 4.9 | | +| [GGUF](https://huggingface.co/mradermacher/gpt5o-reflexion-q-agi-llama-3.1-8b-i1-GGUF/resolve/main/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf) | i1-Q6_K | 5.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf new file mode 100644 index 0000000..fdbaffe --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:040e67ae846acc1959ad4bdda00faf9a85bbc1f43a5709e6ac5e36f944241ee9 +size 1650972128 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf new file mode 100644 index 0000000..3dde977 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:965e4bccbd41f9ab9e51120cbeb2064d72eb6287b285447272f9d63a6e9e61d7 +size 1528583648 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf new file mode 100644 index 0000000..2863bf7 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1fcfdc77ae5274cd6ff32af0251bb490d349610f645149760f8fdabb82c366ca +size 2359752160 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf new file mode 100644 index 0000000..caea692 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f3bc27ce5d8ccd982a4cfe57b402a2e1188da3d8cc6fc65c4001ec369a06388f +size 2196567520 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf new file mode 100644 index 0000000..bd398e5 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:217ce98c371c83b06be4fcb929a0f6ec1f79cd5429bd570d90f8583754b26731 +size 2034914784 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..8f6a891 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:050ec5cfb1a59c1baa72b39aacf9468cd57dc339d1c0b2aa6727e09d93dcf015 +size 1854952928 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf new file mode 100644 index 0000000..d311446 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6058622dbd66433d5429587ff0264003cd5629180a0b704c024cb7d7ff6c187e +size 3114866144 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf new file mode 100644 index 0000000..5d9c4bd --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:846aa648b468fa1f15b9cb3f01efa3bb2eb2a17f969d08b4373a9c43dbaf0c27 +size 2948306400 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf new file mode 100644 index 0000000..884e182 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f968290f05fc431ce72d9f242eeba7b8ba212310d37246b33174dc0c70cedf20 +size 2796525024 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..e0bb487 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:076c9edcfef6195c6bacf5c80f1ab2b91ff625e903b6e668428bacb5394c58a1 +size 2585392608 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf new file mode 100644 index 0000000..97779a1 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c7e2a12d98cb33d636d3a677ffb5217e7b93f1511522a248a1bbda378b4ee6d3 +size 3825808864 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf new file mode 100644 index 0000000..6d772a8 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:672d69f209f5fa8574ca42d824676cedadb8c3496370efe32c54091a48a68fa9 +size 3619337696 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf new file mode 100644 index 0000000..c1c55a8 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9e5843c744e91ddb81c19f49a95baa5bee96e058a3078e53d5da42c6a0d704ba +size 2532865504 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf new file mode 100644 index 0000000..462a0fa --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c58ba58584642b06be3070e1a6a4291de092d7053df07843b41f2ceb022a4131 +size 2319545824 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf new file mode 100644 index 0000000..815ded5 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:371c9d0d41f8a11616cbc1ef64d717f4b51bb84c767647e23f0a7f745b7f5e7d +size 3597112800 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf new file mode 100644 index 0000000..e7db1e1 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9226296c97ad19e204ed1217e62aee705dd72753b95cf927c9c2026bec64b771 +size 3298006496 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf new file mode 100644 index 0000000..39136de --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5408bfdfcd31b84a7568199d03886dc5fb2991e8042f3e7e2dceb4f58c961739 +size 2948306400 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf new file mode 100644 index 0000000..ebb9e2e --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:787bd45e6cfaf8abe14a18c3f6361b697c4803b98ed43469685274c2d44e5bed +size 3837081056 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf new file mode 100644 index 0000000..0f2a25c --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee586299627eea2871398d4e979eac5f98e8688b663be0d04d8fff9270d75dc4 +size 4238751200 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf new file mode 100644 index 0000000..8d54b54 --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c0df28db86b86fb55da0c55f15763b1df5b6faafa974b58773a8ff4dd49dfbc5 +size 4081006048 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf new file mode 100644 index 0000000..47e983b --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f1d01a0a6f8b06f2648d25450a1665b204eaecea306d72953c720a31e3d4dbb9 +size 3856741856 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf new file mode 100644 index 0000000..96f39bb --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b204bd207ac2cf21af98c398ecd2a44bb4be9ccb45662bb10314dccaf2087e8 +size 4783158752 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf new file mode 100644 index 0000000..22c92ab --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2fbf8a86fe8e2cf7470d8b1fc741ec8403d6e0e80e199719ec47b79d682cb874 +size 4651693536 diff --git a/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf new file mode 100644 index 0000000..67f3f2a --- /dev/null +++ b/gpt5o-reflexion-q-agi-llama-3.1-8b.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa6b16143ffe7a4b3778b23e95a2d96f50d14e2c93c5f53db42d88b84373c9c0 +size 5529196000 diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..3ac9ff3 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0f397119f3a978bb3ac0211d706a48e448e4709e5ce06564a62c046a729324ab +size 4562173