commit 026796adbe29584b6684f945b493bf894cb40775 Author: ModelHub XC Date: Tue May 19 02:53:58 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..5647a12 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Graph-Preflexor-8b_12292025.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Graph-Preflexor-8b_12292025.i1-IQ1_M.gguf b/Graph-Preflexor-8b_12292025.i1-IQ1_M.gguf new file mode 100644 index 0000000..32c717d --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c6422ab0ac43d99a9a759f95aefdff531b3adf25d59abff53353430fb6c5006a +size 2256148192 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ1_S.gguf b/Graph-Preflexor-8b_12292025.i1-IQ1_S.gguf new file mode 100644 index 0000000..16290b8 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1c055424432abdb1d72c86b58f338325509a348430f1d9aefcf17b14d0ed783c +size 2115770080 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ2_M.gguf b/Graph-Preflexor-8b_12292025.i1-IQ2_M.gguf new file mode 100644 index 0000000..b61783a --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2e4eef3e310d15de34fff38c3bbaaff7ff977673feae0076b639ae7e329fa08a +size 3051914976 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ2_S.gguf b/Graph-Preflexor-8b_12292025.i1-IQ2_S.gguf new file mode 100644 index 0000000..2ce5baf --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc36a1a55e8cd5e0f127d093f31bca07f3262db37684c68a86e718af74bb8efc +size 2864744160 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ2_XS.gguf b/Graph-Preflexor-8b_12292025.i1-IQ2_XS.gguf new file mode 100644 index 0000000..73ac396 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bf5ba9ca3347bef560d3240308f0881d0d5d72e30c456d2c066fe20a99dce5c3 +size 2696156896 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ2_XXS.gguf b/Graph-Preflexor-8b_12292025.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..10ec1c9 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7942fc8051ad4576f98109359f5e06a89d2796c3e7b04b17754598541a1a781 +size 2490111712 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ3_M.gguf b/Graph-Preflexor-8b_12292025.i1-IQ3_M.gguf new file mode 100644 index 0000000..bd0a95e --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:57742e091b21b088b400cfd1acd647de32f0e19680ef1838a11461ceac493b23 +size 3896620768 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ3_S.gguf b/Graph-Preflexor-8b_12292025.i1-IQ3_S.gguf new file mode 100644 index 0000000..49e1d7c --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93a745e18f7ea004686627614bfc797a8f4c40983d26635f840ac56d4c95a41d +size 3789666016 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ3_XS.gguf b/Graph-Preflexor-8b_12292025.i1-IQ3_XS.gguf new file mode 100644 index 0000000..7f3e1d4 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:60029932c22b45ca04e0dd3eb1b1c803f2904b0915809fbfb73ec052ee0154d7 +size 3626874592 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ3_XXS.gguf b/Graph-Preflexor-8b_12292025.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..55b5a29 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb66a2d79bbdabc6acb15ed1e7be6f2cad1450cdcfeb03a6354fb225259a9819 +size 3369633504 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ4_NL.gguf b/Graph-Preflexor-8b_12292025.i1-IQ4_NL.gguf new file mode 100644 index 0000000..608a4a4 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d1c7fe271e2db9ddd5a1d4de5a4e627c16d5c20bc338c04aae3abd7979953c26 +size 4793624288 diff --git a/Graph-Preflexor-8b_12292025.i1-IQ4_XS.gguf b/Graph-Preflexor-8b_12292025.i1-IQ4_XS.gguf new file mode 100644 index 0000000..79351bf --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e85f70fbf5296853e51127445dfba3d8eb42353c4c6afb1d769ea24b439e3909 +size 4561839840 diff --git a/Graph-Preflexor-8b_12292025.i1-Q2_K.gguf b/Graph-Preflexor-8b_12292025.i1-Q2_K.gguf new file mode 100644 index 0000000..b4dad7e --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7a070f3f285bc686e5a3605ff276982f75ede580d971a61b7b5affd9eca03815 +size 3281733344 diff --git a/Graph-Preflexor-8b_12292025.i1-Q2_K_S.gguf b/Graph-Preflexor-8b_12292025.i1-Q2_K_S.gguf new file mode 100644 index 0000000..201ab43 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:090bdeb86eaa96568ecdb5081367f1e2707995274346be27376166fe283d048b +size 3083552480 diff --git a/Graph-Preflexor-8b_12292025.i1-Q3_K_L.gguf b/Graph-Preflexor-8b_12292025.i1-Q3_K_L.gguf new file mode 100644 index 0000000..4598d86 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37055131528f39505ea0d147a4c631be3690bc8fd138f8b80eab863697ffc2e4 +size 4431394528 diff --git a/Graph-Preflexor-8b_12292025.i1-Q3_K_M.gguf b/Graph-Preflexor-8b_12292025.i1-Q3_K_M.gguf new file mode 100644 index 0000000..91bd38d --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d916ecb6a71a42f45a748d6226e55acbb6eb92c090c95fd797f3a6b2ac9a35ec +size 4124161760 diff --git a/Graph-Preflexor-8b_12292025.i1-Q3_K_S.gguf b/Graph-Preflexor-8b_12292025.i1-Q3_K_S.gguf new file mode 100644 index 0000000..875dc12 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9025ae0ad0644a5d846caa61b9df5ccf2b2a8a5539a3e9b8822161ccd5cd518a +size 3769612000 diff --git a/Graph-Preflexor-8b_12292025.i1-Q4_0.gguf b/Graph-Preflexor-8b_12292025.i1-Q4_0.gguf new file mode 100644 index 0000000..2458606 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:39ff5fb048a4b165bfcc45884cd6fe4260c86a6b5721a54f471d1537256ea6e1 +size 4787332832 diff --git a/Graph-Preflexor-8b_12292025.i1-Q4_1.gguf b/Graph-Preflexor-8b_12292025.i1-Q4_1.gguf new file mode 100644 index 0000000..7032497 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee201fd673100d0250d90e29b5e68828c1d2c587095a3774fba7d81229e57a8f +size 5247756000 diff --git a/Graph-Preflexor-8b_12292025.i1-Q4_K_M.gguf b/Graph-Preflexor-8b_12292025.i1-Q4_K_M.gguf new file mode 100644 index 0000000..3473d56 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9ce4dbd793f3cc3312d780339dc30568b096b51e8dcf3160ffd663cdeba4e15 +size 5027784416 diff --git a/Graph-Preflexor-8b_12292025.i1-Q4_K_S.gguf b/Graph-Preflexor-8b_12292025.i1-Q4_K_S.gguf new file mode 100644 index 0000000..fe09638 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:81a01c813671e3accb877f4b0868a250f3e919501790581c5ddfeeb39a7f13f9 +size 4802012896 diff --git a/Graph-Preflexor-8b_12292025.i1-Q5_K_M.gguf b/Graph-Preflexor-8b_12292025.i1-Q5_K_M.gguf new file mode 100644 index 0000000..0c61e3c --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1e20cb85847d60e73ebf178deb04773dfb5bc7ee30833f77332bfc601a1ba02f +size 5851113184 diff --git a/Graph-Preflexor-8b_12292025.i1-Q5_K_S.gguf b/Graph-Preflexor-8b_12292025.i1-Q5_K_S.gguf new file mode 100644 index 0000000..573b5d6 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b5cd727c3fd4f65c94dd7c8807d4f9c5dfab7b7436b849c091490bb38b4e01b5 +size 5720762080 diff --git a/Graph-Preflexor-8b_12292025.i1-Q6_K.gguf b/Graph-Preflexor-8b_12292025.i1-Q6_K.gguf new file mode 100644 index 0000000..9b2ad87 --- /dev/null +++ b/Graph-Preflexor-8b_12292025.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:935140d7755323e1fd24e797c765dbfeb12578398ff1f7c2e8dfcf9d4814c0f7 +size 6725900000 diff --git a/Graph-Preflexor-8b_12292025.imatrix.gguf b/Graph-Preflexor-8b_12292025.imatrix.gguf new file mode 100644 index 0000000..98cbfcd --- /dev/null +++ b/Graph-Preflexor-8b_12292025.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4734c780b6b1b2ced6b97edd118bff741fcf3af9e764eb6a5d8cc79ff5974c31 +size 5347200 diff --git a/README.md b/README.md new file mode 100644 index 0000000..364de54 --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: lamm-mit/Graph-Preflexor-8b_12292025 +datasets: +- lamm-mit/graph_reasoning_1K +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: [] +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/lamm-mit/Graph-Preflexor-8b_12292025 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Graph-Preflexor-8b_12292025-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | | +| [GGUF](https://huggingface.co/mradermacher/Graph-Preflexor-8b_12292025-i1-GGUF/resolve/main/Graph-Preflexor-8b_12292025.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +