commit d6f734aaffae0e378b82c4d8edb8ee7d604d350c Author: ModelHub XC Date: Tue May 26 10:23:25 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b4102f6 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Olmo-3-7B-Think-Math-Code.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ1_M.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ1_M.gguf new file mode 100644 index 0000000..48c5ead --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0480fbd4a1524fd1e4a341d523468fbb193d86d34838ab6dc301114e3c4258ff +size 1938876288 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ1_S.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ1_S.gguf new file mode 100644 index 0000000..a425f12 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05e63f903a9490428eac4e219634d780496368005933c93a2a064bca0c490973 +size 1816487808 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ2_M.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ2_M.gguf new file mode 100644 index 0000000..51d08b8 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:10d7dff0ec29bd4ef96c52222c88dcd0218a88ba1da5ecbbbbe2c024714fdd77 +size 2676059968 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ2_S.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ2_S.gguf new file mode 100644 index 0000000..2aa5e53 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7a26f75f8fd19c5462d716f4d06c568bc1939555f368657cf1aaf7a64bb5505d +size 2512875328 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ2_XS.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ2_XS.gguf new file mode 100644 index 0000000..07d95ab --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6b953445500f9dad70fb48ec74addb5d9f9565fa15cbabe0cdbca987b727017 +size 2322818944 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ2_XXS.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..0c51680 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ff88e867062cf913b51ed588f32110336f107837aa3aa87f07f39b6e09c855b +size 2142857088 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ3_M.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ3_M.gguf new file mode 100644 index 0000000..16e0dfb --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6b9b0015069a09c7d558993568d19ebe0539880877f86e5629a8ce5f8151039c +size 3468317184 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ3_S.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ3_S.gguf new file mode 100644 index 0000000..37937d6 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:220221c5b304f0c81e4c5a156a11a6d5e301df6ee4c4036101e16bc575ab93de +size 3301757440 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ3_XS.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ3_XS.gguf new file mode 100644 index 0000000..374c6cd --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:953b1da7f119879e77a1f0ada85d28c4dbb2ccc79a2c7fc7298f696a803a21a5 +size 3149976064 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ3_XXS.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..135d01b --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e035294b074587b7827f3620295754ef6f9778f7d51accbd6adf09c399f11ba0 +size 2901700416 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ4_NL.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ4_NL.gguf new file mode 100644 index 0000000..3730d2c --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56d362ef903c6401773a85b9521d1a24ae43706debe251964fd13de2f09a904a +size 4216403136 diff --git a/Olmo-3-7B-Think-Math-Code.i1-IQ4_XS.gguf b/Olmo-3-7B-Think-Math-Code.i1-IQ4_XS.gguf new file mode 100644 index 0000000..606a32a --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2fbb85067b0f1d12604c5dccf6d11c677fc13443e7a428a8080c36fabdbe90a6 +size 4001192384 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q2_K.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q2_K.gguf new file mode 100644 index 0000000..d77ea4c --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35016b075af2da1f4a27e5e36d30e9a854078cb3bcc66b88af2064d17a3a9132 +size 2857912896 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q2_K_S.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q2_K_S.gguf new file mode 100644 index 0000000..4be327b --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cbc71c0a6acb9c290dd224e5670633ac3fa9bc692d8dae50da64d3ce533de541 +size 2644593216 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q3_K_L.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q3_K_L.gguf new file mode 100644 index 0000000..1f8d610 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bbb65f87eb24bdab01dbde01793d5cb31d76955f13834fb4daabb91067e8cf4e +size 3950563840 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q3_K_M.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q3_K_M.gguf new file mode 100644 index 0000000..a03fb55 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:66ec0d92312dad32586e5f8865992d55f436df85a2b57f421bffd6985aa237b1 +size 3651457536 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q3_K_S.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q3_K_S.gguf new file mode 100644 index 0000000..9f0f33f --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c6b6187ecf00a5896d19c10dbb0d624054a61c41989bb9bed404216f36515bea +size 3301757440 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q4_0.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q4_0.gguf new file mode 100644 index 0000000..d379c40 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cf940ff1faac4a7976db4139e86d1ea04d87691e68e519551d9b6209f4a3d68d +size 4227675328 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q4_1.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q4_1.gguf new file mode 100644 index 0000000..0c6ce00 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ca507be16fc53dfdfdd3f1e9db78d916b9139e9ca84c9f2ddc5541f10853abad +size 4646824640 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q4_K_M.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q4_K_M.gguf new file mode 100644 index 0000000..745881a --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e9fad81f0b6655b13785cef7c467eed0ced34ad6925a51bb6c59d29595a00a80 +size 4471600320 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q4_K_S.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q4_K_S.gguf new file mode 100644 index 0000000..ff5d97b --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:43a28de4f08eb99c65cf9b29d8f4ffd82066cc609717f27d7c267179d2568726 +size 4247336128 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q5_K_M.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q5_K_M.gguf new file mode 100644 index 0000000..6191cf1 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1aa98134a6c38fb34eeac021cef22bf61ba1a7c923e17cd72937227c78ebbc8f +size 5208711360 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q5_K_S.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q5_K_S.gguf new file mode 100644 index 0000000..48eceb0 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:93ff5cfdf3c5527b8f1098ef1cd3f21db4ed1735574a6a8c1187b26e35a71a7c +size 5077246144 diff --git a/Olmo-3-7B-Think-Math-Code.i1-Q6_K.gguf b/Olmo-3-7B-Think-Math-Code.i1-Q6_K.gguf new file mode 100644 index 0000000..e939ee2 --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bb53300c26e2ae5fc9a534bee82886377cffc166d3cfb60e447730cbcccb8be2 +size 5991891840 diff --git a/Olmo-3-7B-Think-Math-Code.imatrix.gguf b/Olmo-3-7B-Think-Math-Code.imatrix.gguf new file mode 100644 index 0000000..8c0147d --- /dev/null +++ b/Olmo-3-7B-Think-Math-Code.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cd439afe632198c4a14e07198c94f16c54909c21f7cb29c3138d65612a129fcb +size 4589216 diff --git a/README.md b/README.md new file mode 100644 index 0000000..f23e232 --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +base_model: pmahdavi/Olmo-3-7B-Think-Math-Code +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- mergekit +- merge +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/pmahdavi/Olmo-3-7B-Think-Math-Code + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Olmo-3-7B-Think-Math-Code-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ1_S.gguf) | i1-IQ1_S | 1.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ1_M.gguf) | i1-IQ1_M | 2.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.2 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ2_S.gguf) | i1-IQ2_S | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ2_M.gguf) | i1-IQ2_M | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q2_K.gguf) | i1-Q2_K | 3.0 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.0 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.2 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ3_S.gguf) | i1-IQ3_S | 3.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ3_M.gguf) | i1-IQ3_M | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.1 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.1 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.3 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q4_0.gguf) | i1-Q4_0 | 4.3 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.3 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q4_1.gguf) | i1-Q4_1 | 4.7 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Olmo-3-7B-Think-Math-Code-i1-GGUF/resolve/main/Olmo-3-7B-Think-Math-Code.i1-Q6_K.gguf) | i1-Q6_K | 6.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +