commit 8f208ff49b55f4def01477936e8530c4a16f2c70 Author: ModelHub XC Date: Fri Jul 17 15:42:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..376be52 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_M.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_M.gguf new file mode 100644 index 0000000..93fc8d9 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:756b2df92f4a88b4e3f3d01fb5c0063240254528b1c6f40458620a16491b0915 +size 4553216160 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_S.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_S.gguf new file mode 100644 index 0000000..8a6fae1 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4b8b2e1e3d10d44a154e91e01d20e727b2e46043ee06f71a721c0037d7c06fa9 +size 4150532256 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_M.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_M.gguf new file mode 100644 index 0000000..de70f8b --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:55754c89c8a72d06b6b6ef4b642f967bb8161f05d489e874396cbc0ca3d62940 +size 6449825952 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_S.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_S.gguf new file mode 100644 index 0000000..901d4d9 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24eef15bbb550af030ff69b54ddf48532a5fe77c9f865dec02af96386bc89c78 +size 5912914080 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XS.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..7d4c4dc --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9c01f1d0111b8a7b3d43945c750e6497719dd2d922224b151e1a4d7408a846f +size 5772507296 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XXS.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..32a53c7 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35a80b8382174a879a0fcc02114286029dfd9a4f58e31753ce207cc33e2512f8 +size 5224356000 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_M.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_M.gguf new file mode 100644 index 0000000..298bfa1 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:88704a3585c6221a141c959669d2b40c4b440a09317f69aecdf0073c5a50f20e +size 8530323616 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_S.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_S.gguf new file mode 100644 index 0000000..d28a9b2 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3db4fbe59e95d7b450a51fcb5f6562bba40d51ea01e9437a2cc84fcf83401e70 +size 8401399968 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XS.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..2724f7d --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7294bdc14901c049cb6f20da7aa480da4fd65109b2e4bfd14fd9f7aa99b3c267 +size 7981125792 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XXS.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..932581d --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f0be08c5e6a3f1ffae7a510db644a3df53b04d43017d2974cad9bfc2b9e00f9 +size 7482046624 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ4_XS.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..0738aa3 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:08617d083150dbd083db8814754c5216f9588c74daf433917788b9dc8e9074ee +size 10279143584 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K.gguf new file mode 100644 index 0000000..9527369 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1dac4ea76ada9b8386ea310b3f184ae365bdb581415e5ce8afda000db830c984 +size 7145838752 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K_S.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..cb99033 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6839c0d4eb6a1db4d2427b974f916f565a431d4f9f319a44a1e968842c0c9b30 +size 6673295520 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_L.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..5e03532 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4289b0ecdc33c7a3cc5fc8cd3c4c6624511d4ed8e940e1cb00b456c0457bd17c +size 9970905248 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_M.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..ddb1f26 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0e0af4b96a9a90346245130cfbeebe76764b0d2c44dc26654c6cb78a25de7eb7 +size 9232543904 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_S.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..020e46a --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:52308357e8e01b454848ccb188d6eca60cd9f186668e9edb39ccca49395e7211 +size 8394576032 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_0.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_0.gguf new file mode 100644 index 0000000..cb56d03 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:edaf927b661273a08d32fa6165ca3e775d70400356ec7821b54d6f5e142b4ee1 +size 10886703264 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_1.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_1.gguf new file mode 100644 index 0000000..efe318f --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02e717fc81a96f4433475ae051c7d9a281417945ee55061681771d66568f2379 +size 12003305632 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_M.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..d024df7 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:098a65247b0748fdd110103f34308dc4879ca0b7de23281a689ef04da5ab7c51 +size 11590314144 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_S.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..8425177 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:182faf823587482e226f9345a5485427ace11697f1b3188f1f41ecc32197cbc7 +size 10925811872 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_M.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..eeb5d4a --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d5760aec147f8290c3919404e3d4371af69fcbe85fab29131c7ee8d8922a968b +size 13540239520 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_S.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..550979b --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8bafb39c97d238943f2a666a07ef5bebaa8ac344136328343d7179a622fd6abc +size 13158099104 diff --git a/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q6_K.gguf b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q6_K.gguf new file mode 100644 index 0000000..e3c7663 --- /dev/null +++ b/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ac1db17345659e28dd1eb943f352a317f4228087f0cc6da9daa99d8dcc109880 +size 15612035232 diff --git a/README.md b/README.md new file mode 100644 index 0000000..351cd98 --- /dev/null +++ b/README.md @@ -0,0 +1,97 @@ +--- +base_model: DavidAU/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- merge +- programming +- code generation +- code +- codeqwen +- moe +- coding +- coder +- qwen2 +- chat +- qwen +- qwen-coder +- mixture of experts +- qwen2moe +- 2X7B +- shared expert +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_S.gguf) | i1-IQ1_S | 4.3 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ1_M.gguf) | i1-IQ1_M | 4.7 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 5.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_S.gguf) | i1-IQ2_S | 6.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ2_M.gguf) | i1-IQ2_M | 6.5 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 6.8 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q2_K.gguf) | i1-Q2_K | 7.2 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 7.6 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 8.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 8.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_S.gguf) | i1-IQ3_S | 8.5 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ3_M.gguf) | i1-IQ3_M | 8.6 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 9.3 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 10.1 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 10.4 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_0.gguf) | i1-Q4_0 | 11.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 11.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 11.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q4_1.gguf) | i1-Q4_1 | 12.1 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 13.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 13.6 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B-i1-GGUF/resolve/main/Qwen2.5-2X7B-Coder-Soar-qwen-Coder-Instruct-OlympicCoder-19B.i1-Q6_K.gguf) | i1-Q6_K | 15.7 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..95841e6 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e52976ff3f5df24de7e6067db46680c2dfec6e9a9a3114dc36769e4a31d7cc90 +size 11194539