commit e7c4ede301024cddc56830e2d682edd708aa2f5b Author: ModelHub XC Date: Fri May 8 21:11:52 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..a22f343 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf new file mode 100644 index 0000000..79a7d19 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c81fc9b271cb1de1c24f2b367deffbf11c203035b2d2b14d78318a694432368e +size 3728064704 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf new file mode 100644 index 0000000..2d30097 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d0208f89586af11829c0ebd37c4d97c26221877e85696c267bec4cffeaeb8cf5 +size 3461169344 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf new file mode 100644 index 0000000..8f4aacc --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:177db0d0ffd550f6dce45ffc7069b39516724b9fc18f43e987c0d28eabac65ca +size 5170512064 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf new file mode 100644 index 0000000..2f5d478 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a26bf3cff9d2abc00c353f8750bd19cc38ef5a932d67fa00fed106b48b7d2ee +size 4814651584 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf new file mode 100644 index 0000000..4a5dbe9 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bc66b2a24f92e124a0ef8c023c1750f5eccfad9de503b93c27974ed15924bffa +size 4560208064 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..54d2e69 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cfc9a2862bb606fab39de86d9c7f9ef8cb287957a85aa602e9ba7104dd258e0d +size 4172890304 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf new file mode 100644 index 0000000..fb92ee3 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b94cb6cf4b3c6f32d147c983c0b266c7faffd34595cbec42a77f0cc40a653f29 +size 6697337024 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf new file mode 100644 index 0000000..0a3c012 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a590e9e55317001b8f142189a925d44c9cfc34860b91bdc02757838195718721 +size 6505152704 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf new file mode 100644 index 0000000..a91b1f5 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bff324ac60508575d36df737df7c9c33c85c2278f1700daa8571ca81c7156683 +size 6198444224 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..30b91f0 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7955205a3503f9f039d0c164995815ab449887d9a6023c0005eabf4c289acf37 +size 5782945984 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf new file mode 100644 index 0000000..33421af --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7371074e93ad0730168a8f027a015cfeeb0d1a428e94408588c6a1d5a1f30543 +size 8330330304 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf new file mode 100644 index 0000000..6d54c71 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7ed497d40d10893da6b1788d677044226f61a4a3938a3f70d8481d6f4b1eb8c +size 7908278464 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf new file mode 100644 index 0000000..fe528c1 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f3bf0adf8ae40edf025d4d8eedb35b7a7e5117f4378957ca6d1dc1b8fe07afbd +size 5593546944 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf new file mode 100644 index 0000000..87385bd --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aab3191373765c3c6c11af7f524a5df8b9d8591a9d02b25ceb466290a6adff63 +size 5236703424 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf new file mode 100644 index 0000000..3b2e184 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:efb0780f4b0c84a5f0c241b563bb74a89e13d647ae845932a61146dc2a491259 +size 7704461504 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf new file mode 100644 index 0000000..f512177 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:df9a26f057b80eebe835921de5dd70ba48af149dcf66f0222fa912f55b81b5ae +size 7135609024 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf new file mode 100644 index 0000000..d4b6a28 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc86f67d9e731c7cffade2cdf4741319cd3cb670cc531958d08ba3eb34432cb6 +size 6471729344 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf new file mode 100644 index 0000000..175eb21 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:30c1db876ac31d589dccd89e4983f13d0b9d687467362bf8393b427f7212fffa +size 8326398144 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf new file mode 100644 index 0000000..a9cdcd7 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9819f913f86ffaa9d5fe3aa7796ed7d022e709a647e153ba9ed74bec213a89a4 +size 9158705344 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf new file mode 100644 index 0000000..6017f50 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:148574906a889677b5f3277e10d3141a1f5965398f3e148de10eb118227b07df +size 8785477824 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf new file mode 100644 index 0000000..b853d91 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:97a64e4be9a37c2688eaf2cc6cc11ef9ee0eb2c20376e20c800884966af48550 +size 8356544704 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf new file mode 100644 index 0000000..f891a39 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:970c2d95822e1a3f62683b394dd604590d701be5be9d5cd5f28eb4267edd5e77 +size 10269212864 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf new file mode 100644 index 0000000..04c51bd --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3280da2631c3cb49e22792ae863ed7e013193f0a5c461a27ccdc9e9ea04f397d +size 10018537664 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf new file mode 100644 index 0000000..68dff04 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9060c38ac8193230e8711b1b88be3a2d712827ef0b22240310cc0b80ae57e0f0 +size 11845681344 diff --git a/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf new file mode 100644 index 0000000..0570489 --- /dev/null +++ b/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:15c0f18c0ae8e8973b7e21e4a27c3f04c260d851a486e056c7570fb54dc5a832 +size 8505824 diff --git a/README.md b/README.md new file mode 100644 index 0000000..208d50a --- /dev/null +++ b/README.md @@ -0,0 +1,97 @@ +--- +base_model: sainikhiljuluri2015/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED +datasets: +- NSL-KDD +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- cybersecurity +- network-security +- intrusion-detection +- raft +- dora +- vision-language-model +- llava +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/sainikhiljuluri2015/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_S.gguf) | i1-IQ1_S | 3.6 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ1_M.gguf) | i1-IQ1_M | 3.8 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.7 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_S.gguf) | i1-IQ2_S | 4.9 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ2_M.gguf) | i1-IQ2_M | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.3 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q2_K.gguf) | i1-Q2_K | 5.7 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.3 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_S.gguf) | i1-IQ3_S | 6.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ3_M.gguf) | i1-IQ3_M | 6.8 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.8 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.0 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_0.gguf) | i1-Q4_0 | 8.4 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.4 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q4_1.gguf) | i1-Q4_1 | 9.3 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.1 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.4 | | +| [GGUF](https://huggingface.co/mradermacher/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED-i1-GGUF/resolve/main/Apriel-1.5-15b-Thinker-CYBERSEC-MERGED.i1-Q6_K.gguf) | i1-Q6_K | 11.9 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +