commit bc67a5a7a52629cadd8304e2200a17a41e58fb41 Author: ModelHub XC Date: Mon Apr 13 23:57:06 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..87ee602 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_M.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_M.gguf new file mode 100644 index 0000000..79bd80e --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c6515f1be527f27d2e3274da23e67900cf497a1632b4ded58fa6be1e3b2d6f2b +size 441294976 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_S.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_S.gguf new file mode 100644 index 0000000..94d2010 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:248249f81be92d8df2636b0298af54699adb54cdac0e3fac5b5cc9665a6e2214 +size 418635904 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_M.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_M.gguf new file mode 100644 index 0000000..272ce07 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f988b27d6367fe0d9764b4967cae93b1b7241d02871574bb9c5679ecad48af6c +size 555868288 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_S.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_S.gguf new file mode 100644 index 0000000..aaeaeda --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e0a39df999d468e81a3e84ca3a74a4359408bfbedc9e0af7a7d5702dd2304522 +size 525656192 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XS.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XS.gguf new file mode 100644 index 0000000..d5c6676 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:742419f1879e694c74b690f36c0e48c516bfd47291b1498dcb5a82605338bacf +size 511631488 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XXS.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..82769ef --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:70ad29f6991a3657a0219b6e37866aecda3e71c417d18a9f0562f89ecd5bb635 +size 479060096 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_M.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_M.gguf new file mode 100644 index 0000000..ae2f986 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4cfe6cb782bdcce3cbc2ae15607800202f3f1a5400d61127d95a15f2b967afc2 +size 710979712 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_S.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_S.gguf new file mode 100644 index 0000000..c58b99a --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d4635f53fa88305a879d9dde4a7d809fb29622aadfce560f564aeb7de41649e +size 696496256 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XS.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XS.gguf new file mode 100644 index 0000000..ee93720 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:57ccb671898653d8ad1c29be3166c05452f571a0eaee14cf11259db8c504efa2 +size 671625344 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XXS.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..846b23b --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:addfc2cd5964721887afde79e6589d133ceed9420e60ded67e6b4491dfc80f9a +size 608821376 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_NL.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_NL.gguf new file mode 100644 index 0000000..5c334cb --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ea113a4ee565ab0f69eb14692cf8c42ac1cc427562513d4d2729fac1ad632b70 +size 841740416 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_XS.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_XS.gguf new file mode 100644 index 0000000..2476657 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4eb2225061b7a19d6244a1a4f0ebf29541b989ed9cbc15335e3ebdfd8e8bb083 +size 808120448 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K.gguf new file mode 100644 index 0000000..fa16833 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1444000bd8dc5dde26a93fbc137124c35990906251babf973028085f22c3436c +size 625569920 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K_S.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K_S.gguf new file mode 100644 index 0000000..012c36e --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bcd4f0a8cab07d058ddc0f89643d073f42bd943c1698a4912e67ec208e985893 +size 595095680 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_L.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_L.gguf new file mode 100644 index 0000000..6ebd7c4 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35d967ec59bdb98d2863636b14265e56352d60c5a18c5f2c0cbaeeddcde94dec +size 796176512 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_M.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_M.gguf new file mode 100644 index 0000000..adbe666 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f4674c4bb59f98b2f6b81288617f4ad12d31a788d3505e372e5b7b7af01c5e86 +size 748990592 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_S.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_S.gguf new file mode 100644 index 0000000..479655e --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c24838d4210a62974645e23cf9086a517b3a53f4102f45db55da1e2dce6b49c1 +size 693989504 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_0.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_0.gguf new file mode 100644 index 0000000..af28c10 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:510e75a52560eb62d37008c92e24225d68440c7e443a7f113fdda4f4825d2a98 +size 841478272 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_1.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_1.gguf new file mode 100644 index 0000000..6a16381 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4d2cf7fd3894d17917b3828546357c765406f2e2dce6281d9a200a83ed8b71d8 +size 907800704 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_M.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_M.gguf new file mode 100644 index 0000000..8bd80bc --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f7ea4b187c23572a43fa3c6be2c3dd932128dec889590fa8e13f9d5ed7a1ebaa +size 880742528 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_S.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_S.gguf new file mode 100644 index 0000000..ea754b0 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b33c8735f6b07982592c89d7528cf53e2336b18ac65d7dec9663be93772c1cee +size 844099712 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_M.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_M.gguf new file mode 100644 index 0000000..0f830bc --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:becec147c9603903cf609d34d0e19587ae5cc7a97308fae7234d3bc1e01ed3e4 +size 997527680 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_S.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3d2f128 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9326936f585a1991fdcfa84d2045a60736d018278f848412a523f9ac04d8c2ac +size 976220288 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q6_K.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q6_K.gguf new file mode 100644 index 0000000..fa3bcac --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5ca0067d4a69b90cb063007d4f3a4dd8d1070a593fa6ad15f5018e54d10e36c6 +size 1121611904 diff --git a/Cicikus-v3-1.4B-Opus4.6-Powered.imatrix.gguf b/Cicikus-v3-1.4B-Opus4.6-Powered.imatrix.gguf new file mode 100644 index 0000000..bb41f94 --- /dev/null +++ b/Cicikus-v3-1.4B-Opus4.6-Powered.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bfcff65dd4b8749df2c50befbd084a55b0a7f8ac14f11e24c7f04803ecd5a19c +size 1493984 diff --git a/README.md b/README.md new file mode 100644 index 0000000..b1ee928 --- /dev/null +++ b/README.md @@ -0,0 +1,125 @@ +--- +base_model: pthinc/Cicikus-v3-1.4B-Opus4.6-Powered +datasets: +- pthinc/BCE-Prettybird-Micro-Standard-v0.0.1 +- Alibaba-Apsara/Superior-Reasoning-SFT-gpt-oss-120b +- pthinc/turkish_english_general_dataset +- galaxyMindAiLabs/stem-reasoning-complex +- stanford-oval/ccnews +- nohurry/Opus-4.6-Reasoning-3000x-filtered +language: +- en +- tr +library_name: transformers +license: other +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- chat +- text-generation-inference +- agent +- cicikuş +- cicikus +- prettybird +- bce +- consciousness +- conscious +- llm +- transformers +- optimized +- ethic +- secure +- turkish +- english +- behavioral-consciousness-engine +- model +- reasoning +- think +- thinking +- chain-of-thought +- STEM-expert +- turkish & english +- franken-merge +- bce-aci +- llama-3.2 +- edge-ai +- instruction +- instruct +- opus +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/pthinc/Cicikus-v3-1.4B-Opus4.6-Powered + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ1_M.gguf) | i1-IQ1_M | 0.5 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_S.gguf) | i1-IQ2_S | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.7 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q2_K.gguf) | i1-Q2_K | 0.7 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_0.gguf) | i1-Q4_0 | 0.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q4_1.gguf) | i1-Q4_1 | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-i1-GGUF/resolve/main/Cicikus-v3-1.4B-Opus4.6-Powered.i1-Q6_K.gguf) | i1-Q6_K | 1.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +