commit fbd199a082251ec1b0df6c6bdfe21d0ec481192b Author: ModelHub XC Date: Wed Apr 22 11:44:05 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Cigno-8B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..8964064 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Cigno-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Cigno-8B.i1-IQ1_M.gguf b/Cigno-8B.i1-IQ1_M.gguf new file mode 100644 index 0000000..7d3c180 --- /dev/null +++ b/Cigno-8B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c33acf603ba0422ca91c6cb7ca38670724807a2f174999e2f012e7a6efeccd97 +size 2256148896 diff --git a/Cigno-8B.i1-IQ1_S.gguf b/Cigno-8B.i1-IQ1_S.gguf new file mode 100644 index 0000000..ba6f7c8 --- /dev/null +++ b/Cigno-8B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37cccb718103df1c04ca8577e40517745114637233223c66d22c454cbb74757c +size 2115770784 diff --git a/Cigno-8B.i1-IQ2_M.gguf b/Cigno-8B.i1-IQ2_M.gguf new file mode 100644 index 0000000..b9d73fc --- /dev/null +++ b/Cigno-8B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:973a431deefbb5235ba25196f2112fb79e0f8072a16fc9d2a3cca101ae157a3e +size 3051915680 diff --git a/Cigno-8B.i1-IQ2_S.gguf b/Cigno-8B.i1-IQ2_S.gguf new file mode 100644 index 0000000..6e389ca --- /dev/null +++ b/Cigno-8B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24ec95fed047876564a8064059402ba3afc7f845b6426f5895ca4a854f3329ab +size 2864744864 diff --git a/Cigno-8B.i1-IQ2_XS.gguf b/Cigno-8B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..1d0968a --- /dev/null +++ b/Cigno-8B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:022653b8b7ecbbbd6bab03acb61bb88530af894aab8b8a41fa394cf42261be1a +size 2696157600 diff --git a/Cigno-8B.i1-IQ2_XXS.gguf b/Cigno-8B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..90a5489 --- /dev/null +++ b/Cigno-8B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:281fc2225b75a65ed311c995a70707bf2c657eb422dbca2042f85083ae30e043 +size 2490112416 diff --git a/Cigno-8B.i1-IQ3_M.gguf b/Cigno-8B.i1-IQ3_M.gguf new file mode 100644 index 0000000..9af4992 --- /dev/null +++ b/Cigno-8B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0eb4c1c9cea42e47360150a6030a9db8b32112fdf50e6d199abcaf8f232e5311 +size 3896621472 diff --git a/Cigno-8B.i1-IQ3_S.gguf b/Cigno-8B.i1-IQ3_S.gguf new file mode 100644 index 0000000..682761f --- /dev/null +++ b/Cigno-8B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:76e37856275b1057b1931cc47595b710bad6a1b5ea32bd02e52352e11831a67b +size 3789666720 diff --git a/Cigno-8B.i1-IQ3_XS.gguf b/Cigno-8B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..52aaf7f --- /dev/null +++ b/Cigno-8B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f81478a0f6cfe14b62859526d067278b9e9a45df7ebbb407a0c7e7298ccbda12 +size 3626875296 diff --git a/Cigno-8B.i1-IQ3_XXS.gguf b/Cigno-8B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..602eca6 --- /dev/null +++ b/Cigno-8B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0676f13417878ac54d062ff4ac744f653481c3c1e267b6e844c2ba701e282021 +size 3369634208 diff --git a/Cigno-8B.i1-IQ4_NL.gguf b/Cigno-8B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..be03dcb --- /dev/null +++ b/Cigno-8B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cedc8581ab2068eeded9b9577d3ac9a26f15b30e4c49eb45905fed5ebb4a59e2 +size 4793624992 diff --git a/Cigno-8B.i1-IQ4_XS.gguf b/Cigno-8B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..75ffd9d --- /dev/null +++ b/Cigno-8B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37a8fd3c8b27a7935834d65bf3dd047473ea4cc467c2f4156ac4b460fda05331 +size 4561840544 diff --git a/Cigno-8B.i1-Q2_K.gguf b/Cigno-8B.i1-Q2_K.gguf new file mode 100644 index 0000000..e494318 --- /dev/null +++ b/Cigno-8B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6aa363bd716379c1613f338ad33c9ed5ef2aa90c0be2a84e0d9683b13403c423 +size 3281734048 diff --git a/Cigno-8B.i1-Q2_K_S.gguf b/Cigno-8B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..0b0a7cf --- /dev/null +++ b/Cigno-8B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05c0c04ab9ae93e84b095e1c590052f0a9a713d8daeee46d986541fa9f41fcfd +size 3083553184 diff --git a/Cigno-8B.i1-Q3_K_L.gguf b/Cigno-8B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..19ecb3f --- /dev/null +++ b/Cigno-8B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3058f026e432fbf5aa8ee69e7a0b942e27f5e231a602113100221cf9ed5f14ab +size 4431395232 diff --git a/Cigno-8B.i1-Q3_K_M.gguf b/Cigno-8B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..9ed7acc --- /dev/null +++ b/Cigno-8B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b00df4a402da52f48107b013ac8fbd076c885801a74b7e13fe827bd69b37ffee +size 4124162464 diff --git a/Cigno-8B.i1-Q3_K_S.gguf b/Cigno-8B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..87f53c7 --- /dev/null +++ b/Cigno-8B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:752b4e21c67d4e853407333e02d65cca8b1a5a74c066a0b466a8be9583007772 +size 3769612704 diff --git a/Cigno-8B.i1-Q4_0.gguf b/Cigno-8B.i1-Q4_0.gguf new file mode 100644 index 0000000..9e34243 --- /dev/null +++ b/Cigno-8B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b707ce53262ac77d1d961b734852fbc29e0679eff0fe3bcc5caf827951d5ae6 +size 4787333536 diff --git a/Cigno-8B.i1-Q4_1.gguf b/Cigno-8B.i1-Q4_1.gguf new file mode 100644 index 0000000..d881613 --- /dev/null +++ b/Cigno-8B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:178f67f029e203614577498488206b7a977c4262b16367706ec21116582c14ab +size 5247756704 diff --git a/Cigno-8B.i1-Q4_K_M.gguf b/Cigno-8B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..a0e762b --- /dev/null +++ b/Cigno-8B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4dc93a79190d8a12644a382382ef16ac8f2a488c0f02611ac9fbcf9646bb40a0 +size 5027785120 diff --git a/Cigno-8B.i1-Q4_K_S.gguf b/Cigno-8B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..d789615 --- /dev/null +++ b/Cigno-8B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4ffbdacfe9fc12de77f0271fe4ba099a5966024f78380744a912919d3fa71e06 +size 4802013600 diff --git a/Cigno-8B.i1-Q5_K_M.gguf b/Cigno-8B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..fa72bbe --- /dev/null +++ b/Cigno-8B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f38d4c52f38de340401499ecb786bbc34f745f23b748a96a5ad216cf374afb87 +size 5851113888 diff --git a/Cigno-8B.i1-Q5_K_S.gguf b/Cigno-8B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3f28c4c --- /dev/null +++ b/Cigno-8B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:490c52afa5344ad4f3bc0f35f94f94f4f1926408b8a028f847466eff7f3939f0 +size 5720762784 diff --git a/Cigno-8B.i1-Q6_K.gguf b/Cigno-8B.i1-Q6_K.gguf new file mode 100644 index 0000000..30f911d --- /dev/null +++ b/Cigno-8B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12eb07f396a1a0e1d4622d1263235e76dde579a7fe4ea83c9fbaa9cf462399ff +size 6725900704 diff --git a/README.md b/README.md new file mode 100644 index 0000000..b8fd26e --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: ClaudioItaly/Cigno-8B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- text-generation-inference +- transformers +- unsloth +- qwen3 +- trl +- sft +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/ClaudioItaly/Cigno-8B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Cigno-8B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Cigno-8B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | | +| [GGUF](https://huggingface.co/mradermacher/Cigno-8B-i1-GGUF/resolve/main/Cigno-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..8b3aa80 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f139c7833aabe8fb1fbe404fbb2937eadca048a2a79de381674295f1c7d5bbb +size 5316769