commit eacd44b399fc49a4339e1821a13a9d19e3ae831f Author: ModelHub XC Date: Sat Jun 13 23:28:21 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Lambent-Mira-Iris-v2-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..91de7ce --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Lambent-Mira-Iris-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Lambent-Mira-Iris-v2.i1-IQ1_M.gguf b/Lambent-Mira-Iris-v2.i1-IQ1_M.gguf new file mode 100644 index 0000000..15b39af --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b87f7de0815c47291412ca92b043519cb5f9aca0795bd704aae310c34069c99e +size 6797012544 diff --git a/Lambent-Mira-Iris-v2.i1-IQ1_S.gguf b/Lambent-Mira-Iris-v2.i1-IQ1_S.gguf new file mode 100644 index 0000000..e091c30 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b33ba34cce5165e2dfe26f83408ea268bb17de32aa7278a246abf49fa9918e27 +size 6264014400 diff --git a/Lambent-Mira-Iris-v2.i1-IQ2_M.gguf b/Lambent-Mira-Iris-v2.i1-IQ2_M.gguf new file mode 100644 index 0000000..47764cc --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5f409efc0320456301d770c20914041021f6b18d3d69d1742c82942f6d98f338 +size 9492840000 diff --git a/Lambent-Mira-Iris-v2.i1-IQ2_S.gguf b/Lambent-Mira-Iris-v2.i1-IQ2_S.gguf new file mode 100644 index 0000000..9f6cd55 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6cd885d974d8d1ee179d5f3506cf39bc1e4522608704a9b0784699451640d6c7 +size 8782175808 diff --git a/Lambent-Mira-Iris-v2.i1-IQ2_XS.gguf b/Lambent-Mira-Iris-v2.i1-IQ2_XS.gguf new file mode 100644 index 0000000..df10037 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4cc270cbfccce8cab4c2faf2721644e0197ae976297d74cac7280a7b511139bb +size 8438670912 diff --git a/Lambent-Mira-Iris-v2.i1-IQ2_XXS.gguf b/Lambent-Mira-Iris-v2.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..4bf05d1 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:80e07ad4bc988559a0c2c602fc4b00b218d90305e7928c236db111fabc6f8e05 +size 7685342784 diff --git a/Lambent-Mira-Iris-v2.i1-IQ3_M.gguf b/Lambent-Mira-Iris-v2.i1-IQ3_M.gguf new file mode 100644 index 0000000..e0c1ee5 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:db0dbdc7f72869fc5d029f3fb65638960772935cf0dac3c4a74e6e50d813de94 +size 12546795776 diff --git a/Lambent-Mira-Iris-v2.i1-IQ3_S.gguf b/Lambent-Mira-Iris-v2.i1-IQ3_S.gguf new file mode 100644 index 0000000..a9d042c --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:135e756077ff7b3afe0262e8cadd75baec701b6827dc113877f67d6d8a63f51b +size 12167336192 diff --git a/Lambent-Mira-Iris-v2.i1-IQ3_XS.gguf b/Lambent-Mira-Iris-v2.i1-IQ3_XS.gguf new file mode 100644 index 0000000..9f4bf9a --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b66c5cb802888ed22bc34eaa04ec06b69f04ba49c808c4ac6ff6a47f03d95d36 +size 11561955584 diff --git a/Lambent-Mira-Iris-v2.i1-IQ3_XXS.gguf b/Lambent-Mira-Iris-v2.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..648f52c --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:60a1ec25a2833f4b89362d21ffb83bbe6ee980ca3dd8ffdacb61cce28b4f829c +size 10716245568 diff --git a/Lambent-Mira-Iris-v2.i1-IQ4_XS.gguf b/Lambent-Mira-Iris-v2.i1-IQ4_XS.gguf new file mode 100644 index 0000000..fac5a3a --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:51f9411866c65dd74ae901edd3b761769fc254c65ebc6c43270b5176c24722f8 +size 14767169792 diff --git a/Lambent-Mira-Iris-v2.i1-Q2_K.gguf b/Lambent-Mira-Iris-v2.i1-Q2_K.gguf new file mode 100644 index 0000000..41dd402 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:875605adc38cf80fcd57c0bff6307b1ea155ff1c4428972579ee06922170dd69 +size 10503442688 diff --git a/Lambent-Mira-Iris-v2.i1-Q2_K_S.gguf b/Lambent-Mira-Iris-v2.i1-Q2_K_S.gguf new file mode 100644 index 0000000..2710e38 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:240a797792a73c4ca8d509ef3ace3ee13046ef88ce4f53d8827ed5d0e932f024 +size 9757167872 diff --git a/Lambent-Mira-Iris-v2.i1-Q3_K_L.gguf b/Lambent-Mira-Iris-v2.i1-Q3_K_L.gguf new file mode 100644 index 0000000..7045e42 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02f7785d9aad58d37624cbdabdafc0841f8a2e24e0856c732a9131e4ebfd3afe +size 14543184128 diff --git a/Lambent-Mira-Iris-v2.i1-Q3_K_M.gguf b/Lambent-Mira-Iris-v2.i1-Q3_K_M.gguf new file mode 100644 index 0000000..209e39b --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:817206f44cef79c4baf8111c09a24f29c0d5a54f40d9873cfae29061c56ef94a +size 13437362432 diff --git a/Lambent-Mira-Iris-v2.i1-Q3_K_S.gguf b/Lambent-Mira-Iris-v2.i1-Q3_K_S.gguf new file mode 100644 index 0000000..8cadeda --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b6dda962642aee13339d4f5cc94c645af7ab0070e940c660a9ec6501a52226b9 +size 12167336192 diff --git a/Lambent-Mira-Iris-v2.i1-Q4_0.gguf b/Lambent-Mira-Iris-v2.i1-Q4_0.gguf new file mode 100644 index 0000000..62584b9 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:166975f75a5a0fc9855c38fd3a378b2d4599e310664e9a33c14e33e494be3315 +size 15617696000 diff --git a/Lambent-Mira-Iris-v2.i1-Q4_1.gguf b/Lambent-Mira-Iris-v2.i1-Q4_1.gguf new file mode 100644 index 0000000..f1cf06a --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4f0b109b8bf047c7044cef7b20afeee788a833421c5f980622771dc1fad1fb79 +size 17167016192 diff --git a/Lambent-Mira-Iris-v2.i1-Q4_K_M.gguf b/Lambent-Mira-Iris-v2.i1-Q4_K_M.gguf new file mode 100644 index 0000000..7e9c9fb --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:54e08f2e5d6694d5308463fa5a6ddd868568a8c518e221e731ad9619c8b1767d +size 16546410752 diff --git a/Lambent-Mira-Iris-v2.i1-Q4_K_S.gguf b/Lambent-Mira-Iris-v2.i1-Q4_K_S.gguf new file mode 100644 index 0000000..60c8743 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3be806231875e83b7003e1d6749e1e7504baf6af44b5370de1558007f3125a42 +size 15673778432 diff --git a/Lambent-Mira-Iris-v2.i1-Q5_K_M.gguf b/Lambent-Mira-Iris-v2.i1-Q5_K_M.gguf new file mode 100644 index 0000000..2d1f875 --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b277c32abc70f06ab9ad872d43b685c957be496b5f1158519750f7cf3bec754 +size 19271397632 diff --git a/Lambent-Mira-Iris-v2.i1-Q5_K_S.gguf b/Lambent-Mira-Iris-v2.i1-Q5_K_S.gguf new file mode 100644 index 0000000..967894c --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c767c8a7f66f51b6573d52f6beefc2ce37a47b83d701488ab3a1bba6c22b0f99 +size 18766913792 diff --git a/Lambent-Mira-Iris-v2.i1-Q6_K.gguf b/Lambent-Mira-Iris-v2.i1-Q6_K.gguf new file mode 100644 index 0000000..ba67afb --- /dev/null +++ b/Lambent-Mira-Iris-v2.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:06d2f1566d1c93ed2fdfd78b748f6cd713de9c1b5e9c8f52e13dbf1c6eb67643 +size 22166696192 diff --git a/Lambent-Mira-Iris-v2.imatrix.gguf b/Lambent-Mira-Iris-v2.imatrix.gguf new file mode 100644 index 0000000..dc37921 --- /dev/null +++ b/Lambent-Mira-Iris-v2.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe7f94afc090a07164f045f0eee6278de1201bacab37baba625b2b64db97957e +size 13081760 diff --git a/README.md b/README.md new file mode 100644 index 0000000..cb4009e --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +base_model: virtuous7373/Lambent-Mira-Iris-v2 +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- mergekit +- merge +- Lambent +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/virtuous7373/Lambent-Mira-Iris-v2 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Lambent-Mira-Iris-v2-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 6.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 6.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 7.8 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 8.5 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 8.9 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 9.6 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 9.9 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q2_K.gguf) | i1-Q2_K | 10.6 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 10.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 11.7 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 12.3 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 12.3 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 12.6 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 13.5 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 14.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 14.9 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q4_0.gguf) | i1-Q4_0 | 15.7 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 15.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 16.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q4_1.gguf) | i1-Q4_1 | 17.3 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 18.9 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 19.4 | | +| [GGUF](https://huggingface.co/mradermacher/Lambent-Mira-Iris-v2-i1-GGUF/resolve/main/Lambent-Mira-Iris-v2.i1-Q6_K.gguf) | i1-Q6_K | 22.3 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +