commit 4c52bd614c904a0fb1ef228c51aad392137034be Author: ModelHub XC Date: Sun May 10 03:30:52 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Avnas-7B-v1-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..0e6a06e --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Avnas-7B-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Avnas-7B-v1.i1-IQ1_M.gguf b/Avnas-7B-v1.i1-IQ1_M.gguf new file mode 100644 index 0000000..4b109f4 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f094874277e19d7d8d08750f85c9a506e7b9849147648247e9be3b80fa84e8dc +size 1754446944 diff --git a/Avnas-7B-v1.i1-IQ1_S.gguf b/Avnas-7B-v1.i1-IQ1_S.gguf new file mode 100644 index 0000000..f091c68 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3b017f6527dbbfe2ef93bb3ae083f64c2282b893bbcf96849788140dd73c0010 +size 1612102752 diff --git a/Avnas-7B-v1.i1-IQ2_M.gguf b/Avnas-7B-v1.i1-IQ2_M.gguf new file mode 100644 index 0000000..f3b7d71 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:42fbe602216203c1eec619392138d2e5d3ec0a2289dbef246dac547fc24382cb +size 2500713568 diff --git a/Avnas-7B-v1.i1-IQ2_S.gguf b/Avnas-7B-v1.i1-IQ2_S.gguf new file mode 100644 index 0000000..8e605b1 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a081f9096b33b3d60e2f419419859426fb4320338c527ed216ffb6477c3acee6 +size 2310921312 diff --git a/Avnas-7B-v1.i1-IQ2_XS.gguf b/Avnas-7B-v1.i1-IQ2_XS.gguf new file mode 100644 index 0000000..7d64748 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4efc1e008e9ff265095fdda243e9f48db0f9a6edeb3059485edb1f1ff4dca2ae +size 2198256736 diff --git a/Avnas-7B-v1.i1-IQ2_XXS.gguf b/Avnas-7B-v1.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..6afe00e --- /dev/null +++ b/Avnas-7B-v1.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eb1c373c5294be15f845f0c2d7645cc1220ea5b309b499996df27ca850a6ebae +size 1991687264 diff --git a/Avnas-7B-v1.i1-IQ3_M.gguf b/Avnas-7B-v1.i1-IQ3_M.gguf new file mode 100644 index 0000000..29150b9 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a887c1e1850e81ef767d708591983fa76d41ed78209446d5cde8a735637c930a +size 3284892768 diff --git a/Avnas-7B-v1.i1-IQ3_S.gguf b/Avnas-7B-v1.i1-IQ3_S.gguf new file mode 100644 index 0000000..28aca7c --- /dev/null +++ b/Avnas-7B-v1.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:28fffd581483d8b213298b0bd4c1dfcba1692274285a195f8ad7c07718e78104 +size 3182394464 diff --git a/Avnas-7B-v1.i1-IQ3_XS.gguf b/Avnas-7B-v1.i1-IQ3_XS.gguf new file mode 100644 index 0000000..3ef1036 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f57a106bd720d5decf293961b1a7f78d69bbc93fb571b84b115b76b1e2dea89 +size 3018816608 diff --git a/Avnas-7B-v1.i1-IQ3_XXS.gguf b/Avnas-7B-v1.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..2f87cf7 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd259717dc31e6bad19674346f1c0d3f605af114a6bf805422340a1f4903d1bc +size 2827344992 diff --git a/Avnas-7B-v1.i1-IQ4_NL.gguf b/Avnas-7B-v1.i1-IQ4_NL.gguf new file mode 100644 index 0000000..af62fd8 --- /dev/null +++ b/Avnas-7B-v1.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:30f867a0b3df2c7a45a10374688a967c5796fab47d393d52a89f353c46dc8ccc +size 4125695072 diff --git a/Avnas-7B-v1.i1-IQ4_XS.gguf b/Avnas-7B-v1.i1-IQ4_XS.gguf new file mode 100644 index 0000000..461f09b --- /dev/null +++ b/Avnas-7B-v1.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9b338dcd4e66cd8e5c412e269c0787302f644dd14c9ddd27a8eb15c62a555e7 +size 3907689568 diff --git a/Avnas-7B-v1.i1-Q2_K.gguf b/Avnas-7B-v1.i1-Q2_K.gguf new file mode 100644 index 0000000..ac69df0 --- /dev/null +++ b/Avnas-7B-v1.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe89d83a42d958fe966a24fc59230f9bbe3c70d54508e0cf0e6a7597f5747a1b +size 2719243360 diff --git a/Avnas-7B-v1.i1-Q2_K_S.gguf b/Avnas-7B-v1.i1-Q2_K_S.gguf new file mode 100644 index 0000000..a79a962 --- /dev/null +++ b/Avnas-7B-v1.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:636aefd948203f33d51a0d5605d86e6ddd690b50cd6ee3bc4a53d892a4efc538 +size 2528926816 diff --git a/Avnas-7B-v1.i1-Q3_K_L.gguf b/Avnas-7B-v1.i1-Q3_K_L.gguf new file mode 100644 index 0000000..bafe335 --- /dev/null +++ b/Avnas-7B-v1.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c9891de76f0bd249f22fa3fffc5714e37646180528fa631d8fbd8fd6b0c4f7f6 +size 3822025824 diff --git a/Avnas-7B-v1.i1-Q3_K_M.gguf b/Avnas-7B-v1.i1-Q3_K_M.gguf new file mode 100644 index 0000000..72c65d5 --- /dev/null +++ b/Avnas-7B-v1.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04ce3b77285be56ad6f91d0db7e46cd23cc379a18bf1a64d0cca8643b4793eec +size 3518987360 diff --git a/Avnas-7B-v1.i1-Q3_K_S.gguf b/Avnas-7B-v1.i1-Q3_K_S.gguf new file mode 100644 index 0000000..5920272 --- /dev/null +++ b/Avnas-7B-v1.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37468d2ec4438dc21a7f7211f1c118afaef9c3dab96d9ed692dfc1f8568eb31d +size 3164568672 diff --git a/Avnas-7B-v1.i1-Q4_0.gguf b/Avnas-7B-v1.i1-Q4_0.gguf new file mode 100644 index 0000000..43b1f1f --- /dev/null +++ b/Avnas-7B-v1.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fe93f50d256c0b968a6895677ff9069f0aedc0081d4f7085839f785b86dd3a10 +size 4123597920 diff --git a/Avnas-7B-v1.i1-Q4_1.gguf b/Avnas-7B-v1.i1-Q4_1.gguf new file mode 100644 index 0000000..143e6ca --- /dev/null +++ b/Avnas-7B-v1.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b3c60bde935fce4e3213affe5a7a5402b38eb08b89954506e5ce304d654df73c +size 4553317472 diff --git a/Avnas-7B-v1.i1-Q4_K_M.gguf b/Avnas-7B-v1.i1-Q4_K_M.gguf new file mode 100644 index 0000000..a085222 --- /dev/null +++ b/Avnas-7B-v1.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:776cb2795e292fdf843d9e1f03827bb3b2bb3c31a9c41201bc381111e5bec661 +size 4368440416 diff --git a/Avnas-7B-v1.i1-Q4_K_S.gguf b/Avnas-7B-v1.i1-Q4_K_S.gguf new file mode 100644 index 0000000..0aa03c5 --- /dev/null +++ b/Avnas-7B-v1.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:33d4800c59c33eb65b3e5e5ea04979fa0c2a14662ee3dd3bae5012bad6ecbf80 +size 4140375136 diff --git a/Avnas-7B-v1.i1-Q5_K_M.gguf b/Avnas-7B-v1.i1-Q5_K_M.gguf new file mode 100644 index 0000000..f463ba0 --- /dev/null +++ b/Avnas-7B-v1.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4c8becc0793b5cc029595cf6a0fcfdaea40d3bc8ef5176d9f94ef890c7146504 +size 5131410528 diff --git a/Avnas-7B-v1.i1-Q5_K_S.gguf b/Avnas-7B-v1.i1-Q5_K_S.gguf new file mode 100644 index 0000000..4ff5bc9 --- /dev/null +++ b/Avnas-7B-v1.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0d1115fa923c269696ad28d6fc2f90c5f254109ed750bbb027f28262c0f80bf7 +size 4997717088 diff --git a/Avnas-7B-v1.i1-Q6_K.gguf b/Avnas-7B-v1.i1-Q6_K.gguf new file mode 100644 index 0000000..4dd0495 --- /dev/null +++ b/Avnas-7B-v1.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dc4bd8b8f447fdb69d76a7078b582fa13283ec926f9ecc3ef49817b3077f997c +size 5942066272 diff --git a/Avnas-7B-v1.imatrix.gguf b/Avnas-7B-v1.imatrix.gguf new file mode 100644 index 0000000..9c6ff47 --- /dev/null +++ b/Avnas-7B-v1.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9e7a7cbc80dc9204aa0ea34becb5128c5ba35d2767d79896e677abc35bb9356 +size 5015200 diff --git a/README.md b/README.md new file mode 100644 index 0000000..8367912 --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: DarkArtsForge/Avnas-7B-v1 +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- finetune +- mistral +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/DarkArtsForge/Avnas-7B-v1 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Avnas-7B-v1-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Avnas-7B-v1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.3 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 3.3 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.9 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q4_0.gguf) | i1-Q4_0 | 4.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.2 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q4_1.gguf) | i1-Q4_1 | 4.7 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Avnas-7B-v1-i1-GGUF/resolve/main/Avnas-7B-v1.i1-Q6_K.gguf) | i1-Q6_K | 6.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +