commit 48a1fb8b4f9c6ee24a7aa4ff737f6067a08da28d Author: ModelHub XC Date: Tue Jul 7 09:06:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..8f056af --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Aronnax-N9Bv2-1.0.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Aronnax-N9Bv2-1.0.i1-IQ1_M.gguf b/Aronnax-N9Bv2-1.0.i1-IQ1_M.gguf new file mode 100644 index 0000000..cf5e11f --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d900214dd24836c0c83505effe59c37df1e37626bbd0123b0921162977729a7d +size 4854942080 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ1_S.gguf b/Aronnax-N9Bv2-1.0.i1-IQ1_S.gguf new file mode 100644 index 0000000..3fa6e57 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:083d2af5fbd6a505fdc8c25ff86eee98f1d7e026f2628af204933e0968765878 +size 4825911680 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ2_M.gguf b/Aronnax-N9Bv2-1.0.i1-IQ2_M.gguf new file mode 100644 index 0000000..d42a02b --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4dfd6642f4843eef625138c9af5648b0f8f59af4a5e0b66ef65ceb761f3ee56d +size 4996510080 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ2_S.gguf b/Aronnax-N9Bv2-1.0.i1-IQ2_S.gguf new file mode 100644 index 0000000..4feb135 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d2318cbef91ce41489d87279109f5a23ac91e044455603f10a6e4ed8dec035be +size 4957802880 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ2_XS.gguf b/Aronnax-N9Bv2-1.0.i1-IQ2_XS.gguf new file mode 100644 index 0000000..cbfbda1 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4992b159af6588c4fd5a88581e33381834cd4deae20d128a9917d7a14fecd735 +size 4944900480 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ2_XXS.gguf b/Aronnax-N9Bv2-1.0.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..06a217d --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:41ed5755008d97dc83f49cca4ea37a83cbc0716c53368a462db446a74b0fb5ff +size 4903326080 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ3_M.gguf b/Aronnax-N9Bv2-1.0.i1-IQ3_M.gguf new file mode 100644 index 0000000..aba7798 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:351e948c77bd1f58e794c39e1dd124864009e5cacbfe29e1bcbf30b647069ab8 +size 5207930240 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ3_S.gguf b/Aronnax-N9Bv2-1.0.i1-IQ3_S.gguf new file mode 100644 index 0000000..8998622 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3af7ce96a415673c90f2831afe9257a22e754a796598a98220988a3a5c5dccd8 +size 5131985280 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ3_XS.gguf b/Aronnax-N9Bv2-1.0.i1-IQ3_XS.gguf new file mode 100644 index 0000000..5a9c5cc --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:82ce8e119db4bce93a6ba52ffe7f52c0d1315db2b6e61870dd262ce32be36e20 +size 5131985280 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ3_XXS.gguf b/Aronnax-N9Bv2-1.0.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..ecefdc5 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2a4c4b9593b74e00d110519f1e581d5eb417fa9372d6472fa9b74491d56cd24e +size 5073924480 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ4_NL.gguf b/Aronnax-N9Bv2-1.0.i1-IQ4_NL.gguf new file mode 100644 index 0000000..af8add7 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02eb2e91310d2164cb4f4a908113cf2f720774200c6ab9586b2dd63d0d1da38f +size 5308676480 diff --git a/Aronnax-N9Bv2-1.0.i1-IQ4_XS.gguf b/Aronnax-N9Bv2-1.0.i1-IQ4_XS.gguf new file mode 100644 index 0000000..c5e93a3 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af1631b71f70fb6f31e0dc258c46627861c26ef05a8f896ce8f224b363e2ca9c +size 5267102080 diff --git a/Aronnax-N9Bv2-1.0.i1-Q2_K.gguf b/Aronnax-N9Bv2-1.0.i1-Q2_K.gguf new file mode 100644 index 0000000..3e47921 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b38b0369be68ccea6375dd5725c47d66ecaab0b23c22fa25bce25ccabb53d92b +size 5006186880 diff --git a/Aronnax-N9Bv2-1.0.i1-Q2_K_S.gguf b/Aronnax-N9Bv2-1.0.i1-Q2_K_S.gguf new file mode 100644 index 0000000..a41744c --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e764e7e7dbd5390701a91a18e235ca96f4312fd6cba049fc38c30569b20670ce +size 5058334080 diff --git a/Aronnax-N9Bv2-1.0.i1-Q3_K_L.gguf b/Aronnax-N9Bv2-1.0.i1-Q3_K_L.gguf new file mode 100644 index 0000000..1c63733 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:30645c970183ab46530f4713a59b928cb251b58e523075f563101f117bff4477 +size 5488360320 diff --git a/Aronnax-N9Bv2-1.0.i1-Q3_K_M.gguf b/Aronnax-N9Bv2-1.0.i1-Q3_K_M.gguf new file mode 100644 index 0000000..c7b5843 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:be1a6edac7f91ccf89564aa7c539da5e656ae0382c6086c81e3b5ccd6caf7967 +size 5379729280 diff --git a/Aronnax-N9Bv2-1.0.i1-Q3_K_S.gguf b/Aronnax-N9Bv2-1.0.i1-Q3_K_S.gguf new file mode 100644 index 0000000..5998aa3 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:444a478d6a48edb2a6b3c9b88824ace51256ebd3f3c4272b76b5a6f0ca3b11d0 +size 5131985280 diff --git a/Aronnax-N9Bv2-1.0.i1-Q4_0.gguf b/Aronnax-N9Bv2-1.0.i1-Q4_0.gguf new file mode 100644 index 0000000..e58b5bb --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b8def0dffc79803d98822b01fb842bd91a573889b68dd9dbdb1ea4d327da2ea +size 5339409280 diff --git a/Aronnax-N9Bv2-1.0.i1-Q4_1.gguf b/Aronnax-N9Bv2-1.0.i1-Q4_1.gguf new file mode 100644 index 0000000..f016d5e --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bbecd347bfd8213223513ed00be756890003a181846d501c9c8c106fd7b59217 +size 5827352960 diff --git a/Aronnax-N9Bv2-1.0.i1-Q4_K_M.gguf b/Aronnax-N9Bv2-1.0.i1-Q4_K_M.gguf new file mode 100644 index 0000000..222b8b5 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ff7cd6672780cbae26fafadc61233fbb6d5aee4e3ab269081d7f994a715ac06b +size 6525623680 diff --git a/Aronnax-N9Bv2-1.0.i1-Q4_K_S.gguf b/Aronnax-N9Bv2-1.0.i1-Q4_K_S.gguf new file mode 100644 index 0000000..5448389 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ed0d0e80405598f5c3274ee4aa2dcb43350d06f3810e4c364c551c4307fa9ce +size 6211611520 diff --git a/Aronnax-N9Bv2-1.0.i1-Q5_K_M.gguf b/Aronnax-N9Bv2-1.0.i1-Q5_K_M.gguf new file mode 100644 index 0000000..874bf33 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c350a28ff079d83cdd6af4ffc9624cc11656662da0b3066c23088c16a9ef9f4f +size 7069800320 diff --git a/Aronnax-N9Bv2-1.0.i1-Q5_K_S.gguf b/Aronnax-N9Bv2-1.0.i1-Q5_K_S.gguf new file mode 100644 index 0000000..db8a7ba --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d508a52224ea3e1c6488d3fb1791f96af0107d2e34f51288b24890c1440de33a +size 6781557120 diff --git a/Aronnax-N9Bv2-1.0.i1-Q6_K.gguf b/Aronnax-N9Bv2-1.0.i1-Q6_K.gguf new file mode 100644 index 0000000..aeab7b0 --- /dev/null +++ b/Aronnax-N9Bv2-1.0.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f3bfce72f5e5d4fc9258c6ed19e65cc385548f6a8a7b9bb8f9d459a95bfd0fce +size 9135886720 diff --git a/Aronnax-N9Bv2-1.0.imatrix.gguf b/Aronnax-N9Bv2-1.0.imatrix.gguf new file mode 100644 index 0000000..8f4c47f --- /dev/null +++ b/Aronnax-N9Bv2-1.0.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2f121d346bafce1847f140fa0acfcec65b87488a74a4d1baf4f6818db3e41c96 +size 3921216 diff --git a/README.md b/README.md new file mode 100644 index 0000000..2232fd1 --- /dev/null +++ b/README.md @@ -0,0 +1,93 @@ +--- +base_model: Mitchins/Aronnax-N9Bv2-1.0 +language: +- en +library_name: transformers +license: apache-2.0 +model_name: Aronnax-N9Bv2-1.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- text-generation +- literary +- prose +- creative-writing +- narrative +- nemotron +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Mitchins/Aronnax-N9Bv2-1.0 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Aronnax-N9Bv2-1.0-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ1_S.gguf) | i1-IQ1_S | 4.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ1_M.gguf) | i1-IQ1_M | 5.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 5.0 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ2_XS.gguf) | i1-IQ2_XS | 5.0 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ2_M.gguf) | i1-IQ2_M | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q2_K.gguf) | i1-Q2_K | 5.1 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.2 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ3_S.gguf) | i1-IQ3_S | 5.2 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.2 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ3_M.gguf) | i1-IQ3_M | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.4 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-IQ4_NL.gguf) | i1-IQ4_NL | 5.4 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q4_0.gguf) | i1-Q4_0 | 5.4 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q3_K_M.gguf) | i1-Q3_K_M | 5.5 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q4_1.gguf) | i1-Q4_1 | 5.9 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q4_K_S.gguf) | i1-Q4_K_S | 6.3 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q4_K_M.gguf) | i1-Q4_K_M | 6.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.9 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q5_K_M.gguf) | i1-Q5_K_M | 7.2 | | +| [GGUF](https://huggingface.co/mradermacher/Aronnax-N9Bv2-1.0-i1-GGUF/resolve/main/Aronnax-N9Bv2-1.0.i1-Q6_K.gguf) | i1-Q6_K | 9.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +