commit db8028473c343afddce0f9cb9ba5ccb25aed0373 Author: ModelHub XC Date: Sun May 17 03:07:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..a83d8a6 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Leviathan_NSFW_Agresivo-3.2-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_M.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_M.gguf new file mode 100644 index 0000000..c2ed989 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f3cd9fb94cf33ea164ccf0230ba59a2dc76f89898e7b27789a05d130895527ff +size 413604544 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_S.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_S.gguf new file mode 100644 index 0000000..9fc815b --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:30337a784218d61c80fd8ec5a37386ea1740f6d923b102d84538d58ec44a3fa2 +size 393550528 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_M.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_M.gguf new file mode 100644 index 0000000..8b02273 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af5355abdfbb0059a03086fcd0898ab19212505110cf4025b0ac925ad366f8bf +size 515447488 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_S.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_S.gguf new file mode 100644 index 0000000..cae2ec6 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a6942a297d7dfdf8ab591bf9babc0637faee14f353af71e4905454ec7592fcbe +size 488708800 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XS.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..34a4834 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ae17de01a5fa256d01fe26c28f29fca522c2b530e053ab4bd799eeec231de60b +size 475863744 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XXS.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..7e403ee --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4dc8729901364c0eb52599c56a0a483d61dfaad4f8210147e69b8c7754ea234 +size 447027904 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_M.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_M.gguf new file mode 100644 index 0000000..6d819ad --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:866dd901ecafa3542a6134ca1bf274e03466997e7731412f34ad32b22da3359c +size 657287872 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_S.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_S.gguf new file mode 100644 index 0000000..9f66df9 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:79b5edf8cc207f4673025ed6d9c3fca2405a5e85aa1e0e54accfe2e7dc609ce4 +size 643918528 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XS.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..517bcc9 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5bb8e045dfa1e759d52179884c9ccaf2c7e48a3fff32f8872f7d11db4704775f +size 621112000 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XXS.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..54b975b --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:db03dc26c0cfd26a2831ab96131f2954ad0d4caddf7b3c81f8aa73cbacc719ff +size 562109120 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_NL.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..8e97296 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a35f0437d0b0ea5985dba49268cd76058655d98e59621105d2a882cf60fa0c75 +size 773024448 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_XS.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..20cfaed --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5e59a765f2153720d35528c202a52b1d896a9620f1612e74716867d42cfebfe2 +size 743140032 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K.gguf new file mode 100644 index 0000000..ffeaa25 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2eecd4503c076a4721021ca04507fed0623866cce5dcf554ec342c92b7a98b87 +size 580872896 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K_S.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..0e67828 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:52d9104a2ef15a6f86e69ab144f45082908c47d0440447f82b462df153bd0131 +size 554658496 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_L.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..a04e90d --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7e1f1038fe7500145dee496422a46ef31773e8d28512224443d21f10598733e1 +size 732523200 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_M.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..f2d36c4 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:85d1b6029a3ddbce369d5da1718b5b619b6b26e26c47c4ca49f379b7cb136dcd +size 690842304 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_S.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..5096c19 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:50aecb882038d86f5e8ffd4a75f176e0ef0481469f0f53c9f9c10169d8b62f71 +size 641690304 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_0.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_0.gguf new file mode 100644 index 0000000..9616718 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d18abd5d8974ba017c401e2836700ea4c4686345bae45b8e1e224cc90d349001 +size 773024448 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_1.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_1.gguf new file mode 100644 index 0000000..ae9f296 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c24b70978adfe90d2d47a106a41a38c9e0b96bcb2699c4e96e5e47f64464a036 +size 831744704 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_M.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..2ff4677 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dff87f8613f8b95e3a93d1c8deee35915cb3a367862f430b43646e0e51becede +size 807692992 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_S.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..781e961 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a76d40c309a26484097ff9ff35cf80c97c4f9f46a2df0be2b8ce6c46798d02d1 +size 775645888 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_M.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..9cda80f --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d0e886d900b6784a7436e435ee40f765184ec486f837bc451aa581d09bd26e8c +size 911502016 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_S.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..eb00990 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d83a6597b82194c06839da3d7ca032e823c42ea2794a039ee49499932a71f750 +size 892562112 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q6_K.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q6_K.gguf new file mode 100644 index 0000000..d0e2153 --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1d73518b628088ef0e8e143967fa38a14c4ef3dbb7b4f11c4994cbcd180e72d6 +size 1021799104 diff --git a/Leviathan_NSFW_Agresivo-3.2-1B.imatrix.gguf b/Leviathan_NSFW_Agresivo-3.2-1B.imatrix.gguf new file mode 100644 index 0000000..646492b --- /dev/null +++ b/Leviathan_NSFW_Agresivo-3.2-1B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04558d323ebe7ef24e46f275c940704a998ed85d3da899866f81e991c604ddb8 +size 1328000 diff --git a/README.md b/README.md new file mode 100644 index 0000000..0a8377f --- /dev/null +++ b/README.md @@ -0,0 +1,90 @@ +--- +base_model: Novaciano/Leviathan_NSFW_Agresivo-3.2-1B +language: +- en +- es +library_name: transformers +license: llama3.2 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- mergekit +- merge +- not-for-all-audiences +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Novaciano/Leviathan_NSFW_Agresivo-3.2-1B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.5 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.7 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.7 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.8 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Leviathan_NSFW_Agresivo-3.2-1B-i1-GGUF/resolve/main/Leviathan_NSFW_Agresivo-3.2-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +