commit d872242aa1636dab4943f6d787c0d6a5d12738d4 Author: ModelHub XC Date: Fri May 15 23:07:51 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Heretic-Crckhead-270m-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ed8c7e0 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Heretic-Crckhead-270m.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Heretic-Crckhead-270m.i1-IQ1_M.gguf b/Heretic-Crckhead-270m.i1-IQ1_M.gguf new file mode 100644 index 0000000..d99f869 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ceffcd5baacef3f34ca56d1109a5a63d042100f7492b50d4a2dd6f14e0f56620 +size 230363072 diff --git a/Heretic-Crckhead-270m.i1-IQ1_S.gguf b/Heretic-Crckhead-270m.i1-IQ1_S.gguf new file mode 100644 index 0000000..127c604 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40f4c05c93382715b325319ef2401811b1ec4ef23a9391e77e81529c732d46df +size 229871552 diff --git a/Heretic-Crckhead-270m.i1-IQ2_M.gguf b/Heretic-Crckhead-270m.i1-IQ2_M.gguf new file mode 100644 index 0000000..5339518 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:410ae383920985d42abea963e7c64a64f3f218eff16ed6b1a671e74b70432379 +size 234786752 diff --git a/Heretic-Crckhead-270m.i1-IQ2_S.gguf b/Heretic-Crckhead-270m.i1-IQ2_S.gguf new file mode 100644 index 0000000..d99ad8d --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ccb68fe0a8165ab77d4cfe669e7f76bb2866fc347099466c3b9b4a764ce3a368 +size 234131392 diff --git a/Heretic-Crckhead-270m.i1-IQ2_XS.gguf b/Heretic-Crckhead-270m.i1-IQ2_XS.gguf new file mode 100644 index 0000000..771e951 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:99741df22d9f7e7bc0649ce47de527f04c098f317285c7abde17b4de4ed10839 +size 232206272 diff --git a/Heretic-Crckhead-270m.i1-IQ2_XXS.gguf b/Heretic-Crckhead-270m.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..7e647f9 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b54ddefbfcc9831bcf42030882b0876671c09ef74dd1e3d3b1b2a6e48abd0af9 +size 231182272 diff --git a/Heretic-Crckhead-270m.i1-IQ3_M.gguf b/Heretic-Crckhead-270m.i1-IQ3_M.gguf new file mode 100644 index 0000000..44e32d6 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8b2d41038bae28f7c776529f8fc2e60bc1db6e06104dd7197dc9d39fb2707c9d +size 238995392 diff --git a/Heretic-Crckhead-270m.i1-IQ3_S.gguf b/Heretic-Crckhead-270m.i1-IQ3_S.gguf new file mode 100644 index 0000000..8f2ce2a --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fce2f08512d05daed876479b3251fa7d454c9d8a8fd09b998548ef9bd7bfb94c +size 237080512 diff --git a/Heretic-Crckhead-270m.i1-IQ3_XS.gguf b/Heretic-Crckhead-270m.i1-IQ3_XS.gguf new file mode 100644 index 0000000..756fe48 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:54b5f6774e3eccc91926a56fe0175ec255dcedb33cd1c9b47612edc7ccfb10a3 +size 237080512 diff --git a/Heretic-Crckhead-270m.i1-IQ3_XXS.gguf b/Heretic-Crckhead-270m.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..87931ca --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75a55435778dd5e7e6f9ba0a2cdeb962eeb3b8e187a0f3b020fb505d6234580b +size 235974592 diff --git a/Heretic-Crckhead-270m.i1-IQ4_NL.gguf b/Heretic-Crckhead-270m.i1-IQ4_NL.gguf new file mode 100644 index 0000000..9990cb0 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:51a78c3e958b60b27543eac5abe13ffa944f5b8d3cbf0366a29d5a7b7fdc256a +size 241964992 diff --git a/Heretic-Crckhead-270m.i1-IQ4_XS.gguf b/Heretic-Crckhead-270m.i1-IQ4_XS.gguf new file mode 100644 index 0000000..a34a7e8 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:02c8fde69d9dc0e7026d22a50a2ec96197b0c8e31604b058cd417d2935004ddd +size 240859072 diff --git a/Heretic-Crckhead-270m.i1-Q2_K.gguf b/Heretic-Crckhead-270m.i1-Q2_K.gguf new file mode 100644 index 0000000..6fa0bc7 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4d732d002059a6888e8243c5f8545051d15dcf13c321ffaad898037054c0d6ed +size 237080512 diff --git a/Heretic-Crckhead-270m.i1-Q2_K_S.gguf b/Heretic-Crckhead-270m.i1-Q2_K_S.gguf new file mode 100644 index 0000000..e66a8b2 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0fcbf5b75b97523f529a77d6fbb3c1474a7eda34c68c3f662452964a00767eff +size 234100672 diff --git a/Heretic-Crckhead-270m.i1-Q3_K_L.gguf b/Heretic-Crckhead-270m.i1-Q3_K_L.gguf new file mode 100644 index 0000000..77115af --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2abc3b720cec239bfdb29eb615ce6cc17c4528b01af55146ed518d496171bbe +size 246388672 diff --git a/Heretic-Crckhead-270m.i1-Q3_K_M.gguf b/Heretic-Crckhead-270m.i1-Q3_K_M.gguf new file mode 100644 index 0000000..71c652e --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5c4944770df6dd7f8ce9d62f699eb7569f10378dcf9f31a2c819b3506f3d2c4e +size 241964992 diff --git a/Heretic-Crckhead-270m.i1-Q3_K_S.gguf b/Heretic-Crckhead-270m.i1-Q3_K_S.gguf new file mode 100644 index 0000000..72f3d6e --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7837340a76bdb40e3797586c56e14fde3bb9539ec8847cf89b7e25a5d7a978a +size 236711872 diff --git a/Heretic-Crckhead-270m.i1-Q4_0.gguf b/Heretic-Crckhead-270m.i1-Q4_0.gguf new file mode 100644 index 0000000..650352d --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ffcb8a96be1e09c9e19197d3f8c0e0679290f57dfd8308234965bcfd0b574f2 +size 241575872 diff --git a/Heretic-Crckhead-270m.i1-Q4_1.gguf b/Heretic-Crckhead-270m.i1-Q4_1.gguf new file mode 100644 index 0000000..1631ea7 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7df70bf2d105646ee051f763aac749d7fbbaf09d620ad23542ccb18a7dcbbd83 +size 247678912 diff --git a/Heretic-Crckhead-270m.i1-Q4_K_M.gguf b/Heretic-Crckhead-270m.i1-Q4_K_M.gguf new file mode 100644 index 0000000..3c09b00 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:20c0466d7389c0b07796e059de61fa664a1489065708e63a72b1739790c5ecd1 +size 253116352 diff --git a/Heretic-Crckhead-270m.i1-Q4_K_S.gguf b/Heretic-Crckhead-270m.i1-Q4_K_S.gguf new file mode 100644 index 0000000..feb8187 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:999e54b03ac2c253d428368ff7b943debeab14dc40f3602ac3164b899cb9cfa0 +size 249890752 diff --git a/Heretic-Crckhead-270m.i1-Q5_K_M.gguf b/Heretic-Crckhead-270m.i1-Q5_K_M.gguf new file mode 100644 index 0000000..89d8310 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0605201306f9629a9a9026ffe77ff2136da048276a5dc29db3da4e07430f0a48 +size 260028352 diff --git a/Heretic-Crckhead-270m.i1-Q5_K_S.gguf b/Heretic-Crckhead-270m.i1-Q5_K_S.gguf new file mode 100644 index 0000000..b66be7d --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:caf36dda27a562f4213e9819343ee09d0c79c03b0b648818740d7e378d5351c5 +size 258000832 diff --git a/Heretic-Crckhead-270m.i1-Q6_K.gguf b/Heretic-Crckhead-270m.i1-Q6_K.gguf new file mode 100644 index 0000000..62b1b86 --- /dev/null +++ b/Heretic-Crckhead-270m.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8c1069f1e7c970306fca39cb533ed03690e8afc444108597e129a5bec8ef3385 +size 282976192 diff --git a/Heretic-Crckhead-270m.imatrix.gguf b/Heretic-Crckhead-270m.imatrix.gguf new file mode 100644 index 0000000..d8d995b --- /dev/null +++ b/Heretic-Crckhead-270m.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd9fbea690e35e79555c766c1a14deb5bd577c1a0a8b13aa37570b998a32a62f +size 471008 diff --git a/README.md b/README.md new file mode 100644 index 0000000..ecc4e06 --- /dev/null +++ b/README.md @@ -0,0 +1,86 @@ +--- +base_model: hereticness/Heretic-Crckhead-270m +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- heretic +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/hereticness/Heretic-Crckhead-270m + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Heretic-Crckhead-270m-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Heretic-Crckhead-270m-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.3 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ2_S.gguf) | i1-IQ2_S | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ2_M.gguf) | i1-IQ2_M | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.3 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.3 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ3_S.gguf) | i1-IQ3_S | 0.3 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q2_K.gguf) | i1-Q2_K | 0.3 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ3_M.gguf) | i1-IQ3_M | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q4_0.gguf) | i1-Q4_0 | 0.3 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.3 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.3 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.3 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q4_1.gguf) | i1-Q4_1 | 0.3 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.3 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.4 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.4 | | +| [GGUF](https://huggingface.co/mradermacher/Heretic-Crckhead-270m-i1-GGUF/resolve/main/Heretic-Crckhead-270m.i1-Q6_K.gguf) | i1-Q6_K | 0.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +