commit bf60f9ab21e8e24b9a8cc3924a0a05904b4539ce Author: ModelHub XC Date: Tue Jun 2 14:09:18 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Hemlock-Coder-3B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ec64856 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Hemlock-Coder-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Hemlock-Coder-3B.i1-IQ1_M.gguf b/Hemlock-Coder-3B.i1-IQ1_M.gguf new file mode 100644 index 0000000..d35961c --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7cc837ebb7297af250f1ed5c719de6b6349fa020c474ed4ddfdd30fe1493731b +size 850028224 diff --git a/Hemlock-Coder-3B.i1-IQ1_S.gguf b/Hemlock-Coder-3B.i1-IQ1_S.gguf new file mode 100644 index 0000000..835ec94 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4df81ddaa65d458d0d84b5168a1dc0118645b3a203b0c6ef651d5c641571f5c5 +size 791094976 diff --git a/Hemlock-Coder-3B.i1-IQ2_M.gguf b/Hemlock-Coder-3B.i1-IQ2_M.gguf new file mode 100644 index 0000000..543b0fc --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:31f1daaa3c26e3fe56abd4a5ca262229c8ea73e9baa90084468e70b34241aacf +size 1140516544 diff --git a/Hemlock-Coder-3B.i1-IQ2_S.gguf b/Hemlock-Coder-3B.i1-IQ2_S.gguf new file mode 100644 index 0000000..f7790a1 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:50d5d596decac88da5bd7c671ef341dc2a90873d89057b1e9d3b6adb1c4ed490 +size 1061938880 diff --git a/Hemlock-Coder-3B.i1-IQ2_XS.gguf b/Hemlock-Coder-3B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..6b5e0a9 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4a42ae6d60cb53e065243c2df4f9bc4244f0701233af78224424a833521e9b3 +size 1031546560 diff --git a/Hemlock-Coder-3B.i1-IQ2_XXS.gguf b/Hemlock-Coder-3B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..728f867 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9ccf53f800156a38a34f4afad889fb4a6cd2ae1120827a4880a9483a8019134 +size 948250304 diff --git a/Hemlock-Coder-3B.i1-IQ3_M.gguf b/Hemlock-Coder-3B.i1-IQ3_M.gguf new file mode 100644 index 0000000..82bbf77 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5e986a51078804fbe6d70623ed394bf3d58ff340f58d51fb2fa0c1669d4a5ce4 +size 1488895680 diff --git a/Hemlock-Coder-3B.i1-IQ3_S.gguf b/Hemlock-Coder-3B.i1-IQ3_S.gguf new file mode 100644 index 0000000..1760343 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12d0eac6fe4357dbddc3976d941a04d6181c340778ebd42e32f64b1efa5c5fd8 +size 1456864960 diff --git a/Hemlock-Coder-3B.i1-IQ3_XS.gguf b/Hemlock-Coder-3B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..38b5e07 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:303b1c7ca6c0e053c7eed8c722f73f00184c228d51633f335eec362d70986dae +size 1391836864 diff --git a/Hemlock-Coder-3B.i1-IQ3_XXS.gguf b/Hemlock-Coder-3B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..e19e3e8 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e44e82405b3db516b307c95fd2dd61456879b105fa57093393877518bdf0e348 +size 1282827968 diff --git a/Hemlock-Coder-3B.i1-IQ4_NL.gguf b/Hemlock-Coder-3B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..39aedff --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ba3ffba0bf22981c71a4ecb1b0644e117a441812e585de7eed260718bdfddd3c +size 1825210048 diff --git a/Hemlock-Coder-3B.i1-IQ4_XS.gguf b/Hemlock-Coder-3B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..68ae684 --- /dev/null +++ b/Hemlock-Coder-3B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d590ec2f46d744097309c1407c4e807616d7672339c0c3cafd3a7c33a90c84a +size 1739095744 diff --git a/Hemlock-Coder-3B.i1-Q2_K.gguf b/Hemlock-Coder-3B.i1-Q2_K.gguf new file mode 100644 index 0000000..fb7fe00 --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:51fb55a8a2d5e6261aa99521472175ac72c9ae19d5afcecef1bf54a061694528 +size 1274756800 diff --git a/Hemlock-Coder-3B.i1-Q2_K_S.gguf b/Hemlock-Coder-3B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..0eef434 --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4370eb6ae8d55ce321a274617e088c1ee72587fd1b323a8d7e62fb14d30dba0f +size 1198128832 diff --git a/Hemlock-Coder-3B.i1-Q3_K_L.gguf b/Hemlock-Coder-3B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..779e91f --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2e01f588a13f877aca698d0ab802e5fa1501d6168d2e5b4a836b80d4f7dc0bd9 +size 1707392704 diff --git a/Hemlock-Coder-3B.i1-Q3_K_M.gguf b/Hemlock-Coder-3B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..44c7df7 --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:796ad232f714caa6547932f62b3f28874137e76783bc2bb458b234ce2174b4cf +size 1590476480 diff --git a/Hemlock-Coder-3B.i1-Q3_K_S.gguf b/Hemlock-Coder-3B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..1247428 --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:83065afbb43e645f2ae44bf9378fc87400fcbce82d4b1b27ba54034b5d273c85 +size 1454358208 diff --git a/Hemlock-Coder-3B.i1-Q4_0.gguf b/Hemlock-Coder-3B.i1-Q4_0.gguf new file mode 100644 index 0000000..bdb2ff5 --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:59cbcd97afacc5fcb2112ded0e752b7c6ef1c47dbd34a9bc9a71b926c0e805dc +size 1828486848 diff --git a/Hemlock-Coder-3B.i1-Q4_1.gguf b/Hemlock-Coder-3B.i1-Q4_1.gguf new file mode 100644 index 0000000..573c633 --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:41626f9582c15bc0766083f021501a94dadc79da5ace8951de006cc9be3a667e +size 1996259008 diff --git a/Hemlock-Coder-3B.i1-Q4_K_M.gguf b/Hemlock-Coder-3B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..e23092d --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee255186293be4338bdc3ca1ff1d0937269fa30cb3fa9dc7659eb218b01505fe +size 1929903808 diff --git a/Hemlock-Coder-3B.i1-Q4_K_S.gguf b/Hemlock-Coder-3B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..4d43e1b --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1b6f5bcbbea0c83a5c20e31dbf6562609c8832e3f41bc50d5f8af409da361edf +size 1834385088 diff --git a/Hemlock-Coder-3B.i1-Q5_K_M.gguf b/Hemlock-Coder-3B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..84c63cd --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a18fddd8779a78268d5e57cfae685b8ce533ee244ffc9ad5be511cc264f4597b +size 2224815808 diff --git a/Hemlock-Coder-3B.i1-Q5_K_S.gguf b/Hemlock-Coder-3B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..aec124e --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a9bee6a9304eda0369ca4a48a436fa4912b90d70f1df5e82f09571f2975396af +size 2169667264 diff --git a/Hemlock-Coder-3B.i1-Q6_K.gguf b/Hemlock-Coder-3B.i1-Q6_K.gguf new file mode 100644 index 0000000..d219e81 --- /dev/null +++ b/Hemlock-Coder-3B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:29cd565109b83c0f35405de4f846cd5f770b6de34ce37123f6a3adf47cfcfc42 +size 2538159808 diff --git a/Hemlock-Coder-3B.imatrix.gguf b/Hemlock-Coder-3B.imatrix.gguf new file mode 100644 index 0000000..b8e9c21 --- /dev/null +++ b/Hemlock-Coder-3B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af45378346bf3eb6b069f676a8e7eb6c38d3f33a144ffd556660ded6797f3be6 +size 3393408 diff --git a/README.md b/README.md new file mode 100644 index 0000000..8bdf75a --- /dev/null +++ b/README.md @@ -0,0 +1,90 @@ +--- +base_model: nbeerbower/Hemlock-Coder-3B +datasets: +- hemlang/Hemlock-SFT +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- merlina +- text-generation +- sft +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/nbeerbower/Hemlock-Coder-3B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Hemlock-Coder-3B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Hemlock-Coder-3B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Hemlock-Coder-3B-i1-GGUF/resolve/main/Hemlock-Coder-3B.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +