commit 5ab6c39a6b87141b62f5ef5d9c2faed1fd64ebd0 Author: ModelHub XC Date: Thu May 14 12:45:41 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/HY-MT1.5-1.8B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b2a3844 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HY-MT1.5-1.8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/HY-MT1.5-1.8B.i1-IQ1_M.gguf b/HY-MT1.5-1.8B.i1-IQ1_M.gguf new file mode 100644 index 0000000..d9fc07c --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ce6e7a19a061f2f819053cd7568bacea510313a22d9ac6707faf3173cb88820f +size 535692000 diff --git a/HY-MT1.5-1.8B.i1-IQ1_S.gguf b/HY-MT1.5-1.8B.i1-IQ1_S.gguf new file mode 100644 index 0000000..72a9b8e --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3c74abb7f4cd0c75dbed542c9ad7300b897fa8998f70ebe1c5dee54322a2055f +size 504627936 diff --git a/HY-MT1.5-1.8B.i1-IQ2_M.gguf b/HY-MT1.5-1.8B.i1-IQ2_M.gguf new file mode 100644 index 0000000..f1b0e0b --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:49506eb0c6591afaaaa885f664e216c3c582016a3f692e02e7ce2c8bc17d0311 +size 698483424 diff --git a/HY-MT1.5-1.8B.i1-IQ2_S.gguf b/HY-MT1.5-1.8B.i1-IQ2_S.gguf new file mode 100644 index 0000000..87ac67f --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6a841cfac02ee5b4fa2d1dbbe8be7d01b4038d4d426401eecf61aa1a701815e +size 657064672 diff --git a/HY-MT1.5-1.8B.i1-IQ2_XS.gguf b/HY-MT1.5-1.8B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..ca52358 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f4687482e6390e68b7d4d59b9d71ab9ab1e405ed80d7c7cd0fea265e4945931 +size 633078496 diff --git a/HY-MT1.5-1.8B.i1-IQ2_XXS.gguf b/HY-MT1.5-1.8B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..bd4936f --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1560bcfa393044fd600f7de55d98a0ab8b606ca660e2ec2e52e5f9135294833 +size 587465440 diff --git a/HY-MT1.5-1.8B.i1-IQ3_M.gguf b/HY-MT1.5-1.8B.i1-IQ3_M.gguf new file mode 100644 index 0000000..eb06112 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3996292b0224d1dc2d94e50611028f5cb9eaf14fc2bdd0cd68956e41a296a7b4 +size 900822016 diff --git a/HY-MT1.5-1.8B.i1-IQ3_S.gguf b/HY-MT1.5-1.8B.i1-IQ3_S.gguf new file mode 100644 index 0000000..5caba71 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:569fcf524ce71eed5fb67fd1d7c641c8d723fd4bd86e49531bba9b54779d7cb5 +size 876311552 diff --git a/HY-MT1.5-1.8B.i1-IQ3_XS.gguf b/HY-MT1.5-1.8B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..43b546d --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f3365b6a7fcce616635acbe859031a964908e8b405a51c581cb3e28da7e7a6f6 +size 840135680 diff --git a/HY-MT1.5-1.8B.i1-IQ3_XXS.gguf b/HY-MT1.5-1.8B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..8bcd1a4 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:880064b5e205f52ba53b28e3a5f8163687ac59baed21c192670f293afc50af63 +size 768475872 diff --git a/HY-MT1.5-1.8B.i1-IQ4_NL.gguf b/HY-MT1.5-1.8B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..fd1a144 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:699c7ad67b2b23f2bc276c93917fe33e9492c6b85b8b3125f4e89fd404477ee4 +size 1081046016 diff --git a/HY-MT1.5-1.8B.i1-IQ4_XS.gguf b/HY-MT1.5-1.8B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..aaa7e8b --- /dev/null +++ b/HY-MT1.5-1.8B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:872b7569af941168ec2c5ee8969a5cad33c5f7ed2e0cde7e8286942b2e6159db +size 1033860096 diff --git a/HY-MT1.5-1.8B.i1-Q2_K.gguf b/HY-MT1.5-1.8B.i1-Q2_K.gguf new file mode 100644 index 0000000..888f270 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75476d645df26e8986d1c61d345085eb9d589a6c36bfdac379a71ed2355656ff +size 777483264 diff --git a/HY-MT1.5-1.8B.i1-Q2_K_S.gguf b/HY-MT1.5-1.8B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..aa21129 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d5649638b6286f8522a6d677f0a310bbc1b8fbb0ed06584c3e6bca548372f3c +size 734753792 diff --git a/HY-MT1.5-1.8B.i1-Q3_K_L.gguf b/HY-MT1.5-1.8B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..9f58e1b --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24356d9a65ded5a2ebabfb4f8de328bbc70a20816c972cd76e835fa4d37a0168 +size 1018917888 diff --git a/HY-MT1.5-1.8B.i1-Q3_K_M.gguf b/HY-MT1.5-1.8B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..43e881f --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89722f7647beaf6a2d2ae6af3aac92f12bccb1d26ec293d5445d99191ba8803d +size 951022592 diff --git a/HY-MT1.5-1.8B.i1-Q3_K_S.gguf b/HY-MT1.5-1.8B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..1d9eba1 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c5d29ea8855f8935f5e91ba5271a530f9ca463f6fc62e38499c371d6aabae631 +size 871855104 diff --git a/HY-MT1.5-1.8B.i1-Q4_0.gguf b/HY-MT1.5-1.8B.i1-Q4_0.gguf new file mode 100644 index 0000000..16b97a2 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:343f073e5a1ea4941a49d8be46af116222d3315ec96202363cede100364dd5d0 +size 1079997440 diff --git a/HY-MT1.5-1.8B.i1-Q4_1.gguf b/HY-MT1.5-1.8B.i1-Q4_1.gguf new file mode 100644 index 0000000..835147c --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40016a3fdb857325dba6efc89dc25c3d2d7c077557e290158f68207ab8c07530 +size 1173320704 diff --git a/HY-MT1.5-1.8B.i1-Q4_K_M.gguf b/HY-MT1.5-1.8B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..df60469 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c823ee3b57f49d3d3efdf749ffa4296b748263e98479282e55cb655617e75c8 +size 1133081600 diff --git a/HY-MT1.5-1.8B.i1-Q4_K_S.gguf b/HY-MT1.5-1.8B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..2736d0a --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e3331325282a1a47672b3310f5f16a4284b64775c5da56715b6051a22528e833 +size 1083667456 diff --git a/HY-MT1.5-1.8B.i1-Q5_K_M.gguf b/HY-MT1.5-1.8B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..9688186 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aeb8fe3973b8793fe838260fcf2d43829555e2aeeba8cfc9ef6cb7a9f1057ccb +size 1298756608 diff --git a/HY-MT1.5-1.8B.i1-Q5_K_S.gguf b/HY-MT1.5-1.8B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..200ed45 --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a9c1e4c3d2a5cf51f1c2f77a8c9518c8b6e9dcd4a3f26aff6c7b2cf672f3a803 +size 1269789696 diff --git a/HY-MT1.5-1.8B.i1-Q6_K.gguf b/HY-MT1.5-1.8B.i1-Q6_K.gguf new file mode 100644 index 0000000..1a0093b --- /dev/null +++ b/HY-MT1.5-1.8B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5b8307a031203c41a73b2a6b4d8d32b058f41302699683361f0596e8aa9e784f +size 1474786304 diff --git a/HY-MT1.5-1.8B.imatrix.gguf b/HY-MT1.5-1.8B.imatrix.gguf new file mode 100644 index 0000000..29967c6 --- /dev/null +++ b/HY-MT1.5-1.8B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f8d7548e6f74c77db1c2fa679eb98747c447ca21384ed3b56a506c43fcb06fe4 +size 2393760 diff --git a/README.md b/README.md new file mode 100644 index 0000000..eebb5d9 --- /dev/null +++ b/README.md @@ -0,0 +1,121 @@ +--- +base_model: tencent/HY-MT1.5-1.8B +language: +- zh +- en +- fr +- pt +- es +- ja +- tr +- ru +- ar +- ko +- th +- it +- de +- vi +- ms +- id +- tl +- hi +- pl +- cs +- nl +- km +- my +- fa +- gu +- ur +- te +- mr +- he +- bn +- ta +- uk +- bo +- kk +- mn +- ug +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- translation +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/tencent/HY-MT1.5-1.8B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#HY-MT1.5-1.8B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/HY-MT1.5-1.8B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/HY-MT1.5-1.8B-i1-GGUF/resolve/main/HY-MT1.5-1.8B.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +