commit 3d986ee41d58fd9bc2156d7875edf58da2ffe66f Author: ModelHub XC Date: Sat May 9 02:29:55 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..0e477fd --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +EZO-gemma-2-2b-jpn-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ1_M.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ1_M.gguf new file mode 100644 index 0000000..19d9985 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:173e679982579d883606958afe857ea0dfb7f482846537407c8ccf82bfa552da +size 873798208 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ1_S.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ1_S.gguf new file mode 100644 index 0000000..235dc8d --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4fa44e62e6099d351af534fd0f523c677cdb17fc2e193cf2efe1d36d48c7ad7b +size 832160320 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ2_M.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ2_M.gguf new file mode 100644 index 0000000..962c617 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e9b76f9a5b29cd72d14be0e0e94a07a34a1a7a9df59df59226eaba08dc97edaa +size 1088014912 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ2_S.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ2_S.gguf new file mode 100644 index 0000000..53b88d2 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61bdfef6f70c612dcced735bdd80124adad9c7021e33a15a6fce322d4f584f9c +size 1032497728 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ2_XS.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ2_XS.gguf new file mode 100644 index 0000000..7c63091 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:39da16e3be99a7b31591b94a1457d2813f5542a5868d39e1f4f6c7e54cc24ce2 +size 1002545728 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..40ff208 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:18878a5ca381156df765e861d1cd726ac758971422f7a29788f7c8f23133f79f +size 943194688 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ3_M.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ3_M.gguf new file mode 100644 index 0000000..77b3c90 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2986e5d32fe26bd040b30d0717e5a2e5597de0a1617ad1128f0800a60a78f1e7 +size 1393562176 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ3_S.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ3_S.gguf new file mode 100644 index 0000000..ba38e84 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cf43d9ae7d6008c879545675e2a63169f9986b0503c9d873f96627384387fa53 +size 1360661056 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ3_XS.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ3_XS.gguf new file mode 100644 index 0000000..458c267 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c42926419dd340cf506957fbe3c07ff1e15fe0ebe15eb7b6c91d8c97846df3b +size 1314212416 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..543a279 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e0e239dea22a14bd4ca5e187d2baf4bb07159986776d265b5153016fd1de1807 +size 1181686336 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ4_NL.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ4_NL.gguf new file mode 100644 index 0000000..b9e993e --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:357154d33b31ab639eb0cfd558501f37057e4c33a13effa232b52d4fc80decc1 +size 1629510208 diff --git a/EZO-gemma-2-2b-jpn-it.i1-IQ4_XS.gguf b/EZO-gemma-2-2b-jpn-it.i1-IQ4_XS.gguf new file mode 100644 index 0000000..393ab73 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4f9a7ee4aaa1af6679116a325c48dbb896f5753ea00656fadc5739a809513849 +size 1566251584 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q2_K.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q2_K.gguf new file mode 100644 index 0000000..56c5057 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8dc5634646d6982ca50112e6a99c57da5636a6d68b75111fb25d8e9b04cb2a42 +size 1229830720 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q2_K_S.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q2_K_S.gguf new file mode 100644 index 0000000..393b7a6 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:59e4781ca69610996f7a453de48638db0bd0c8e75e4070874144dcd7b689bb34 +size 1170000448 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q3_K_L.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q3_K_L.gguf new file mode 100644 index 0000000..fde2367 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a3e83d3fd64561c5b7c02435d7d2bc2b7b2c07bd2efdb4440750d765945c0204 +size 1550436928 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q3_K_M.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q3_K_M.gguf new file mode 100644 index 0000000..ef1e7e5 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1161be8aeb558bc3d7687288af4863999c4b8ce86c61833c818bad52cbbf33ea +size 1461668416 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q3_K_S.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q3_K_S.gguf new file mode 100644 index 0000000..c909991 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7e65566121daeae289f92ed1720c3d8adc14151cba79f1620f357448bc47bb8 +size 1360661056 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q4_0.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q4_0.gguf new file mode 100644 index 0000000..7bed64f --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1518e82f8114142d60d74fc1591b52ac2a9da1360a497dae968a4fb2fbc64e3f +size 1633491520 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q4_1.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q4_1.gguf new file mode 100644 index 0000000..abfb239 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:39bd94860fb306209c8e9d5b48e0fb365f97243d43f526e596030aebd133d3c7 +size 1756027456 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q4_K_M.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q4_K_M.gguf new file mode 100644 index 0000000..3ec31b1 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d3e47f3224efce2853419c6387742d6141c964a4510312654efa67a4a5e2db27 +size 1708583488 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q4_K_S.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q4_K_S.gguf new file mode 100644 index 0000000..887618a --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9198d5c58842fdcc3a7e216a743056606d45d9a97cdf8ce666e504eb45b63975 +size 1638652480 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q5_K_M.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q5_K_M.gguf new file mode 100644 index 0000000..189bc1d --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5d556af52f1327eb6b2b4c9a06117f9439f0fd5cfd7dfde4413c433743470ebb +size 1923279424 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q5_K_S.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q5_K_S.gguf new file mode 100644 index 0000000..98f0688 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d87835e6cacd54b7c48bdff99e49a6d31461594d2aa6e70fedd7794a5da39468 +size 1882544704 diff --git a/EZO-gemma-2-2b-jpn-it.i1-Q6_K.gguf b/EZO-gemma-2-2b-jpn-it.i1-Q6_K.gguf new file mode 100644 index 0000000..ec7c149 --- /dev/null +++ b/EZO-gemma-2-2b-jpn-it.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3c9e92caf87263e7bd0065f6180932c6d0d3d0a2ab6e2f36ebcbdced9126e595 +size 2151393856 diff --git a/README.md b/README.md new file mode 100644 index 0000000..fb74ec3 --- /dev/null +++ b/README.md @@ -0,0 +1,83 @@ +--- +base_model: AXCXEPT/EZO-gemma-2-2b-jpn-it +language: +- en +library_name: transformers +license: gemma +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- conversational +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/AXCXEPT/EZO-gemma-2-2b-jpn-it + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#EZO-gemma-2-2b-jpn-it-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.3 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ3_S.gguf) | i1-IQ3_S | 1.5 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ3_M.gguf) | i1-IQ3_M | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.7 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q4_1.gguf) | i1-Q4_1 | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/EZO-gemma-2-2b-jpn-it-i1-GGUF/resolve/main/EZO-gemma-2-2b-jpn-it.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..b913546 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:349b141fd9fd90027b1043a75861d3822101b1bd4b6ea9043596f1e9cda64d87 +size 2375559