commit 771975aaab24cab5768696dec6fca65552c12d44 Author: ModelHub XC Date: Fri Sep 11 06:40:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/translategemma-4b-it-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..3c37079 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +translategemma-4b-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..ade2fd8 --- /dev/null +++ b/README.md @@ -0,0 +1,92 @@ +--- +base_model: google/translategemma-4b-it +extra_gated_button_content: Acknowledge license +extra_gated_heading: Access Gemma on Hugging Face +extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and + agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging + Face and click below. Requests are processed immediately. +language: +- en +library_name: transformers +license: gemma +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/google/translategemma-4b-it + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#translategemma-4b-it-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/translategemma-4b-it-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/translategemma-4b-it-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/translategemma-4b-it.i1-IQ1_M.gguf b/translategemma-4b-it.i1-IQ1_M.gguf new file mode 100644 index 0000000..6e62ed3 --- /dev/null +++ b/translategemma-4b-it.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bfd833ca14da22dda234c72c7e5dacfe95dae29e052d9f2a73921f435db49737 +size 1199586848 diff --git a/translategemma-4b-it.i1-IQ1_S.gguf b/translategemma-4b-it.i1-IQ1_S.gguf new file mode 100644 index 0000000..636e2ad --- /dev/null +++ b/translategemma-4b-it.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:53d9990a6aba588a07632b2b97a8e3bf9c875da1f18aa92f55d1af2c6ba4321e +size 1133108768 diff --git a/translategemma-4b-it.i1-IQ2_M.gguf b/translategemma-4b-it.i1-IQ2_M.gguf new file mode 100644 index 0000000..3115824 --- /dev/null +++ b/translategemma-4b-it.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b71d80a96c042bd093f4a181efe95acb0ee23f454942d9c53a75c95399d82ca2 +size 1537998368 diff --git a/translategemma-4b-it.i1-IQ2_S.gguf b/translategemma-4b-it.i1-IQ2_S.gguf new file mode 100644 index 0000000..7ca5d96 --- /dev/null +++ b/translategemma-4b-it.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f63b452bc9840c0d5323e2d72697e24b3dda6bc052ffd3d86ac7c9d017329b71 +size 1449360928 diff --git a/translategemma-4b-it.i1-IQ2_XS.gguf b/translategemma-4b-it.i1-IQ2_XS.gguf new file mode 100644 index 0000000..5ab69f6 --- /dev/null +++ b/translategemma-4b-it.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4334f0dcefaa714cbe706b045ca39ff2ce1a7dc502b629ce0cfdbaea5722b02 +size 1404591648 diff --git a/translategemma-4b-it.i1-IQ2_XXS.gguf b/translategemma-4b-it.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..2b49388 --- /dev/null +++ b/translategemma-4b-it.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:776cc15cce731e8d59a7aa44cfc9a49fdf10c78e1a8195c53924e87597520d28 +size 1310383648 diff --git a/translategemma-4b-it.i1-IQ3_M.gguf b/translategemma-4b-it.i1-IQ3_M.gguf new file mode 100644 index 0000000..664287c --- /dev/null +++ b/translategemma-4b-it.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b654232b30851d445b2599d41065ea08aefe3899063b8c4546b89ab2b7df9b94 +size 1986818848 diff --git a/translategemma-4b-it.i1-IQ3_S.gguf b/translategemma-4b-it.i1-IQ3_S.gguf new file mode 100644 index 0000000..b4efd19 --- /dev/null +++ b/translategemma-4b-it.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:281d4e7bad867dc44862f0c7dd15abbc0ff2301d124bb23c442cf6b08a27ebb3 +size 1937380128 diff --git a/translategemma-4b-it.i1-IQ3_XS.gguf b/translategemma-4b-it.i1-IQ3_XS.gguf new file mode 100644 index 0000000..e193e12 --- /dev/null +++ b/translategemma-4b-it.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b1698bb26221c1095d02f71b18f1cbc4a7547a753da07841b31214f8085d8b0 +size 1863406368 diff --git a/translategemma-4b-it.i1-IQ3_XXS.gguf b/translategemma-4b-it.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..363fea3 --- /dev/null +++ b/translategemma-4b-it.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16133c35d182fcfa9e42789769154878cd44d211b616a69d1746a41eeb1a4fc0 +size 1689468448 diff --git a/translategemma-4b-it.i1-IQ4_NL.gguf b/translategemma-4b-it.i1-IQ4_NL.gguf new file mode 100644 index 0000000..ecd8ec0 --- /dev/null +++ b/translategemma-4b-it.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2956f1ce0d1f93baa39550ca3a4d78dd3cf31e40cb85fc2ea0654b0785c2be1b +size 2363527968 diff --git a/translategemma-4b-it.i1-IQ4_XS.gguf b/translategemma-4b-it.i1-IQ4_XS.gguf new file mode 100644 index 0000000..79b45e6 --- /dev/null +++ b/translategemma-4b-it.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3b162bd67ff111266166dd462834982ead9ab06286b80d155cfa59933b170a28 +size 2263257888 diff --git a/translategemma-4b-it.i1-Q2_K.gguf b/translategemma-4b-it.i1-Q2_K.gguf new file mode 100644 index 0000000..536cda7 --- /dev/null +++ b/translategemma-4b-it.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1157135ded08500709254003c578ec1e7d6e0d707702d10b8f57071958768702 +size 1729180448 diff --git a/translategemma-4b-it.i1-Q2_K_S.gguf b/translategemma-4b-it.i1-Q2_K_S.gguf new file mode 100644 index 0000000..496e5e0 --- /dev/null +++ b/translategemma-4b-it.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ca3bcade0ada60edfc418c04297c8a0ea448904a3184504cbc91adb322b91d2 +size 1636078368 diff --git a/translategemma-4b-it.i1-Q3_K_L.gguf b/translategemma-4b-it.i1-Q3_K_L.gguf new file mode 100644 index 0000000..1a0b455 --- /dev/null +++ b/translategemma-4b-it.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:028c5b852234e02033fe7fd2965c1c06bb0171cb13595f149b3357f1c2f5767c +size 2236101408 diff --git a/translategemma-4b-it.i1-Q3_K_M.gguf b/translategemma-4b-it.i1-Q3_K_M.gguf new file mode 100644 index 0000000..9682c89 --- /dev/null +++ b/translategemma-4b-it.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:47b5d2d0da7fb109aa5684a2cde027e47077de88103eeeacfe9e44c4b6251bca +size 2098475808 diff --git a/translategemma-4b-it.i1-Q3_K_S.gguf b/translategemma-4b-it.i1-Q3_K_S.gguf new file mode 100644 index 0000000..8cdcbb5 --- /dev/null +++ b/translategemma-4b-it.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bc3d294488d819ae9495a0609205024188377f8fde2f929724d8bf0ef8353ead +size 1937380128 diff --git a/translategemma-4b-it.i1-Q4_0.gguf b/translategemma-4b-it.i1-Q4_0.gguf new file mode 100644 index 0000000..cc11807 --- /dev/null +++ b/translategemma-4b-it.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4d2fc369f0eeae074f1953b4b2a703ccab54963656c574420ce3b42b8422677 +size 2370081568 diff --git a/translategemma-4b-it.i1-Q4_1.gguf b/translategemma-4b-it.i1-Q4_1.gguf new file mode 100644 index 0000000..67a85b4 --- /dev/null +++ b/translategemma-4b-it.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a0c368a19e373c2df48e19359129ea0c8f7e29ff03636e8046dd79e5011aef4a +size 2564068128 diff --git a/translategemma-4b-it.i1-Q4_K_M.gguf b/translategemma-4b-it.i1-Q4_K_M.gguf new file mode 100644 index 0000000..5b142bd --- /dev/null +++ b/translategemma-4b-it.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ad35e3ea97c07f9d374494d80eefe3f877b6e65d257eb866c4f0af98c40e566 +size 2489910048 diff --git a/translategemma-4b-it.i1-Q4_K_S.gguf b/translategemma-4b-it.i1-Q4_K_S.gguf new file mode 100644 index 0000000..5d8c314 --- /dev/null +++ b/translategemma-4b-it.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4a4f536e7f9fea1140a81eb5aba7b5f9df6caf38ddaccd68088b92c893af1a8 +size 2377945888 diff --git a/translategemma-4b-it.i1-Q5_K_M.gguf b/translategemma-4b-it.i1-Q5_K_M.gguf new file mode 100644 index 0000000..4761676 --- /dev/null +++ b/translategemma-4b-it.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8b6ed7e79b13af0760897a88b04b20b7cd42240abc172cbad0133bf358107787 +size 2829714208 diff --git a/translategemma-4b-it.i1-Q5_K_S.gguf b/translategemma-4b-it.i1-Q5_K_S.gguf new file mode 100644 index 0000000..17ab0ef --- /dev/null +++ b/translategemma-4b-it.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:671f9a394d79cb19f97728ec1b95249a0a9c13806a0961ff940a62f960494d63 +size 2764608288 diff --git a/translategemma-4b-it.i1-Q6_K.gguf b/translategemma-4b-it.i1-Q6_K.gguf new file mode 100644 index 0000000..eccbbd9 --- /dev/null +++ b/translategemma-4b-it.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9fa4fe2cddcfc6d6b49b6e86bcdba70aa2b6cb76c13f609736b3c70f4daf598a +size 3190756128 diff --git a/translategemma-4b-it.imatrix.gguf b/translategemma-4b-it.imatrix.gguf new file mode 100644 index 0000000..3e195f6 --- /dev/null +++ b/translategemma-4b-it.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:15a4a2d93541e8f2a9be67c047b0403bfe1fa6ffeab619f13e40fb3a0851a16b +size 3448608