mradermacher/translategemma-4b-it-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/translategemma-4b-it-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-11 06:40:16 +08:00
commit 771975aaab
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
translategemma-4b-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: google/translategemma-4b-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/google/translategemma-4b-it
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#translategemma-4b-it-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/translategemma-4b-it-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/translategemma-4b-it-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/translategemma-4b-it-i1-GGUF/resolve/main/translategemma-4b-it.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
translategemma-4b-it.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bfd833ca14da22dda234c72c7e5dacfe95dae29e052d9f2a73921f435db49737
size 1199586848

3
translategemma-4b-it.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53d9990a6aba588a07632b2b97a8e3bf9c875da1f18aa92f55d1af2c6ba4321e
size 1133108768

3
translategemma-4b-it.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b71d80a96c042bd093f4a181efe95acb0ee23f454942d9c53a75c95399d82ca2
size 1537998368

3
translategemma-4b-it.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f63b452bc9840c0d5323e2d72697e24b3dda6bc052ffd3d86ac7c9d017329b71
size 1449360928

3
translategemma-4b-it.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4334f0dcefaa714cbe706b045ca39ff2ce1a7dc502b629ce0cfdbaea5722b02
size 1404591648

3
translategemma-4b-it.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:776cc15cce731e8d59a7aa44cfc9a49fdf10c78e1a8195c53924e87597520d28
size 1310383648

3
translategemma-4b-it.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b654232b30851d445b2599d41065ea08aefe3899063b8c4546b89ab2b7df9b94
size 1986818848

3
translategemma-4b-it.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:281d4e7bad867dc44862f0c7dd15abbc0ff2301d124bb23c442cf6b08a27ebb3
size 1937380128

3
translategemma-4b-it.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b1698bb26221c1095d02f71b18f1cbc4a7547a753da07841b31214f8085d8b0
size 1863406368

3
translategemma-4b-it.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16133c35d182fcfa9e42789769154878cd44d211b616a69d1746a41eeb1a4fc0
size 1689468448

3
translategemma-4b-it.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2956f1ce0d1f93baa39550ca3a4d78dd3cf31e40cb85fc2ea0654b0785c2be1b
size 2363527968

3
translategemma-4b-it.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b162bd67ff111266166dd462834982ead9ab06286b80d155cfa59933b170a28
size 2263257888

3
translategemma-4b-it.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1157135ded08500709254003c578ec1e7d6e0d707702d10b8f57071958768702
size 1729180448

3
translategemma-4b-it.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ca3bcade0ada60edfc418c04297c8a0ea448904a3184504cbc91adb322b91d2
size 1636078368

3
translategemma-4b-it.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:028c5b852234e02033fe7fd2965c1c06bb0171cb13595f149b3357f1c2f5767c
size 2236101408

3
translategemma-4b-it.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47b5d2d0da7fb109aa5684a2cde027e47077de88103eeeacfe9e44c4b6251bca
size 2098475808

3
translategemma-4b-it.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc3d294488d819ae9495a0609205024188377f8fde2f929724d8bf0ef8353ead
size 1937380128

3
translategemma-4b-it.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4d2fc369f0eeae074f1953b4b2a703ccab54963656c574420ce3b42b8422677
size 2370081568

3
translategemma-4b-it.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a0c368a19e373c2df48e19359129ea0c8f7e29ff03636e8046dd79e5011aef4a
size 2564068128

3
translategemma-4b-it.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ad35e3ea97c07f9d374494d80eefe3f877b6e65d257eb866c4f0af98c40e566
size 2489910048

3
translategemma-4b-it.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4a4f536e7f9fea1140a81eb5aba7b5f9df6caf38ddaccd68088b92c893af1a8
size 2377945888

3
translategemma-4b-it.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b6ed7e79b13af0760897a88b04b20b7cd42240abc172cbad0133bf358107787
size 2829714208

3
translategemma-4b-it.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:671f9a394d79cb19f97728ec1b95249a0a9c13806a0961ff940a62f960494d63
size 2764608288

3
translategemma-4b-it.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fa4fe2cddcfc6d6b49b6e86bcdba70aa2b6cb76c13f609736b3c70f4daf598a
size 3190756128

3
translategemma-4b-it.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15a4a2d93541e8f2a9be67c047b0403bfe1fa6ffeab619f13e40fb3a0851a16b
size 3448608