mradermacher/gemma-2-2b-jpn-it-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-2-2b-jpn-it-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 15:02:16 +08:00
commit 0795743753
27 changed files with 217 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: google/gemma-2-2b-jpn-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- ja
library_name: transformers
license: gemma
quantized_by: mradermacher
tags:
- conversational
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/google/gemma-2-2b-jpn-it
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ3_S.gguf) | i1-IQ3_S | 1.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ3_M.gguf) | i1-IQ3_M | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 1.7 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 1.7 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 1.7 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF/resolve/main/gemma-2-2b-jpn-it.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-2-2b-jpn-it.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fa14a66810bf46b1e37d528ed20eb931f760ae1b42be27abf1100b984c939c6
size 873798208

3
gemma-2-2b-jpn-it.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3006348f7e3a6fe5719ebc1d18c4201ef73c60ed96a80e599206ad94505684b9
size 832160320

3
gemma-2-2b-jpn-it.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa5c49efc8ef94de2580603312702d434072427056ef53c88031ef307b1b83f7
size 1088014912

3
gemma-2-2b-jpn-it.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:efa0cbdf790264112bd560f72badee0bc5ef0c9f49ed1ec5c1f67632eb05aa3c
size 1032497728

3
gemma-2-2b-jpn-it.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:161deb06c5ac66b60ae4a6d1481b4d55437eb398df370028bca16950326a1b96
size 1002545728

3
gemma-2-2b-jpn-it.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ec91bf8c9316a33ca8703b0dd0b6f327df4b535d250d6575c596795630938d4
size 943194688

3
gemma-2-2b-jpn-it.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b9d4fa6e36fc416da90a35b3cc582087ca8c17dbf7a5b0a056abfefeeeadd06
size 1393562176

3
gemma-2-2b-jpn-it.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30bfc08892d16e8ae9d8d180f2aa1f976a3b8c505e18d877ed39333117ee8a53
size 1360661056

3
gemma-2-2b-jpn-it.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:757a4a932a14b7a27e3eecb73907365974a6bf9d83a7e5d2fe496b7f77129bf5
size 1314212416

3
gemma-2-2b-jpn-it.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96a2e3cb3db693fabd38e5adecf972ea84fc9deba5b7d0f9beae003ced830f97
size 1181686336

3
gemma-2-2b-jpn-it.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:574c7e7204d1e28c47a4312fdeb0d5b81aefb20e5906e186267283ac96a8bd33
size 1566251584

3
gemma-2-2b-jpn-it.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:637b9dee3d7e7750ef475d813966fff8354c5f8a9c45279ff14507c45da93144
size 1229830720

3
gemma-2-2b-jpn-it.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99431b24f1a25a6b5cc17cb5b99fef28138a43b6fa3eac24a80bc0d0221427c7
size 1550436928

3
gemma-2-2b-jpn-it.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5281447390adeb065317b16008569dcac6c14b577eb416addbd92a9050029bc8
size 1461668416

3
gemma-2-2b-jpn-it.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:521281481b91897c40883c49966bd9fe54c22d63e8739cf426495825cd80e571
size 1360661056

3
gemma-2-2b-jpn-it.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bf5fdff2ad50fd96a03f2ce8eb513cc06c7a085e2d78d9534619bada88443b5
size 1633491520

3
gemma-2-2b-jpn-it.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:080e4e5482e78f9f574dd99a6637d4e823068316ccb343f05ecf40cc9b5b0c0c
size 1629510208

3
gemma-2-2b-jpn-it.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff429c4f0e8ee6340de50cdf74184d8871362c33ab003c98a10a2e8f1d367c39
size 1629510208

3
gemma-2-2b-jpn-it.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70875711884c93c097df1adc6f087bc5e9b7ad101024213b1776a1a19b665e0a
size 1629510208

3
gemma-2-2b-jpn-it.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84dbd9550e530f34a9c2edd59afb9d2cc987d41d23a8828bd235fb5c4894c527
size 1708583488

3
gemma-2-2b-jpn-it.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e01800a214e162b543a713c9462e4c40085a50c1f44be5314fe18b71b9d4497
size 1638652480

3
gemma-2-2b-jpn-it.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a292033a11a261cafc7b8a846070eba12066db84e8fd7f111d7fc38831a89ef
size 1923279424

3
gemma-2-2b-jpn-it.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01cef1e2b9d60eeeed6f8c186ca2f05c1231f788b2da13092968096b8e5d67f6
size 1882544704

3
gemma-2-2b-jpn-it.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fbdee9493a918f561c28518b73f474d6ddaa5694d5f26bbac0b3b920c26e0319
size 2151393856

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc46a9c8e3e6440c9060de3fe8c4efaf486ee56d74fc260f4d6a8b36794f6075
size 2375559