mradermacher/gemma-2-2b-jpn-it-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-2-2b-jpn-it-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-10 19:01:11 +08:00
commit e74b8202a0
15 changed files with 159 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.f16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-2b-jpn-it.Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text

72
README.md Normal file
View File

@@ -0,0 +1,72 @@
---
base_model: google/gemma-2-2b-jpn-it
extra_gated_button_content: Acknowledge license
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
Face and click below. Requests are processed immediately.
language:
- ja
library_name: transformers
license: gemma
quantized_by: mradermacher
tags:
- conversational
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/google/gemma-2-2b-jpn-it
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q2_K.gguf) | Q2_K | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q3_K_S.gguf) | Q3_K_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q3_K_M.gguf) | Q3_K_M | 1.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q3_K_L.gguf) | Q3_K_L | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.IQ4_XS.gguf) | IQ4_XS | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q4_0_4_4.gguf) | Q4_0_4_4 | 1.7 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q4_K_S.gguf) | Q4_K_S | 1.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q4_K_M.gguf) | Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q5_K_S.gguf) | Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q5_K_M.gguf) | Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q6_K.gguf) | Q6_K | 2.3 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.Q8_0.gguf) | Q8_0 | 2.9 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-2b-jpn-it-GGUF/resolve/main/gemma-2-2b-jpn-it.f16.gguf) | f16 | 5.3 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
gemma-2-2b-jpn-it.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7e7e9c7f54d977965f40e63ab24350d5accce416fd86fa210ac1d7f96eef1e0
size 1576204640

3
gemma-2-2b-jpn-it.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb5e6cfe130484693656d840b7760cb56d6f1fefed5c53b197b9736575330d3b
size 1229830496

3
gemma-2-2b-jpn-it.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b1fcd7bd035fc4d043fb72dc3a5a5534ba9a83a03cb56059d20a8f3503bbb78
size 1550436704

3
gemma-2-2b-jpn-it.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05b6ae791e976f2969ad6595969c6c6ff3bc250d0f6bd73ed5afcee68008e4c7
size 1461668192

3
gemma-2-2b-jpn-it.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b32836fc8fd4feed507046d07e0db98a4d03001941ffd2a22d8c0adaae9a62dc
size 1360660832

3
gemma-2-2b-jpn-it.Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6f0bf5f3de09c7d21c28abf3719a49bb41e527b739a50a89d55e1cadffd0a19
size 1629509984

3
gemma-2-2b-jpn-it.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0ff87a896965e4fdc9c44d0df49a63f6f18448b095f3025cdc7286e4aa6934b
size 1708583264

3
gemma-2-2b-jpn-it.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:841eec91fd3f1e2822eb59c3a0cf7b69f9ee42be87c4259f56eca43b3b7f3592
size 1638652256

3
gemma-2-2b-jpn-it.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:801c7d3a0d99a8bee7405084cfc46db451be3d33134744b5a71ae5b6122af724
size 1923279200

3
gemma-2-2b-jpn-it.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c9cd72a009e210e791a749958e7a05a0bb806e8d357b9bfd8d67e71264a2848
size 1882544480

3
gemma-2-2b-jpn-it.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04457be2c985026ee7f8132b62c55a11bb6ec019612f710716da6763102344c0
size 2151393632

3
gemma-2-2b-jpn-it.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1826567bffaa86d2468bcdcd96b45a5f457d9911920fb908d3e778234f64a98
size 2784495968

3
gemma-2-2b-jpn-it.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d71fd88c271e6eae1ec9f3f920805ee25bf10d5d84d837e7871c702688344968
size 5235214688