mradermacher/Gumini-1B-Base-inherit-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Gumini-1B-Base-inherit-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-12 12:22:33 +08:00
commit f7f0560507
27 changed files with 234 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Gumini-1B-Base-inherit.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Gumini-1B-Base-inherit.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff37ef9daac867853734dc8439e02d929116e6f6655fdfadba9c47919e8bd873
size 394638080

3
Gumini-1B-Base-inherit.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:779d770e7c79e7d190e1d96ffa59c03d91c974f7b7bcd0fc8370885d45e5d0ad
size 378209024

3
Gumini-1B-Base-inherit.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a613d47108505c084051f575177b4ce24d896ce923620b3cd9c670a41d2eeaba
size 475329280

3
Gumini-1B-Base-inherit.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e0efd368a6be1d63ae117d35a1e7ff0fd6990535e3666565c9c2af2400fef4da
size 453423872

3
Gumini-1B-Base-inherit.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:598f42d51dc564844929a3687c424bd7fd59a41cb19e941201f919a76b0aee0a
size 445235968

3
Gumini-1B-Base-inherit.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a16f4928672a0f2f21e11aae8ef86f98f2436055817df7ae2519cc85e82f248
size 422019840

3
Gumini-1B-Base-inherit.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db24b41d1f20d917df7a4f59ff5b38f5f99f149f1162d149e349b279d507ded7
size 601889536

3
Gumini-1B-Base-inherit.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21f46b7748269f6ecd32b1a2b09b8dd1f001150e9b2a7764e2deacf482b27b28
size 593324800

3
Gumini-1B-Base-inherit.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89bf8b6611371da18f54852887031bbbb7a5fceb4a48d5969712bd82db896301
size 576318208

3
Gumini-1B-Base-inherit.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:93e17d28caa9f965474fef746404505adb39a9e7f7dae1596e654da11319fa6f
size 515134208

3
Gumini-1B-Base-inherit.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca23839ff59b4a0acc1e2bb9b304057fff02847c93b576f448bad56f5bef0840
size 695642880

3
Gumini-1B-Base-inherit.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7fee0d332b3d7443c1a302d653549a1d8eaef3a2d1a82570653f15a73add479
size 671722240

3
Gumini-1B-Base-inherit.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a984d6f4588a3c7761f5af0c62130b3f5e2e4625571335e73b483bde5b5808db
size 542739200

3
Gumini-1B-Base-inherit.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3616904759ce388e9f91b53df00bdd5857a034d651e297f656d61075608168cf
size 520866560

3
Gumini-1B-Base-inherit.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a710e76fa202a77479e9f7241f18d9c1b976a5ee30971a4c8aabc21ee800d5e5
size 662915840

3
Gumini-1B-Base-inherit.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d62b63f74156e5a588ed2e4d0ec3a45a110644a46facbf7786385bfd568eb802
size 628968192

3
Gumini-1B-Base-inherit.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dc56cb8700fd9a9fe8f7e5b3ca5fb1abe77b9938c0a5ef294a14b19d8ae1096
size 592628480

3
Gumini-1B-Base-inherit.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:850281bd8b66c2427e3cfa654ef365ce279572e12a285fb2cf3d0ea484e52700
size 696396544

3
Gumini-1B-Base-inherit.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8d7d8ab7415818cd7dd4d36cbbad6491e7a7058afe34eb40a180bc1acb36ae4
size 743156480

3
Gumini-1B-Base-inherit.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff5b77a6b3f0431e0eaaa422b8af2ca8e10aa8a1a4c2a125e80611eb9fde8ca2
size 724724480

3
Gumini-1B-Base-inherit.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e23a53d5ead33a11f834f809cfd82f31c4b169456a5f1cf15efac9122ef56b23
size 698067712

3
Gumini-1B-Base-inherit.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38fa38d5c464b4a5a3b6f5e0c725f447f037cd6a133e663f5fffdc16d90d292b
size 806644480

3
Gumini-1B-Base-inherit.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75da8c2a8f70b2c7afbeb0f9c2a7153bf037361e6d17236431caf89ac9c40945
size 791325440

3
Gumini-1B-Base-inherit.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17af2e8ad45542e0ac22705699105330541fda6ef759d35a4500714e18230ce4
size 893684480

3
Gumini-1B-Base-inherit.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d96e3d78acfb071250432db557a0463eb7fd4277e8bf4150e2e6da71082982a
size 942656

99
README.md Normal file
View File

@@ -0,0 +1,99 @@
---
base_model: GuminiResearch/Gumini-1B-Base
datasets:
- HuggingFaceFW/fineweb-edu
- uonlp/CulturaX
- wikimedia/wikipedia
language:
- ko
- en
library_name: transformers
license: other
license_link: https://huggingface.co/Qwen/Qwen2.5-3B/blob/main/LICENSE
license_name: qwen-research
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation
- korean
- bilingual
- qwen2
- built-with-qwen
- continued-pretraining
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/GuminiResearch/Gumini-1B-Base
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Gumini-1B-Base-inherit-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ1_M.gguf) | i1-IQ1_M | 0.5 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ2_S.gguf) | i1-IQ2_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ2_M.gguf) | i1-IQ2_M | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q2_K.gguf) | i1-Q2_K | 0.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ3_M.gguf) | i1-IQ3_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q4_1.gguf) | i1-Q4_1 | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Gumini-1B-Base-inherit-i1-GGUF/resolve/main/Gumini-1B-Base-inherit.i1-Q6_K.gguf) | i1-Q6_K | 1.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->