Hampetiudo/gemma-2-Ifable-9B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Hampetiudo/gemma-2-Ifable-9B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-09 14:13:18 +08:00
commit 2531166977
37 changed files with 194 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

70
.gitattributes vendored Normal file
View File

@@ -0,0 +1,70 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-BF16-imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-BF16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-TQ1_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-TQ2_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-Ifable-9B-F16.gguf filter=lfs diff=lfs merge=lfs -text

19
README.md Normal file
View File

@@ -0,0 +1,19 @@
---
license: gemma
base_model:
- ifable/gemma-2-Ifable-9B
pipeline_tag: text-generation
---
## 🛑 Note: not every quant is displayed on the table on the right, you can find everything [here](https://huggingface.co/Hampetiudo/gemma-2-Ifable-9B-i1-GGUF/tree/main).
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3804">b3804</a> for quantization.
Original model: https://huggingface.co/ifable/gemma-2-Ifable-9B
All quants were made using the imatrix option (except BF16, that's the original precision). The imatrix was generated with the dataset from [here](https://gist.github.com/tristandruyen/9e207a95c7d75ddf37525d353e00659c), using the BF16 GGUF with a context size of 8192 tokens (default is 512 but higher/same as model context size should improve quality) and 13 chunks.
How to make your own quants:
https://github.com/ggerganov/llama.cpp/tree/master/examples/imatrix
https://github.com/ggerganov/llama.cpp/tree/master/examples/quantize

3
gemma-2-Ifable-9B-BF16-imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e6b3029ac61d83b3baaf18537923d16e14d63b54d606ab0e835f2b467970a0e
size 6116912

3
gemma-2-Ifable-9B-BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6185e4e882faec57cdd16459f9b1df97f5668a2cd9c82b247057cf3492ae390
size 18490680224

3
gemma-2-Ifable-9B-F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3653f02417b2e083b8ae022ff8b27e6feb3074ef83aabe1cfa95db0428e8b7e
size 18490680512

3
gemma-2-Ifable-9B-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:873bb3e2cc31a02027783447efc7d9cad8f197af832614becd430b206368e405
size 2545951936

3
gemma-2-Ifable-9B-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de7cebedd7a49818a924ca84ef6b9e6ad7ea32c54f3e3b1bf3dd204c0c95d87a
size 2378564800

3
gemma-2-Ifable-9B-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36ceee0fe7a696f13ff12520dae319e22b7be4665ccd24d4a8392bd415f0600d
size 3434669248

3
gemma-2-Ifable-9B-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb5971cc9afd6875d762d99186fcdeca9900f6eabd3852155a0b696b11c2fe86
size 3211486400

3
gemma-2-Ifable-9B-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e855bd32515845ffba5b884dfc3b3768d4dbdaae99940a6f7199a0614d6e8610
size 3067380928

3
gemma-2-Ifable-9B-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef0bb8f763df238d0cde1c95e43216bcd3df23412de85e6c2511a508f792046a
size 2824930496

3
gemma-2-Ifable-9B-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc065bb31a3b70f9bd7e3f480031f5238825582706d9a6e315bc364879965517
size 4494615744

3
gemma-2-Ifable-9B-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80dcf453b9be4a771c97e4c37d0b4710cb45d60006eff6934d3e1cba7fc9e23b
size 4337665216

3
gemma-2-Ifable-9B-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3d4e0b179c7039accaa6af0a87215060dabbe85a7b95293932f16e451692e4b
size 4144989376

3
gemma-2-Ifable-9B-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e7b59ee800b9f085fa410194a62c6da0391df7ca4c08e1a8c3da84bac9e6226
size 3796739264

3
gemma-2-Ifable-9B-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e6dcd5f880bf1580625d0a0c8786af902a27e921f5b705688ef58eb6c123655
size 5443142848

3
gemma-2-Ifable-9B-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06a71a204a71e6696dc04494f15de2c40146a284ee3edde025550ec8818010aa
size 5183030464

3
gemma-2-Ifable-9B-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5403a07b805cd4c676b5034758bde3dedf38aa47ddc483fc04338aed0e0c2180
size 3805398208

3
gemma-2-Ifable-9B-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:844f3414733cc51af3ae7b1574b564512f3c60fd2bbee725ac32a7528347c357
size 3552511168

3
gemma-2-Ifable-9B-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:695685ce5a1758a84a84120907a3971b3a05843e4e8e6befbaf2ef8cbdd70c58
size 5132453056

3
gemma-2-Ifable-9B-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7831cd81f476499d3bb5551e51b068a326b4f25afa0122708646ec3ad6fec157
size 4761781440

3
gemma-2-Ifable-9B-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a64897e41b420d6e03174eab5c267127afa03db28098f71721531e0f245e948
size 4337665216

3
gemma-2-Ifable-9B-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e58daedf034d00685dfa9e5b8dcf020c191bc6180a8cfe0a5ec302e644f3f269
size 5459199168

3
gemma-2-Ifable-9B-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d1706297599e977f71641a80e6defd7feff8eba8acd89dd19ae7fef1228df0d
size 5443142848

3
gemma-2-Ifable-9B-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95debfd3d3080ee9b84e45cae79a58b8a6156a5d5ef215eebec183dc0586087d
size 5443142848

3
gemma-2-Ifable-9B-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45161fb48127143d2c270290d9d49067cb5ee823ceac795f723d866a4827214a
size 5443142848

3
gemma-2-Ifable-9B-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36b90443deea3b16a8d838c7c5897f6ede92796862676b2c31f1fd87dfc42fa3
size 5963367616

3
gemma-2-Ifable-9B-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42889c0d15b71537c6f837a0ba4a56c68810ada3ae88bb799924e6ffe44a218e
size 5761057984

3
gemma-2-Ifable-9B-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2bbfedd567d0b4762f012e77fb5d2153799e36bc97d7f9e028041a445b7306c
size 5478925504

3
gemma-2-Ifable-9B-Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d27e8756bd8d363a83df2cf89d25849ef8845d84c83d4cab4eebea0d43d03079
size 6499648704

3
gemma-2-Ifable-9B-Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba1f75ae1fb638385b9188ab3391ce1f3d27fa8543940588a878b2b397becfdc
size 7003817152

3
gemma-2-Ifable-9B-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5de249e13c8580e56649c4b9815ffa88073744fbe53b3a7fc6dbd3cecf93a3d8
size 6647366848

3
gemma-2-Ifable-9B-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:944c753e68b1d5cbb103173e478fe48f739ab3d6a39f3b4d0a1502f20b0d562c
size 6483592384

3
gemma-2-Ifable-9B-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c39c62ce89f921c9319da1b0a56da5e6eb8ad89398f3d79e060d9fe05b1d63c3
size 7589070016

3
gemma-2-Ifable-9B-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff0b11fd47446b0716392bebdd3fe7d341cad7a64a24add5ecab15c394c841e0
size 9827148992

3
gemma-2-Ifable-9B-TQ1_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38c630a01fac340167b740256f6aefeb13ba308e0aed741a9ebbe81827baea59
size 2516878528

3
gemma-2-Ifable-9B-TQ2_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cff5bc8e3b0a1e7b0eed92d88954e6640f10cb3e572618e65b1418861a2c539
size 2907047104