mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-01 13:54:59 +08:00
commit 13bb91bec8
27 changed files with 217 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Athena-codegemma-2-9b-v1.1a.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Athena-codegemma-2-9b-v1.1a.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6382117bef348876b39ece8de57557bf2965ee0de9c92cb4109b494d901db1bc
size 2545952320

3
Athena-codegemma-2-9b-v1.1a.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48af3d2f1398cd508a0032317d07c9f153f2342720c4d91d27a9f97f4a2d95d7
size 2378565184

3
Athena-codegemma-2-9b-v1.1a.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d52c52abe374436fa7da9d7baadb379ddc79646df179c0c51c91209d113431db
size 3434669632

3
Athena-codegemma-2-9b-v1.1a.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a5b37747d4b1b5babaa6f7bf7545c39b013c59e777892ec882802fa7a7f4ac0
size 3211486784

3
Athena-codegemma-2-9b-v1.1a.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a25072fb03be199881020dd73908dd7ceb8ae2d30222ad8ea0faa88941ab777b
size 3067381312

3
Athena-codegemma-2-9b-v1.1a.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5d5ee50b04facc8e8a2e69f2ffb226e89b9b54a9ebef5037c63d9016403ddea
size 2824930880

3
Athena-codegemma-2-9b-v1.1a.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:178cbc52a72bedaa2000f2df9a48ab027c7d72bae11aee5a45f3e04b2273cfaa
size 4494616128

3
Athena-codegemma-2-9b-v1.1a.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:481c09b27e72cd021750dd188be4d3f07a93945203179fb1eaa067c270fbbe72
size 4337665600

3
Athena-codegemma-2-9b-v1.1a.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b9d14cd6dd9d4d942ed00dd663a4286d730f90cd02934f1e2ce6062233cb6cb
size 4144989760

3
Athena-codegemma-2-9b-v1.1a.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79b7044bcfb216f77b6763cbd0ccf21f6f9747bc6bb5bf2035d4292e625776b6
size 3796739648

3
Athena-codegemma-2-9b-v1.1a.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:793c96bfdad62abf53c7676cb5c80cc2e396d82231aa6af2c8ccd8ced27e6df9
size 5183030848

3
Athena-codegemma-2-9b-v1.1a.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a798508a7dbb03fe752316dd3817596674385caddee72049105c7e4f927c084
size 3805398592

3
Athena-codegemma-2-9b-v1.1a.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69f33ef930f198012f7b7fdf9a3589271cf19f473a58323e04b2e9212dfdb45d
size 5132453440

3
Athena-codegemma-2-9b-v1.1a.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8fc0934671ad2fab916ccaa2a1f6b57a5efd0aa7815078186f532a18129f321
size 4761781824

3
Athena-codegemma-2-9b-v1.1a.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8765e74a9d686013ef40900536b5820e49406398cf8e270d60cfd6e86e7bcad
size 4337665600

3
Athena-codegemma-2-9b-v1.1a.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9903638475b02ef87cdd0db8a4ac13a68a5dfe29b05bfeeb14dfcb89f701497b
size 5459199552

3
Athena-codegemma-2-9b-v1.1a.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c6f7cb1eae81f991f455290ac4f238334cf964a2bbbc84b203c52c123d5c59e
size 5443143232

3
Athena-codegemma-2-9b-v1.1a.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a132f5d2dbbcb3843edc8d15ac6a25e058d932fcb7f650482da469b1a7e0e17
size 5443143232

3
Athena-codegemma-2-9b-v1.1a.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38042602dd84af1cb931692f24f8066ca7814d16d54af2dc23b4d8c196888c9f
size 5443143232

3
Athena-codegemma-2-9b-v1.1a.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0627b01dfea41f0864b2de936ba8fc09e15af1e2bb328f39a56fd57764b6d67a
size 5761058368

3
Athena-codegemma-2-9b-v1.1a.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b09bac2c26753b7c52fa29d0075a09c019803a4dbe781a9033410e35b82dd829
size 5478925888

3
Athena-codegemma-2-9b-v1.1a.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4005b03f97f95d61e097a7af240ce096de8a07577ea516847a9d6bfcd46f849
size 6647367232

3
Athena-codegemma-2-9b-v1.1a.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17b8780b79322790039539b3edc8c9012f0b2c003b4e8bf079ae4126a71fc0df
size 6483592768

3
Athena-codegemma-2-9b-v1.1a.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc837ea8dddfb0204f399ef897188b949144715029ec8bc77445a3af513da17f
size 7589070400

82
README.md Normal file
View File

@@ -0,0 +1,82 @@
---
base_model: EpistemeAI/Athena-codegemma-2-9b-v1.1a
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- gemma2
- trl
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/EpistemeAI/Athena-codegemma-2-9b-v1.1a
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 5.5 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 5.5 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 5.5 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-codegemma-2-9b-v1.1a-i1-GGUF/resolve/main/Athena-codegemma-2-9b-v1.1a.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba270f32fa4603b2037a77eb42736344dfa00c9a16552a4b29876de9944def24
size 6116887