mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-09 20:48:39 +08:00
commit 570d533fa1
24 changed files with 202 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d343f9e3c7a8d29d4d8bb83e6dcbcb9d515eb1ac808169b66be7f9134a0400c2
size 2545952864

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f1ad5b24031ecc634bf9fc5f4484cdd5b7e6087f4ca1cb36d0d6795415e50d1
size 2378565728

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4efe4a77bcb7fad1aaeff5b9be5558b8b761aacbdfa6764b4b6662c17fb90491
size 3434670176

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:227f2e6d74cb064d4d745038c42d815b6bb2e894693b1fad3487e4cab9a97799
size 3211487328

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c19c994135f3fafaecf4104a2e0fb430e2c7f7e1a8b49b2a6e5a1cbef5224f0e
size 3067381856

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8565ea5c55c5b1b75acc65f283d66b3128c731b49cd618b110d4b1dc55b8dd7
size 2824931424

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21a6b9a98a4c89edf5a510a9a6f530fb5747fc3883aa3f856f54c2d183fa6735
size 4494616672

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e4a921a5326f79b3e261f25c11871d7a4c6ba44e2a9db0df75fbc4ffd45dfab
size 4337666144

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3bc72476b75e11b20688c796d333416250de9d1f22166b70c8c64c24ed6a7a67
size 4144990304

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc6121c76f84cdf0298e89078d820ef8f2e93878d1a292349e3705464c200694
size 3796740192

3
Athena-gemma-2-9b-it-Philos-KTO.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d321eb47f93665c97d16f01e31f14a068052c407a47e83ba1620022d9bceeee
size 5183031392

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:289704848396fc3a67096826e9db5a6bf211ec767a3925cd55dcef4098f197af
size 3805399136

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac7615f9b4eb5f4a69e75f6b3da0c6df5c4dbcc544d871c79ed3faf9072f8f1e
size 5132453984

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37958b8b7eb7049e1a3b3c50571f02e13dab3eb70c1c28dc3af7bc08ea560949
size 4761782368

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7877e03f615bba8a014f0923dad1a5a061aeb0aab13455f985feddd99322a29a
size 4337666144

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a71c4f7edee39779866cafa438c01eb9068948d202652dbf28457e324296fea5
size 5459200096

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a1ad10f9b4a5e3489599014eeb0f777b57ec57257ddb616ccebdd84ca2c1dbb
size 5761058912

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a91a7d7ab26da9d59e0e6fc868992103d3729958f0f0d95176148c894422ec15
size 5478926432

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68aa8cd2ff1a47337af907049aeac95e878c7b7ac5d966a4f0df1aad7884b2e0
size 6647367776

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bff4c20c7d151f3d23540c32200a95abe30259fb7b7896d1f52a26fa65c7f554
size 6483593312

3
Athena-gemma-2-9b-it-Philos-KTO.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f99d52896cb1aac8c2fcc3194672d1ec4a98e7b25a3551df8218a7d5ed068591
size 7589070944

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: EpistemeAI2/Athena-gemma-2-9b-it-Philos-KTO
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- gemma2
- trl
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/EpistemeAI2/Athena-gemma-2-9b-it-Philos-KTO
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/Athena-gemma-2-9b-it-Philos-KTO-i1-GGUF/resolve/main/Athena-gemma-2-9b-it-Philos-KTO.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5dcf92f8e1dc688998643eac43d3739e0d7adcedd4568bff47f0928b0a5e150
size 6116887