mradermacher/kona2-12B-Base-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/kona2-12B-Base-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-16 09:04:16 +08:00
commit b2f491fb96
27 changed files with 228 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
kona2-12B-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

93
README.md Normal file
View File

@@ -0,0 +1,93 @@
---
base_model: tbilisi-ai-lab/kona2-12B-Base
language:
- ka
- en
- multilingual
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- llm
- georgian
- multilingual
- pretrained
- mistral
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/tbilisi-ai-lab/kona2-12B-Base
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#kona2-12B-Base-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/kona2-12B-Base-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 3.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 3.4 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.8 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.1 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q2_K.gguf) | i1-Q2_K | 5.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 5.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 6.0 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.3 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q4_0.gguf) | i1-Q4_0 | 7.3 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.3 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.4 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q4_1.gguf) | i1-Q4_1 | 8.0 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.0 | |
| [GGUF](https://huggingface.co/mradermacher/kona2-12B-Base-i1-GGUF/resolve/main/kona2-12B-Base.i1-Q6_K.gguf) | i1-Q6_K | 10.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
kona2-12B-Base.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b89b28bf4eeefed51b75acc11eb642d41c538feb0a6b16f8dad9fb377cf9faa
size 3326293632

3
kona2-12B-Base.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2646894d00dd57df35f95af4f61b3d4edf7c073b121ad7554a4f21e8ee266ef7
size 3103880832

3
kona2-12B-Base.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f9b8fd1a2887917e3f1c2017a9161ddfaf8ded76249c78fedef85383a9b3e70
size 4550097344

3
kona2-12B-Base.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8671628e0d0b71b1b6fc3510efc7392dce64d111a8212e9691186fc347bd233f
size 4253546944

3
kona2-12B-Base.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f50ee44b9dd86f108ca2b855916ea9fdf5a4bc71636f24b0327c2720f1b1af75
size 4019746432

3
kona2-12B-Base.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e43f7385681ee64f7c3d60023dfcf6aa949fb449ea370c2ccda5e3dd5a06bb7
size 3696981632

3
kona2-12B-Base.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6216822dbf6fafff69cfcf7e638ac0dc5c461835491c4c249e55ec4367f88096
size 5850912448

3
kona2-12B-Base.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ca1142465c403fd8ff7fd4bae3e2df48b258ef7475b015674823a412459b9a8
size 5690758848

3
kona2-12B-Base.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dcad398f91546ec653ff138b0979e21ee020d0eccecf7f5ea9c0be93dbfcca45
size 5435168448

3
kona2-12B-Base.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a24734c112b5d89624531caf128c1f1d51cb8ae90ff4caeb812cb61070b33121
size 5060458944

3
kona2-12B-Base.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:190dc9b3234ffde4c244a870c5355f14c65b13d41b4e4ddc7fc7a8df07aaf24e
size 7240201120

3
kona2-12B-Base.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72f3e2d247312a287722f438e84f9ee94341a9d313d8447854404324ebd675f3
size 6881794560

3
kona2-12B-Base.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f16a618e5d365a34ab6f134c24aea67543befe503d0ede6b90fdc717e66d5314
size 4909323136

3
kona2-12B-Base.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cd23e4a789f806e38a0c571e60412a92743f0d514df5ffbeee19da2249635c2
size 4611953536

3
kona2-12B-Base.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ad0d7481293ccb2fa03d5bd9556e333748c0abeae15bd6d660ac57dad77ff8a
size 6690182848

3
kona2-12B-Base.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4e7136739a9b2ad54d13e92fb7721982d3f922c722de74135bfcdca4d54e978
size 6211770048

3
kona2-12B-Base.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:488a7de1d5a3407fbbe0094abf5ac3398a5547ff89271a64f0ec9f5ede3de206
size 5662906048

3
kona2-12B-Base.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa900c5bf8bc07da652e011b02fd1e9a29457c70387c2683820975199e6b67a0
size 7236924320

3
kona2-12B-Base.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f69a4a3afea755c4b02d87e7e105746b3ed91921c10fe4eb085f3e52f7c5411
size 7943907040

3
kona2-12B-Base.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6077841919e788fd2478ce1780fc4160e53c43c03f18cabb4b36ff905e9395ba
size 7619490720

3
kona2-12B-Base.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0fe51b67ee89f1898170397e289dd227e02a1ae075765764bde00a047345c43
size 7262483360

3
kona2-12B-Base.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dd8859d281fb17840b41b3b76d078ecf19a589d7108824fca3e683def23a978
size 8882723360

3
kona2-12B-Base.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79ff91dca8514151a83bacc88c198fa0f7b4a691d061321f7a30503a798bb669
size 8673827360

3
kona2-12B-Base.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18fc818ef140cfaf90a7075c88cf078bc82d660c4896500a6469d78e90a1a615
size 10224908064

3
kona2-12B-Base.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92ba699c37991f56d1b2e9520bc822f03528cfae442ad9e90dedf446257cb704
size 7088192