mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-09 21:21:01 +08:00
commit f423de423f
27 changed files with 213 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc9fca7740c7f23303f3169df142364c3e1718ae5cd047e3f7c1b5990a0caf3b
size 2161973056

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:907cffa6fbd0e5ae3c08b567644b459d1b99fb82ed042572aa98e12e49815914
size 2019628864

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd95d0065903d6709daa5f9a3b2c5e016c64f17e818c1eb83afb0ce8fe53dad6
size 2948282176

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:685f0448c75a9074bf6da4b5d327d62d1f9263ca65590a13b1f6df6b16435138
size 2758489920

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6286d008156483ac40f5021a9b25313046ba6e00abf2924950912777d0a6f5a4
size 2605782848

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68287df48d37e5733140ad282c3caec1e271f8e1b06a2ed19a34af2f94d78ae3
size 2399213376

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a23678863510d6e4d701628c5eed86c054ef521a449929d4147e93fab90abf6
size 3784824640

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee1de062d2eef18ce33c73f18089660a959be01a26dcfe58d6471ffa188f3578
size 3682326336

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:018ec8ff22c3ec110a4b73b5dc9a6c830f81aee4a181bbaa04565a3e5a6abab3
size 3518748480

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9daa846a3ce58273948c393348a210165f51d63565d9e0c4cda40f2e67f0f48a
size 3274913600

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8196e7ce12469fc82d78110f3dbb1bed32d52400e791200d93e2aec2f4e38d8d
size 4677990208

3
Auro-Kosmos-EVAA-v2.2-8B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad78d88457ab2699559ed5da1a1464e441ff13d5ba4be7923502bbcfe58a8449
size 4447663936

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc47d316e5d5f60edb5f631f67ae011b52fbe8196eefc7fef035ac3a5c2bbbfd
size 3179132736

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d5e11c6c8c2fc98c5b6f5e78550ce83969e7327b9ffd1a9bc8a8fa61fbb5c20
size 2988816192

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2710a4b70961bbe11142d828b2f72750c597b1b55f831f7c601aae8255a0b8bd
size 4321957696

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b79adf8d99ae6a3707ba98b9db4aa046d59fe59149b23d84332528df1ff978bc
size 4018919232

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8e796a3a771ce62afac9efd2fe8a2ffcd166b3d93a3e7e9427de2e1c9e29120
size 3664500544

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3be800abcdce4dff18ff166a7636836d630b7feb1f654de49e3ccaebd046a591
size 4675893056

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f092c7ab70a139a113e9468b41ce802db624cb5a903a4b4c27542ef4797bab3
size 5130254144

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d05a71569ad1dba27ec4eb1bed1b76b617757cd54e30a0eda87dde294eb89ec
size 4920735552

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b06c328904cfe5bb846a2c7fca5e7db4ed309a2aabc5e43b82b3eb5e93e8d956
size 4692670272

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75a6f5561bef8e8942ed8d3e8ceb0acd40c4b7ca12c62d3154cc5aa01674dedc
size 5732988736

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be2470c3ba094bed5eeafac6c844791fd6c68e1234651a614108db23386f5a56
size 5599295296

3
Auro-Kosmos-EVAA-v2.2-8B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b87567b25d23b1655875a584a6cc10cbe0c4a34e2c12b8786bf8cb9960d6e691
size 6596007744

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: jaspionjader/Auro-Kosmos-EVAA-v2.2-8B
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/jaspionjader/Auro-Kosmos-EVAA-v2.2-8B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Auro-Kosmos-EVAA-v2.2-8B-i1-GGUF/resolve/main/Auro-Kosmos-EVAA-v2.2-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67e08871fea5d83a07914e616584eb1cc1c0af39cc4237bc1234a85e1ec8487e
size 4988157