mradermacher/aeon-360M-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/aeon-360M-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-13 05:48:01 +08:00
commit aab435216f
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
aeon-360M.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aeon-360M.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: gustavokuklinski/aeon-360M
datasets:
- gustavokuklinski/aeon
- gustavokuklinski/aeon-books
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/gustavokuklinski/aeon-360M
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#aeon-360M-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/aeon-360M-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ2_S.gguf) | i1-IQ2_S | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ2_M.gguf) | i1-IQ2_M | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ3_S.gguf) | i1-IQ3_S | 0.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q2_K.gguf) | i1-Q2_K | 0.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ3_M.gguf) | i1-IQ3_M | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.3 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q4_0.gguf) | i1-Q4_0 | 0.3 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.3 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q4_1.gguf) | i1-Q4_1 | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.4 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/aeon-360M-i1-GGUF/resolve/main/aeon-360M.i1-Q6_K.gguf) | i1-Q6_K | 0.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
aeon-360M.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b9212fbac2f41a12dce9a519394cbb4dea69c46f60e40e29acf58f009e154f3
size 203161376

3
aeon-360M.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e8cb438eecf8d216ef7a4ea4af6857e5e12d7014327c64699f04a8f76763aed
size 201548576

3
aeon-360M.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99e92787a572e34bf38acb00fa52f2c1bbf511724a93137056c73ec439e17c3e
size 211148576

3
aeon-360M.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f54478c3983ef9acbbb3929b14e7388b9c7a7c5403b890efe5b5c29b7755cf8
size 208998176

3
aeon-360M.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cf6e4badfe1ed71f3790ffe37e3fcbacb335d841cd3eb7ced890805ec068e52
size 207999776

3
aeon-360M.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89236ecab4d17c6403db9a534908fc3c6061f0e25c9fb319ec208e878781881b
size 205849376

3
aeon-360M.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4383f17240cde93081da99ebb36593936764e4bc47fd53bef691c7328b8ca04
size 224895776

3
aeon-360M.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54a545781c78432f436b14c4fe0e9fecd5ff2302aaac9c7b55ddd29898e99d42
size 218674976

3
aeon-360M.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9863d72fb6b613169a63709762b8920ffac260fd7fde022d0f04c72d7e9d2fc8
size 218674976

3
aeon-360M.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e24bacace1effd66ee7d54f213ee9a96b2730f006e913e42fb5d3ef37c0a01cb
size 214988576

3
aeon-360M.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68cfe40675407298daa59458d63ed36de8a4354797453861ce3e5583f6a1e17d
size 229119776

3
aeon-360M.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08c58a838664583e66666ad8d853866e742ffbef40e6f66052d1931b38b76c98
size 226662176

3
aeon-360M.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58c758a28b0c34e0941f9aada3b4fa67eefb1fef246947bb2c5ebcdc4626b021
size 218674976

3
aeon-360M.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5e00f71951513584e9348a99513bdbbee40928bd311553d6945cb9c8a0c34c7
size 212991776

3
aeon-360M.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:185d57013a940c2d9ec892451a2e8bc9e35a8ec3777e92db3f4c053778ee461d
size 246322976

3
aeon-360M.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f951636df0812b4f2195a7985557cbae2e054b003e8895bf9de81149393cdbe9
size 234687776

3
aeon-360M.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e9d89ca81d99772264555e555291c392e9d042504fa9ce09bfe80d9092386ae
size 218674976

3
aeon-360M.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c36dce2718f285363fe63cd77677af44436c541d2ef34db5f7f7216a8fc73783
size 229734176

3
aeon-360M.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85db320947c2f4acd3fca0e098c8611abf0cfd0a4eeb0be712e29a1e00013ff3
size 248780576

3
aeon-360M.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2f805e19d60bd8081dd9e92bf634491908277611c455677f87917226b1905f1
size 270591776

3
aeon-360M.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d02f58ac2e763c38dd73a28f5ebf1090ce06ebd9c67e7b0c023cb81f5181548
size 259916576

3
aeon-360M.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59a5ada94cb935ad61e00483fc6ffb7f491b8fb44e3c99f3d17258191e248dc8
size 289945376

3
aeon-360M.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29fe2415ef1587db5e976f5507f6d057d0377595d90fbdb5da2b66ffa9746ab1
size 283186976

3
aeon-360M.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab491ceed406659eca652638876d173db832ce81d79e14dc41af34746a8117d8
size 367359776

3
aeon-360M.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7efe2ddd2e5dc374f58a4990b26b9b8e86566e01f5fd4a62128e189359ff8dbb
size 1099424