duyntnet/Aethora-7b-v1-imatrix-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: duyntnet/Aethora-7b-v1-imatrix-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-14 10:28:19 +08:00
commit 4f6dfb0a6c
29 changed files with 222 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

62
.gitattributes vendored Normal file
View File

@@ -0,0 +1,62 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Aethora-7b-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

3
Aethora-7b-v1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46e7d707b5897a9dc38e7bfc04d602632836d3f99b90c9bb77913e4c8c880d3a
size 1754447456

3
Aethora-7b-v1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09c5a4a3af6f7ada6ffae8cf44f4a932d0d0bf330832773a69336fe61e3a7644
size 1612103264

3
Aethora-7b-v1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49953696c318a08c94d77e7c09b6133ae99a6fda864d654f7fe27c18e0d3060e
size 2500714080

3
Aethora-7b-v1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7233606fd02d5fb72b2f5278fb9a67afbdded8e5589f8e8ada1e29b317e3ba9
size 2310921824

3
Aethora-7b-v1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd3ef76595e06c85582ca30e2755801a2f4fe64d416f0f793f84cb34d9d5abce
size 2198257248

3
Aethora-7b-v1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41b24d05186e3e626613a239f0b3de2d0c39abd1bbfccd85b46538242982e17f
size 1991687776

3
Aethora-7b-v1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fe194ff2fe60896ea5556a571e9043c0a43d2ccffa7997f34ac802b057bc20d
size 3284893280

3
Aethora-7b-v1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:842c884ef0d0d7c6aeb7de04d8289cbd60a936c7fb320c50c9db0305fa6babd6
size 3182394976

3
Aethora-7b-v1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b9393c301e9be3afa982400720543bfbc3c6ac62daf565f10b8c9b9279eda7f
size 3018817120

3
Aethora-7b-v1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa23d724f8636174367342d6149a8a1fd67aa93cd5b46dab2663e3c01eec8abe
size 2827345504

3
Aethora-7b-v1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8b1a438329c40b3a85c7411de647ff4d62fa854f8285472c2066b7e74ddc0a9
size 4125695584

3
Aethora-7b-v1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae116321b7c15733bc474547a654945f0bb7d4cd122ffda1df9aa6a6649461cd
size 3907690080

3
Aethora-7b-v1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd8c0eebe9d432d3cf9600fd0be82a62ab237391509298fb319d507f82ab70a7
size 2719243872

3
Aethora-7b-v1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba37cb1f867608d3baab4d1e691af8624e4179c44d55458a284ae383b39f0989
size 2528927328

3
Aethora-7b-v1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:109cd34306dde3a6c89ffb9a5d9a978c4cf1ea5155d2816892a6d4e0ffee7192
size 3822026336

3
Aethora-7b-v1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:690232059e29ea98164777e4f6d93df8b59bb6ed9ea18ba2288f3516b80ab817
size 3518987872

3
Aethora-7b-v1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6eb9d2bfee26771eb4770eddaa786fedfd03503a33c84ffe11fbdb1a8f1c720
size 3164569184

3
Aethora-7b-v1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:555c41ee78001bbb4ff0507c92f4ff863e1a5a4602e7723278fa7c3977d0eaef
size 4123598432

3
Aethora-7b-v1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b079cadf4fb33e70edbd1d13ad7abff8aa0d341e061015d56ff79f52635b95c2
size 4553317984

3
Aethora-7b-v1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b5b2853db887fe2f089910b6a104aab2b4586c5b0f924e62170b3b157cd4663
size 4368440928

3
Aethora-7b-v1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:106b8fceb0dd0d3bd8bb9f5e040e0c1b0eac72c0e1984b3208d8eb9b6cf40725
size 4140375648

3
Aethora-7b-v1-Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed6c04fec8af2d47cb317fa42da205dfd21e34f8238aee2d4a58d0d949155df4
size 5012397664

3
Aethora-7b-v1-Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5508eacf16f2fb623affb247ab7a9bb0692e52e2122bf4da405893f28c6f7cba
size 5442117216

3
Aethora-7b-v1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d365156afd42ebe4c9d19275c3ba70da6b7d78a947624d86343e4d4317ebfed6
size 5131411040

3
Aethora-7b-v1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1b400635d137284e6b94fc77f34d1b09cf8dc5af3e8f88f16a1b0e6451357e2
size 4997717600

3
Aethora-7b-v1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef632de84df1dde868ac3a6db5b709d8b480131c11fe6dfa64728b6dbc678f18
size 5942066784

3
Aethora-7b-v1-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0164e5b34b638a190259203abafb6ca84f931749621728bf60347d66787181e7
size 7695859296

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
license: other
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- transformers
- gguf
- imatrix
- Aethora-7b-v1
---
Quantizations of https://huggingface.co/SteelStorage/Aethora-7b-v1
### Open source inference clients/UIs
* [llama.cpp](https://github.com/ggerganov/llama.cpp)
* [KoboldCPP](https://github.com/LostRuins/koboldcpp)
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui)
* [jan](https://github.com/menloresearch/jan)
* [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp)
* [croco.cpp](https://github.com/Nexesenex/croco.cpp)
### Closed source inference clients/UIs
* [LM Studio](https://lmstudio.ai/)
* More will be added...
---
# From original readme
Aethora-7B-V1
=============
![](https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/c0--_3VtlhfpJrmT7XBPV.png)
**Creator:** [SteelSkull](https://huggingface.co/Steelskull)
**About Aethora:** Trained on 2 Full Epochs of Aethora-7b-V1 using Aether-V1.9 Dataset, Aethora is a model trained specifically for general use with a focus in RP/Story based on the 2.5mil row (around 1 billion tokens) Aether dataset.
**Model Quants:** Quants provided by: \[N/A\] .
**Model Sources:**
* Developed & Funded by: [Steelskull](https://huggingface.co/Steelskull)
* Finetuned from model: [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
* Finetuning Repository: [Aether Dataset](https://huggingface.co/datasets/TheSkullery/Aether-V1.9)
* Model type: BF16
* License: A2
**Finetune Information:**
* Hardware Type: H100 x1
* Hours Used: 60-Hrs
* Cloud Provider: [Runpod.io](https://www.runpod.io)
* Compute Region: US-IL
**Dataset Information:**
* Version v1.9: Fixed an error where 'system' and 'tools' records were not being carried over to the final dataframe. Added an 'origins' record for dataset sources.
* Version 1.8.5: Removed missing conversations or starting messages that are empty, and selectively omitted certain phrases for coherence and relevance.
**Datasets Used:**
* grimulkan/bluemoon\_Karen\_cleaned
* Doctor-Shotgun/no-robots-sharegpt
* Locutusque/Hercules-v3.0
* jondurbin/airoboros-3.2
* openerotica/freedom-rp
* teknium/OpenHermes-2.5
* Doctor-Shotgun/capybara-sharegpt
* KaraKaraWitch/PIPPA-ShareGPT-formatted
* Locutusque/bagel-clean-v0.3-shuffled
* Locutusque/hyperion-v3.0
**Dataset Summary (Processed / Removed):**
* Total Objects Removed: **209074**
* Deduplication Stats: Starting row count: 4738917, Final row count: 2673175, Rows removed: **2065742**