79 lines
2.5 KiB
Markdown
79 lines
2.5 KiB
Markdown
---
|
|
license: other
|
|
language:
|
|
- en
|
|
pipeline_tag: text-generation
|
|
inference: false
|
|
tags:
|
|
- transformers
|
|
- gguf
|
|
- imatrix
|
|
- Aethora-7b-v1
|
|
---
|
|
|
|
Quantizations of https://huggingface.co/SteelStorage/Aethora-7b-v1
|
|
|
|
|
|
### Open source inference clients/UIs
|
|
* [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
|
* [KoboldCPP](https://github.com/LostRuins/koboldcpp)
|
|
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui)
|
|
* [jan](https://github.com/menloresearch/jan)
|
|
* [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp)
|
|
* [croco.cpp](https://github.com/Nexesenex/croco.cpp)
|
|
|
|
### Closed source inference clients/UIs
|
|
* [LM Studio](https://lmstudio.ai/)
|
|
* More will be added...
|
|
---
|
|
|
|
# From original readme
|
|
|
|
Aethora-7B-V1
|
|
=============
|
|
|
|
|
|
|
|
**Creator:** [SteelSkull](https://huggingface.co/Steelskull)
|
|
|
|
**About Aethora:** Trained on 2 Full Epochs of Aethora-7b-V1 using Aether-V1.9 Dataset, Aethora is a model trained specifically for general use with a focus in RP/Story based on the 2.5mil row (around 1 billion tokens) Aether dataset.
|
|
|
|
**Model Quants:** Quants provided by: \[N/A\] .
|
|
|
|
**Model Sources:**
|
|
|
|
* Developed & Funded by: [Steelskull](https://huggingface.co/Steelskull)
|
|
* Finetuned from model: [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
|
|
* Finetuning Repository: [Aether Dataset](https://huggingface.co/datasets/TheSkullery/Aether-V1.9)
|
|
* Model type: BF16
|
|
* License: A2
|
|
|
|
**Finetune Information:**
|
|
|
|
* Hardware Type: H100 x1
|
|
* Hours Used: 60-Hrs
|
|
* Cloud Provider: [Runpod.io](https://www.runpod.io)
|
|
* Compute Region: US-IL
|
|
|
|
**Dataset Information:**
|
|
|
|
* Version v1.9: Fixed an error where 'system' and 'tools' records were not being carried over to the final dataframe. Added an 'origins' record for dataset sources.
|
|
* Version 1.8.5: Removed missing conversations or starting messages that are empty, and selectively omitted certain phrases for coherence and relevance.
|
|
|
|
**Datasets Used:**
|
|
|
|
* grimulkan/bluemoon\_Karen\_cleaned
|
|
* Doctor-Shotgun/no-robots-sharegpt
|
|
* Locutusque/Hercules-v3.0
|
|
* jondurbin/airoboros-3.2
|
|
* openerotica/freedom-rp
|
|
* teknium/OpenHermes-2.5
|
|
* Doctor-Shotgun/capybara-sharegpt
|
|
* KaraKaraWitch/PIPPA-ShareGPT-formatted
|
|
* Locutusque/bagel-clean-v0.3-shuffled
|
|
* Locutusque/hyperion-v3.0
|
|
|
|
**Dataset Summary (Processed / Removed):**
|
|
|
|
* Total Objects Removed: **209074**
|
|
* Deduplication Stats: Starting row count: 4738917, Final row count: 2673175, Rows removed: **2065742** |