初始化项目,由ModelHub XC社区提供模型
Model: Maxilicious20/Aether-2.2-Pro-GGUF Source: Original Platform
This commit is contained in:
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
aether_2_2_pro_f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
aether_2_2_pro_q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
aether_2_2_pro_q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
52
README.md
Normal file
52
README.md
Normal file
@@ -0,0 +1,52 @@
|
|||||||
|
---
|
||||||
|
library_name: gguf
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- llama.cpp
|
||||||
|
- lm-studio
|
||||||
|
- aether
|
||||||
|
- german
|
||||||
|
- english
|
||||||
|
- text-generation
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- de
|
||||||
|
- en
|
||||||
|
---
|
||||||
|
|
||||||
|
# Aether 2.2 Pro - GGUF
|
||||||
|
|
||||||
|
Pre-quantized GGUF binaries for **Aether 2.2 Pro**.
|
||||||
|
|
||||||
|
Trained with SFT (Supervised Fine-Tuning) and PEFT (LoRA) on a custom dataset using local NVIDIA RTX GPU acceleration, Aether 2.2 Pro delivers optimized performance, strong conversational capabilities, and reliable multilingual responses in German and English.
|
||||||
|
|
||||||
|
> 🔗 **Looking for the Base / LoRA Adapter?**
|
||||||
|
> If you want to use the Hugging Face Transformers PEFT adapter instead, check out the main repository:
|
||||||
|
> 👉 **[Maxilicious20/Aether-2.2-Pro](https://huggingface.co/Maxilicious20/Aether-2.2-Pro)**
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 📦 Available Files & Quantizations
|
||||||
|
|
||||||
|
Choose the right file depending on your system's VRAM/RAM and performance needs:
|
||||||
|
|
||||||
|
| Filename | Quantization | Quality | Size | Description / Recommendation |
|
||||||
|
| :--- | :--- | :--- | :--- | :--- |
|
||||||
|
| `aether_2_2_pro_f16.gguf` | FP16 / F16 | Maximum | ~2.88 GB | Uncompressed full precision. Best quality. |
|
||||||
|
| `aether_2_2_pro_q8_0.gguf` | Q8_0 | Very High | ~1.53 GB | Near-lossless quantization. Excellent balance of precision and speed. |
|
||||||
|
| `aether_2_2_pro_q4_k_m.gguf` | Q4_K_M | Balanced | ~940 MB | **Recommended.** Lightweight, fast, and optimized for low VRAM/RAM setups. |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 🚀 How to Run Locally
|
||||||
|
|
||||||
|
### 1. LM Studio
|
||||||
|
1. Open LM Studio.
|
||||||
|
2. Search for `Maxilicious20/Aether-2.2-Pro-GGUF` or paste the repository ID.
|
||||||
|
3. Download your preferred quantization (e.g., `aether_2_2_pro_q4_k_m.gguf`).
|
||||||
|
4. Load the model and start chatting!
|
||||||
|
|
||||||
|
### 2. Ollama / llama.cpp
|
||||||
|
You can run the GGUF file directly using `llama.cpp`:
|
||||||
|
```bash
|
||||||
|
./llama-cli -m aether_2_2_pro_q4_k_m.gguf -p "Hello Aether Pro!" -n 256
|
||||||
3
aether_2_2_pro_f16.gguf
Normal file
3
aether_2_2_pro_f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9caffa56205e37edeaac014b3029aaa31953c9c99fae74f40fb153f81a188e3b
|
||||||
|
size 3093668832
|
||||||
3
aether_2_2_pro_q4_k_m.gguf
Normal file
3
aether_2_2_pro_q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7e3c64fe934e50125caf8a3f82699dd4cf90be30f5e923de368055cb14b996df
|
||||||
|
size 986047968
|
||||||
3
aether_2_2_pro_q8_0.gguf
Normal file
3
aether_2_2_pro_q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:71d2c99505c051fd076bc2aa8c5f0f90f32353c9d329623d1d21e2982f7d8e54
|
||||||
|
size 1646572512
|
||||||
Reference in New Issue
Block a user