初始化项目,由ModelHub XC社区提供模型

Model: QuantFactory/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-30 09:45:15 +08:00
commit a3c65f1a22
16 changed files with 134 additions and 0 deletions

43
README.md Normal file
View File

@@ -0,0 +1,43 @@
---
license: llama3
base_model: OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated
pipeline_tag: text-generation
tags:
- llama
- conversational
---
# QuantFactory/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated-GGUF
This is quantized version of [OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated](https://huggingface.co/OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated) created using llama.cpp
# Model Description
Based on Meta-Llama-3-8b-Instruct, and is governed by Meta Llama 3 License agreement:
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
This is a fine tune using an improved Dolphin and WizardLM dataset intended to make the model follow instructions better and refuse less.
Version 0.6 also uses the abliterated version of llama 3 8b instruct which should not refuse any commands.
OpenLLM Benchmark:
Training:
- 2048 sequence length since the dataset has an average length of under 1000 tokens, while the base model is 8192 sequence length. From testing it still performs the same 8192 context just fine.
- Training duration is around 2 days on 2xRTX 3090, using 4-bit loading and Qlora 64-rank 128-alpha resulting in ~2% trainable weights.
Instruct format:
```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{ user_message_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{{ model_answer_1 }}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{ user_message_2 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
```