QuantFactory/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: QuantFactory/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-30 09:45:15 +08:00
commit a3c65f1a22
16 changed files with 134 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9ed968bd607446b6a5f1e2375db9cd9cb20d696e9469b9f8222e68594ea4a7f
size 3179131200

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8dcfe9987992ef78f7eddc5dd82f76ee11db4722d1d33f8c0aaca210d90e000
size 4321956160

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04080d09f00d215b491de352d097baa22cc5a0ba2047bc4c97997e7015aaa3c6
size 4018917696

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f0c9aad58a3a89d2213445b9716ec49c34b441812a1428c601644ed94576a0a
size 3664499008

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9df182ad457af7a93da6410b9ef8a4290012260c2542e9ee65c85bf1305d110e
size 4661211456

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9971289227cf3b08223f99ece55a8f19940f8b08df3c5d350a8f5aff50c08a70
size 5130252608

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c1acafc1261cefd674bc004bb16f6b871de61801bfdb1767d4c246cc4ca6120
size 4920734016

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:559060aade0435fbd95a804f97ee0b31b677fbf949f9bb57c79a416b497353f1
size 4692668736

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4ad2435f63cfacae49eafe9631e3e91a8fccbff691e57328db1285a531d9b8d
size 5599293760

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d2ae34df6cc4db71cfe8e56912c7a41b91af59f3c57cd3c7ab35992216739eb
size 6068334912

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4eefa806d45ece77c8094f9d2174958b2518aaa4cb3baafbbaa1c70fab6eaa48
size 5732987200

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acfe1fbfac7b5bd08102703a1d4126a87a4bfdc6b3f804eb3eaf7b0f516ac0c4
size 5599293760

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e78b00dbe5283968f8163d7613b2162270f213185cab23e6a4de875014de6520
size 6596006208

3
ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4bb1da6e89c9ba527d47adb8f942d1145fdb5c2149922d64915a4699a46e694
size 8540770624

43
README.md Normal file
View File

@@ -0,0 +1,43 @@
---
license: llama3
base_model: OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated
pipeline_tag: text-generation
tags:
- llama
- conversational
---
# QuantFactory/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated-GGUF
This is quantized version of [OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated](https://huggingface.co/OwenArli/ArliAI-Llama-3-8B-Dolfin-v0.6-Abliterated) created using llama.cpp
# Model Description
Based on Meta-Llama-3-8b-Instruct, and is governed by Meta Llama 3 License agreement:
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
This is a fine tune using an improved Dolphin and WizardLM dataset intended to make the model follow instructions better and refuse less.
Version 0.6 also uses the abliterated version of llama 3 8b instruct which should not refuse any commands.
OpenLLM Benchmark:
Training:
- 2048 sequence length since the dataset has an average length of under 1000 tokens, while the base model is 8192 sequence length. From testing it still performs the same 8192 context just fine.
- Training duration is around 2 days on 2xRTX 3090, using 4-bit loading and Qlora 64-rank 128-alpha resulting in ~2% trainable weights.
Instruct format:
```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{ user_message_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{{ model_answer_1 }}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{ user_message_2 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
```