QuantFactory/Halu-8B-Llama3-Blackroot-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: QuantFactory/Halu-8B-Llama3-Blackroot-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-06 01:59:12 +08:00
commit e731c666c9
17 changed files with 268 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-Blackroot.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text

3
Halu-8B-Llama3-Blackroot.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:179a18f702a912f6298a730be72cb54f7ab4c5577a48407e3093459af833a56c
size 3179131136

3
Halu-8B-Llama3-Blackroot.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fde98ffea9180421a30fd6f4d8f068d6cf53113f07cd8db9b4b6bacf333185ad
size 4321956096

3
Halu-8B-Llama3-Blackroot.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:579f476957f8012f937b582fb60eea5f8f7759a97d907e5187625aec28c97143
size 4018917632

3
Halu-8B-Llama3-Blackroot.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c92ca39983439e658df746794388fa4daff9da57e57f98323af377a2dd0f41dc
size 3664498944

3
Halu-8B-Llama3-Blackroot.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:664b1b5f6c443fb2fecbbf0ce9831f9799f2b313e2ec51ccf76c77fa0f326c28
size 4661211392

3
Halu-8B-Llama3-Blackroot.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6570726208c4711b479cd07be6c650e409f4422e5b4341ffa44e6473e24433c9
size 5130252544

3
Halu-8B-Llama3-Blackroot.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:477781e6cda7e34a3e53b5351154bf249231cea5a43f88406cdd12f138b6f11b
size 4920733952

3
Halu-8B-Llama3-Blackroot.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d672539c481d4eb463404b261df9c0b03b5afa36f353b03e6277234e4c9a677
size 4692668672

3
Halu-8B-Llama3-Blackroot.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86f10fbfe3eded5fb19efe213048bd73864a375800b39014cc869bd661855935
size 5599293696

3
Halu-8B-Llama3-Blackroot.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7387e606e319b1f86a653758d9c9682bcce035d53617cdf01118fa8cc80345c7
size 6068334848

3
Halu-8B-Llama3-Blackroot.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba8d3d67094b5210af989fa8ff6566c197657af9dae09c3b63a49c32badddd8c
size 5732987136

3
Halu-8B-Llama3-Blackroot.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23e018807531d1c058e639940614aeb172ddac6d1aa2e935f4f6e0f82943d65c
size 5599293696

3
Halu-8B-Llama3-Blackroot.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4c4afbcd8336c7ff763df7d730173f397a6eb21580e4d319b3c03afdc6c7916
size 6596006144

3
Halu-8B-Llama3-Blackroot.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d67424a24c8d58c7516b1c96aecee399b5bd759f81187fb5c4bdf4e8f032cfc
size 8540770560

176
README.md Normal file
View File

@@ -0,0 +1,176 @@
---
license: llama3
library_name: transformers
tags:
- mergekit
- merge
- not-for-all-audiences
base_model: Hastagaras/Halu-8B-Llama3-Blackroot
model-index:
- name: Halu-8B-Llama3-Blackroot
results:
- task:
type: text-generation
name: Text Generation
dataset:
name: AI2 Reasoning Challenge (25-Shot)
type: ai2_arc
config: ARC-Challenge
split: test
args:
num_few_shot: 25
metrics:
- type: acc_norm
value: 63.82
name: normalized accuracy
source:
url: >-
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: HellaSwag (10-Shot)
type: hellaswag
split: validation
args:
num_few_shot: 10
metrics:
- type: acc_norm
value: 84.55
name: normalized accuracy
source:
url: >-
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MMLU (5-Shot)
type: cais/mmlu
config: all
split: test
args:
num_few_shot: 5
metrics:
- type: acc
value: 67.04
name: accuracy
source:
url: >-
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: TruthfulQA (0-shot)
type: truthful_qa
config: multiple_choice
split: validation
args:
num_few_shot: 0
metrics:
- type: mc2
value: 53.28
source:
url: >-
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: Winogrande (5-shot)
type: winogrande
config: winogrande_xl
split: validation
args:
num_few_shot: 5
metrics:
- type: acc
value: 79.48
name: accuracy
source:
url: >-
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: GSM8k (5-shot)
type: gsm8k
config: main
split: test
args:
num_few_shot: 5
metrics:
- type: acc
value: 70.51
name: accuracy
source:
url: >-
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Hastagaras/Halu-8B-Llama3-Blackroot
name: Open LLM Leaderboard
pipeline_tag: text-generation
---
# Halu-8B-Llama3-Blackroot-GGUF
This is quantized version of [Hastagaras/Halu-8B-Llama3-Blackroot](https://huggingface.co/Hastagaras/Halu-8B-Llama3-Blackroot?not-for-all-audiences=true) created using llama.cpp
## Model Description
**VERY IMPORTANT:** This model has not been extensively tested or evaluated, and its performance characteristics are currently unknown. It may generate harmful, biased, or inappropriate content. Please exercise caution and use it at your own risk and discretion.
I just tried [saishf's](https://huggingface.co/saishf) merged model, and it's great. So I decided to try a similar merge method with [Blackroot's](https://huggingface.co/Blackroot) LoRA that I had found earlier.
I don't know what to say about this model... this model is very strange...Maybe because Blackroot's amazing Loras used human data and not synthetic data, hence the model turned out to be very human-like...even the actions or narrations.
**WARNING:** This model is very unsafe in certain parts...especially in RP.
[IMATRIX GGUF IS HERE](https://huggingface.co/Lewdiculous/Halu-8B-Llama3-Blackroot-GGUF-IQ-Imatrix) made available by [Lewdiculous](https://huggingface.co/Lewdiculous)
[STATIC GGUF IS HERE](https://huggingface.co/mradermacher/Halu-8B-Llama3-Blackroot-GGUF/tree/main) made avaible by [mradermacher](https://huggingface.co/mradermacher)
<div align="left">
<img src="https://huggingface.co/Hastagaras/Halu-8B-Llama3-Blackroot/resolve/main/Halu (1).png" width="500"/>
</div>
### Merge Method
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Hastagaras/Halu-8B-Llama3-v0.3](https://huggingface.co/Hastagaras/Halu-8B-Llama3-v0.3) as a base.
### Models Merged
The following models were included in the merge:
* [Hastagaras/Halu-8B-Llama3-v0.3](https://huggingface.co/Hastagaras/Halu-8B-Llama3-v0.3) + [Blackroot/Llama-3-LongStory-LORA](https://huggingface.co/Blackroot/Llama-3-LongStory-LORA)
* [Hastagaras/Halu-8B-Llama3-v0.3](https://huggingface.co/Hastagaras/Halu-8B-Llama3-v0.3) + [Blackroot/Llama-3-8B-Abomination-LORA](https://huggingface.co/Blackroot/Llama-3-8B-Abomination-LORA)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
- model: Hastagaras/Halu-8B-Llama3-v0.3+Blackroot/Llama-3-LongStory-LORA
- model: Hastagaras/Halu-8B-Llama3-v0.3+Blackroot/Llama-3-8B-Abomination-LORA
merge_method: model_stock
base_model: Hastagaras/Halu-8B-Llama3-v0.3
dtype: bfloat16
```
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Hastagaras__Halu-8B-Llama3-Blackroot)
| Metric |Value|
|---------------------------------|----:|
|Avg. |69.78|
|AI2 Reasoning Challenge (25-Shot)|63.82|
|HellaSwag (10-Shot) |84.55|
|MMLU (5-Shot) |67.04|
|TruthfulQA (0-shot) |53.28|
|Winogrande (5-shot) |79.48|
|GSM8k (5-shot) |70.51|

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}