Model: abdukuzi/ultimate-llama-merged Source: Original Platform
base_model, library_name, license, pipeline_tag, tags, inference, widget
| base_model | library_name | license | pipeline_tag | tags | inference | widget | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
transformers | apache-2.0 | text-generation |
|
|
|
merged_model
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DARE TIES merge method using mlabonne/NeuralDaredevil-8B-abliterated as a base.
Models Merged
The following models were included in the merge:
- SicariusSicariiStuff/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated
- huihui-ai/Dolphin3.0-Llama3.1-8B-abliterated
Configuration
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: mlabonne/NeuralDaredevil-8B-abliterated
layer_range: [0, 32]
parameters:
weight: 0.4
density: 0.5
- model: huihui-ai/Dolphin3.0-Llama3.1-8B-abliterated
layer_range: [0, 32]
parameters:
weight: 0.35
density: 0.5
- model: SicariusSicariiStuff/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated
layer_range: [0, 32]
parameters:
weight: 0.25
density: 0.5
merge_method: dare_ties
base_model: mlabonne/NeuralDaredevil-8B-abliterated
tokenizer_source: base
parameters:
normalize: true
int8_mask: true
dtype: bfloat16
Description
Languages
Jinja
100%