ChaoticNeutrals/This_is_fine_7B
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
92fdf7fd266442abdf9fea150f822edacfdaebee
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

license, library_name, tags, base_model, model-index
license library_name tags base_model model-index
other transformers
mergekit
merge
jeiku/NarrativeNexus_7B
mlabonne/AlphaMonarch-7B
CultriX/NeuralTrix-bf16
jeiku/Cookie_7B
jeiku/Luna_7B
name results
This_is_fine_7B
task dataset metrics source
type name
text-generation Text Generation
name type config split args
AI2 Reasoning Challenge (25-Shot) ai2_arc ARC-Challenge test
num_few_shot
25
type value name
acc_norm 70.31 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/This_is_fine_7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type split args
HellaSwag (10-Shot) hellaswag validation
num_few_shot
10
type value name
acc_norm 87.28 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/This_is_fine_7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
MMLU (5-Shot) cais/mmlu all test
num_few_shot
5
type value name
acc 64.51 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/This_is_fine_7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
TruthfulQA (0-shot) truthful_qa multiple_choice validation
num_few_shot
0
type value
mc2 65.79
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/This_is_fine_7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
Winogrande (5-shot) winogrande winogrande_xl validation
num_few_shot
5
type value name
acc 81.61 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/This_is_fine_7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
GSM8k (5-shot) gsm8k main test
num_few_shot
5
type value name
acc 62.77 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/This_is_fine_7B Open LLM Leaderboard

Fine

image/jpeg

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using mlabonne/AlphaMonarch-7B as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

merge_method: dare_ties
base_model: mlabonne/AlphaMonarch-7B
parameters:
  normalize: true
models:
  - model: jeiku/Luna_7B
    parameters:
      weight: 0.75
  - model: jeiku/Cookie_7B
    parameters:
      weight: 1
  - model: jeiku/NarrativeNexus_7B
    parameters:
      weight: 0.5
  - model: CultriX/NeuralTrix-bf16
    parameters:
      weight: 0.75
  - model: mlabonne/AlphaMonarch-7B
    parameters:
      weight: 1           
dtype: float16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 72.05
AI2 Reasoning Challenge (25-Shot) 70.31
HellaSwag (10-Shot) 87.28
MMLU (5-Shot) 64.51
TruthfulQA (0-shot) 65.79
Winogrande (5-shot) 81.61
GSM8k (5-shot) 62.77
Description
Model synced from source: ChaoticNeutrals/This_is_fine_7B
Readme 1 MiB