language, license, library_name, tags, base_model, model-index
language license library_name tags base_model model-index
en
apache-2.0 transformers
mergekit
merge
Nondzu/Mistral-7B-Instruct-v0.2-code-ft
NousResearch/Nous-Hermes-2-Mistral-7B-DPO
cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser
eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
name results
Gonzo-Chat-7B
task dataset metrics source
type name
text-generation Text Generation
name type config split args
AI2 Reasoning Challenge (25-Shot) ai2_arc ARC-Challenge test
num_few_shot
25
type value name
acc_norm 65.02 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Badgids/Gonzo-Chat-7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type split args
HellaSwag (10-Shot) hellaswag validation
num_few_shot
10
type value name
acc_norm 85.4 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Badgids/Gonzo-Chat-7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
MMLU (5-Shot) cais/mmlu all test
num_few_shot
5
type value name
acc 63.75 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Badgids/Gonzo-Chat-7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
TruthfulQA (0-shot) truthful_qa multiple_choice validation
num_few_shot
0
type value
mc2 60.23
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Badgids/Gonzo-Chat-7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
Winogrande (5-shot) winogrande winogrande_xl validation
num_few_shot
5
type value name
acc 77.74 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Badgids/Gonzo-Chat-7B Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
GSM8k (5-shot) gsm8k main test
num_few_shot
5
type value name
acc 47.61 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Badgids/Gonzo-Chat-7B Open LLM Leaderboard

Gonzo-Chat-7B

Gonzo-Chat-7B is a merged LLM based on Mistral v0.01 with a 8192 Context length that likes to chat, roleplay, work with agents, do some lite programming, and then beat the brakes off you in the back alley...

The BEST Open Source 7B Street Fighting LLM of 2024!!!

SF-III.jpg

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 66.63
AI2 Reasoning Challenge (25-Shot) 65.02
HellaSwag (10-Shot) 85.40
MMLU (5-Shot) 63.75
TruthfulQA (0-shot) 60.23
Winogrande (5-shot) 77.74
GSM8k (5-shot) 47.61

LLM-Colosseum Results

All contestents fought using the same LLM-Colosseum default settings. Each contestant fought 25 rounds with every other contestant.

https://github.com/OpenGenerativeAI/llm-colosseum

Gonzo-Chat-7B .vs Mistral v0.2, Dolphon-Mistral v0.2, Deepseek-Coder-6.7b-instruct

games-won.png

download.png

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
    # No parameters necessary for base model
  - model: cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser
    parameters:
      density: 0.53
      weight: 0.4
  - model:  NousResearch/Nous-Hermes-2-Mistral-7B-DPO
    parameters:
      density: 0.53
      weight: 0.3
  - model: Nondzu/Mistral-7B-Instruct-v0.2-code-ft
    parameters:
      density: 0.53
      weight: 0.3
merge_method: dare_ties
base_model: eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
parameters:
  int8_mask: true
dtype: bfloat16
Description
Model synced from source: Badgids/Gonzo-Chat-7B
Readme 1 MiB