mlabonne/NeuralPipe-7B-ties
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
NeuralPipe-7B-ties/README.md
ModelHub XC c8744ad387 初始化项目，由ModelHub XC社区提供模型 
Model: mlabonne/NeuralPipe-7B-ties
Source: Original Platform
2026-06-29 17:19:13 +08:00

4.4 KiB
Raw Permalink Blame History

license, base_model, tags, model-index
license base_model tags model-index
apache-2.0
OpenPipe/mistral-ft-optimized-1218
mlabonne/NeuralHermes-2.5-Mistral-7B
merge
name results
NeuralPipe-7B-ties
task dataset metrics source
type name
text-generation Text Generation
name type config split args
AI2 Reasoning Challenge (25-Shot) ai2_arc ARC-Challenge test
num_few_shot
25
type value name
acc_norm 67.92 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/NeuralPipe-7B-ties Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type split args
HellaSwag (10-Shot) hellaswag validation
num_few_shot
10
type value name
acc_norm 86.04 normalized accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/NeuralPipe-7B-ties Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
MMLU (5-Shot) cais/mmlu all test
num_few_shot
5
type value name
acc 64.24 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/NeuralPipe-7B-ties Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
TruthfulQA (0-shot) truthful_qa multiple_choice validation
num_few_shot
0
type value
mc2 61.37
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/NeuralPipe-7B-ties Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
Winogrande (5-shot) winogrande winogrande_xl validation
num_few_shot
5
type value name
acc 80.19 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/NeuralPipe-7B-ties Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
GSM8k (5-shot) gsm8k main test
num_few_shot
5
type value name
acc 69.52 accuracy
url name
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/NeuralPipe-7B-ties Open LLM Leaderboard

NeuralPipe-7B-ties

This model is a merge of the following models made with mergekit:

⚡ Quantized models

Thanks to TheBloke for the quantized models:

🧩 Configuration

models:
  - model: mistralai/Mistral-7B-v0.1
    # no parameters necessary for base model
  - model: OpenPipe/mistral-ft-optimized-1218
    parameters:
      density: 0.5
      weight: 0.5
  - model: mlabonne/NeuralHermes-2.5-Mistral-7B
    parameters:
      density: 0.5
      weight: 0.3
merge_method: ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
  normalize: true
  int8_mask: true
dtype: float16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 71.55
AI2 Reasoning Challenge (25-Shot) 67.92
HellaSwag (10-Shot) 86.04
MMLU (5-Shot) 64.24
TruthfulQA (0-shot) 61.37
Winogrande (5-shot) 80.19
GSM8k (5-shot) 69.52