Marsouuu/general7Bv2-ECE-PRYMMAL-Martial
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
general7Bv2-ECE-PRYMMAL-Mar…/README.md
ModelHub XC 2d5a7cb6c1 初始化项目，由ModelHub XC社区提供模型 
Model: Marsouuu/general7Bv2-ECE-PRYMMAL-Martial
Source: Original Platform
2026-08-30 04:42:18 +08:00

4.2 KiB
Raw Permalink Blame History

license, library_name, tags, base_model, model-index
license library_name tags base_model model-index
apache-2.0 transformers
mergekit
merge
Tsunami-th/Tsunami-0.5x-7B-Instruct
fblgit/cybertron-v4-qw7B-MGS
name results
general3Bv2-ECE-PRYMMAL-Martial
task dataset metrics source
type name
text-generation Text Generation
name type args
IFEval (0-Shot) HuggingFaceH4/ifeval
num_few_shot
0
type value name
inst_level_strict_acc and prompt_level_strict_acc 56.93 strict accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Marsouuu/general3Bv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
BBH (3-Shot) BBH
num_few_shot
3
type value name
acc_norm 37.67 normalized accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Marsouuu/general3Bv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
MATH Lvl 5 (4-Shot) hendrycks/competition_math
num_few_shot
4
type value name
exact_match 31.42 exact match
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Marsouuu/general3Bv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
GPQA (0-shot) Idavidrein/gpqa
num_few_shot
0
type value name
acc_norm 8.05 acc_norm
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Marsouuu/general3Bv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
MuSR (0-shot) TAUR-Lab/MuSR
num_few_shot
0
type value name
acc_norm 13.28 acc_norm
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Marsouuu/general3Bv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test
num_few_shot
5
type value name
acc 38.87 accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Marsouuu/general3Bv2-ECE-PRYMMAL-Martial Open LLM Leaderboard

my-output

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:


slices:
  - sources:
      - model: fblgit/cybertron-v4-qw7B-MGS
        layer_range: [0, 28]
      - model: Tsunami-th/Tsunami-0.5x-7B-Instruct
        layer_range: [0, 28]
merge_method: slerp
base_model: fblgit/cybertron-v4-qw7B-MGS
parameters:
  t:
    - filter: self_attn
      value: [0, 0.25, 0.5, 0.75, 1]
    - filter: mlp
      value: [1, 0.75, 0.5, 0.25, 0]
    - value: 0.5
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 31.04
IFEval (0-Shot) 56.93
BBH (3-Shot) 37.67
MATH Lvl 5 (4-Shot) 31.42
GPQA (0-shot) 8.05
MuSR (0-shot) 13.28
MMLU-PRO (5-shot) 38.87