brgx53/3Blarenegv3-ECE-PRYMMAL-Martial
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
523ef99abca5f1e38f5abc07bd746b8bda5bfa02
3Blarenegv3-ECE-PRYMMAL-Mar…/README.md
ModelHub XC 523ef99abc 初始化项目，由ModelHub XC社区提供模型 
Model: brgx53/3Blarenegv3-ECE-PRYMMAL-Martial
Source: Original Platform
2026-04-25 02:19:06 +08:00

4.2 KiB
Raw Blame History

license, library_name, tags, base_model, model-index
license library_name tags base_model model-index
apache-2.0 transformers
mergekit
merge
fblgit/cybertron-v4-qw7B-MGS
Tsunami-th/Tsunami-0.5x-7B-Instruct
name results
3Bgeneralv2-ECE-PRYMMAL-Martial
task dataset metrics source
type name
text-generation Text Generation
name type args
IFEval (0-Shot) HuggingFaceH4/ifeval
num_few_shot
0
type value name
inst_level_strict_acc and prompt_level_strict_acc 56.77 strict accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=brgx53/3Bgeneralv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
BBH (3-Shot) BBH
num_few_shot
3
type value name
acc_norm 37.25 normalized accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=brgx53/3Bgeneralv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
MATH Lvl 5 (4-Shot) hendrycks/competition_math
num_few_shot
4
type value name
exact_match 30.74 exact match
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=brgx53/3Bgeneralv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
GPQA (0-shot) Idavidrein/gpqa
num_few_shot
0
type value name
acc_norm 8.17 acc_norm
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=brgx53/3Bgeneralv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
MuSR (0-shot) TAUR-Lab/MuSR
num_few_shot
0
type value name
acc_norm 12.79 acc_norm
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=brgx53/3Bgeneralv2-ECE-PRYMMAL-Martial Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test
num_few_shot
5
type value name
acc 38.95 accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=brgx53/3Bgeneralv2-ECE-PRYMMAL-Martial Open LLM Leaderboard

my-output

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:


slices:
  - sources:
      - model: fblgit/cybertron-v4-qw7B-MGS
        layer_range: [0, 28]
      - model: Tsunami-th/Tsunami-0.5x-7B-Instruct
        layer_range: [0, 28]
merge_method: slerp
base_model: Tsunami-th/Tsunami-0.5x-7B-Instruct
parameters:
  t:
    - filter: self_attn
      value: [1, 0.75, 0.5, 0.25, 0]
    - filter: mlp
      value: [0, 0.25, 0.5, 0.75, 1]
    - value: 0.5
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 30.78
IFEval (0-Shot) 56.77
BBH (3-Shot) 37.25
MATH Lvl 5 (4-Shot) 30.74
GPQA (0-shot) 8.17
MuSR (0-shot) 12.79
MMLU-PRO (5-shot) 38.95