sthenno-com/miscii-14b-1225
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: sthenno-com/miscii-14b-1225
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-22 05:20:13 +08:00
commit b204f3dce4
19 changed files with 151943 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

174
README.md Normal file
View File

@@ -0,0 +1,174 @@
---
language:
- zho
- eng
- fra
- spa
- por
- deu
- ita
- rus
- jpn
- kor
- vie
- tha
- ara
license: apache-2.0
library_name: transformers
tags:
- mergekit
- merge
- custom-research
- miscii
base_model:
- sthenno-com/miscii-14b-1028
- Qwen/Qwen2.5-14B-Instruct
metrics:
- accuracy
model-index:
- name: miscii-14b-1225
results:
- task:
type: text-generation
name: Text Generation
dataset:
name: IFEval (0-Shot)
type: HuggingFaceH4/ifeval
args:
num_few_shot: 0
metrics:
- type: inst_level_strict_acc and prompt_level_strict_acc
value: 78.78
name: strict accuracy
source:
url: >-
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: BBH (3-Shot)
type: BBH
args:
num_few_shot: 3
metrics:
- type: acc_norm
value: 50.91
name: normalized accuracy
source:
url: >-
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MATH Lvl 5 (4-Shot)
type: hendrycks/competition_math
args:
num_few_shot: 4
metrics:
- type: exact_match
value: 31.57
name: exact match
source:
url: >-
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: GPQA (0-shot)
type: Idavidrein/gpqa
args:
num_few_shot: 0
metrics:
- type: acc_norm
value: 17
name: acc_norm
source:
url: >-
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MuSR (0-shot)
type: TAUR-Lab/MuSR
args:
num_few_shot: 0
metrics:
- type: acc_norm
value: 14.77
name: acc_norm
source:
url: >-
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MMLU-PRO (5-shot)
type: TIGER-Lab/MMLU-Pro
config: main
split: test
args:
num_few_shot: 5
metrics:
- type: acc
value: 47.46
name: accuracy
source:
url: >-
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sthenno-com/miscii-14b-1225
name: Open LLM Leaderboard
---
# miscii-14b-1225
![](Rrharil.png)
Image source: [Rrhar'il | Phigros](https://phigros.fandom.com/wiki/Rrhar%27il)
## Prompting & Usage
See [miscii-14b-1028](https://huggingface.co/sthenno-com/miscii-14b-1028) for more details.
## Training Details
Coming soon
## Merge Details
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
Congratulations to the **miscii** series models for surpassing 40 points for the first time!
As of **December 25, 2024**, this should be the **best-performing 14B model** in the tests, right?
| Metric |Value|
|-------------------|----:|
|Avg. |40.08|
|IFEval (0-Shot) |78.78|
|BBH (3-Shot) |50.91|
|MATH Lvl 5 (4-Shot)|31.57|
|GPQA (0-shot) |17.00|
|MuSR (0-shot) |14.77|
|MMLU-PRO (5-shot) |47.46|
## Refined since 2025-02-15
| Metric |Value|
|-------------------|----:|
|Avg. |42.35|
|IFEval (0-Shot) |78.78|
|BBH (3-Shot) |50.91|
|MATH Lvl 5 (4-Shot)|45.17|
|GPQA (0-shot) |17.00|
|MuSR (0-shot) |14.77|
|MMLU-PRO (5-shot) |47.46|