初始化项目,由ModelHub XC社区提供模型

Model: yeen214/llama2_7b_merge_orcafamily
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-04 18:32:18 +08:00
commit 1b0996d108
10 changed files with 93574 additions and 0 deletions

28
README.md Normal file
View File

@@ -0,0 +1,28 @@
---
license: mit
datasets:
- Open-Orca/SlimOrca
- beaugogh/openorca-multiplechoice-10k
language:
- en
metrics:
- accuracy
---
This model is based on the LLama 7b model as a backbone, and datasets from various Orcas have been fine-tuned and merged.
The three models were combined, and the model with the best ARC and MMLU performance was given the highest weight.
First: fine-tuning beaugogh/openorca-multiplechoice-10k on llama2 7b, but using the NEFTune method.
Second: model fine-tuned with the SlimOrca dataset on llama2 7b.
Third : Model with beaugogh/openorca-multiplechoice-10k fine-tuned on llama2 7b.
We'll add the results once we have the official results