17 lines
524 B
Markdown
17 lines
524 B
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
---
|
||
|
|
|
||
|
|
# Base Model - SOLAR-10.7B
|
||
|
|
|
||
|
|
This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.
|
||
|
|
|
||
|
|
Please check specific details in the GitHub Repository.
|
||
|
|
|
||
|
|
GitHub Repository: https://github.com/gauss5930/iDUS
|
||
|
|
|
||
|
|
# 🏆 HuggingFace Open LLM Leaderboard
|
||
|
|
|
||
|
|
|Model|ARC|HellaSwag|MMLU|TruthfulQA|Winogrande|GSM8K|Average|
|
||
|
|
|---|---|---|---|---|---|---|---|
|
||
|
|
|Llama2_init_Mistral|60.07|83.3|64.09|42.15|78.37|37.91|60.98|
|