29 lines
812 B
Markdown
29 lines
812 B
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
- es
|
||
|
|
- fr
|
||
|
|
tags:
|
||
|
|
- merge
|
||
|
|
---
|
||
|
|
|
||
|
|
|
||
|
|
palmer-003 is appvoid's lastest effort into creating the best small, general language model possible.
|
||
|
|
|
||
|
|
```
|
||
|
|
Query: Your instruction
|
||
|
|
|
||
|
|
Answer:
|
||
|
|
```
|
||
|
|
|
||
|
|
**Evaluation**
|
||
|
|
```
|
||
|
|
Model MMLU ARC-C OBQA HellaSwag PIQA Winogrande Average Params
|
||
|
|
tinyllama-3t | 0.2577 | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.4738 | 1.1B |
|
||
|
|
zyte-1b | 0.2397 | 0.3353 | 0.3700 | 0.6086 | 0.7541 | 0.5998 | 0.4845 | 1.1B |
|
||
|
|
palmer-003 | 0.2523 | 0.3439 | 0.3740 | 0.6208 | 0.7524 | 0.6590 | 0.5004 | 1.1B |
|
||
|
|
qwen-1.8b | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 | 1.8B |
|
||
|
|
```
|
||
|
|
|
||
|
|
You can support me [through kofi](https://ko-fi.com/appvoid).
|