20 lines
567 B
Markdown
20 lines
567 B
Markdown
|
---
|
||
|
|
library_name: transformers
|
||
|
|
tags: []
|
||
|
|
---
|
||
|
|
|
||
|
|
# OLMo-150M-as_fm3_tg_omi1
|
||
|
|
|
||
|
|
150M OLMo model pretrained on Algebraic Stack, FineMath3+, TinyGSM, and OpenMathInstruct1.
|
||
|
|
|
||
|
|
## Reading Model Names
|
||
|
|
|
||
|
|
Model names contain the contents of the pretraining dataset, delimited by underscores.
|
||
|
|
|
||
|
|
* as: Algebraic Stack
|
||
|
|
* fm3: FineMath3+
|
||
|
|
* tg: TinyGSM
|
||
|
|
* omi1: OpenMathInstruct1
|
||
|
|
* omi2: OpenMathInstruct2
|
||
|
|
|
||
|
|
If there is a `{n}x` in front of the dataset abbreviation, that means it was repeated `n` times during pretraining. For instance, `2xtg` refers to two passes over the TinyGSM dataset.
|