rosieyzh/OLMo-150M-as_fm3_tg_omi1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
main
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

library_name, tags
library_name tags
transformers

OLMo-150M-as_fm3_tg_omi1

150M OLMo model pretrained on Algebraic Stack, FineMath3+, TinyGSM, and OpenMathInstruct1.

Reading Model Names

Model names contain the contents of the pretraining dataset, delimited by underscores.

  • as: Algebraic Stack
  • fm3: FineMath3+
  • tg: TinyGSM
  • omi1: OpenMathInstruct1
  • omi2: OpenMathInstruct2

If there is a {n}x in front of the dataset abbreviation, that means it was repeated n times during pretraining. For instance, 2xtg refers to two passes over the TinyGSM dataset.

Description
Model synced from source: rosieyzh/OLMo-150M-as_fm3_tg_omi1
Readme 655 KiB