初始化项目,由ModelHub XC社区提供模型
Model: rosieyzh/OLMo-150M-as_fm3_tg_omi1 Source: Original Platform
This commit is contained in:
20
README.md
Normal file
20
README.md
Normal file
@@ -0,0 +1,20 @@
|
||||
---
|
||||
library_name: transformers
|
||||
tags: []
|
||||
---
|
||||
|
||||
# OLMo-150M-as_fm3_tg_omi1
|
||||
|
||||
150M OLMo model pretrained on Algebraic Stack, FineMath3+, TinyGSM, and OpenMathInstruct1.
|
||||
|
||||
## Reading Model Names
|
||||
|
||||
Model names contain the contents of the pretraining dataset, delimited by underscores.
|
||||
|
||||
* as: Algebraic Stack
|
||||
* fm3: FineMath3+
|
||||
* tg: TinyGSM
|
||||
* omi1: OpenMathInstruct1
|
||||
* omi2: OpenMathInstruct2
|
||||
|
||||
If there is a `{n}x` in front of the dataset abbreviation, that means it was repeated `n` times during pretraining. For instance, `2xtg` refers to two passes over the TinyGSM dataset.
|
||||
Reference in New Issue
Block a user