yuchenj/gpt2_124M_100B_FinewebEdu_hf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
bb5bdb1c6f2b191775ad1072869d3a66e7a01237
gpt2_124M_100B_FinewebEdu_hf/README.md
ModelHub XC bb5bdb1c6f 初始化项目，由ModelHub XC社区提供模型 
Model: yuchenj/gpt2_124M_100B_FinewebEdu_hf
Source: Original Platform
2026-08-03 19:11:18 +08:00

270 B
Raw Blame History

library_name, datasets
library_name datasets
transformers
HuggingFaceFW/fineweb-edu

This is a GPT-2 (124M) model trained in llm.c for 100B tokens with cosine LR on Fineweb-Edu.

A lot more detailed info and observations are here: https://x.com/Yuchenj_UW/status/1814703583453192272