nikitastheo/goldfish-eng-ell-sequential_interleaved
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
b9e3c3f76ea14f920cc0f52d8bd322166655930f
goldfish-eng-ell-sequential…/README.md
ModelHub XC b9e3c3f76e 初始化项目，由ModelHub XC社区提供模型 
Model: nikitastheo/goldfish-eng-ell-sequential_interleaved
Source: Original Platform
2026-07-20 11:37:11 +08:00

584 B
Raw Blame History

tags, library_name
tags library_name
causal-lm
text-generation
transformers

nikitastheo/goldfish-eng-ell-sequential_interleaved

Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no Trainer).

Training details

  • Base config: gpt_base_config.json
  • Tokenizer: nikitastheo/goldfish-eng-ell-tokenizer
  • Max steps: 21640
  • Learning rate: 0.0001
  • LR scheduler: linear
  • Warmup steps: 2164
  • Batch size (per device): 32
  • Gradient accumulation steps: 1
  • Total train batch size: 32
  • Language switch epoch: 10