初始化项目,由ModelHub XC社区提供模型

Model: nikitastheo/goldfish-eng-ell-sequential_interleaved
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-20 11:37:11 +08:00
commit b9e3c3f76e
9 changed files with 220705 additions and 0 deletions

24
README.md Normal file
View File

@@ -0,0 +1,24 @@
---
tags:
- causal-lm
- text-generation
library_name: transformers
---
# nikitastheo/goldfish-eng-ell-sequential_interleaved
Trained with train_clm.py, a Hugging Face Accelerate causal-LM training script (no `Trainer`).
## Training details
- **Base config**: `gpt_base_config.json`
- **Tokenizer**: `nikitastheo/goldfish-eng-ell-tokenizer`
- **Max steps**: 21640
- **Learning rate**: 0.0001
- **LR scheduler**: linear
- **Warmup steps**: 2164
- **Batch size (per device)**: 32
- **Gradient accumulation steps**: 1
- **Total train batch size**: 32
- **Language switch epoch**: 10