Files
LLM_TRAINING/special_tokens_map.json
ModelHub XC 17ac698d48 初始化项目,由ModelHub XC社区提供模型
Model: LikelySurf/LLM_TRAINING
Source: Original Platform
2026-08-29 12:58:17 +08:00

7 lines
131 B
JSON

{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}