Files
dot-125m-identity/tokenizer_config.json
ModelHub XC d3a840bcf7 初始化项目,由ModelHub XC社区提供模型
Model: perletter/dot-125m-identity
Source: Original Platform
2026-09-28 02:57:17 +08:00

9 lines
217 B
JSON

{
"backend": "tokenizers",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 512,
"pad_token": "<|endoftext|>",
"tokenizer_class": "PreTrainedTokenizerFast"
}