Files
pythia-160m-ppt-control_shu…/tokenizer_config.json
ModelHub XC 9bffcbf409 初始化项目,由ModelHub XC社区提供模型
Model: sashaboguraev/pythia-160m-ppt-control_shuffle_dyck_steps250-seed208
Source: Original Platform
2026-08-08 07:43:17 +08:00

14 lines
349 B
JSON

{
"add_prefix_space": false,
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"errors": "replace",
"is_local": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|padding|>",
"tokenizer_class": "GPTNeoXTokenizer",
"trim_offsets": true,
"unk_token": "<|endoftext|>"
}