Files
gpt-2-xl_camel-ai-physics/tokenizer_config.json
ModelHub XC de3997a612 初始化项目,由ModelHub XC社区提供模型
Model: lgaalves/gpt-2-xl_camel-ai-physics
Source: Original Platform
2026-06-14 17:38:40 +08:00

10 lines
234 B
JSON

{
"add_prefix_space": false,
"bos_token": "<|endoftext|>",
"clean_up_tokenization_spaces": true,
"eos_token": "<|endoftext|>",
"model_max_length": 1024,
"tokenizer_class": "GPT2Tokenizer",
"unk_token": "<|endoftext|>"
}