Files
gpt2_1558M_final4_hf/special_tokens_map.json
ModelHub XC 7b8c4b827b 初始化项目,由ModelHub XC社区提供模型
Model: karpathy/gpt2_1558M_final4_hf
Source: Original Platform
2026-10-05 04:33:19 +08:00

24 lines
438 B
JSON

{
"bos_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"unk_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
}
}