Files
tinycomma-1.8b-llama3-token…/special_tokens_map.json
ModelHub XC 9120218e7d 初始化项目,由ModelHub XC社区提供模型
Model: jacquelinehe/tinycomma-1.8b-llama3-tokenizer
Source: Original Platform
2026-05-14 02:10:37 +08:00

17 lines
301 B
JSON

{
"bos_token": {
"content": "<|begin_of_text|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "<|end_of_text|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}