Files
opus-1.5/tokenizer_config.json
ModelHub XC 5ec4488993 初始化项目,由ModelHub XC社区提供模型
Model: opus-research/opus-1.5
Source: Original Platform
2026-09-19 13:55:17 +08:00

9 lines
203 B
JSON

{
"bos_token": "<s>",
"eos_token": "</s>",
"model_max_length": 1024,
"tokenizer_class": "LlamaTokenizer",
"unk_token": "<unk>",
"pad_token": "<pad>",
"clean_up_tokenization_spaces": false
}