polyglot-ko-12.8b/tokenizer_config.json at main - polyglot-ko-12.8b - Gitea: Git with a cup of tea

EleutherAI/polyglot-ko-12.8b

Files

ModelHub XC b0fb6e33a6 初始化项目，由ModelHub XC社区提供模型

Model: EleutherAI/polyglot-ko-12.8b
Source: Original Platform

2026-05-20 20:06:12 +08:00

6 lines

174 B

JSON

Raw Permalink Blame History

 {
     "name_or_path": "EleutherAI/polyglot-ko-12.8b",
     "eos_token": "<|endoftext|>",
     "pad_token": "<|endoftext|>",
     "tokenizer_class": "PreTrainedTokenizerFast"
   }