gpt2-small-japanese-char/special_tokens_map.json at main - gpt2-small-japanese-char - Gitea: Git with a cup of tea

ku-nlp/gpt2-small-japanese-char

Files

ModelHub XC da8e2f862c 初始化项目，由ModelHub XC社区提供模型

Model: ku-nlp/gpt2-small-japanese-char
Source: Original Platform

2026-06-24 10:46:16 +08:00

7 lines

96 B

JSON

Raw Permalink Blame History

 {
   "bos_token": "<s>",
   "eos_token": "</s>",
   "pad_token": "[PAD]",
   "unk_token": "[UNK]"
 }