gpt2-medium-japanese-char/special_tokens_map.json at main - gpt2-medium-japanese-char - Gitea: Git with a cup of tea

ku-nlp/gpt2-medium-japanese-char

Files

ModelHub XC 89c4156c1e 初始化项目，由ModelHub XC社区提供模型

Model: ku-nlp/gpt2-medium-japanese-char
Source: Original Platform

2026-06-08 12:24:21 +08:00

7 lines

96 B

JSON

Raw Permalink Blame History

 {
   "bos_token": "<s>",
   "eos_token": "</s>",
   "pad_token": "[PAD]",
   "unk_token": "[UNK]"
 }