初始化项目,由ModelHub XC社区提供模型

Model: nlp-waseda/gpt2-small-japanese
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-03 14:33:18 +08:00
commit e1ad9ba9a4
8 changed files with 128183 additions and 0 deletions

1
tokenizer_config.json Normal file
View File

@@ -0,0 +1 @@
{"eos_token": "</s>", "unk_token": "<unk>", "additional_special_tokens": [], "sp_model_kwargs": {}, "tokenizer_class": "ReformerTokenizer"}