初始化项目,由ModelHub XC社区提供模型

Model: ai4bharat/IndicGPT
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-07 06:56:16 +08:00
commit 388d18a639
10 changed files with 64078 additions and 0 deletions

1
special_tokens_map.json Normal file
View File

@@ -0,0 +1 @@
{"bos_token": "[CLS]", "eos_token": "[SEP]", "unk_token": "<unk>", "sep_token": "[SEP]", "pad_token": "<pad>", "cls_token": "[CLS]", "mask_token": {"content": "[MASK]", "single_word": false, "lstrip": true, "rstrip": false, "normalized": true}, "additional_special_tokens": ["<s>", "</s>", "<2as>", "<2bn>", "<2en>", "<2gu>", "<2hi>", "<2kn>", "<2ml>", "<2mr>", "<2or>", "<2pa>", "<2ta>", "<2te>"]}