Files
marathi-gpt/tokenizer_config.json

1 line
155 B
JSON
Raw Normal View History

{"special_tokens_map_file": "marathi_gpt/special_tokens_map.json", "name_or_path": "l3cube-pune/marathi-gpt", "tokenizer_class": "PreTrainedTokenizerFast"}