Files
galactica-30b/tokenizer_config.json

6 lines
166 B
JSON
Raw Permalink Normal View History

{
"name_or_path": "/content/tokenizer",
"special_tokens_map_file": "/content/tokenizer/special_tokens_map.json",
"tokenizer_class": "PreTrainedTokenizerFast"
}