Files
galactica-orca-wizardlm-1.3b/tokenizer_config.json

6 lines
119 B
JSON
Raw Normal View History

{
"clean_up_tokenization_spaces": true,
"model_max_length": 2048,
"tokenizer_class": "PreTrainedTokenizerFast"
}