Files
gpt2-medium-dutch-embeddings/tokenizer_config.json

6 lines
108 B
JSON
Raw Normal View History

{
"unk_token": "<unk>",
"bos_token": "<s>",
"eos_token": "</s>",
"add_prefix_space": false
}