Files
Marin-32B-Base-GPTQMODEL-AW…/generation_config.json

12 lines
234 B
JSON
Raw Permalink Normal View History

{
"_from_model_config": true,
"begin_suppress_tokens": [
128000,
128001
],
"bos_token_id": 128000,
"decoder_start_token_id": 128000,
"do_sample": true,
"eos_token_id": 128001,
"transformers_version": "4.57.1"
}