初始化项目,由ModelHub XC社区提供模型

Model: RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-06 12:33:35 +08:00
commit fd6d700fec
12 changed files with 322 additions and 0 deletions

9
generation_config.json Normal file
View File

@@ -0,0 +1,9 @@
{
"_from_model_config": true,
"bos_token_id": 128000,
"do_sample": true,
"eos_token_id": 128001,
"temperature": 0.6,
"top_p": 0.9,
"transformers_version": "4.43.3"
}