初始化项目,由ModelHub XC社区提供模型
Model: Tasmay-Tib/qwen2.5-1.5b-medical-sft-resta Source: Original Platform
This commit is contained in:
16
harmful_hparams.json
Normal file
16
harmful_hparams.json
Normal file
@@ -0,0 +1,16 @@
|
||||
{
|
||||
"lora_rank": 16,
|
||||
"lora_alpha": 32,
|
||||
"lora_dropout": 0.05,
|
||||
"target_modules": [
|
||||
"q_proj",
|
||||
"k_proj",
|
||||
"v_proj",
|
||||
"o_proj"
|
||||
],
|
||||
"learning_rate": 0.0002,
|
||||
"batch_size": 2,
|
||||
"gradient_accumulation_steps": 8,
|
||||
"epochs": 3,
|
||||
"max_length": 512
|
||||
}
|
||||
Reference in New Issue
Block a user