初始化项目,由ModelHub XC社区提供模型

Model: Tasmay-Tib/qwen2.5-1.5b-medical-sft-resta
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-12 03:53:02 +08:00
commit 519a4700ae
10 changed files with 455029 additions and 0 deletions

16
harmful_hparams.json Normal file
View File

@@ -0,0 +1,16 @@
{
"lora_rank": 16,
"lora_alpha": 32,
"lora_dropout": 0.05,
"target_modules": [
"q_proj",
"k_proj",
"v_proj",
"o_proj"
],
"learning_rate": 0.0002,
"batch_size": 2,
"gradient_accumulation_steps": 8,
"epochs": 3,
"max_length": 512
}