Jeesup/tofu_Llama-3.2-1B-Instruct_forget10_SimNPO_qat-int4
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Jeesup/tofu_Llama-3.2-1B-Instruct_forget10_SimNPO_qat-int4
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-04 16:18:17 +08:00
commit 4aa37f6cc7
15 changed files with 4189 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

20
.hydra/overrides.yaml Normal file
View File

@@ -0,0 +1,20 @@
- experiment=unlearn/tofu/default.yaml
- trainer=SimNPO
- task_name=tofu_Llama-3.2-1B-Instruct_forget10_SimNPO_qat-int4
- model=Llama-3.2-1B-Instruct
- forget_split=forget10
- retain_split=retain90
- holdout_split=holdout10
- model.model_args.pretrained_model_name_or_path=open-unlearning/tofu_Llama-3.2-1B-Instruct_full
- model.model_args.attn_implementation=sdpa
- trainer.args.per_device_train_batch_size=4
- trainer.args.gradient_accumulation_steps=4
- trainer.args.ddp_find_unused_parameters=true
- trainer.args.do_eval=false
- trainer.args.save_strategy=no
- +trainer.args.push_to_hub=true
- +trainer.args.hub_model_id=Jeesup/tofu_Llama-3.2-1B-Instruct_forget10_SimNPO_qat-int4
- +trainer.args.hub_strategy=end
- +trainer.args.hub_private_repo=false
- paths.output_dir=saves/unlearn/qat-baseline/tofu_Llama-3.2-1B-Instruct_forget10_SimNPO_qat-int4
- +quant=qat_w4