初始化项目,由ModelHub XC社区提供模型
Model: JoaoBoer/tofu_Llama-3.1-8B-Instruct_forget05_NPO Source: Original Platform
This commit is contained in:
45
README.md
Normal file
45
README.md
Normal file
@@ -0,0 +1,45 @@
|
||||
---
|
||||
license: llama3.1
|
||||
base_model: open-unlearning/tofu_Llama-3.1-8B-Instruct_full
|
||||
library_name: transformers
|
||||
pipeline_tag: text-generation
|
||||
datasets:
|
||||
- locuslab/TOFU
|
||||
tags:
|
||||
- unlearning
|
||||
- tofu
|
||||
- NPO
|
||||
- forget05
|
||||
---
|
||||
|
||||
# tofu_Llama-3.1-8B-Instruct_forget05_NPO
|
||||
|
||||
`open-unlearning/tofu_Llama-3.1-8B-Instruct_full` unlearned on the TOFU `forget05` split with **NPO**, trained with the [open-unlearning](https://github.com/locuslab/open-unlearning) framework. Used as a weight-unlearning baseline / draft model in the [Speculative-Decoding-Unlearning](https://github.com/JoaoVitorBoer/Speculative-Decoding-Unlearning) project.
|
||||
|
||||
Full training config: `.hydra/config.yaml`. TOFU evaluation outputs: `evals/`.
|
||||
|
||||
## Method hyperparameters
|
||||
|
||||
```yaml
|
||||
gamma: 1.0
|
||||
alpha: 2
|
||||
retain_loss_type: NLL
|
||||
beta: 0.1
|
||||
```
|
||||
|
||||
## TOFU summary metrics
|
||||
|
||||
| metric | value |
|
||||
|---|---|
|
||||
| exact_memorization | 0.5073 |
|
||||
| extraction_strength | 0.0558 |
|
||||
| forget_Q_A_PARA_Prob | 0.0237 |
|
||||
| forget_Q_A_gibberish | 0.8973 |
|
||||
| forget_quality | 0.0118 |
|
||||
| forget_truth_ratio | 0.6632 |
|
||||
| mia_loss | 0.0650 |
|
||||
| mia_min_k | 0.0673 |
|
||||
| mia_min_k_plus_plus | 0.1206 |
|
||||
| mia_zlib | 0.1069 |
|
||||
| model_utility | 0.5679 |
|
||||
| privleak | 44.8684 |
|
||||
Reference in New Issue
Block a user