DreamFast/Qwen-2.5-7b-apostate
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: DreamFast/Qwen-2.5-7b-apostate
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-20 07:52:09 +08:00
commit 41710371bf
17 changed files with 871 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

119
report.md Normal file
View File

@@ -0,0 +1,119 @@
# Apostate Run Report
## Summary
| Metric | Value |
| --- | --- |
| Base model | Qwen/Qwen2.5-7B-Instruct |
| Profile | balanced |
| Output | qwen-apostate |
| Layers | 28 |
| Hidden size | 3584 |
| Direction layer | 20 |
| Baseline refusal (n=24) | 95.8% |
| Edited refusal | 22.9% |
| Refusal metric | classifier + weak guard |
| Harmless KL | 0.090 |
| Target refusal | 3.0% |
| KL target | 0.060 |
| KL budget | 0.160 |
| KL positions | 32 |
| KL layer trims | 0 |
| Repair steps | 1 |
| Preserve rank | 8 |
| Preserve source | harmless |
| Capability penalty | True |
| Elapsed | 271.2 sec |
## Command
```text
apostate ablate --model Qwen/Qwen2.5-7B-Instruct --out qwen-apostate
```
## Best Parameters
| Parameter | Value |
| --- | --- |
| direction_source | activations |
| direction_layer_frac | 0.742 |
| refusal_rank | 1 |
| strength | 1.0861 |
| band_center | 0.49 |
| band_width | 0.5636 |
| causal_mix | 0.6642 |
| causal_power | 1.2972 |
| direction_sign | 1.0 |
| ablate_embed | True |
| embed_scale | 0.0405 |
| ablate_head | False |
| head_scale | 0.0103 |
| head_alpha | 0.6951 |
## Best Trial
| Metric | Value |
| --- | --- |
| refusal | 0.75 |
| kl | 0.0128 |
| capability_logprob | -7.9867 |
| capability_drift | 0.0 |
## Layer Alphas
| Layer | Alpha |
| --- | --- |
| 0 | 0.667 |
| 1 | 0.667 |
| 2 | 0.667 |
| 3 | 0.667 |
| 4 | 0.667 |
| 5 | 0.667 |
| 6 | 1.206 |
| 7 | 1.222 |
| 8 | 1.205 |
| 9 | 1.202 |
| 10 | 1.210 |
| 11 | 0.000 |
| 12 | 1.240 |
| 13 | 1.333 |
| 14 | 1.333 |
| 15 | 1.333 |
| 16 | 1.333 |
| 17 | 1.202 |
| 18 | 1.448 |
| 19 | 1.333 |
| 20 | 1.333 |
| 21 | 0.667 |
| 22 | 0.667 |
| 23 | 0.667 |
| 24 | 0.667 |
| 25 | 0.667 |
| 26 | 0.667 |
| 27 | 0.667 |
## Guard History
| iter | separation | ratio | rank | refusal | kl | reverted |
| --- | --- | --- | --- | --- | --- | --- |
| 0 | 40.6304 | 0.5426 | 1 | 0.75 | 0.0128 | |
| 1 | 40.7273 | 0.5439 | 1 | 0.4688 | 0.0278 | |
## Timings
| Phase | Seconds |
| --- | --- |
| load_model | 12.5 |
| load_prompts | 16.0 |
| baseline_refusal | 5.2 |
| activation_fit | 13.7 |
| causal_scores | 12.2 |
| optimize_profile | 90.7 |
| guard | 22.4 |
| refine_refusal | 14.3 |
| validation_metrics | 0.0 |
| repair | 57.8 |
| prune | 0.0 |
| test_metrics | 13.6 |
| bake | 13.0 |
## Measurement
| field | value |
| --- | --- |
| refusal judge | classifier + weak guard |
| preservation metric | harmless kl |
| capability suites | gsm8k, humaneval, mbpp |