Qwen-2.5-7b-apostate/report.md

Apostate Run Report

Summary

Metric	Value
Base model	Qwen/Qwen2.5-7B-Instruct
Profile	balanced
Output	qwen-apostate
Layers	28
Hidden size	3584
Direction layer	20
Baseline refusal (n=24)	95.8%
Edited refusal	22.9%
Refusal metric	classifier + weak guard
Harmless KL	0.090
Target refusal	3.0%
KL target	0.060
KL budget	0.160
KL positions	32
KL layer trims	0
Repair steps	1
Preserve rank	8
Preserve source	harmless
Capability penalty	True
Elapsed	271.2 sec

Command

apostate ablate --model Qwen/Qwen2.5-7B-Instruct --out qwen-apostate

Best Parameters

Parameter	Value
direction_source	activations
direction_layer_frac	0.742
refusal_rank	1
strength	1.0861
band_center	0.49
band_width	0.5636
causal_mix	0.6642
causal_power	1.2972
direction_sign	1.0
ablate_embed	True
embed_scale	0.0405
ablate_head	False
head_scale	0.0103
head_alpha	0.6951

Best Trial

Metric	Value
refusal	0.75
kl	0.0128
capability_logprob	-7.9867
capability_drift	0.0

Layer Alphas

Layer	Alpha
0	0.667
1	0.667
2	0.667
3	0.667
4	0.667
5	0.667
6	1.206
7	1.222
8	1.205
9	1.202
10	1.210
11	0.000
12	1.240
13	1.333
14	1.333
15	1.333
16	1.333
17	1.202
18	1.448
19	1.333
20	1.333
21	0.667
22	0.667
23	0.667
24	0.667
25	0.667
26	0.667
27	0.667

Guard History

iter	separation	ratio	rank	refusal	kl	reverted
0	40.6304	0.5426	1	0.75	0.0128
1	40.7273	0.5439	1	0.4688	0.0278

Timings

Phase	Seconds
load_model	12.5
load_prompts	16.0
baseline_refusal	5.2
activation_fit	13.7
causal_scores	12.2
optimize_profile	90.7
guard	22.4
refine_refusal	14.3
validation_metrics	0.0
repair	57.8
prune	0.0
test_metrics	13.6
bake	13.0

Measurement

field	value
refusal judge	classifier + weak guard
preservation metric	harmless kl
capability suites	gsm8k, humaneval, mbpp