jackf857/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: jackf857/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 20:14:22 +08:00
commit 74414d18a2
23 changed files with 166086 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

36
.gitattributes vendored Normal file
View File

@@ -0,0 +1,36 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
tokenizer.json filter=lfs diff=lfs merge=lfs -text

82
README.md Normal file
View File

@@ -0,0 +1,82 @@
---
library_name: transformers
license: apache-2.0
base_model: jackf857/qwen3-8b-base-sft-hh-helpful-4xh200-batch-64-20260417-214452
tags:
- alignment-handbook
- new-dpo
- generated_from_trainer
datasets:
- Anthropic/hh-rlhf
model-index:
- name: qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6
This model is a fine-tuned version of [jackf857/qwen3-8b-base-sft-hh-helpful-4xh200-batch-64-20260417-214452](https://huggingface.co/jackf857/qwen3-8b-base-sft-hh-helpful-4xh200-batch-64-20260417-214452) on the Anthropic/hh-rlhf dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5224
- Fcm Dpo/beta: 0.0073
- Margin Dpo/margin Mean: 73.6023
- Margin Dpo/margin Std: 100.2118
- Logps/chosen: -265.1147
- Logps/rejected: -332.2911
- Logps/ref Chosen: -100.4936
- Logps/ref Rejected: -94.0678
- Logits/chosen: -1.8407
- Logits/rejected: -1.4555
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-07
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- num_devices: 4
- gradient_accumulation_steps: 2
- total_train_batch_size: 64
- total_eval_batch_size: 32
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 1
### Training results
| Training Loss | Epoch | Step | Validation Loss | Fcm Dpo/beta | Margin Dpo/margin Mean | Margin Dpo/margin Std | Logps/chosen | Logps/rejected | Logps/ref Chosen | Logps/ref Rejected | Logits/chosen | Logits/rejected |
|:-------------:|:------:|:----:|:---------------:|:------------:|:----------------------:|:---------------------:|:------------:|:--------------:|:----------------:|:------------------:|:-------------:|:---------------:|
| 0.9831 | 0.1468 | 100 | 0.5851 | 0.1290 | 3.0273 | 6.0741 | -103.4172 | -100.0187 | -100.4936 | -94.0678 | 0.0310 | 0.2743 |
| 0.9603 | 0.2937 | 200 | 0.5345 | 0.0330 | 15.0670 | 21.7615 | -123.5883 | -132.2295 | -100.4936 | -94.0678 | -1.4398 | -1.1262 |
| 1.0079 | 0.4405 | 300 | 0.5175 | 0.0128 | 42.6819 | 56.6599 | -199.0951 | -235.3512 | -100.4936 | -94.0678 | -1.7159 | -1.3591 |
| 0.9031 | 0.5874 | 400 | 0.5321 | 0.0072 | 66.1747 | 89.8270 | -255.0186 | -314.7675 | -100.4936 | -94.0678 | -1.9564 | -1.5863 |
| 1.0372 | 0.7342 | 500 | 0.5229 | 0.0074 | 72.2195 | 99.1610 | -264.5698 | -330.3635 | -100.4936 | -94.0678 | -1.9734 | -1.5979 |
| 0.9868 | 0.8811 | 600 | 0.5224 | 0.0073 | 73.6023 | 100.2118 | -265.1147 | -332.2911 | -100.4936 | -94.0678 | -1.8407 | -1.4555 |
### Framework versions
- Transformers 4.51.0
- Pytorch 2.3.1+cu121
- Datasets 2.21.0
- Tokenizers 0.21.4

28
added_tokens.json Normal file
View File

@@ -0,0 +1,28 @@
{
"</think>": 151668,
"</tool_call>": 151658,
"</tool_response>": 151666,
"<think>": 151667,
"<tool_call>": 151657,
"<tool_response>": 151665,
"<|box_end|>": 151649,
"<|box_start|>": 151648,
"<|endoftext|>": 151643,
"<|file_sep|>": 151664,
"<|fim_middle|>": 151660,
"<|fim_pad|>": 151662,
"<|fim_prefix|>": 151659,
"<|fim_suffix|>": 151661,
"<|im_end|>": 151645,
"<|im_start|>": 151644,
"<|image_pad|>": 151655,
"<|object_ref_end|>": 151647,
"<|object_ref_start|>": 151646,
"<|quad_end|>": 151651,
"<|quad_start|>": 151650,
"<|repo_name|>": 151663,
"<|video_pad|>": 151656,
"<|vision_end|>": 151653,
"<|vision_pad|>": 151654,
"<|vision_start|>": 151652
}

23
all_results.json Normal file
View File

@@ -0,0 +1,23 @@
{
"epoch": 1.0,
"eval_fcm_dpo/beta": 0.0065701245330274105,
"eval_logits/chosen": -1.905737042427063,
"eval_logits/rejected": -1.5243432521820068,
"eval_logps/chosen": -265.6040954589844,
"eval_logps/ref_chosen": -100.49356842041016,
"eval_logps/ref_rejected": -94.06775665283203,
"eval_logps/rejected": -333.0381164550781,
"eval_loss": 0.5309035181999207,
"eval_margin_dpo/margin_mean": 73.85983276367188,
"eval_margin_dpo/margin_std": 100.37892150878906,
"eval_runtime": 43.7708,
"eval_samples": 2339,
"eval_samples_per_second": 53.437,
"eval_steps_per_second": 1.691,
"total_flos": 0.0,
"train_loss": 1.0153061533114283,
"train_runtime": 2239.7507,
"train_samples": 43598,
"train_samples_per_second": 19.466,
"train_steps_per_second": 0.304
}

30
config.json Normal file
View File

@@ -0,0 +1,30 @@
{
"architectures": [
"Qwen3ForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 151643,
"eos_token_id": 151643,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 12288,
"max_position_embeddings": 32768,
"max_window_layers": 36,
"model_type": "qwen3",
"num_attention_heads": 32,
"num_hidden_layers": 36,
"num_key_value_heads": 8,
"rms_norm_eps": 1e-06,
"rope_scaling": null,
"rope_theta": 1000000,
"sliding_window": null,
"tie_word_embeddings": false,
"torch_dtype": "float32",
"transformers_version": "4.51.0",
"use_cache": true,
"use_sliding_window": false,
"vocab_size": 151936
}

17
eval_results.json Normal file
View File

@@ -0,0 +1,17 @@
{
"epoch": 1.0,
"eval_fcm_dpo/beta": 0.0065701245330274105,
"eval_logits/chosen": -1.905737042427063,
"eval_logits/rejected": -1.5243432521820068,
"eval_logps/chosen": -265.6040954589844,
"eval_logps/ref_chosen": -100.49356842041016,
"eval_logps/ref_rejected": -94.06775665283203,
"eval_logps/rejected": -333.0381164550781,
"eval_loss": 0.5309035181999207,
"eval_margin_dpo/margin_mean": 73.85983276367188,
"eval_margin_dpo/margin_std": 100.37892150878906,
"eval_runtime": 43.7708,
"eval_samples": 2339,
"eval_samples_per_second": 53.437,
"eval_steps_per_second": 1.691
}

6
generation_config.json Normal file
View File

@@ -0,0 +1,6 @@
{
"bos_token_id": 151643,
"eos_token_id": 151643,
"max_new_tokens": 2048,
"transformers_version": "4.51.0"
}

681
margin_logs/margins.jsonl Normal file
View File

@@ -0,0 +1,681 @@
{"epoch": 0.0, "step": 1, "batch_size": 64, "mean": 0.061235010623931885, "std": 0.44581517577171326, "min": -0.9558563232421875, "p10": -0.49806652069091795, "median": 0.0538330078125, "p90": 0.6431861877441406, "max": 1.349212646484375, "pos_frac": 0.5625, "sample": [0.2952117919921875, -0.9558563232421875, 0.002197265625, 0.5723953247070312, 0.45829010009765625, 0.045989990234375, 0.07258987426757812, 0.16957473754882812, -0.0712890625, 0.067230224609375, 0.061676025390625, 0.9847030639648438, 0.25745391845703125, 0.223114013671875, 0.8358078002929688, -0.205474853515625, -0.4477996826171875, -0.6458778381347656, 1.101287841796875, 0.0405731201171875, -0.05789947509765625, 0.8459625244140625, -0.16561508178710938, -0.1964569091796875, -0.08588409423828125, 0.07699203491210938, -0.15012359619140625, 0.08970260620117188, -0.6135711669921875, -0.3250083923339844, -0.5196094512939453, -0.055461883544921875, 0.06568145751953125, -0.1916046142578125, 0.07837677001953125, -0.5969200134277344, -0.6232337951660156, -0.23907470703125, 0.10578536987304688, 1.349212646484375, 0.6396026611328125, -0.1342315673828125, -0.33837318420410156, -0.6055755615234375, 0.28924560546875, -0.053333282470703125, -0.13497543334960938, 0.040065765380859375, 0.156463623046875, 0.30047607421875, 0.18242645263671875, -0.4043922424316406, 0.10161590576171875, -0.2782421112060547, 0.6447219848632812, 0.592559814453125, 0.2892589569091797, 0.2594795227050781, 0.278594970703125, 0.7102890014648438, -0.0288848876953125, 0.5050926208496094, -0.35527801513671875, -0.3906135559082031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000001.npy"}
{"epoch": 0.0014684287812041115, "step": 2, "batch_size": 64, "mean": -0.12442246079444885, "std": 0.41391414403915405, "min": -1.25341796875, "p10": -0.5899612426757812, "median": -0.16697025299072266, "p90": 0.40547485351562507, "max": 0.74664306640625, "pos_frac": 0.375, "sample": [-0.4356536865234375, 0.0176544189453125, -0.20431900024414062, 0.74664306640625, -0.2661247253417969, -0.1260967254638672, -0.8647918701171875, -0.17073822021484375, -0.477691650390625, -0.18256378173828125, 0.3944091796875, -0.16320228576660156, -0.3320465087890625, -0.39223480224609375, -0.4348640441894531, -0.602691650390625, -1.201324462890625, -0.4142303466796875, -0.037799835205078125, 0.09072113037109375, -0.5269927978515625, 0.05698394775390625, 0.5052413940429688, 0.13204193115234375, -0.4286689758300781, 0.03350067138671875, 0.65325927734375, 0.6349716186523438, -0.19322967529296875, 0.34609222412109375, 0.65667724609375, -0.2496337890625, -0.6125564575195312, -0.11834716796875, -0.10693359375, -0.062713623046875, -0.3054351806640625, 0.3363838195800781, 0.35395050048828125, -0.008523941040039062, -0.6783828735351562, 0.23185348510742188, -0.02996826171875, -0.4708709716796875, -1.25341796875, -0.22631072998046875, 0.0096588134765625, 0.437835693359375, 0.345306396484375, 0.17419815063476562, -0.5602569580078125, 0.17741012573242188, 0.04550933837890625, -0.2523040771484375, -0.6806221008300781, -0.28516387939453125, -0.21526336669921875, -0.24713897705078125, 0.18416213989257812, 0.41021728515625, -0.4717559814453125, -0.22457504272460938, 0.0484161376953125, -0.47069549560546875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000002.npy"}
{"epoch": 0.002936857562408223, "step": 3, "batch_size": 64, "mean": 0.014965400099754333, "std": 0.456424355506897, "min": -1.1258697509765625, "p10": -0.595195198059082, "median": 0.043182373046875, "p90": 0.5922954559326173, "max": 1.12786865234375, "pos_frac": 0.546875, "sample": [-0.6029033660888672, -0.911865234375, 0.1763153076171875, 0.0651092529296875, 0.3923759460449219, -0.18950462341308594, 0.14054107666015625, 0.08456993103027344, 0.2709808349609375, -0.14229774475097656, 0.6973876953125, 0.5523185729980469, -1.1258697509765625, -0.20796966552734375, -0.078369140625, 0.055694580078125, -0.57720947265625, -0.6348648071289062, -0.7830657958984375, -0.106048583984375, 0.6094284057617188, 0.8430023193359375, 0.197174072265625, -0.25201416015625, 0.06450653076171875, 0.03399658203125, -0.4391937255859375, -0.17305755615234375, 0.04698944091796875, -0.8885498046875, 0.44861602783203125, 0.0986175537109375, 0.013353347778320312, 0.418304443359375, -0.248809814453125, 0.1596832275390625, -0.01377105712890625, -0.2791481018066406, 0.30573272705078125, 0.4403038024902344, -0.29293060302734375, 0.134063720703125, 0.3950958251953125, 0.4018821716308594, -0.258209228515625, -0.24568939208984375, 0.7665863037109375, -0.2421875, 0.27696990966796875, 0.03937530517578125, -0.3887939453125, -0.2666740417480469, 0.17680740356445312, 0.7966537475585938, -0.45803070068359375, -0.87750244140625, -0.21836090087890625, 0.6378250122070312, -0.06058502197265625, 0.4389190673828125, -0.02663707733154297, 1.12786865234375, 0.4224395751953125, 0.21841049194335938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000003.npy"}
{"epoch": 0.004405286343612335, "step": 4, "batch_size": 64, "mean": 0.020858705043792725, "std": 0.39295896887779236, "min": -1.5392608642578125, "p10": -0.45865821838378906, "median": 0.061443328857421875, "p90": 0.5029525756835938, "max": 0.6849651336669922, "pos_frac": 0.609375, "sample": [-0.5045928955078125, -0.0574951171875, 0.14188003540039062, -0.4986114501953125, -0.547332763671875, 0.07889556884765625, 0.138946533203125, 0.35711669921875, 0.6849651336669922, -0.2372283935546875, 0.03411865234375, 0.1604156494140625, 0.05081939697265625, 0.2833709716796875, -0.374725341796875, 0.1900930404663086, 0.3489532470703125, 0.3610343933105469, 0.4197120666503906, 0.03988075256347656, -0.242584228515625, -0.33620452880859375, -0.24564361572265625, 0.5070037841796875, 0.6623077392578125, -1.5392608642578125, 0.26126861572265625, 0.0720672607421875, -0.4659767150878906, 0.513763427734375, -0.05111885070800781, 0.047550201416015625, -0.44158172607421875, 0.5620040893554688, 0.5935115814208984, -0.007904052734375, 0.1534881591796875, 0.42890167236328125, -0.002044677734375, -0.8445587158203125, -0.2234039306640625, 0.034058570861816406, -0.23534393310546875, -0.11190032958984375, 0.1864471435546875, -0.27056121826171875, 0.5999755859375, -0.7739105224609375, -0.07393836975097656, 0.010467529296875, 0.41347503662109375, -0.37038421630859375, -0.0077228546142578125, 0.09783172607421875, 0.10543441772460938, 0.016510009765625, 0.493499755859375, -0.27739715576171875, 0.2513427734375, 0.083038330078125, 0.0808868408203125, 0.23792648315429688, 0.13714599609375, 0.23627471923828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000004.npy"}
{"epoch": 0.005873715124816446, "step": 5, "batch_size": 64, "mean": 0.050250083208084106, "std": 0.46115413308143616, "min": -1.4350204467773438, "p10": -0.5997360229492187, "median": 0.10786819458007812, "p90": 0.613800048828125, "max": 0.9797210693359375, "pos_frac": 0.609375, "sample": [-0.05596923828125, 0.4426116943359375, 0.9797210693359375, -0.2719001770019531, 0.55908203125, -0.939605712890625, -0.10009002685546875, -0.26470947265625, 0.05677604675292969, 0.29526519775390625, 0.4035797119140625, 0.02789306640625, -0.09948539733886719, -0.4963798522949219, 0.6186065673828125, 0.046466827392578125, 0.4091606140136719, -0.2671852111816406, -0.7401962280273438, 0.611236572265625, 0.614898681640625, 0.7828140258789062, 0.687957763671875, -0.4164466857910156, 0.1392230987548828, -0.6291427612304688, 0.18212890625, 0.059741973876953125, 0.212554931640625, -0.06111907958984375, 0.13265609741210938, 0.22059249877929688, 0.12271881103515625, 0.09470367431640625, 0.1709136962890625, -1.4350204467773438, -0.04151153564453125, 0.13220596313476562, -0.0965728759765625, 0.49114227294921875, 0.3625030517578125, -0.5311203002929688, -0.7393836975097656, 0.228790283203125, 0.099853515625, 0.4904327392578125, -0.06656265258789062, -0.0484466552734375, -0.42026519775390625, 0.18964767456054688, 0.6017189025878906, 0.00742340087890625, 0.11588287353515625, -0.7720794677734375, -0.7352371215820312, 0.7516632080078125, 0.76641845703125, 0.1287689208984375, 0.5141525268554688, -0.2549896240234375, 0.17726898193359375, 0.1511077880859375, -0.21746826171875, -0.16339111328125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000005.npy"}
{"epoch": 0.007342143906020558, "step": 6, "batch_size": 64, "mean": -0.012855678796768188, "std": 0.4534810185432434, "min": -1.25262451171875, "p10": -0.5141487121582031, "median": 0.015073776245117188, "p90": 0.49160842895507817, "max": 0.9294586181640625, "pos_frac": 0.515625, "sample": [0.9294586181640625, 0.2570648193359375, 0.008922576904296875, -0.18935394287109375, -0.199554443359375, -0.01511383056640625, 0.132415771484375, -0.14378738403320312, -0.9499740600585938, -1.1980133056640625, -0.47502899169921875, -0.056652069091796875, 0.30796051025390625, -0.34765625, 0.381988525390625, 0.1121063232421875, -0.22469329833984375, 0.5652389526367188, 0.0531768798828125, 0.4690704345703125, 0.3829689025878906, -0.086334228515625, -0.160552978515625, 0.16835403442382812, 0.13053131103515625, -0.03565216064453125, 0.1070404052734375, 0.5324859619140625, -0.530914306640625, -0.4286308288574219, 0.48448944091796875, -0.6484603881835938, 0.4745635986328125, 0.18479156494140625, 0.605682373046875, 0.9205169677734375, 0.438629150390625, -0.028942108154296875, -0.055522918701171875, -0.8113555908203125, 0.09722900390625, 0.494659423828125, 0.5677337646484375, 0.09561538696289062, 0.2353973388671875, -0.10498428344726562, -0.4033317565917969, 0.4043998718261719, -0.137481689453125, 0.19829559326171875, 0.3209228515625, 0.2798004150390625, -0.14655303955078125, 0.10594558715820312, 0.13553619384765625, -0.42626380920410156, -0.25213623046875, -0.205963134765625, -1.130859375, -0.186065673828125, 0.0212249755859375, -0.3578147888183594, -1.25262451171875, -0.2367095947265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000006.npy"}
{"epoch": 0.00881057268722467, "step": 7, "batch_size": 64, "mean": 0.06436613202095032, "std": 0.5290825366973877, "min": -0.9635543823242188, "p10": -0.5229545593261719, "median": 0.09592437744140625, "p90": 0.6153366088867188, "max": 2.313720703125, "pos_frac": 0.53125, "sample": [0.28116607666015625, -0.118133544921875, 0.2548866271972656, 0.44460296630859375, -0.1761016845703125, -0.7268486022949219, 0.18441009521484375, -0.099700927734375, 0.25171661376953125, 0.48326873779296875, 0.612335205078125, -0.3421173095703125, 0.6335678100585938, -0.16661453247070312, 1.1714935302734375, 0.2541046142578125, -0.15111160278320312, -0.04913139343261719, -0.21782302856445312, -0.6963958740234375, 0.18462371826171875, 0.219512939453125, 0.30684661865234375, -0.3516349792480469, -0.9418487548828125, 0.28130149841308594, 0.3187255859375, -0.2561511993408203, -0.0023193359375, -0.5576934814453125, -0.27194976806640625, -0.41054534912109375, 0.19028472900390625, 0.3265228271484375, 0.14810943603515625, 0.26006317138671875, -0.5265731811523438, 0.26294708251953125, 2.313720703125, -0.097869873046875, -0.92608642578125, 0.2012481689453125, -0.3591423034667969, -0.204833984375, 0.724395751953125, 0.2960662841796875, -0.5145111083984375, -0.18524169921875, -0.2201385498046875, 0.39012908935546875, 1.2130126953125, 0.6166229248046875, -0.9635543823242188, -0.05039215087890625, -0.30410003662109375, 0.0347137451171875, 0.212432861328125, -0.4550018310546875, 0.203521728515625, 0.6589813232421875, 0.04373931884765625, 0.445220947265625, 0.2362060546875, -0.19750213623046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000007.npy"}
{"epoch": 0.010279001468428781, "step": 8, "batch_size": 64, "mean": -0.11213211715221405, "std": 0.4139474630355835, "min": -1.1396636962890625, "p10": -0.6442901611328125, "median": -0.07636499404907227, "p90": 0.3714994430541993, "max": 0.926513671875, "pos_frac": 0.40625, "sample": [0.1102142333984375, -0.1576690673828125, 0.027362823486328125, -0.3565692901611328, 0.355316162109375, -0.10873603820800781, 0.14641952514648438, -0.6890487670898438, 0.7685394287109375, -0.5408706665039062, -0.5462875366210938, 0.6866531372070312, -0.23784255981445312, 0.057979583740234375, 0.001434326171875, -0.0401611328125, -0.3192462921142578, -0.20987701416015625, -0.08473968505859375, 0.060821533203125, 0.0816802978515625, 0.225860595703125, -1.05621337890625, -1.1396636962890625, -0.22064208984375, -0.45317840576171875, -0.0568695068359375, -0.28214263916015625, -0.8209381103515625, 0.49217987060546875, 0.01041412353515625, 0.5407257080078125, -0.09528732299804688, 0.203399658203125, -0.12842178344726562, -0.18480682373046875, -0.5716705322265625, 0.3556232452392578, -0.07491016387939453, 0.0160369873046875, -0.618377685546875, -0.2762451171875, -0.24633026123046875, -0.849853515625, -0.4932518005371094, -0.48822021484375, -0.796844482421875, -0.0362091064453125, 0.1695995330810547, -0.07781982421875, 0.27703857421875, 0.37830352783203125, -0.437103271484375, -0.2049560546875, 0.0884246826171875, 0.20798110961914062, 0.5087814331054688, 0.00498199462890625, -0.6553955078125, 0.926513671875, -0.2680702209472656, -0.05841827392578125, 0.034725189208984375, -0.03057861328125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000008.npy"}
{"epoch": 0.011747430249632892, "step": 9, "batch_size": 64, "mean": 0.020801380276679993, "std": 0.49004927277565, "min": -1.2135086059570312, "p10": -0.5505428314208984, "median": 0.017258167266845703, "p90": 0.6556114196777347, "max": 1.0081024169921875, "pos_frac": 0.53125, "sample": [-0.491912841796875, 0.154571533203125, 0.7674026489257812, -0.021942138671875, -0.13044357299804688, -0.19608688354492188, 0.3235626220703125, -0.06397628784179688, 0.09197998046875, 0.00150299072265625, -0.326690673828125, -0.5760498046875, -0.4739990234375, 0.8680191040039062, 0.33206939697265625, 1.0081024169921875, 0.6985130310058594, 0.15790176391601562, 0.2776031494140625, -0.38452911376953125, -0.502197265625, -0.09506607055664062, 0.3520965576171875, -0.7941055297851562, -0.7601165771484375, 0.028900146484375, -0.38947296142578125, -0.082763671875, 0.35434722900390625, -0.461822509765625, -0.16617202758789062, 0.2804450988769531, -0.02591705322265625, 0.8075027465820312, 0.10151290893554688, -0.4408416748046875, 0.005616188049316406, -0.000980377197265625, 0.4744720458984375, -1.2135086059570312, -0.4520759582519531, 0.3103179931640625, 0.4642333984375, 0.3501091003417969, -0.48874664306640625, 0.7372360229492188, 0.37923431396484375, -0.420013427734375, 0.07775115966796875, -0.040927886962890625, 0.47045135498046875, 0.12684249877929688, 0.2942962646484375, -0.5712623596191406, 0.3524284362792969, -0.9370269775390625, 0.5436553955078125, -0.368499755859375, 0.5555076599121094, 0.50311279296875, -0.05713653564453125, 0.9129180908203125, -1.04083251953125, 0.14218902587890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000009.npy"}
{"epoch": 0.013215859030837005, "step": 10, "batch_size": 64, "mean": -0.07037210464477539, "std": 0.4621691405773163, "min": -1.1674385070800781, "p10": -0.6334968566894531, "median": -0.014514923095703125, "p90": 0.4082340240478516, "max": 1.276580810546875, "pos_frac": 0.46875, "sample": [0.201568603515625, -0.001674652099609375, -0.33704566955566406, 0.08233642578125, 0.3061866760253906, -0.068206787109375, -0.05318260192871094, -0.91986083984375, -0.3732757568359375, -0.7490463256835938, -0.36606597900390625, 0.27750396728515625, -0.2135009765625, -0.40457916259765625, 0.19731903076171875, -0.5104522705078125, -0.8551177978515625, 0.05123138427734375, 0.07109451293945312, -0.5704879760742188, 1.276580810546875, -0.30548858642578125, 0.20947265625, 0.1490001678466797, -0.10807037353515625, 0.30509185791015625, -1.053131103515625, -1.1674385070800781, -0.31586456298828125, -0.37635040283203125, 0.9894561767578125, 0.15822601318359375, -0.23845481872558594, -0.22867584228515625, -0.102935791015625, -0.6241989135742188, -0.0081787109375, 0.154541015625, 0.1646881103515625, 0.023370742797851562, -0.22529983520507812, -0.035064697265625, 0.3984794616699219, 0.05377197265625, -0.48470306396484375, -0.02085113525390625, -0.196533203125, 0.48709869384765625, 0.0463104248046875, -0.45517730712890625, -0.329620361328125, 0.36466407775878906, 0.3443145751953125, 0.005817413330078125, 0.10515594482421875, 0.20269393920898438, -0.6101722717285156, 0.41241455078125, -0.637481689453125, 0.82391357421875, -0.6859130859375, 0.437713623046875, 0.7625846862792969, 0.06568527221679688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000010.npy"}
{"epoch": 0.014684287812041116, "step": 11, "batch_size": 64, "mean": 0.053068608045578, "std": 0.4189911186695099, "min": -0.71270751953125, "p10": -0.5400146484374999, "median": 0.056382179260253906, "p90": 0.550079345703125, "max": 1.273284912109375, "pos_frac": 0.546875, "sample": [0.16375350952148438, 0.2333984375, 0.15923118591308594, -0.005832672119140625, 0.2266693115234375, -0.002899169921875, 0.6132659912109375, -0.2548084259033203, 0.19656944274902344, 0.970916748046875, 0.09222412109375, 0.5025367736816406, 0.5390777587890625, -0.67230224609375, -0.1138916015625, 0.2334747314453125, -0.05658721923828125, 0.0099029541015625, 0.97186279296875, -0.1506805419921875, 0.002056121826171875, -0.06324005126953125, 0.12140274047851562, -0.2193145751953125, 0.37689208984375, -0.3030357360839844, 0.2499847412109375, 0.5547943115234375, -0.4886932373046875, 0.5878143310546875, 0.34716796875, -0.0476531982421875, 0.2526435852050781, -0.223876953125, -0.360565185546875, -0.2818603515625, -0.6366500854492188, -0.4970550537109375, 0.1132965087890625, 0.12971878051757812, 0.31878662109375, -0.6234054565429688, 0.482452392578125, -0.71270751953125, 0.11774444580078125, -0.582672119140625, 0.9428787231445312, 0.07912445068359375, 1.273284912109375, -0.08459854125976562, -0.2971229553222656, 0.3726043701171875, -0.5584259033203125, 0.2916412353515625, -0.13685226440429688, -0.0201568603515625, 0.1295623779296875, -0.01822662353515625, -0.3926353454589844, 0.10232162475585938, -0.6277847290039062, 0.03363990783691406, -0.18280601501464844, 0.22003555297851562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000011.npy"}
{"epoch": 0.016152716593245228, "step": 12, "batch_size": 64, "mean": 0.011729925870895386, "std": 0.5200908780097961, "min": -1.458038330078125, "p10": -0.6015251159667968, "median": 0.044747352600097656, "p90": 0.6956314086914064, "max": 1.120452880859375, "pos_frac": 0.546875, "sample": [0.3284149169921875, -0.25658416748046875, 0.3593902587890625, -0.96051025390625, -0.5645294189453125, -0.4496612548828125, -0.35767364501953125, 0.70458984375, 0.0731658935546875, -0.22127532958984375, 0.3057861328125, -1.458038330078125, -0.5412139892578125, 0.0032958984375, 0.13083267211914062, -0.3771209716796875, 0.0382232666015625, 1.120452880859375, -0.1819019317626953, 0.029895782470703125, 0.9902496337890625, -0.0828094482421875, 0.2730712890625, -0.2558135986328125, 0.8587875366210938, -0.618865966796875, 0.6747283935546875, -1.2048797607421875, 0.08574295043945312, 0.3772125244140625, -0.61077880859375, -0.5799331665039062, -0.5094985961914062, 0.28084564208984375, 0.1045989990234375, 0.5322418212890625, -0.28334617614746094, -0.793914794921875, -0.01811981201171875, -0.057468414306640625, 0.066192626953125, -0.10691452026367188, 0.07854461669921875, 0.8323516845703125, 0.199798583984375, -0.12126922607421875, 0.1497344970703125, -0.8203887939453125, -0.18540191650390625, 0.5658950805664062, -0.37216949462890625, -0.1222991943359375, -0.07572174072265625, 0.59149169921875, 0.108978271484375, 0.7955322265625, 0.4329376220703125, -0.2978553771972656, 0.19951629638671875, 0.05127143859863281, 0.249267578125, 0.2708168029785156, 1.0045166015625, 0.3683013916015625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000012.npy"}
{"epoch": 0.01762114537444934, "step": 13, "batch_size": 64, "mean": -0.05992648005485535, "std": 0.4594220221042633, "min": -1.248565673828125, "p10": -0.6414340972900389, "median": -0.11239242553710938, "p90": 0.5087562561035157, "max": 1.50872802734375, "pos_frac": 0.390625, "sample": [-0.097412109375, -0.40200042724609375, -0.0741424560546875, -0.8432693481445312, 0.1962738037109375, 0.07083892822265625, -0.8145065307617188, 0.16962051391601562, -0.7192573547363281, -0.276702880859375, -0.1236572265625, -0.172637939453125, -0.3923835754394531, 0.17414093017578125, 0.1380615234375, 0.6632003784179688, -0.8163986206054688, -0.189208984375, -0.07394027709960938, 0.51690673828125, 0.2457256317138672, 0.29036712646484375, 0.6244888305664062, -0.047405242919921875, -0.2993431091308594, 0.8609619140625, -0.3354988098144531, 0.022708892822265625, -0.0037784576416015625, 0.060699462890625, -0.3167877197265625, -0.27400970458984375, -0.018829345703125, 0.44283294677734375, -0.166473388671875, -0.12744522094726562, -0.34607696533203125, 0.48973846435546875, 0.19389915466308594, -1.248565673828125, -0.18301773071289062, -0.17431640625, 0.26776123046875, -0.2816314697265625, -0.45984649658203125, 0.14656448364257812, -0.1936187744140625, -0.8119850158691406, 0.6003684997558594, -0.340087890625, -0.405731201171875, -0.38849639892578125, -0.7439956665039062, -0.15858078002929688, 0.12799835205078125, 1.50872802734375, -0.3439521789550781, -0.10112762451171875, 0.9376220703125, -0.24684906005859375, 0.1792755126953125, -0.132659912109375, 0.22526168823242188, 0.15628814697265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000013.npy"}
{"epoch": 0.01908957415565345, "step": 14, "batch_size": 64, "mean": -0.01999080181121826, "std": 0.46131253242492676, "min": -1.5675735473632812, "p10": -0.6650863647460936, "median": -0.00131988525390625, "p90": 0.5624290466308595, "max": 0.969329833984375, "pos_frac": 0.5, "sample": [0.13909149169921875, -0.33934783935546875, 0.25594139099121094, 0.5887451171875, -0.7191619873046875, -0.1349334716796875, -0.40484619140625, -0.0053863525390625, -1.5675735473632812, 0.21016693115234375, -0.38982391357421875, 0.38063812255859375, 0.716583251953125, 0.060546875, -0.538909912109375, -0.21242523193359375, 0.7610282897949219, 0.5701217651367188, -0.7413482666015625, -0.2269439697265625, 0.0458831787109375, -0.22668075561523438, -0.04276275634765625, 0.020660400390625, -0.2547149658203125, 0.5044021606445312, 0.5444793701171875, -0.06299209594726562, 0.7178115844726562, -0.406707763671875, -0.18029022216796875, -0.2881202697753906, 0.00274658203125, -0.8647918701171875, -0.19155120849609375, 0.291717529296875, -0.0640106201171875, -0.1293487548828125, 0.3658599853515625, 0.15816116333007812, 0.21209716796875, 0.32863616943359375, -0.9658584594726562, 0.0789794921875, -0.501068115234375, 0.08840179443359375, 0.25794219970703125, 0.704193115234375, -0.04911041259765625, 0.22492218017578125, -0.399566650390625, -0.012908935546875, -0.8038177490234375, -0.1348114013671875, -0.06089210510253906, -0.206634521484375, 0.12294769287109375, 0.969329833984375, 0.20891952514648438, 0.22231292724609375, 0.104217529296875, 0.3049812316894531, -0.7420806884765625, 0.42754364013671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000014.npy"}
{"epoch": 0.020558002936857563, "step": 15, "batch_size": 64, "mean": 0.06978106498718262, "std": 0.4787669777870178, "min": -1.0323257446289062, "p10": -0.47330245971679685, "median": 0.034122467041015625, "p90": 0.5984104156494142, "max": 1.838653564453125, "pos_frac": 0.578125, "sample": [0.08858871459960938, 0.644927978515625, 0.35352325439453125, 0.021787643432617188, 0.2850341796875, -0.43945884704589844, 0.013349533081054688, 0.26575469970703125, 0.09198760986328125, 0.401611328125, -0.033355712890625, 0.022457122802734375, -0.2993011474609375, 0.35101318359375, -0.4755363464355469, 0.264129638671875, 0.30258941650390625, 0.727508544921875, 0.02410125732421875, -0.112884521484375, -0.8458633422851562, 0.4899444580078125, -0.6426162719726562, -0.1449127197265625, 0.362701416015625, -0.39935302734375, -0.4680900573730469, -0.32027435302734375, 0.18389892578125, -0.0558013916015625, 0.4834747314453125, 0.13742828369140625, 0.61102294921875, -0.21841812133789062, -0.726287841796875, -1.0323257446289062, 0.6636734008789062, -0.09029388427734375, -0.11650848388671875, -0.11527442932128906, -0.0032501220703125, 0.5106773376464844, -0.000438690185546875, -0.12385368347167969, 0.6947517395019531, 0.06502914428710938, -0.5547351837158203, 0.012540817260742188, 0.24573516845703125, -0.847442626953125, 1.2279815673828125, 0.36208343505859375, 0.5689811706542969, 0.23363113403320312, 0.0441436767578125, 0.4948883056640625, 1.838653564453125, 0.34926605224609375, -0.2876605987548828, -0.33951568603515625, 0.12520980834960938, 0.1260986328125, -0.31374359130859375, -0.2169952392578125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000015.npy"}
{"epoch": 0.022026431718061675, "step": 16, "batch_size": 64, "mean": 0.015878498554229736, "std": 0.5513888001441956, "min": -1.7042465209960938, "p10": -0.6040153503417969, "median": -0.014085769653320312, "p90": 0.604778289794922, "max": 1.2442703247070312, "pos_frac": 0.5, "sample": [-0.10348892211914062, 1.0698699951171875, -0.08568572998046875, 1.2442703247070312, 0.5150909423828125, -0.2296295166015625, 0.5302276611328125, 0.004222869873046875, -0.13389968872070312, 1.088897705078125, -0.87994384765625, 0.20494461059570312, 0.1577911376953125, -0.1704864501953125, 0.15213966369628906, 0.5333251953125, -0.13818359375, -0.6174545288085938, -0.5566558837890625, -1.5968551635742188, 0.4671478271484375, -0.1436309814453125, -0.03459930419921875, 0.5706787109375, -0.048583984375, 0.07403564453125, 0.4128570556640625, -0.10488128662109375, -0.14476585388183594, -0.04609107971191406, 0.03931427001953125, 0.6798057556152344, 0.3038291931152344, 0.5529251098632812, -0.10905838012695312, -0.43201446533203125, 0.6193923950195312, -0.122955322265625, 0.05448150634765625, 0.28720855712890625, 0.2105426788330078, 0.623992919921875, 0.1717090606689453, -0.309112548828125, 0.498138427734375, -0.6017990112304688, -0.03548431396484375, -0.04725074768066406, -0.39736175537109375, 0.10269927978515625, -0.29349517822265625, -0.6049652099609375, 0.9017181396484375, -0.3448333740234375, 0.09398651123046875, -0.39138031005859375, 0.1058807373046875, 0.55322265625, -1.7042465209960938, -1.2049560546875, -0.69403076171875, -0.0323944091796875, 0.23202133178710938, 0.32003021240234375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000016.npy"}
{"epoch": 0.023494860499265784, "step": 17, "batch_size": 64, "mean": 0.08168637752532959, "std": 0.4811326265335083, "min": -1.10064697265625, "p10": -0.44996337890625, "median": 0.025850296020507812, "p90": 0.615300750732422, "max": 1.660614013671875, "pos_frac": 0.5625, "sample": [0.029541015625, -0.035030364990234375, 0.173797607421875, 0.5271453857421875, 0.8920669555664062, 0.19577980041503906, 0.9028472900390625, 0.1432647705078125, -0.028308868408203125, -0.48609161376953125, 0.15929412841796875, 1.2815093994140625, -0.4525909423828125, 0.8851318359375, 0.00432586669921875, 0.32283782958984375, 0.01727294921875, 0.2746772766113281, -0.030941009521484375, 0.43878936767578125, -0.0220489501953125, -0.145721435546875, -0.2587165832519531, 0.5732536315917969, 0.21570587158203125, 0.022159576416015625, 0.5518417358398438, -0.5845489501953125, -0.1515350341796875, -0.2577629089355469, -0.7448577880859375, 0.032623291015625, 0.824462890625, -0.562530517578125, -0.24718475341796875, -0.2967071533203125, 0.21515655517578125, -0.053104400634765625, 0.034252166748046875, -1.10064697265625, 0.3037567138671875, 0.4121513366699219, -0.4316864013671875, -0.04049873352050781, 0.00130462646484375, 0.1138916015625, 0.15377044677734375, -0.16139984130859375, 0.5940933227539062, -0.12579727172851562, 0.30135345458984375, -0.16941070556640625, 1.660614013671875, -0.2986412048339844, 0.33437347412109375, 0.429168701171875, -0.36041259765625, -0.3621673583984375, 0.6243896484375, -0.8507843017578125, -0.15076065063476562, -0.4438323974609375, 0.21422576904296875, 0.22081756591796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000017.npy"}
{"epoch": 0.024963289280469897, "step": 18, "batch_size": 64, "mean": -0.03281354904174805, "std": 0.5458509922027588, "min": -1.424224853515625, "p10": -0.6397163391113281, "median": 0.01363372802734375, "p90": 0.5853111267089852, "max": 1.638031005859375, "pos_frac": 0.5, "sample": [0.06031036376953125, -0.8029632568359375, -0.14133453369140625, 1.2598114013671875, -0.38600921630859375, 0.045650482177734375, -0.5062141418457031, -1.2933349609375, 0.6702423095703125, -0.5502166748046875, -0.75396728515625, -0.1794891357421875, -0.088409423828125, -1.005859375, 0.345672607421875, 1.1177444458007812, 0.0738372802734375, 0.21190643310546875, -0.8789634704589844, 0.7515640258789062, 0.09694671630859375, 0.1083526611328125, -0.47454833984375, -0.2684974670410156, 0.38713836669921875, -0.15683746337890625, -0.5760955810546875, 0.1357421875, -0.2115325927734375, 0.3737640380859375, 0.19805145263671875, -0.09464454650878906, 0.3349113464355469, 0.2105255126953125, 0.211334228515625, 0.03692626953125, 0.08919906616210938, 0.2761363983154297, 1.638031005859375, -0.5850982666015625, -0.000492095947265625, -0.17009735107421875, 0.27667999267578125, -0.5501251220703125, -1.424224853515625, -0.6069412231445312, 0.14053726196289062, 0.18960189819335938, 0.3524627685546875, -0.6537628173828125, -0.2851371765136719, -0.036407470703125, 0.9182815551757812, -0.230010986328125, -0.12092018127441406, -0.283721923828125, -0.3052215576171875, -0.11743354797363281, 0.7303619384765625, 0.10820770263671875, 0.2815589904785156, -0.19342803955078125, 0.1726226806640625, 0.027759552001953125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000018.npy"}
{"epoch": 0.02643171806167401, "step": 19, "batch_size": 64, "mean": -0.07938426733016968, "std": 0.3820852041244507, "min": -1.003173828125, "p10": -0.55648193359375, "median": -0.07369327545166016, "p90": 0.39879035949707037, "max": 0.9000091552734375, "pos_frac": 0.40625, "sample": [-0.3709564208984375, 0.5288028717041016, -0.11291885375976562, -0.2521858215332031, -0.07001113891601562, 0.14788818359375, 0.23466110229492188, -1.003173828125, 0.045566558837890625, -0.4241943359375, 0.24512100219726562, -0.2880096435546875, -0.173126220703125, -0.6991043090820312, 0.2633056640625, 0.060516357421875, 0.391754150390625, 0.46209716796875, 0.9000091552734375, -0.2265472412109375, -0.3448944091796875, 0.011749267578125, 0.11120414733886719, -0.231842041015625, -0.07737541198730469, -0.12532997131347656, 0.50482177734375, -0.029205322265625, -0.021953582763671875, 0.10292816162109375, -0.00530242919921875, 0.5671844482421875, 0.28526878356933594, -0.23273468017578125, -0.3402252197265625, -0.2991981506347656, 0.2922821044921875, 0.018358230590820312, -0.18951416015625, -0.97552490234375, 0.01464080810546875, -0.9234619140625, -0.1511993408203125, -0.69342041015625, -0.16106414794921875, -0.3944549560546875, -0.29607391357421875, -0.42156219482421875, -0.538665771484375, -0.47231292724609375, 0.36359405517578125, -0.14162826538085938, -0.117431640625, -0.026317596435546875, 0.2830810546875, 0.040500640869140625, -0.24329376220703125, 0.4018058776855469, -0.00250244140625, -0.564117431640625, 0.4236297607421875, 0.16234970092773438, 0.32514190673828125, -0.628021240234375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000019.npy"}
{"epoch": 0.027900146842878122, "step": 20, "batch_size": 64, "mean": 0.025068938732147217, "std": 0.49268946051597595, "min": -1.283935546875, "p10": -0.599932861328125, "median": 0.03421783447265625, "p90": 0.5344738006591797, "max": 1.5731201171875, "pos_frac": 0.53125, "sample": [0.033935546875, 0.3413124084472656, 0.05454254150390625, -0.4401702880859375, 0.2918548583984375, 0.07238006591796875, -0.29715728759765625, 0.07279205322265625, 0.5399703979492188, -0.26251983642578125, -0.58245849609375, 0.45562744140625, -0.7040596008300781, 0.1742401123046875, 0.307098388671875, 0.047519683837890625, 0.5216484069824219, -0.23516082763671875, 0.4242401123046875, 0.0345001220703125, -0.08446502685546875, -0.607421875, 1.2593460083007812, -0.19186019897460938, -1.283935546875, 0.32724761962890625, 0.2550048828125, -0.2521553039550781, -0.12066650390625, -0.19221115112304688, -0.16495132446289062, 0.0210723876953125, 0.793701171875, -0.3629951477050781, 0.5802040100097656, 0.04160308837890625, -0.1849212646484375, -0.242584228515625, -0.11912155151367188, 0.391448974609375, -0.4392852783203125, -0.2645416259765625, -0.8082427978515625, 0.37105560302734375, 0.2521514892578125, -0.08304214477539062, -0.89776611328125, 0.3572845458984375, 0.41759490966796875, -0.3277702331542969, -0.68536376953125, -0.9455337524414062, 0.37500762939453125, 0.457855224609375, 0.8194732666015625, -0.012149810791015625, 0.610992431640625, 0.18933486938476562, 0.14400100708007812, -0.172637939453125, 0.16196060180664062, 1.5731201171875, -0.16997528076171875, -0.031585693359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000020.npy"}
{"epoch": 0.02936857562408223, "step": 21, "batch_size": 64, "mean": 0.09163343906402588, "std": 0.41489726305007935, "min": -0.6199951171875, "p10": -0.45552978515625, "median": 0.10741806030273438, "p90": 0.6384391784667972, "max": 1.1800994873046875, "pos_frac": 0.578125, "sample": [-0.497161865234375, -0.10247039794921875, 0.7241897583007812, -0.6199951171875, -0.395599365234375, 0.10056495666503906, 0.2972888946533203, 0.40666961669921875, 0.43122100830078125, -0.45760345458984375, -0.149261474609375, 0.33589935302734375, -0.18607139587402344, -0.5765838623046875, 0.03923225402832031, 0.49273681640625, -0.06154632568359375, 0.334625244140625, 0.35729217529296875, -0.2136993408203125, -0.291839599609375, 1.0192108154296875, 0.8838653564453125, -0.45069122314453125, -0.1685504913330078, 0.11157989501953125, 1.1800994873046875, 0.3079071044921875, 0.08461761474609375, 0.1032562255859375, 0.1741180419921875, 0.334686279296875, 0.1673736572265625, -0.29360198974609375, -0.2919158935546875, -0.03818511962890625, -0.3549346923828125, -0.24221038818359375, 0.2676544189453125, 0.19721221923828125, 0.5644989013671875, -0.3423614501953125, -0.5978164672851562, 0.2163410186767578, 0.3673515319824219, 0.15613937377929688, -0.15504837036132812, 0.6701278686523438, -0.00460052490234375, -0.5345001220703125, -0.19404983520507812, 0.07596206665039062, -0.2709808349609375, -0.4960479736328125, 0.6782608032226562, -0.27117156982421875, 0.3153076171875, 0.13095855712890625, 0.39112091064453125, 0.40959930419921875, 0.8920974731445312, 0.12479400634765625, 0.5250282287597656, 0.254150390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000021.npy"}
{"epoch": 0.030837004405286344, "step": 22, "batch_size": 64, "mean": 0.02373659610748291, "std": 0.4126981496810913, "min": -1.053131103515625, "p10": -0.4960292816162109, "median": 0.06216621398925781, "p90": 0.4515380859375, "max": 1.2950439453125, "pos_frac": 0.546875, "sample": [0.2111053466796875, 0.6728515625, -0.25286865234375, -0.0231475830078125, 0.5994415283203125, -0.6207427978515625, -0.405853271484375, -0.09981536865234375, -0.49967193603515625, 0.44924163818359375, -0.1578521728515625, -0.442962646484375, -0.507537841796875, 0.003070831298828125, -0.8138923645019531, -1.053131103515625, -0.0804901123046875, 0.17235565185546875, 0.20611572265625, 0.4132843017578125, -0.4875297546386719, 0.5204620361328125, 0.31877899169921875, 0.3950653076171875, 0.368804931640625, 0.27283477783203125, 0.2176361083984375, -0.26416015625, 0.3116912841796875, -0.1632843017578125, -0.24383163452148438, 0.14025115966796875, -0.6841278076171875, 0.1408538818359375, 0.218536376953125, -0.27610015869140625, -0.1800079345703125, -0.2859039306640625, 0.17760658264160156, -0.23372650146484375, 0.2104644775390625, 0.22522735595703125, 0.14850234985351562, -0.24390792846679688, 0.0038909912109375, -0.31890869140625, -0.0386962890625, 0.60430908203125, 0.4322967529296875, 0.3479881286621094, -0.430633544921875, 0.42645263671875, 0.3939170837402344, 0.027194976806640625, 0.097137451171875, -0.625640869140625, 0.2622528076171875, 0.35608673095703125, -0.2180023193359375, 1.2950439453125, 0.495086669921875, -0.0334320068359375, 0.45252227783203125, -0.3833599090576172], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000022.npy"}
{"epoch": 0.032305433186490456, "step": 23, "batch_size": 64, "mean": -0.05415254831314087, "std": 0.4110610783100128, "min": -1.60888671875, "p10": -0.48993263244628904, "median": -0.013914108276367188, "p90": 0.40613784790039065, "max": 0.84295654296875, "pos_frac": 0.453125, "sample": [-0.010469436645507812, 0.4111824035644531, 0.0046234130859375, 0.07281494140625, 0.15042877197265625, -0.4949531555175781, 0.44272422790527344, -0.157989501953125, -0.3162727355957031, 0.3893890380859375, 0.322113037109375, -0.26219940185546875, -0.1585540771484375, -0.3946533203125, -0.15439224243164062, -0.015850067138671875, 0.03753662109375, -0.42198944091796875, -0.32598876953125, 0.07860946655273438, -0.6077346801757812, 0.37100982666015625, 0.6572952270507812, -0.3763236999511719, -0.35779571533203125, -0.9359130859375, 0.14727020263671875, -0.0119781494140625, 0.6467132568359375, 0.84295654296875, -0.15370941162109375, 0.11505126953125, 0.15264129638671875, -0.031475067138671875, -0.36488914489746094, -0.18155670166015625, -0.3584136962890625, -0.17514801025390625, -0.032817840576171875, 0.5813179016113281, 0.3943672180175781, -0.011236190795898438, 0.05651664733886719, 0.18640518188476562, -0.3745994567871094, 0.2310943603515625, 0.3412933349609375, -0.517059326171875, -0.2899932861328125, -0.625823974609375, 0.08294868469238281, -0.06732559204101562, 0.16399002075195312, 0.3497276306152344, 0.4858417510986328, -0.285064697265625, 0.16652679443359375, -1.60888671875, -0.08195304870605469, -0.808563232421875, 0.3273468017578125, -0.47821807861328125, 0.1041259765625, -0.329833984375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000023.npy"}
{"epoch": 0.033773861967694566, "step": 24, "batch_size": 64, "mean": 0.03898155689239502, "std": 0.46922895312309265, "min": -1.081024169921875, "p10": -0.5974523544311522, "median": -0.015270233154296875, "p90": 0.6718433380126954, "max": 1.1497955322265625, "pos_frac": 0.484375, "sample": [-0.28041839599609375, -0.23750686645507812, -0.6492576599121094, -0.08784294128417969, 0.42945098876953125, -0.00025177001953125, 0.4704437255859375, -0.14927291870117188, -0.22119140625, 0.05522918701171875, -0.16220855712890625, 0.359588623046875, -0.15108299255371094, 0.42059326171875, 0.2538414001464844, -0.0302886962890625, -0.306976318359375, -0.8388938903808594, -0.308929443359375, 0.2174835205078125, -0.08158111572265625, 0.17602920532226562, 0.19061851501464844, -0.7714385986328125, 1.1497955322265625, 0.24478530883789062, 0.6723594665527344, 0.4293365478515625, -0.230926513671875, 0.3522796630859375, 0.620819091796875, -0.41585540771484375, -0.21793746948242188, 0.7168731689453125, 0.20338821411132812, 0.12786865234375, 0.47222900390625, -0.19416046142578125, 0.6706390380859375, 0.14754486083984375, -0.301483154296875, -0.6458225250244141, -0.1270599365234375, 0.796112060546875, -0.2985496520996094, -0.12728118896484375, 0.718414306640625, -0.15065956115722656, -1.081024169921875, 0.1654815673828125, 0.0920562744140625, -0.32697486877441406, -0.7398872375488281, -0.26695823669433594, 0.308319091796875, -0.1197509765625, 0.21930313110351562, 0.9086151123046875, -0.08929634094238281, 1.0177078247070312, -0.484588623046875, 0.3863525390625, -0.827728271484375, 0.424346923828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000024.npy"}
{"epoch": 0.03524229074889868, "step": 25, "batch_size": 64, "mean": 0.05028343200683594, "std": 0.3765219449996948, "min": -0.657928466796875, "p10": -0.43697509765625, "median": 0.04723072052001953, "p90": 0.41669368743896484, "max": 1.2425994873046875, "pos_frac": 0.625, "sample": [-0.17417144775390625, -0.3479042053222656, 0.075927734375, 0.17945098876953125, 0.043025970458984375, 0.04834175109863281, 0.417022705078125, -0.34293365478515625, -0.4376983642578125, -0.1891765594482422, 0.7571258544921875, 0.089813232421875, 0.10378646850585938, 0.3467864990234375, 0.6317596435546875, 0.031068801879882812, -0.6453475952148438, -0.43776702880859375, 0.02239990234375, -0.03926849365234375, -0.25232696533203125, 0.8946037292480469, 0.17682647705078125, 0.6916656494140625, 0.40592193603515625, 0.1775054931640625, 0.2884674072265625, 0.39534759521484375, -0.448883056640625, -0.18284034729003906, -0.657928466796875, -0.4878349304199219, -0.21638107299804688, -0.4352874755859375, -0.47674560546875, 0.04930877685546875, 0.04504966735839844, 1.0017242431640625, 1.2425994873046875, 0.1963043212890625, 0.20080947875976562, -0.2700958251953125, 0.25243377685546875, 0.03203582763671875, 0.04611968994140625, -0.1941986083984375, 0.15242767333984375, -0.3384246826171875, 0.2200164794921875, 0.0951385498046875, 0.164337158203125, -0.4187469482421875, 0.02126312255859375, 0.10626220703125, 0.13446807861328125, 0.4159259796142578, 0.17009735107421875, -0.13442230224609375, 0.03328704833984375, 0.15095138549804688, -0.0573272705078125, -0.2458953857421875, -0.11278533935546875, 0.2551231384277344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000025.npy"}
{"epoch": 0.03671071953010279, "step": 26, "batch_size": 64, "mean": 0.072520911693573, "std": 0.414627343416214, "min": -0.936004638671875, "p10": -0.3963409423828125, "median": 0.12196731567382812, "p90": 0.5826358795166019, "max": 1.1750335693359375, "pos_frac": 0.5625, "sample": [0.22930908203125, 0.19655227661132812, 0.40748023986816406, -0.7862167358398438, 0.39385986328125, 0.33145904541015625, -0.4702606201171875, 0.654052734375, 0.617340087890625, -0.400909423828125, 1.1750335693359375, 0.7645111083984375, 0.33050537109375, 0.3621826171875, 0.2124786376953125, 0.022186279296875, -0.498809814453125, 0.178619384765625, 0.427947998046875, -0.09949874877929688, -0.2709159851074219, -0.056598663330078125, 0.2908592224121094, 0.7056427001953125, -0.8178329467773438, -0.936004638671875, -0.2877349853515625, -0.1265869140625, 0.2830181121826172, -0.8278732299804688, 0.16229248046875, -0.322235107421875, -0.050289154052734375, -0.01055908203125, -0.23413658142089844, 0.13205718994140625, -0.3450164794921875, -0.2195281982421875, 0.3219490051269531, -0.145294189453125, -0.034259796142578125, 0.4904327392578125, 0.13164520263671875, -0.10852813720703125, 0.45552825927734375, 0.19274139404296875, -0.09769439697265625, -0.159698486328125, -0.04264640808105469, 0.5016593933105469, 0.074676513671875, 0.01141357421875, -0.38568115234375, 0.1122894287109375, 0.445953369140625, 0.64520263671875, -0.11862945556640625, 0.1515960693359375, 0.9412918090820312, -0.3307037353515625, -0.057254791259765625, 0.14781570434570312, 0.16608810424804688, 0.21506500244140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000026.npy"}
{"epoch": 0.0381791483113069, "step": 27, "batch_size": 64, "mean": 0.08974292874336243, "std": 0.4769224226474762, "min": -1.5447998046875, "p10": -0.3277442932128906, "median": 0.07131576538085938, "p90": 0.67774658203125, "max": 0.9720611572265625, "pos_frac": 0.59375, "sample": [0.19358444213867188, 0.9546165466308594, -0.6001129150390625, -0.4619560241699219, 0.09436798095703125, 0.199066162109375, -0.0651092529296875, 0.7569427490234375, 0.37066650390625, -0.19957351684570312, 0.0477142333984375, 0.5380325317382812, 0.7890777587890625, -0.14570236206054688, -0.318023681640625, 0.542694091796875, 0.404510498046875, 0.015411376953125, 0.3956336975097656, 0.153350830078125, 0.035541534423828125, 0.0589752197265625, 0.19146728515625, -0.23562049865722656, -0.1032257080078125, -0.28398895263671875, -0.10126876831054688, -0.17350387573242188, 0.8635826110839844, 0.6821823120117188, 0.15215301513671875, 0.22053146362304688, 0.02706146240234375, -0.012359619140625, -0.04305267333984375, 0.9720611572265625, -0.32793426513671875, -0.327301025390625, -0.18389511108398438, -0.2190399169921875, 0.08365631103515625, -0.1812286376953125, -1.2720794677734375, 0.20099639892578125, -0.2904090881347656, -1.5447998046875, 0.08927154541015625, 0.3874359130859375, -0.2111663818359375, -0.05002593994140625, 0.31986236572265625, 0.5422515869140625, 0.6140060424804688, 0.6673965454101562, 0.909149169921875, 0.6278152465820312, -0.8392105102539062, 0.138580322265625, -0.01717376708984375, 0.39319610595703125, 0.00075531005859375, 0.4891357421875, -0.5160293579101562, 0.3446044921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000027.npy"}
{"epoch": 0.039647577092511016, "step": 28, "batch_size": 64, "mean": 0.12937626242637634, "std": 0.42452389001846313, "min": -1.18731689453125, "p10": -0.41595573425292964, "median": 0.15478134155273438, "p90": 0.6402637481689454, "max": 1.38092041015625, "pos_frac": 0.65625, "sample": [0.7977523803710938, 0.007049560546875, 0.501068115234375, 0.2993888854980469, -0.3566856384277344, 0.19626617431640625, 0.09129524230957031, 0.12360000610351562, 0.18825149536132812, -0.04517364501953125, 0.33527374267578125, -0.128448486328125, -0.0355224609375, -0.6187896728515625, -0.2835693359375, 0.18596267700195312, -0.15634918212890625, -0.133941650390625, -0.56103515625, 0.4094390869140625, 0.369720458984375, 0.081634521484375, 0.94036865234375, 1.38092041015625, 0.3475799560546875, 0.11249542236328125, 0.60137939453125, 0.4277191162109375, -0.12548828125, 0.34653472900390625, 0.053218841552734375, -0.23601531982421875, -0.13454437255859375, 0.4260101318359375, 0.6750221252441406, -0.3919258117675781, 0.040851593017578125, 0.4600830078125, -0.05007171630859375, 0.6236572265625, 0.6905670166015625, 0.3956489562988281, 0.21711349487304688, -0.1651763916015625, 0.20046234130859375, -1.18731689453125, -0.02495574951171875, 0.2672920227050781, 0.222991943359375, 0.28076934814453125, -0.4618568420410156, -0.0096282958984375, 0.4849357604980469, 0.23221588134765625, -0.5123939514160156, 0.0262603759765625, 0.04723358154296875, 0.65802001953125, -0.805145263671875, -0.4262542724609375, 0.6473808288574219, 0.3551025390625, 0.0897674560546875, 0.2920646667480469], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000028.npy"}
{"epoch": 0.041116005873715125, "step": 29, "batch_size": 64, "mean": 0.11628936231136322, "std": 0.4898125231266022, "min": -1.2747802734375, "p10": -0.5047500610351562, "median": 0.09204959869384766, "p90": 0.7017753601074219, "max": 1.1805076599121094, "pos_frac": 0.640625, "sample": [-0.08485794067382812, 0.10090827941894531, 0.109771728515625, 0.4473533630371094, 0.6844558715820312, -0.30867767333984375, -0.63958740234375, 0.03063201904296875, -0.710784912109375, 0.5208282470703125, -0.465789794921875, -0.12475872039794922, 0.6086959838867188, 1.0260009765625, -0.1617584228515625, 0.430694580078125, -0.511016845703125, 0.6269798278808594, 0.2121124267578125, 0.6445503234863281, -0.05629730224609375, 0.4712791442871094, -0.34644317626953125, 0.7854766845703125, 0.9850616455078125, 0.3649139404296875, 1.1805076599121094, 0.03070068359375, 0.2816925048828125, -1.2747802734375, 0.44503021240234375, 0.24847793579101562, -0.41884613037109375, 0.8715667724609375, 0.38268280029296875, -0.6124725341796875, 0.0335540771484375, -0.17798233032226562, 0.08319091796875, 0.6575927734375, -0.6930084228515625, 0.15289306640625, 0.31488800048828125, -0.4901275634765625, 0.2798480987548828, 0.3895835876464844, 0.0720062255859375, 0.01386260986328125, -2.288818359375e-05, 0.28970909118652344, -0.2478199005126953, 0.022863388061523438, 0.709197998046875, -0.39711761474609375, 0.525238037109375, 0.0416259765625, -0.6870269775390625, -0.4605255126953125, 0.3105888366699219, 0.00994873046875, 0.9551849365234375, -0.09461212158203125, 0.166717529296875, -0.11203384399414062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000029.npy"}
{"epoch": 0.042584434654919234, "step": 30, "batch_size": 64, "mean": 0.11767733097076416, "std": 0.5188489556312561, "min": -0.768890380859375, "p10": -0.5124351501464843, "median": 0.1428394317626953, "p90": 0.6388031005859376, "max": 2.34698486328125, "pos_frac": 0.5625, "sample": [-0.3286285400390625, 0.6629409790039062, 0.13829421997070312, 0.2125396728515625, 0.2276763916015625, 0.1473846435546875, 0.43492889404296875, -0.0910491943359375, -0.2690544128417969, -0.054473876953125, 0.01987457275390625, 1.4671859741210938, 0.37233734130859375, -0.03519439697265625, -0.077392578125, -0.6063308715820312, -0.5240478515625, 0.1963043212890625, -0.32796478271484375, -0.6637115478515625, -0.49359893798828125, 0.51922607421875, -0.5205078125, -0.27944183349609375, -0.0618896484375, -0.3306121826171875, 0.303985595703125, 0.4709930419921875, 0.016386032104492188, -0.38846778869628906, -0.140594482421875, 0.18412208557128906, 0.5729827880859375, -0.02330780029296875, 0.4436988830566406, 0.14759063720703125, 0.149505615234375, 2.34698486328125, 1.290069580078125, 0.7780914306640625, -0.06331443786621094, 0.203765869140625, 0.2565574645996094, 0.10988616943359375, 0.2138824462890625, -0.6888809204101562, -0.768890380859375, -0.028270721435546875, 0.1556987762451172, -0.04816436767578125, 0.3479042053222656, -0.03228759765625, 0.15013694763183594, 0.42235565185546875, -0.11885833740234375, 0.7206192016601562, 0.6048583984375, 0.653350830078125, -0.3902130126953125, 0.3282012939453125, -0.22896575927734375, 0.3187713623046875, -0.6548080444335938, 0.18117904663085938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000030.npy"}
{"epoch": 0.04405286343612335, "step": 31, "batch_size": 64, "mean": 0.05853772163391113, "std": 0.4506562054157257, "min": -1.1836624145507812, "p10": -0.40784225463867185, "median": 0.034852027893066406, "p90": 0.6275005340576173, "max": 1.217254638671875, "pos_frac": 0.515625, "sample": [-0.18190765380859375, -0.44161224365234375, 0.5860366821289062, 0.44678497314453125, 0.17057037353515625, -0.03672027587890625, 0.07285308837890625, -0.2264251708984375, -0.12673187255859375, 0.354949951171875, -1.1836624145507812, 0.6089820861816406, 0.03942108154296875, 0.030282974243164062, -0.2926521301269531, -0.24294662475585938, 0.06224822998046875, -0.11541938781738281, 0.58599853515625, 0.06017303466796875, -0.06439971923828125, -0.2159423828125, 0.08782958984375, 0.6833648681640625, 0.14918136596679688, -0.4245796203613281, -0.1820068359375, -0.056324005126953125, -0.1834716796875, 0.5666275024414062, -0.721893310546875, -0.2781982421875, 0.08831787109375, -0.891387939453125, 1.0943641662597656, 1.0892181396484375, -0.00931549072265625, 0.10887908935546875, 0.15784454345703125, -0.42235565185546875, 0.25983428955078125, -0.067596435546875, -0.23002243041992188, 0.12205314636230469, -0.128021240234375, 0.856536865234375, 0.06943511962890625, -0.2057037353515625, 0.2768821716308594, -0.1962909698486328, 0.14992904663085938, -0.0635986328125, 0.0905914306640625, 1.02838134765625, -0.3739776611328125, 0.3634185791015625, 0.15491104125976562, -0.3238372802734375, 1.217254638671875, 0.13404083251953125, 0.63543701171875, -0.009185791015625, -0.18418121337890625, -0.5758514404296875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000031.npy"}
{"epoch": 0.04552129221732746, "step": 32, "batch_size": 64, "mean": 0.14585140347480774, "std": 0.448910653591156, "min": -1.392364501953125, "p10": -0.36424064636230463, "median": 0.11298751831054688, "p90": 0.6976875305175781, "max": 1.1174468994140625, "pos_frac": 0.671875, "sample": [0.47290802001953125, 0.7733306884765625, -0.2638702392578125, 0.859527587890625, -0.20209693908691406, 0.5800933837890625, -0.5236968994140625, 0.8716583251953125, 0.061946868896484375, 0.7169876098632812, 0.05309295654296875, 0.018947601318359375, 0.149078369140625, -0.033267974853515625, -1.392364501953125, 0.3319244384765625, 0.09796142578125, 0.06288528442382812, 0.6810836791992188, -0.051666259765625, 0.35027313232421875, 0.2885589599609375, 0.3878936767578125, -0.389739990234375, -0.02278900146484375, 0.30877685546875, 0.36283111572265625, 0.6416015625, 0.02655029296875, 0.447174072265625, 0.2271728515625, 0.18088722229003906, -0.6399612426757812, 0.6114501953125, 0.3255043029785156, 0.669647216796875, 0.30194854736328125, -0.07938385009765625, -0.1939849853515625, 0.2593574523925781, -0.180694580078125, 0.06471633911132812, -0.3057746887207031, 0.36946868896484375, 0.31640625, -0.23773193359375, -0.1842803955078125, 0.00617218017578125, 0.574798583984375, -0.1271209716796875, -0.3892974853515625, 0.046962738037109375, -0.9614105224609375, 0.704803466796875, 0.18552398681640625, 0.12801361083984375, -0.47753143310546875, 1.1174468994140625, 0.053508758544921875, 0.48150634765625, -0.15288734436035156, -0.100799560546875, 0.9951705932617188, 0.07928848266601562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000032.npy"}
{"epoch": 0.04698972099853157, "step": 33, "batch_size": 64, "mean": 0.1619182527065277, "std": 0.5235087871551514, "min": -1.0712509155273438, "p10": -0.5348712921142578, "median": 0.14406967163085938, "p90": 0.8169044494628908, "max": 1.612548828125, "pos_frac": 0.6875, "sample": [-0.23682403564453125, 0.622039794921875, 0.5902023315429688, -0.5050201416015625, 0.1224365234375, -0.2429351806640625, -0.9672622680664062, -0.1083984375, 0.34046173095703125, 0.4304332733154297, 0.9753189086914062, 0.331298828125, 1.612548828125, 0.5101051330566406, 0.0945281982421875, 0.09285736083984375, 0.3640899658203125, -0.1311798095703125, 0.26678466796875, -0.788787841796875, 0.1297149658203125, 0.1219940185546875, 0.8278656005859375, 0.7913284301757812, 1.2142868041992188, 0.37700653076171875, 0.60101318359375, 0.95166015625, -0.20001220703125, 0.387359619140625, -0.7744560241699219, 0.11175537109375, -1.0712509155273438, 0.5772533416748047, 0.10785102844238281, 0.5101280212402344, 0.10815811157226562, -0.03575897216796875, 0.212188720703125, 0.14656448364257812, 0.9377212524414062, 0.1688690185546875, -0.45404815673828125, 0.1143646240234375, 0.2502288818359375, 0.283294677734375, 0.1882476806640625, 0.42006683349609375, 0.14157485961914062, 0.23140716552734375, -0.01320648193359375, 0.36185264587402344, 0.9493026733398438, -0.5476646423339844, -0.96051025390625, 0.7116165161132812, -0.2752971649169922, -0.04341888427734375, -0.007137298583984375, 0.13653564453125, -0.8613624572753906, -0.0960235595703125, 0.06727218627929688, 0.19173431396484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000033.npy"}
{"epoch": 0.048458149779735685, "step": 34, "batch_size": 64, "mean": 0.19678422808647156, "std": 0.48577016592025757, "min": -1.0810508728027344, "p10": -0.2586261749267578, "median": 0.12546730041503906, "p90": 0.7834716796875003, "max": 2.207763671875, "pos_frac": 0.75, "sample": [0.31302642822265625, 0.21794891357421875, 0.719940185546875, 0.18332290649414062, 0.89031982421875, 0.0191802978515625, 0.523193359375, 0.12723541259765625, -0.6193351745605469, 0.3069610595703125, -0.14404296875, -0.2528667449951172, 0.28614044189453125, 0.15515899658203125, 1.1570892333984375, 1.01580810546875, -1.0810508728027344, 0.13592910766601562, -0.2134552001953125, 0.35082244873046875, 0.0304412841796875, -0.14154815673828125, -0.25307464599609375, 0.1058197021484375, 2.207763671875, 0.6100311279296875, -0.38525390625, 0.063262939453125, 0.178436279296875, 0.0649261474609375, 0.810699462890625, 0.30289459228515625, 0.2386474609375, 0.07587432861328125, 1.490081787109375, -0.2610054016113281, -0.45335960388183594, 0.473602294921875, 0.12369918823242188, 0.111175537109375, -0.36722564697265625, 0.048931121826171875, 0.2737998962402344, 0.202392578125, 0.1610565185546875, 0.21583175659179688, 0.05965995788574219, -0.046112060546875, 0.8723526000976562, -0.41359710693359375, -0.062286376953125, 0.6748046875, 0.02685546875, 0.31241607666015625, 0.0283966064453125, -0.08128738403320312, 0.278045654296875, 0.058013916015625, 0.07816314697265625, 0.08551788330078125, -0.1659698486328125, 0.56060791015625, 0.10797500610351562, 0.20140838623046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000034.npy"}
{"epoch": 0.049926578560939794, "step": 35, "batch_size": 64, "mean": 0.1951252818107605, "std": 0.41694679856300354, "min": -0.67413330078125, "p10": -0.32028636932373045, "median": 0.1326751708984375, "p90": 0.7069664001464845, "max": 1.1695709228515625, "pos_frac": 0.671875, "sample": [0.3829002380371094, 0.6879539489746094, 0.231292724609375, -0.035511016845703125, -0.4749870300292969, 0.24908828735351562, 0.868682861328125, 0.6452102661132812, -0.2013702392578125, 0.31793212890625, 0.0272369384765625, -0.3265857696533203, 0.10161590576171875, 0.5237464904785156, -0.44281768798828125, -0.12165069580078125, -0.1525421142578125, -0.11676025390625, 0.62786865234375, 0.4701061248779297, -0.027835845947265625, 0.5452423095703125, 0.4250946044921875, 0.21341705322265625, -0.5014572143554688, 0.08867645263671875, 0.4002227783203125, -0.67413330078125, -0.08077239990234375, 0.7693862915039062, 1.1670379638671875, 0.05066680908203125, 0.18798828125, 0.15946197509765625, -0.3055877685546875, -0.38045501708984375, 0.5074005126953125, 0.4356536865234375, -0.5720977783203125, -0.0505523681640625, -0.1567840576171875, 0.7151145935058594, 0.2499237060546875, 0.26192474365234375, 0.10588836669921875, -0.18437957763671875, 0.30792236328125, -0.044097900390625, -0.07881927490234375, 0.056110382080078125, 0.060817718505859375, 0.01273345947265625, 0.3670501708984375, 1.09844970703125, 1.1230316162109375, 0.2716331481933594, 1.1695709228515625, 0.06629562377929688, 0.35155487060546875, 0.10456085205078125, 0.011066436767578125, 0.4723663330078125, -0.0739593505859375, 0.6012763977050781], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000035.npy"}
{"epoch": 0.0513950073421439, "step": 36, "batch_size": 64, "mean": 0.12170398235321045, "std": 0.5622895359992981, "min": -1.1847686767578125, "p10": -0.2762115478515625, "median": 0.08995246887207031, "p90": 0.7841876983642582, "max": 2.1054229736328125, "pos_frac": 0.59375, "sample": [0.13400650024414062, -0.27799224853515625, -0.20456695556640625, -0.16411590576171875, -0.28443145751953125, 0.28339385986328125, 0.0079803466796875, 0.16897201538085938, 0.278167724609375, 2.1054229736328125, -0.27205657958984375, -0.24038314819335938, -0.16720962524414062, 0.1657543182373047, 0.4923095703125, -0.03629302978515625, 0.7069816589355469, 0.8172760009765625, 1.097198486328125, 0.8581085205078125, 0.16619873046875, -0.244171142578125, -0.8711090087890625, 0.19854736328125, 1.4732513427734375, 0.99566650390625, -0.0438079833984375, 0.0342559814453125, -1.1847686767578125, 0.20966339111328125, -0.16234207153320312, 0.20088958740234375, -0.05200958251953125, -0.134124755859375, 0.10367202758789062, -0.23466873168945312, -1.15057373046875, 0.06395721435546875, -0.1841583251953125, 0.22641754150390625, 0.18303680419921875, 0.1746368408203125, -0.04988861083984375, -0.06418609619140625, -0.14898681640625, 0.0660400390625, 0.32848358154296875, 1.7718429565429688, 0.370513916015625, 0.23093032836914062, -0.09185028076171875, 0.11417388916015625, 0.39379119873046875, 0.040740966796875, 0.65814208984375, 0.12064933776855469, -0.45916748046875, 0.19895172119140625, -0.130767822265625, 0.17434310913085938, -0.0713348388671875, 0.07623291015625, -1.1083145141601562, 0.13173294067382812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000036.npy"}
{"epoch": 0.05286343612334802, "step": 37, "batch_size": 64, "mean": 0.3155764639377594, "std": 0.570335328578949, "min": -1.3829803466796875, "p10": -0.2274918556213379, "median": 0.24626398086547852, "p90": 0.9368659973144532, "max": 2.1020660400390625, "pos_frac": 0.703125, "sample": [-0.215545654296875, -0.23261165618896484, 0.201690673828125, 0.7194976806640625, -0.19936752319335938, -0.19008255004882812, 0.084320068359375, 0.37129974365234375, 0.6225814819335938, 0.10824203491210938, 1.0207366943359375, 1.5142669677734375, -0.04964447021484375, 0.6263427734375, -0.2075347900390625, 0.8625717163085938, 0.4041557312011719, 0.09168529510498047, 0.10375595092773438, 1.874969482421875, 0.01615142822265625, -0.50604248046875, -0.0519256591796875, 0.7977638244628906, 0.21502685546875, -0.053798675537109375, 0.3142852783203125, -0.2840576171875, -0.13596343994140625, -0.0802154541015625, 0.13045310974121094, 0.9310073852539062, 0.24573230743408203, 0.6988296508789062, 0.3507537841796875, 0.5697975158691406, 0.3645200729370117, -0.316558837890625, 0.2980194091796875, 2.1020660400390625, -0.09153366088867188, -1.3829803466796875, 0.2165679931640625, 0.5227813720703125, 0.6181869506835938, -0.24265289306640625, 0.0034027099609375, 0.246795654296875, -0.5949478149414062, 1.3119964599609375, 0.675506591796875, 0.42852020263671875, 0.496490478515625, 0.36188507080078125, 0.11588859558105469, 0.1427459716796875, 0.29778289794921875, 0.9393768310546875, 0.8649959564208984, 0.5222625732421875, -0.00058746337890625, 1.40057373046875, -0.08539581298828125, 0.3120574951171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000037.npy"}
{"epoch": 0.05433186490455213, "step": 38, "batch_size": 64, "mean": 0.197601780295372, "std": 0.5851863622665405, "min": -1.0821533203125, "p10": -0.429443359375, "median": 0.13782119750976562, "p90": 0.6804428100585941, "max": 2.959686279296875, "pos_frac": 0.65625, "sample": [0.003971099853515625, 0.71649169921875, 2.959686279296875, 0.09386444091796875, 0.46758270263671875, -0.4355316162109375, -0.6443710327148438, 0.42824554443359375, -0.0818939208984375, -1.0821533203125, 1.011505126953125, 0.5931472778320312, 0.3117218017578125, -0.16416168212890625, -0.4234619140625, -0.3157501220703125, 0.15545654296875, 0.366912841796875, -0.01904296875, 0.0466156005859375, 0.19426727294921875, 0.5811004638671875, 0.5517959594726562, 0.07860565185546875, -0.4320068359375, 0.2989540100097656, 0.85809326171875, 0.4661712646484375, 0.4479942321777344, -0.6597213745117188, 0.06197547912597656, -0.12915802001953125, -0.37950897216796875, 0.1383819580078125, 0.029005050659179688, -0.08450698852539062, 0.0447845458984375, 1.6843414306640625, -0.2793464660644531, 0.5679168701171875, -0.06218719482421875, 0.514739990234375, 0.27056884765625, 0.14795303344726562, 0.2707939147949219, 0.5442123413085938, -0.18757247924804688, 0.5490264892578125, -0.14218902587890625, 0.5514144897460938, -0.26226043701171875, -0.4740142822265625, 0.010494232177734375, 0.13726043701171875, -0.7675247192382812, 0.417816162109375, 0.9315338134765625, 1.0037155151367188, -0.18505859375, 0.3833160400390625, -0.048274993896484375, 0.044737815856933594, 0.5963287353515625, 0.37371063232421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000038.npy"}
{"epoch": 0.055800293685756244, "step": 39, "batch_size": 64, "mean": 0.30969101190567017, "std": 0.5326091647148132, "min": -1.013458251953125, "p10": -0.26588134765625, "median": 0.29773902893066406, "p90": 0.8907577514648438, "max": 2.6031036376953125, "pos_frac": 0.75, "sample": [0.024242401123046875, -0.269561767578125, 0.787200927734375, -0.25261688232421875, 0.656219482421875, 0.4974212646484375, 0.4725532531738281, 0.17369842529296875, -0.3840484619140625, 0.146087646484375, 0.8825225830078125, 0.5234298706054688, 0.894287109375, -0.3214111328125, 0.9133949279785156, 0.073333740234375, 0.503265380859375, -0.7391357421875, 1.2882308959960938, 0.13353729248046875, 0.5985260009765625, 0.630340576171875, 0.2608642578125, 0.9343833923339844, -0.00019073486328125, 0.4295196533203125, 0.0707244873046875, 0.9448661804199219, -1.013458251953125, -0.1474609375, 0.8012046813964844, 0.2917137145996094, 0.5511703491210938, 0.3649139404296875, -0.65374755859375, 0.37246131896972656, -0.03435516357421875, 0.6042404174804688, 0.30376434326171875, 2.6031036376953125, 0.16706085205078125, 0.2873382568359375, 0.1453704833984375, 0.16410064697265625, 0.9291114807128906, 0.3783683776855469, -0.257293701171875, 0.2501564025878906, -0.6857833862304688, 0.4467582702636719, 0.4689483642578125, 0.73974609375, 0.845489501953125, 0.335845947265625, -0.031581878662109375, 0.6303634643554688, 0.4634857177734375, -0.05431365966796875, 0.30780792236328125, 0.07308387756347656, -0.05971717834472656, 0.13295459747314453, -0.04298973083496094, 0.2706794738769531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000039.npy"}
{"epoch": 0.05726872246696035, "step": 40, "batch_size": 64, "mean": 0.24696248769760132, "std": 0.4907507300376892, "min": -0.7838058471679688, "p10": -0.33672027587890624, "median": 0.19103622436523438, "p90": 1.0531639099121095, "max": 1.255035400390625, "pos_frac": 0.6875, "sample": [-0.10449981689453125, 1.0801467895507812, 0.16680145263671875, -0.35285186767578125, -0.7838058471679688, 0.3361625671386719, -0.3374481201171875, 0.8062744140625, 0.5276603698730469, 0.3595733642578125, 0.5485992431640625, -0.33502197265625, -0.1869220733642578, 0.7657699584960938, -0.017604827880859375, 0.03081512451171875, 0.250457763671875, 0.7874755859375, 0.11127662658691406, 0.044281005859375, -0.45943450927734375, -0.18401336669921875, -0.2169647216796875, 1.0080413818359375, 1.1326675415039062, 0.4405670166015625, -0.08275985717773438, -0.046947479248046875, 0.14185333251953125, 0.137481689453125, 1.0725021362304688, 0.2193470001220703, 0.05510711669921875, 0.4828948974609375, 0.3683929443359375, 0.751983642578125, 0.3144569396972656, 1.1335296630859375, 0.04965972900390625, 0.00713348388671875, 0.885498046875, 0.19567108154296875, -0.34012603759765625, 1.255035400390625, -0.5781383514404297, 0.01015472412109375, 0.701812744140625, 0.1864013671875, 0.3551788330078125, 0.3288764953613281, 1.245635986328125, -0.6308212280273438, 1.1406784057617188, 0.29361724853515625, 0.3675384521484375, -0.20714569091796875, -0.3229827880859375, 0.0371551513671875, -0.1165924072265625, 0.3836708068847656, -0.2965240478515625, 0.6841011047363281, 0.2291412353515625, -0.024875640869140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000040.npy"}
{"epoch": 0.05873715124816446, "step": 41, "batch_size": 64, "mean": 0.32906582951545715, "std": 0.7648838758468628, "min": -1.503143310546875, "p10": -0.32902984619140624, "median": 0.15473556518554688, "p90": 1.178848266601563, "max": 3.262237548828125, "pos_frac": 0.625, "sample": [0.61419677734375, -0.3028411865234375, -0.01772308349609375, 0.4532432556152344, 1.0893402099609375, -0.6663818359375, 0.2632598876953125, -0.0089569091796875, -1.503143310546875, -0.13077545166015625, 2.7764434814453125, -0.04434967041015625, 0.9586639404296875, 2.0005340576171875, 0.12955474853515625, 0.3454742431640625, -0.06581878662109375, 0.8774261474609375, -0.3311767578125, -0.2322998046875, 0.00090789794921875, 0.9214096069335938, 0.5207443237304688, -0.1480560302734375, 3.262237548828125, 0.9186668395996094, 1.32757568359375, 0.851531982421875, -0.09746551513671875, -0.196319580078125, 0.5412063598632812, -0.303985595703125, -0.3240203857421875, -0.2840557098388672, -0.04735755920410156, 1.2189865112304688, 0.886810302734375, 0.2949066162109375, -0.5032196044921875, 0.9380378723144531, 1.3888092041015625, 0.4338493347167969, -0.633697509765625, 0.81671142578125, -0.1428680419921875, -0.7174224853515625, 0.03432464599609375, 0.3326911926269531, 0.01485443115234375, 0.3947257995605469, 0.2565631866455078, 0.3319435119628906, -0.222503662109375, 0.4081878662109375, 0.16156005859375, 0.4709739685058594, 0.0385894775390625, 1.2172088623046875, 0.6559829711914062, -0.45592498779296875, -0.020549774169921875, 0.06363677978515625, 0.10144424438476562, 0.14791107177734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000041.npy"}
{"epoch": 0.06020558002936858, "step": 42, "batch_size": 64, "mean": 0.4246218204498291, "std": 0.5134807229042053, "min": -0.9201507568359375, "p10": -0.17092342376708983, "median": 0.35631752014160156, "p90": 1.057888412475586, "max": 1.662994384765625, "pos_frac": 0.8125, "sample": [0.0977783203125, 0.33832550048828125, 0.23862457275390625, 0.715240478515625, 0.86041259765625, 0.4058837890625, -0.300933837890625, 1.5761566162109375, 0.5055503845214844, 0.65240478515625, -0.1730194091796875, 0.8961563110351562, 0.008403778076171875, 1.40423583984375, 0.37758636474609375, 0.6406402587890625, 1.0444221496582031, -0.003726959228515625, 0.20449447631835938, 0.237030029296875, 0.6427383422851562, 0.3168601989746094, 1.662994384765625, -0.269195556640625, -0.1660327911376953, 0.9813346862792969, 1.112152099609375, 1.0106658935546875, 0.056026458740234375, 1.0285110473632812, 0.41412353515625, 1.3354949951171875, -0.0736093521118164, 0.9556732177734375, 0.40239715576171875, 0.23722076416015625, -0.9201507568359375, -0.048931121826171875, 0.5923919677734375, -0.1417388916015625, 0.05596923828125, -0.47115325927734375, 0.1458282470703125, 1.06365966796875, 1.2624626159667969, 0.8585357666015625, 0.47006988525390625, 0.3595008850097656, 0.261962890625, 0.3531341552734375, 0.0448760986328125, 0.7324981689453125, -0.2873687744140625, 0.0899200439453125, 0.7728042602539062, 0.4677581787109375, 0.23148345947265625, 0.847076416015625, 0.0134735107421875, -0.18505859375, 0.6097335815429688, 0.2637481689453125, 0.05628776550292969, 0.3040008544921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000042.npy"}
{"epoch": 0.06167400881057269, "step": 43, "batch_size": 64, "mean": 0.440337598323822, "std": 0.7300507426261902, "min": -0.6455612182617188, "p10": -0.3686092376708984, "median": 0.3212261199951172, "p90": 1.1698028564453127, "max": 2.84344482421875, "pos_frac": 0.75, "sample": [0.12583160400390625, -0.3471107482910156, 0.16290664672851562, 0.26416778564453125, 0.052211761474609375, 1.00732421875, -0.38489532470703125, -0.3778228759765625, -0.6455612182617188, 0.7233619689941406, -0.399658203125, -0.25609588623046875, 0.5059890747070312, -0.24799346923828125, 0.8170661926269531, 0.5402412414550781, -0.46800994873046875, 0.9921798706054688, -0.296844482421875, -0.0225830078125, 0.832244873046875, 0.3511466979980469, -0.24147796630859375, 1.0362815856933594, 0.3849029541015625, 0.7910346984863281, -0.3118438720703125, 0.38787078857421875, -0.34361839294433594, 0.67529296875, -0.560516357421875, -0.2832756042480469, 0.572509765625, 0.725067138671875, -0.606231689453125, 0.38143157958984375, 0.563873291015625, 0.2480602264404297, 0.15091323852539062, 0.71710205078125, 1.1379623413085938, 0.19379425048828125, 0.6402359008789062, 2.4719696044921875, 1.1834487915039062, 0.15052032470703125, 0.15988540649414062, 0.22796630859375, 2.6197357177734375, 0.2913055419921875, 1.4267196655273438, 0.5394744873046875, 1.6969528198242188, 0.5722637176513672, 0.8161087036132812, 2.84344482421875, 0.1249542236328125, 1.8466625213623047, 0.14664077758789062, 0.13005828857421875, 0.6739654541015625, 0.2539520263671875, 0.6530532836914062, 0.16505813598632812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000043.npy"}
{"epoch": 0.0631424375917768, "step": 44, "batch_size": 64, "mean": 0.3891381621360779, "std": 0.6281799674034119, "min": -0.8956146240234375, "p10": -0.39566459655761715, "median": 0.40944480895996094, "p90": 0.9346710205078127, "max": 2.9352340698242188, "pos_frac": 0.78125, "sample": [0.3167915344238281, 0.5132217407226562, 0.053485870361328125, -0.004993438720703125, 2.9352340698242188, 0.704437255859375, 0.0695953369140625, 0.7537689208984375, 0.05106353759765625, 0.056751251220703125, 0.29278564453125, 0.5209922790527344, 0.315399169921875, -0.8956146240234375, 0.96673583984375, -0.8364715576171875, -0.0667266845703125, 0.429931640625, 0.8196258544921875, 0.1471099853515625, 0.4526329040527344, 0.491912841796875, 0.95196533203125, 0.48517608642578125, 0.27197265625, 0.894317626953125, 1.1051101684570312, -0.32975006103515625, 0.5377655029296875, 0.5462226867675781, -0.606353759765625, 0.6703147888183594, 0.06066322326660156, -0.048095703125, 0.3591728210449219, 0.06610107421875, 0.8819503784179688, 0.5683307647705078, 0.756561279296875, 1.5962982177734375, -0.1426239013671875, 0.579925537109375, 0.5721282958984375, 0.08256149291992188, -0.35333251953125, 0.680267333984375, 1.5262298583984375, 0.65582275390625, 0.4382915496826172, 0.26996803283691406, 0.116851806640625, 0.61541748046875, -0.4814453125, 0.756317138671875, -0.4138069152832031, 1.98345947265625, 0.3889579772949219, -0.6008453369140625, 0.22711944580078125, 0.5773735046386719, -0.01013946533203125, -0.4793815612792969, 0.1681365966796875, 0.8921966552734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000044.npy"}
{"epoch": 0.06461086637298091, "step": 45, "batch_size": 64, "mean": 0.18222709000110626, "std": 0.5997575521469116, "min": -1.365325927734375, "p10": -0.480804443359375, "median": 0.1744518280029297, "p90": 0.8280624389648439, "max": 2.40728759765625, "pos_frac": 0.6875, "sample": [0.483306884765625, 1.131378173828125, -0.9631118774414062, 0.3176536560058594, 0.056560516357421875, 0.47829437255859375, 0.1230010986328125, 0.7454071044921875, 0.845123291015625, 0.458709716796875, 0.16124725341796875, 0.5408706665039062, 0.34886932373046875, -0.37543487548828125, -0.2246246337890625, -0.7736091613769531, -0.12993621826171875, 0.17998123168945312, -0.013515472412109375, 0.5655632019042969, 0.5609359741210938, 0.44486522674560547, 0.44525146484375, 0.050594329833984375, -0.4150104522705078, 0.8705291748046875, 0.105010986328125, -0.49098968505859375, -0.0171966552734375, 0.1423778533935547, 0.6036834716796875, 0.1045379638671875, 0.23397064208984375, 0.6786041259765625, -0.570770263671875, -1.1040496826171875, 0.7882537841796875, 0.024791717529296875, 0.19902420043945312, -0.07630157470703125, 0.3065452575683594, -0.4346046447753906, -0.33116912841796875, -0.22402191162109375, 0.440582275390625, 2.40728759765625, 1.3359222412109375, 0.16892242431640625, -0.2598876953125, -0.32408905029296875, 0.7535305023193359, 0.1443023681640625, 1.14312744140625, 0.3931732177734375, -0.6523666381835938, 0.2320556640625, -1.365325927734375, 0.0194091796875, 0.2787971496582031, 1.0231475830078125, 0.061748504638671875, 0.22186279296875, 0.24677658081054688, -0.45703887939453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000045.npy"}
{"epoch": 0.06607929515418502, "step": 46, "batch_size": 64, "mean": 0.4864158034324646, "std": 0.5561732649803162, "min": -0.2779350280761719, "p10": -0.08248291015624996, "median": 0.2711372375488281, "p90": 1.3168815612792972, "max": 2.0511245727539062, "pos_frac": 0.84375, "sample": [0.6550064086914062, -0.164764404296875, 1.2397689819335938, 1.7662353515625, 0.6624183654785156, 0.01578521728515625, -0.030059814453125, 0.2342987060546875, -0.20313262939453125, 0.3525543212890625, 0.27875518798828125, -0.0036754608154296875, -0.09888458251953125, 1.1040611267089844, 0.451019287109375, 0.22612762451171875, 0.5025405883789062, -0.04421234130859375, 0.2120513916015625, 1.2265625, 0.11026763916015625, 0.263519287109375, 1.5769805908203125, 0.9381637573242188, 1.0135307312011719, 0.5321884155273438, 1.3499298095703125, 0.11870956420898438, 1.0628433227539062, 0.11600112915039062, 0.09136199951171875, 0.1062469482421875, 1.52764892578125, 0.20819091796875, 1.616790771484375, 0.5891761779785156, -0.2779350280761719, 0.20907211303710938, 0.44178009033203125, 0.6306076049804688, 0.13137435913085938, 0.6864852905273438, 0.1821441650390625, 0.13927459716796875, 1.72601318359375, 0.15776443481445312, 0.03362274169921875, 0.8165283203125, 0.1039285659790039, 0.9519577026367188, 0.01442718505859375, 2.0511245727539062, 0.5707588195800781, 0.13117218017578125, -0.2545318603515625, 0.5211639404296875, 0.7230453491210938, 0.53369140625, -0.163848876953125, 0.9369964599609375, 0.23395538330078125, 0.3493022918701172, -0.2314014434814453, 0.178131103515625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000046.npy"}
{"epoch": 0.06754772393538913, "step": 47, "batch_size": 64, "mean": 0.39373981952667236, "std": 0.7439931631088257, "min": -1.3268203735351562, "p10": -0.3523147583007812, "median": 0.2413167953491211, "p90": 1.2534591674804694, "max": 2.3057403564453125, "pos_frac": 0.671875, "sample": [0.32712554931640625, 1.7964324951171875, -0.012416839599609375, 0.1299896240234375, 2.3057403564453125, 0.12520599365234375, 0.5577850341796875, 0.8953781127929688, 0.6851119995117188, -0.3109893798828125, -0.247528076171875, -0.4523963928222656, 1.3201828002929688, 0.19094085693359375, 0.09502410888671875, 0.5209121704101562, 0.2988128662109375, -0.5596199035644531, 0.10276031494140625, -0.1739654541015625, 1.0977706909179688, 0.258941650390625, -0.10284423828125, 0.16083145141601562, -0.20105743408203125, -0.052143096923828125, 0.403900146484375, 0.30224609375, 0.836181640625, 0.7047309875488281, -0.08237743377685547, -0.16610336303710938, 0.45900726318359375, 0.9615097045898438, -0.1050872802734375, -0.2563896179199219, -1.3268203735351562, 0.2236919403076172, 0.169189453125, 0.37677001953125, 1.90045166015625, 1.0597572326660156, 0.9770545959472656, 0.06884765625, 2.1354446411132812, 0.9074249267578125, 1.08154296875, 1.0940589904785156, 0.2032470703125, 2.0448760986328125, -1.0516510009765625, 0.98870849609375, -0.4053497314453125, 0.7220802307128906, -0.370025634765625, -0.12868499755859375, 0.5486297607421875, 0.8123703002929688, -0.5350341796875, 0.28879356384277344, 2.037872314453125, -0.3030242919921875, 0.012132644653320312, -0.14661026000976562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000047.npy"}
{"epoch": 0.06901615271659324, "step": 48, "batch_size": 64, "mean": 0.6404985189437866, "std": 0.8608392477035522, "min": -2.1654815673828125, "p10": -0.28416595458984373, "median": 0.5530796051025391, "p90": 1.9207981109619146, "max": 2.5526885986328125, "pos_frac": 0.78125, "sample": [-0.03298187255859375, 0.5038108825683594, 2.207611083984375, 1.6691665649414062, 1.0672073364257812, 2.5187339782714844, -0.4646148681640625, -0.302947998046875, -0.103240966796875, 0.6193618774414062, 0.5223541259765625, 2.5526885986328125, -2.1654815673828125, 2.1284027099609375, -0.08174896240234375, 0.0697174072265625, 2.217315673828125, 0.007021903991699219, 0.372589111328125, 0.6480827331542969, -0.4112701416015625, 0.5504722595214844, -0.09809303283691406, 1.0671234130859375, 0.2274932861328125, 1.8187637329101562, 0.5572662353515625, 1.0287208557128906, 0.5245361328125, 0.9591464996337891, 0.38724517822265625, 1.1096000671386719, 0.82305908203125, 0.39156532287597656, 0.198699951171875, -0.401123046875, 1.0970916748046875, 0.7316131591796875, 0.9337615966796875, 0.834869384765625, 0.20855331420898438, -0.2403411865234375, 0.5556869506835938, -0.10396575927734375, 1.0304412841796875, 0.1889972686767578, 0.1436309814453125, -0.15145111083984375, 0.4228096008300781, 0.02242279052734375, -0.4336700439453125, 0.7079582214355469, 1.47772216796875, 1.0217666625976562, 1.3011932373046875, 2.518280029296875, 0.9634056091308594, 0.05492401123046875, -0.3378429412841797, 0.2303466796875, 1.79864501953125, 0.6248512268066406, 0.7394237518310547, 1.9645271301269531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000048.npy"}
{"epoch": 0.07048458149779736, "step": 49, "batch_size": 64, "mean": 0.7378373146057129, "std": 0.9297176599502563, "min": -0.7508163452148438, "p10": -0.23568820953369138, "median": 0.5979747772216797, "p90": 2.2076263427734375, "max": 3.1835479736328125, "pos_frac": 0.71875, "sample": [-0.20345306396484375, 1.1934356689453125, -0.4192161560058594, 0.6062583923339844, -0.24788475036621094, 0.7979507446289062, -0.117218017578125, -0.4463615417480469, -0.0977935791015625, -0.038360595703125, 0.37216949462890625, 0.0672454833984375, 2.2619171142578125, 1.8055191040039062, 0.251434326171875, 1.706878662109375, -0.12841033935546875, 0.53033447265625, 2.5095748901367188, 0.940093994140625, -0.20094680786132812, -0.47552490234375, 0.7897186279296875, -0.20293807983398438, 2.024169921875, 0.8734588623046875, 0.6447601318359375, -0.7508163452148438, 0.1999969482421875, 0.40410614013671875, 1.5658950805664062, 2.26837158203125, 1.4793243408203125, 0.9481735229492188, 0.7896499633789062, 0.8098068237304688, 0.12891387939453125, 0.8323516845703125, 0.2370452880859375, 1.8777542114257812, 0.5563278198242188, -0.049813270568847656, 0.6666259765625, -0.2072296142578125, 2.4597244262695312, 1.05487060546875, 0.9918670654296875, 0.562652587890625, -0.5388336181640625, 2.156890869140625, -0.0042095184326171875, -0.07020187377929688, 3.1835479736328125, 2.9057693481445312, 1.3144378662109375, 0.589691162109375, 0.211395263671875, 1.0995559692382812, 0.5001983642578125, 1.4092636108398438, 2.2293701171875, -0.6947784423828125, 0.22686767578125, 1.0802154541015625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000049.npy"}
{"epoch": 0.07195301027900147, "step": 50, "batch_size": 64, "mean": 0.7001360654830933, "std": 0.9334550499916077, "min": -0.8433380126953125, "p10": -0.33257904052734366, "median": 0.46404266357421875, "p90": 1.9114562988281252, "max": 3.3524017333984375, "pos_frac": 0.8125, "sample": [1.99041748046875, 0.1392364501953125, 0.458465576171875, 0.3431549072265625, 0.17324066162109375, 0.8394775390625, 0.1449127197265625, -0.5833091735839844, 0.5659408569335938, 0.3373584747314453, -0.2551994323730469, 1.6600799560546875, 0.4696197509765625, 0.7931060791015625, 0.13836669921875, 0.364990234375, 2.5010833740234375, 0.6230506896972656, 0.510498046875, 2.8967819213867188, -0.7558383941650391, 1.9802093505859375, 1.1451873779296875, 0.7843399047851562, -0.3657417297363281, 0.9628067016601562, -0.4618072509765625, 0.16849136352539062, 0.03653717041015625, 0.9228973388671875, 0.29122161865234375, 1.8510017395019531, 1.88372802734375, 3.3524017333984375, -0.3685302734375, 1.429422378540039, -0.74169921875, 1.7907028198242188, 0.022380828857421875, 1.7299652099609375, -0.8433380126953125, 1.4932594299316406, 0.8234710693359375, -0.02051544189453125, 0.6026840209960938, 0.0547943115234375, 0.6911087036132812, 0.133819580078125, 1.92333984375, 0.08831787109375, 0.06622314453125, 0.2148590087890625, 1.452117919921875, -0.00339508056640625, 0.3906402587890625, 0.386474609375, 0.7660903930664062, 1.0249557495117188, 1.14569091796875, -0.17824554443359375, 1.540496826171875, 3.21917724609375, -0.0314483642578125, 0.09918212890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000050.npy"}
{"epoch": 0.07342143906020558, "step": 51, "batch_size": 64, "mean": 0.6637749671936035, "std": 1.0269356966018677, "min": -2.1955184936523438, "p10": -0.31457633972167953, "median": 0.5394706726074219, "p90": 1.751589965820313, "max": 4.3691558837890625, "pos_frac": 0.828125, "sample": [0.9066390991210938, -0.5550994873046875, -0.3927154541015625, 0.020503997802734375, 0.33388519287109375, 0.99530029296875, 0.9784927368164062, -0.6678581237792969, -2.1955184936523438, -1.0283203125, 2.5464630126953125, 0.931884765625, 0.5985889434814453, 0.7729415893554688, 0.45301055908203125, 2.4142303466796875, 0.3000640869140625, 0.8846492767333984, 1.0969467163085938, 1.2205619812011719, 0.8433952331542969, 1.2756195068359375, 0.2552947998046875, 0.3954925537109375, 0.42626953125, 1.3838958740234375, 0.5753707885742188, 0.5842056274414062, 0.6416854858398438, 0.2649688720703125, 0.74700927734375, 0.28917694091796875, 0.44004058837890625, 0.3085823059082031, -0.13225173950195312, 4.3691558837890625, 0.24541854858398438, 1.6465301513671875, 1.7966156005859375, 0.35755157470703125, 0.00469970703125, 0.5674362182617188, 1.4973220825195312, 2.4933929443359375, 0.6600570678710938, 1.0270118713378906, 0.7823028564453125, -1.0863418579101562, -0.09966278076171875, 2.7588043212890625, 3.3988800048828125, -0.7375946044921875, 0.037200927734375, -0.00452423095703125, 0.17742347717285156, 0.3481407165527344, -0.0003147125244140625, 0.19760894775390625, 1.018035888671875, 1.497161865234375, 0.511505126953125, 0.317718505859375, 0.7223701477050781, 0.0642852783203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000051.npy"}
{"epoch": 0.07488986784140969, "step": 52, "batch_size": 64, "mean": 0.8731374740600586, "std": 0.9050233960151672, "min": -0.5888633728027344, "p10": -0.061713409423828094, "median": 0.7357368469238281, "p90": 2.1912754058837898, "max": 4.044281005859375, "pos_frac": 0.859375, "sample": [0.11750984191894531, 2.0349273681640625, 0.10925674438476562, 0.39212799072265625, -0.47552490234375, 1.1775665283203125, 1.1138992309570312, 1.2295913696289062, 0.32232666015625, 2.5009918212890625, 0.6220703125, 1.402191162109375, 0.45081329345703125, -0.5888633728027344, 1.026123046875, 0.8630485534667969, 0.9679107666015625, 0.717926025390625, 1.190704345703125, 1.8303298950195312, 1.4383773803710938, 1.1355743408203125, 0.3411712646484375, 0.6213607788085938, 0.27677154541015625, 0.9868545532226562, 0.265472412109375, 1.3368453979492188, 0.3884544372558594, 2.9517059326171875, 4.044281005859375, -0.1634368896484375, 0.376434326171875, -0.24675750732421875, 0.8012428283691406, 1.318572998046875, 2.4496078491210938, -0.075347900390625, 0.05518341064453125, 2.258281707763672, -0.02989959716796875, 0.7069625854492188, 1.51373291015625, -0.42641448974609375, 0.0305023193359375, 1.7071304321289062, 0.973785400390625, 1.97039794921875, 0.17071533203125, 0.6255607604980469, 0.7606849670410156, 2.6715850830078125, 0.7896080017089844, 0.42731475830078125, -0.00412750244140625, 2.6622581481933594, 0.00049591064453125, 0.5074844360351562, 0.566558837890625, 0.942230224609375, 0.7599334716796875, 0.7535476684570312, 0.3905162811279297, -0.15534210205078125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000052.npy"}
{"epoch": 0.0763582966226138, "step": 53, "batch_size": 64, "mean": 1.1096991300582886, "std": 1.3793892860412598, "min": -1.2493743896484375, "p10": -0.39312744140624983, "median": 0.9662189483642578, "p90": 2.727716064453125, "max": 7.2117919921875, "pos_frac": 0.8125, "sample": [0.37468719482421875, 0.7606964111328125, 1.1517181396484375, 5.04327392578125, 0.02143096923828125, -1.2493743896484375, 1.8485641479492188, -0.47803497314453125, 1.3177986145019531, 1.582977294921875, 3.1853790283203125, 7.2117919921875, 1.1649169921875, 0.7193679809570312, 0.6891555786132812, 0.088531494140625, -0.1753082275390625, 1.709228515625, 0.5726165771484375, 1.7058258056640625, 1.2831573486328125, -0.210479736328125, 2.623065948486328, 0.82281494140625, 1.1989021301269531, 1.3361282348632812, 1.9920501708984375, -0.062255859375, 1.6600875854492188, 0.5537052154541016, 2.759429931640625, -0.5515594482421875, 0.9527244567871094, 1.05377197265625, 1.4296455383300781, 1.0120124816894531, -0.0005340576171875, 1.37982177734375, 0.35840606689453125, 0.7428741455078125, -0.2413482666015625, -0.6465797424316406, 1.6900920867919922, 2.9695167541503906, 0.3712921142578125, 1.8457756042480469, 3.1548614501953125, -1.0597915649414062, -0.45819091796875, 0.6862564086914062, 0.4994544982910156, 0.6315956115722656, 0.42053985595703125, -0.4581756591796875, 0.18154144287109375, 1.1592788696289062, 0.5709342956542969, 2.6046676635742188, 0.9797134399414062, 2.653717041015625, 1.009613037109375, 1.7125396728515625, 2.9824676513671875, 0.1819610595703125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000053.npy"}
{"epoch": 0.07782672540381791, "step": 54, "batch_size": 64, "mean": 1.1452147960662842, "std": 1.2940552234649658, "min": -0.907867431640625, "p10": -0.15399265289306635, "median": 0.8768634796142578, "p90": 2.6290252685546878, "max": 6.178009033203125, "pos_frac": 0.828125, "sample": [0.03571319580078125, 1.73565673828125, 0.5810165405273438, 0.17005157470703125, 0.8577766418457031, 0.13076019287109375, 1.4092559814453125, -0.48738861083984375, 2.3367691040039062, 1.467254638671875, 0.6624050140380859, 1.4563369750976562, 1.5351486206054688, 0.8959503173828125, -0.907867431640625, 0.539031982421875, 0.551849365234375, 0.7944488525390625, 1.9074745178222656, 4.3701324462890625, -0.10784339904785156, 1.6829681396484375, 2.8739471435546875, -0.00665283203125, 2.612213134765625, -0.2952461242675781, 0.9999847412109375, 1.9549179077148438, 1.2577552795410156, 1.8069725036621094, -0.011394500732421875, 0.5400733947753906, 2.2570114135742188, 0.5502662658691406, -0.17377090454101562, 1.5195159912109375, 2.6918182373046875, -0.0062255859375, 0.35748291015625, 2.2358932495117188, 0.8451080322265625, 0.6397781372070312, 2.63623046875, -0.5216217041015625, -0.35332298278808594, 1.6131515502929688, -0.19311904907226562, 1.1037445068359375, 0.9938468933105469, 0.3098297119140625, 1.7722091674804688, 0.38134002685546875, 1.2775726318359375, 0.31565093994140625, 0.18240737915039062, 4.725738525390625, 1.1374244689941406, 1.5562973022460938, 0.6815567016601562, 1.54669189453125, 0.0025081634521484375, 6.178009033203125, 0.07451057434082031, 3.6067352294921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000054.npy"}
{"epoch": 0.07929515418502203, "step": 55, "batch_size": 64, "mean": 1.180344581604004, "std": 1.682395339012146, "min": -2.171672821044922, "p10": -0.3481884002685547, "median": 0.7047882080078125, "p90": 3.154093170166016, "max": 7.075096130371094, "pos_frac": 0.765625, "sample": [2.654632568359375, 2.3207244873046875, -0.754791259765625, 2.7017059326171875, 3.421142578125, -0.9359283447265625, 0.6701583862304688, 1.8743438720703125, 3.641277313232422, 3.0415725708007812, 1.4820556640625, 0.6067829132080078, 1.1754150390625, 0.23492431640625, 7.075096130371094, 2.5186614990234375, 1.290802001953125, 1.5652236938476562, 2.7902870178222656, -2.171672821044922, 2.4759368896484375, -0.2210693359375, 0.22683334350585938, -0.22795486450195312, 4.131072998046875, 0.112823486328125, 2.28656005859375, 1.34869384765625, 0.4775962829589844, 0.18062591552734375, -0.18975830078125, 1.3397979736328125, 1.5031852722167969, 0.7305049896240234, 0.6492767333984375, -0.3439826965332031, 0.5114631652832031, -0.3356475830078125, 2.609180450439453, 1.8763961791992188, 0.18202972412109375, 0.088714599609375, -0.0002288818359375, 6.59356689453125, 3.370838165283203, -0.5432662963867188, -0.0331573486328125, -0.6001052856445312, 0.08736038208007812, -2.05596923828125, 0.5352249145507812, 1.0216064453125, 2.6740341186523438, 0.23706817626953125, 1.4750213623046875, 0.7243766784667969, 0.257843017578125, 3.2023162841796875, 0.46443939208984375, 1.4307937622070312, -0.3499908447265625, 0.6851997375488281, -0.04381561279296875, 1.7942047119140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000055.npy"}
{"epoch": 0.08076358296622614, "step": 56, "batch_size": 64, "mean": 1.0600528717041016, "std": 1.6872669458389282, "min": -3.21820068359375, "p10": -0.2765686988830565, "median": 0.9283218383789062, "p90": 2.9861183166503937, "max": 7.85675048828125, "pos_frac": 0.84375, "sample": [0.2961387634277344, 0.9644393920898438, 0.1631011962890625, 1.6918869018554688, -0.6755905151367188, 0.7246360778808594, 4.9720611572265625, 0.6028289794921875, -1.37969970703125, -0.3292999267578125, 0.4466705322265625, 0.6617813110351562, 1.4539794921875, 3.351409912109375, 1.0154151916503906, 0.14104461669921875, 1.0542621612548828, 1.2586746215820312, 5.835155487060547, 2.1053009033203125, 0.2986869812011719, 1.0100326538085938, 1.228240966796875, 0.9265594482421875, 1.458221435546875, 0.930084228515625, 0.09019851684570312, -0.034732818603515625, 1.0968666076660156, 0.550872802734375, 2.2060470581054688, 3.56439208984375, 0.9989013671875, 0.7062597274780273, 0.4102821350097656, 1.94586181640625, -0.3683433532714844, 0.94268798828125, 0.80230712890625, 5.2342987060546875, 1.7166061401367188, 0.2429180145263672, 1.1201362609863281, 7.85675048828125, 1.5620803833007812, 1.2014198303222656, -0.15135765075683594, 0.01312255859375, 0.5274772644042969, 1.4780197143554688, 0.4648284912109375, -0.15352916717529297, 1.1063690185546875, 1.3513259887695312, -1.377105712890625, 1.033599853515625, 0.7927322387695312, -3.21820068359375, 0.2857627868652344, 1.335235595703125, -1.7462615966796875, 0.2149658203125, 0.5141372680664062, 3.3204345703125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000056.npy"}
{"epoch": 0.08223201174743025, "step": 57, "batch_size": 64, "mean": 1.146733283996582, "std": 1.5436279773712158, "min": -0.9683914184570312, "p10": -0.43125648498535146, "median": 0.6254367828369141, "p90": 3.394924926757813, "max": 6.327728271484375, "pos_frac": 0.765625, "sample": [0.58660888671875, 0.876861572265625, 1.2938880920410156, 3.6565017700195312, 2.60565185546875, -0.5799560546875, 3.6337738037109375, -0.011578559875488281, 1.464935302734375, 1.0235595703125, 1.552764892578125, 0.2621879577636719, -0.15250396728515625, -0.152313232421875, 1.2767333984375, 6.327728271484375, 0.09136772155761719, 1.8987045288085938, -0.9368133544921875, 4.490478515625, 2.3001327514648438, 0.5407943725585938, 0.4628143310546875, 0.4612693786621094, -0.09725189208984375, 0.354278564453125, 2.7354354858398438, -0.8809814453125, 0.5572280883789062, 2.501922607421875, 1.7851104736328125, 0.6944694519042969, 0.327056884765625, 0.11726951599121094, -0.8636474609375, 5.1595458984375, 0.24736785888671875, 0.446258544921875, 0.5260238647460938, 2.6815032958984375, 3.165985107421875, 0.6435661315917969, 1.971649169921875, 1.1783027648925781, 1.2190399169921875, 0.6073074340820312, 0.5282135009765625, -0.3359565734863281, 2.48028564453125, -0.304443359375, -0.47209930419921875, 3.5502166748046875, -0.9683914184570312, 0.0017852783203125, 1.91357421875, 0.6730804443359375, -0.05843544006347656, 1.9010353088378906, -0.07916259765625, -0.9096298217773438, 0.06595611572265625, 2.9486236572265625, 0.9122047424316406, 3.4930419921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000057.npy"}
{"epoch": 0.08370044052863436, "step": 58, "batch_size": 64, "mean": 1.50048828125, "std": 1.9516478776931763, "min": -2.327117919921875, "p10": -0.15416831970214834, "median": 0.9101333618164062, "p90": 4.258811378479004, "max": 8.787307739257812, "pos_frac": 0.859375, "sample": [1.986114501953125, 0.018810272216796875, -0.5035896301269531, 1.3448829650878906, 1.1981048583984375, -0.2509880065917969, 0.30652618408203125, 0.6087722778320312, 2.4155731201171875, 0.31090545654296875, 0.37928009033203125, 6.774650573730469, 0.526763916015625, 1.7379074096679688, 0.5127372741699219, 0.86956787109375, 1.0793266296386719, -0.610015869140625, 2.1014251708984375, 2.8758010864257812, 0.9970703125, 0.9506988525390625, 4.621406555175781, -0.5618515014648438, 2.8535537719726562, 1.5990676879882812, 2.002960205078125, 4.200437545776367, 3.9755020141601562, 1.1531829833984375, 8.787307739257812, 1.2068557739257812, -0.05438232421875, 0.3146038055419922, 0.6537971496582031, 0.30682945251464844, 0.186004638671875, 0.4812660217285156, 3.4930648803710938, 0.212127685546875, -0.19693374633789062, 0.37751197814941406, 5.7351226806640625, 1.9824600219726562, 2.755035400390625, 4.2838287353515625, 1.2642822265625, 1.627044677734375, 1.6294097900390625, 5.950408935546875, -0.03491401672363281, 0.22370147705078125, 0.178436279296875, 2.1365814208984375, 0.6309661865234375, 0.18000030517578125, 4.725006103515625, -2.327117919921875, 0.510009765625, 0.7531204223632812, 0.14440155029296875, 0.3414764404296875, -0.229461669921875, 2.3288116455078125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000058.npy"}
{"epoch": 0.08516886930983847, "step": 59, "batch_size": 64, "mean": 1.230258584022522, "std": 1.4626355171203613, "min": -1.9707717895507812, "p10": -0.09826526641845701, "median": 0.9131813049316406, "p90": 2.9949600219726564, "max": 5.888336181640625, "pos_frac": 0.84375, "sample": [0.7897109985351562, 0.46613311767578125, 2.046600341796875, 0.10382080078125, 1.2041473388671875, 2.9342269897460938, 0.2017364501953125, 5.2143402099609375, 0.1928558349609375, 2.57611083984375, -0.10984039306640625, 1.6574249267578125, 3.0209884643554688, 0.09693527221679688, 2.00128173828125, 0.6915092468261719, -0.35415077209472656, 2.4908065795898438, 1.0949630737304688, 2.0805587768554688, -0.40398406982421875, -1.9707717895507812, 0.1642608642578125, 1.2927818298339844, 1.0120162963867188, 2.6084442138671875, 0.7762336730957031, -0.07125663757324219, 1.3978805541992188, 0.3068695068359375, 0.5839385986328125, -0.4674720764160156, 0.9056015014648438, 0.47299957275390625, 0.18994140625, 0.76361083984375, 2.749858856201172, 0.9207611083984375, 1.186737060546875, 0.6019248962402344, 1.5238685607910156, 3.3966064453125, 0.042072296142578125, -0.6172103881835938, 0.5173759460449219, 1.0459098815917969, 1.7233428955078125, 1.0701751708984375, 2.0576248168945312, 2.416576385498047, 1.2251968383789062, 0.33124542236328125, 2.6596832275390625, 3.3656845092773438, -0.024410247802734375, -0.1657562255859375, 1.2638092041015625, 0.40503692626953125, -0.057178497314453125, 0.032501220703125, 5.888336181640625, 3.5650558471679688, 0.279052734375, 5.3714141845703125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000059.npy"}
{"epoch": 0.08663729809104258, "step": 60, "batch_size": 64, "mean": 1.1427747011184692, "std": 1.431063175201416, "min": -1.2105712890625, "p10": -0.2394561767578125, "median": 0.7011089324951172, "p90": 3.538854217529297, "max": 4.472221374511719, "pos_frac": 0.796875, "sample": [0.08820724487304688, 3.91485595703125, 0.06397056579589844, -0.24029159545898438, 1.0084152221679688, 1.0142097473144531, 2.7240333557128906, 3.932342529296875, 1.019195556640625, 2.5951995849609375, 1.112640380859375, 1.2213363647460938, -0.12186622619628906, 0.6733970642089844, 3.2031631469726562, 0.8196258544921875, 2.5712890625, 2.075481414794922, 0.514923095703125, 0.6312179565429688, 3.9110946655273438, 0.90203857421875, 3.5446929931640625, 2.9814071655273438, 0.0952911376953125, 1.5213546752929688, 0.38237762451171875, 0.31256103515625, 0.5184783935546875, -0.20958709716796875, 0.6231460571289062, 4.155250549316406, -0.0897216796875, 2.53497314453125, 0.4359016418457031, 0.2226848602294922, -0.566864013671875, 0.72882080078125, -0.1539764404296875, -0.5536270141601562, 1.0881423950195312, 1.9605178833007812, 3.5252304077148438, 2.91815185546875, 4.472221374511719, -0.2952556610107422, 0.8933868408203125, 4.0660247802734375, 0.8766632080078125, -0.148284912109375, 1.8004646301269531, -0.23750686645507812, 0.47548675537109375, -1.0156173706054688, 1.49591064453125, -0.7252655029296875, -1.2105712890625, 0.5218429565429688, 0.9847793579101562, 0.5275192260742188, 0.426116943359375, 0.02339935302734375, 0.4332542419433594, 0.16332626342773438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000060.npy"}
{"epoch": 0.0881057268722467, "step": 61, "batch_size": 64, "mean": 1.1766784191131592, "std": 1.8787564039230347, "min": -2.778228759765625, "p10": -0.41949310302734366, "median": 0.7488136291503906, "p90": 3.631978607177736, "max": 9.64288330078125, "pos_frac": 0.828125, "sample": [0.2595958709716797, 0.345611572265625, 1.0577545166015625, 0.34148406982421875, 1.716827392578125, 0.48177337646484375, 0.563018798828125, 3.7694473266601562, 0.1103668212890625, 3.31121826171875, 0.5980300903320312, 5.1849822998046875, 3.214630126953125, -0.355438232421875, 2.2265167236328125, 1.5072479248046875, -0.9676361083984375, 0.9147796630859375, 0.01104736328125, -0.7865142822265625, 4.049171447753906, -2.1385040283203125, 2.76995849609375, 0.5338478088378906, 1.3657150268554688, 0.5789985656738281, 1.2088623046875, 0.7511749267578125, 0.5300636291503906, 2.2079315185546875, 1.2270355224609375, 1.5340576171875, 1.4402618408203125, 1.209014892578125, 9.64288330078125, 2.1385498046875, 0.39239501953125, -0.25975799560546875, -2.778228759765625, -0.4469451904296875, 0.7920417785644531, -0.14495468139648438, 4.36279296875, 0.7464523315429688, 0.2502899169921875, 5.1352691650390625, 0.7770004272460938, 0.1535186767578125, 0.3890380859375, 0.927337646484375, 4.182514190673828, -0.11511611938476562, -1.241363525390625, 0.3011054992675781, 0.3311119079589844, 0.7805671691894531, 0.14628219604492188, 0.35695648193359375, 2.5149688720703125, 2.1381683349609375, 1.9949874877929688, 0.6964454650878906, -0.7989463806152344, 1.1697235107421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000061.npy"}
{"epoch": 0.08957415565345081, "step": 62, "batch_size": 64, "mean": 1.2114923000335693, "std": 2.0069589614868164, "min": -6.709869384765625, "p10": -0.08417778015136716, "median": 0.8805885314941406, "p90": 3.540851974487305, "max": 9.304397583007812, "pos_frac": 0.84375, "sample": [0.6046867370605469, 0.7608299255371094, -1.1613502502441406, 4.181907653808594, 0.9954566955566406, 0.044727325439453125, 1.2988204956054688, 0.22363662719726562, 2.3166847229003906, -0.880462646484375, 4.828216552734375, 0.1843109130859375, 0.8729209899902344, -0.5057411193847656, 0.5866241455078125, 0.09434890747070312, 1.4444122314453125, 2.274993896484375, 0.10074043273925781, 1.2567214965820312, 0.5980033874511719, 3.55804443359375, 1.2858352661132812, -0.060062408447265625, 0.051799774169921875, 4.892326354980469, -0.05835914611816406, 3.5007362365722656, 0.8448925018310547, 6.218711853027344, 2.0667762756347656, 3.9906463623046875, 1.978851318359375, 0.7428932189941406, 1.2755889892578125, 1.8214340209960938, 0.00122833251953125, 0.46600341796875, 1.185211181640625, 1.521728515625, 0.1562347412109375, -0.094512939453125, 0.19127655029296875, 0.8882560729980469, -0.48687744140625, 0.4032859802246094, 1.6066932678222656, 1.6159706115722656, 2.3643112182617188, 1.516357421875, 1.3121299743652344, 0.41020774841308594, -0.17730712890625, 1.6992931365966797, 3.086578369140625, 0.715057373046875, 0.10467529296875, 0.9380035400390625, 9.304397583007812, -0.0190887451171875, 0.8897686004638672, 0.8142852783203125, 1.6016082763671875, -6.709869384765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000062.npy"}
{"epoch": 0.09104258443465492, "step": 63, "batch_size": 64, "mean": 1.4869378805160522, "std": 1.606654167175293, "min": -2.214019775390625, "p10": -0.4143989562988281, "median": 1.3711891174316406, "p90": 3.2688510894775393, "max": 5.839881896972656, "pos_frac": 0.828125, "sample": [0.6821441650390625, 3.2268829345703125, 2.6521759033203125, 3.8206558227539062, -0.9622802734375, -0.20272064208984375, -0.9262542724609375, 3.16253662109375, 2.6605987548828125, 1.3642349243164062, 0.8922882080078125, 1.3352432250976562, 0.3496856689453125, 0.4952583312988281, -0.2250804901123047, -0.5818443298339844, 4.654937744140625, 0.6465663909912109, 0.0776824951171875, 3.0352783203125, 5.839881896972656, 0.8909378051757812, 0.9139633178710938, -0.22217750549316406, 0.37374114990234375, 0.9640083312988281, 0.41309356689453125, 0.02414703369140625, 2.2636260986328125, 1.1368350982666016, 2.7419281005859375, 1.8043060302734375, 3.1289215087890625, 0.6698226928710938, 1.5956497192382812, 1.9335174560546875, 3.2841758728027344, 2.1779327392578125, 1.4558181762695312, 1.4755706787109375, 0.570648193359375, 2.075225830078125, -0.39910888671875, -0.7567367553710938, -2.214019775390625, 2.4508094787597656, 0.5328330993652344, 0.5925445556640625, 2.5101470947265625, 1.91571044921875, 0.8896484375, 3.916717529296875, 3.5380783081054688, -0.42095184326171875, 2.4082298278808594, 0.19330978393554688, 1.8134346008300781, 5.659820556640625, 1.471954345703125, -0.8745651245117188, 3.23309326171875, 3.038543701171875, 2.6168212890625, 1.378143310546875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000063.npy"}
{"epoch": 0.09251101321585903, "step": 64, "batch_size": 64, "mean": 1.7406915426254272, "std": 2.2855756282806396, "min": -1.4246330261230469, "p10": -0.3218727111816405, "median": 1.1036415100097656, "p90": 4.240724182128907, "max": 10.1448974609375, "pos_frac": 0.796875, "sample": [-1.3702774047851562, 1.09454345703125, 4.6212615966796875, 0.5749053955078125, 0.9320220947265625, 1.13751220703125, 0.6271133422851562, 0.1527862548828125, 0.6449737548828125, -0.18972015380859375, 0.183563232421875, 1.6462631225585938, 0.29836273193359375, 2.1460723876953125, -0.8448410034179688, 0.6353759765625, 1.4897308349609375, 0.3599987030029297, 6.395713806152344, 0.16570281982421875, 2.6914634704589844, -0.589874267578125, 4.2662353515625, -0.03168487548828125, -1.4246330261230469, 0.3058624267578125, -0.135223388671875, 0.6874732971191406, -0.378509521484375, 2.284992218017578, -0.153961181640625, 0.001789093017578125, 10.1448974609375, 1.357553482055664, -0.011905670166015625, 2.4235572814941406, -1.1054534912109375, 1.8697662353515625, 4.1811981201171875, 0.5855255126953125, 0.49152183532714844, 2.1074676513671875, 4.1250762939453125, 4.04620361328125, -0.787506103515625, 2.0979843139648438, 3.4653778076171875, 3.1762237548828125, 7.084747314453125, 2.1272201538085938, 3.0743484497070312, 2.0794677734375, 3.6009979248046875, 0.8907508850097656, 8.974884033203125, -0.007724761962890625, 0.06967544555664062, 1.3616256713867188, 3.4465179443359375, 2.79345703125, 2.8464889526367188, 0.86407470703125, 4.692508697509766, 1.1127395629882812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000064.npy"}
{"epoch": 0.09397944199706314, "step": 65, "batch_size": 64, "mean": 1.780156135559082, "std": 2.106813907623291, "min": -2.6395111083984375, "p10": -0.07904853820800774, "median": 1.3105621337890625, "p90": 5.040901184082032, "max": 9.422744750976562, "pos_frac": 0.875, "sample": [5.1652984619140625, 5.977813720703125, 0.56390380859375, 1.72283935546875, 1.2030487060546875, 0.3940582275390625, -0.1092071533203125, 0.9776611328125, 0.7338409423828125, 0.8470611572265625, 9.422744750976562, -1.0407066345214844, 0.17968368530273438, 1.4488677978515625, 4.750640869140625, -0.008678436279296875, 2.6670455932617188, 0.5493993759155273, 1.1014251708984375, -2.6395111083984375, 1.9715423583984375, 4.272308349609375, 1.3829193115234375, 0.8399658203125, 3.311920166015625, 5.9795684814453125, 3.967529296875, 2.4500274658203125, 5.5037384033203125, 0.2397308349609375, 1.2382049560546875, 0.6406402587890625, -0.4592437744140625, 0.9847564697265625, 2.549560546875, 1.8556861877441406, 1.829376220703125, 0.0770416259765625, 6.164375305175781, 0.2627601623535156, 0.724395751953125, -1.1371994018554688, 1.1946868896484375, 0.2361297607421875, 6.195068359375, 0.5283126831054688, 2.5936279296875, 0.1482086181640625, 3.067474365234375, 4.355140686035156, 1.4748992919921875, -0.252899169921875, 1.7301712036132812, 1.5913238525390625, 2.3524627685546875, 1.00396728515625, 1.4698562622070312, -0.8117523193359375, 1.5023193359375, 2.1795806884765625, 0.19052505493164062, 2.0994415283203125, 0.8872146606445312, 1.6374015808105469], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000065.npy"}
{"epoch": 0.09544787077826726, "step": 66, "batch_size": 64, "mean": 1.2560513019561768, "std": 1.9524377584457397, "min": -3.5600433349609375, "p10": -0.6730453491210937, "median": 0.660003662109375, "p90": 3.7039730072021486, "max": 7.114692687988281, "pos_frac": 0.8125, "sample": [2.2132186889648438, 4.5848541259765625, 3.74432373046875, 1.1492996215820312, 1.24932861328125, 0.5136260986328125, 0.19131088256835938, 0.6154899597167969, 0.15424346923828125, 1.6135482788085938, 3.1449966430664062, 0.6058387756347656, 0.7787857055664062, 0.3835906982421875, -1.5142059326171875, -3.5600433349609375, 1.117919921875, 0.2942543029785156, 0.9690589904785156, 7.114692687988281, 0.24565887451171875, 1.9074172973632812, 0.3744659423828125, 1.2046661376953125, -0.648468017578125, 0.40926361083984375, -0.32578277587890625, 1.9265098571777344, 0.9909439086914062, 0.694427490234375, 0.588531494140625, 6.128715515136719, 3.609821319580078, 2.0307769775390625, 1.67193603515625, 1.1351776123046875, 1.95538330078125, 0.3371124267578125, 0.4359474182128906, 3.0263595581054688, 0.625579833984375, -0.9274368286132812, 0.1753692626953125, 0.4140167236328125, 1.4113578796386719, -0.6917190551757812, 1.3702392578125, -0.07363510131835938, -1.4921875, 0.54193115234375, 2.5792312622070312, 1.6259994506835938, 6.4777679443359375, -0.717041015625, 0.034946441650390625, 5.5190582275390625, -0.6835784912109375, 0.48554229736328125, -0.19106292724609375, 0.4276084899902344, 5.552825927734375, -0.4062919616699219, 2.610443115234375, 2.6553192138671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000066.npy"}
{"epoch": 0.09691629955947137, "step": 67, "batch_size": 64, "mean": 1.1451354026794434, "std": 2.713418960571289, "min": -4.3499755859375, "p10": -1.6302581787109376, "median": 0.6448345184326172, "p90": 4.98715744018555, "max": 10.442214965820312, "pos_frac": 0.703125, "sample": [5.4271240234375, 0.5195693969726562, 8.348228454589844, 1.571014404296875, 0.13060569763183594, 0.0107879638671875, 5.561553955078125, 1.0861244201660156, 1.111053466796875, 0.00612640380859375, 0.4924736022949219, 2.5814208984375, -1.63189697265625, 0.6621932983398438, -0.08402252197265625, -1.1380043029785156, 1.6277313232421875, 2.4178848266601562, -0.15826034545898438, -1.626434326171875, 1.8929672241210938, 0.81048583984375, 1.9376716613769531, 0.1908111572265625, -0.19036865234375, -0.715301513671875, 3.2953338623046875, -0.02631378173828125, 1.0204620361328125, -1.5359115600585938, -1.2099609375, 2.162120819091797, 1.5527725219726562, 0.19231796264648438, -0.402374267578125, 0.449920654296875, 0.40937042236328125, 0.27512359619140625, -1.8232421875, -1.549407958984375, -2.2224578857421875, 3.3827590942382812, 0.5474166870117188, 1.5272102355957031, 1.8218307495117188, 2.5742225646972656, 0.3372631072998047, 4.237495422363281, 0.9330005645751953, 5.308441162109375, -1.99774169921875, 1.4392719268798828, 2.5994644165039062, 1.0473175048828125, 1.6282501220703125, -2.755596160888672, 8.20526123046875, 1.3321456909179688, -4.3499755859375, 7.061164855957031, 10.442214965820312, 0.6274757385253906, -3.410919189453125, -0.6786003112792969], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000067.npy"}
{"epoch": 0.09838472834067548, "step": 68, "batch_size": 64, "mean": 2.152301549911499, "std": 2.9446916580200195, "min": -1.953094482421875, "p10": -0.3538463592529297, "median": 1.4214191436767578, "p90": 6.495100402832039, "max": 14.620193481445312, "pos_frac": 0.84375, "sample": [1.8829116821289062, 2.2499618530273438, 3.4779510498046875, 1.8701896667480469, 0.542388916015625, 4.5134124755859375, 4.5981597900390625, 3.193359375, -1.2979698181152344, 0.1295757293701172, 1.6496124267578125, 14.620193481445312, 4.048088073730469, 2.619110107421875, 1.70416259765625, 0.7287750244140625, 1.3521499633789062, 3.9514236450195312, 0.5312118530273438, 7.907203674316406, 0.36537933349609375, 1.6731681823730469, 0.8381614685058594, 0.048919677734375, 0.5937786102294922, 2.8990020751953125, 7.308074951171875, 9.559860229492188, 2.5807418823242188, -1.953094482421875, 2.5457000732421875, 1.3584823608398438, 0.22013092041015625, 2.7037353515625, 1.879791259765625, 1.0864944458007812, 0.006214141845703125, -0.04707145690917969, 0.6978378295898438, 2.69097900390625, -1.7730560302734375, 0.21044158935546875, -0.3598213195800781, -0.0402984619140625, 1.0034942626953125, 1.046600341796875, 1.6206645965576172, 7.71002197265625, -1.4082489013671875, 0.15650272369384766, 1.468841552734375, 8.826095581054688, 8.135673522949219, 2.3126220703125, -0.5250167846679688, 3.4826278686523438, 1.1815338134765625, 1.3739967346191406, 3.3040924072265625, 0.8088455200195312, -0.33990478515625, -0.8673667907714844, 1.142669677734375, 1.9481277465820312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000068.npy"}
{"epoch": 0.09985315712187959, "step": 69, "batch_size": 64, "mean": 2.3075122833251953, "std": 3.0359442234039307, "min": -6.7233123779296875, "p10": 0.0029857635498047, "median": 1.7228527069091797, "p90": 5.133695220947266, "max": 14.223281860351562, "pos_frac": 0.890625, "sample": [0.8845977783203125, -1.0886192321777344, 8.3006591796875, 0.40296173095703125, 2.7714767456054688, 4.751678466796875, -6.7233123779296875, 1.25970458984375, -0.13237571716308594, 0.4076995849609375, 0.5269012451171875, 0.4041900634765625, 4.4058074951171875, 0.22377395629882812, 1.6805839538574219, 4.317226409912109, 4.085357666015625, 2.4715347290039062, 5.3117218017578125, 4.4170989990234375, 1.76531982421875, 0.5848007202148438, 1.7651214599609375, 2.6617431640625, 3.3735275268554688, 3.5198516845703125, 0.9235000610351562, 12.670356750488281, 2.6065521240234375, 1.4935379028320312, 0.6863174438476562, -1.0570144653320312, 1.5923538208007812, 8.384414672851562, 0.5690727233886719, 5.148414611816406, 2.6600570678710938, 2.488128662109375, 2.0766372680664062, 0.2535896301269531, 0.015293121337890625, 4.2080841064453125, 0.81842041015625, -0.002288818359375, 0.3445701599121094, 1.4403228759765625, 3.1607437133789062, 5.0993499755859375, 1.271636962890625, 0.054607391357421875, 2.0642662048339844, 1.8776779174804688, 0.40123748779296875, 1.3333282470703125, 1.9528427124023438, 1.242950439453125, 6.241729736328125, 14.223281860351562, 2.4028778076171875, 3.6328506469726562, -0.7468490600585938, 0.9839420318603516, -0.13817596435546875, 2.953125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000069.npy"}
{"epoch": 0.1013215859030837, "step": 70, "batch_size": 64, "mean": 2.644542932510376, "std": 3.3996503353118896, "min": -2.8913421630859375, "p10": -0.7195949554443358, "median": 1.7118358612060547, "p90": 6.739074707031252, "max": 16.63671875, "pos_frac": 0.8125, "sample": [0.07540130615234375, 8.139968872070312, 2.688323974609375, 0.8444061279296875, -0.764068603515625, 1.0993843078613281, -2.8913421630859375, 6.3911895751953125, -0.6535720825195312, 0.5658493041992188, 2.7671661376953125, -1.1818161010742188, -1.2559795379638672, 3.67474365234375, 16.63671875, 1.4915809631347656, 6.8881683349609375, 4.3478240966796875, 3.888885498046875, 5.311737060546875, 4.126197814941406, 5.336704254150391, 1.6030311584472656, 5.2841339111328125, -1.3343658447265625, 4.006256103515625, -0.47247314453125, 1.1729660034179688, 1.2321929931640625, 0.7456588745117188, -0.29399871826171875, 8.805747985839844, 1.4848556518554688, 2.1901092529296875, 3.9395370483398438, 2.0021820068359375, 1.280792236328125, 1.8206405639648438, 1.9680976867675781, 0.17406463623046875, 0.4514198303222656, -1.0590667724609375, 0.7139129638671875, -0.2086181640625, 1.5895919799804688, -0.1480712890625, 8.734947204589844, 4.9673919677734375, 3.443084716796875, 0.9498062133789062, 2.0472793579101562, 4.145236968994141, 0.4921436309814453, 2.7548751831054688, 1.0893211364746094, 2.6640090942382812, 10.458877563476562, 4.787467956542969, 11.290870666503906, 0.7921295166015625, -0.7478904724121094, 0.5020751953125, 2.6530494689941406, 3.7500076293945312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000070.npy"}
{"epoch": 0.1027900146842878, "step": 71, "batch_size": 64, "mean": 3.6519851684570312, "std": 4.1211137771606445, "min": -2.1156387329101562, "p10": 0.010806846618652353, "median": 2.8068199157714844, "p90": 8.743852233886722, "max": 19.810455322265625, "pos_frac": 0.90625, "sample": [1.054656982421875, 13.572906494140625, 0.01999664306640625, -0.6965827941894531, 8.157371520996094, -0.449493408203125, 2.122100830078125, 3.140522003173828, 1.0339889526367188, 3.1245498657226562, 3.8680572509765625, 2.2465152740478516, 2.9440383911132812, -0.13634681701660156, 2.368804931640625, 2.5633697509765625, 4.91851806640625, 6.61151123046875, 1.3725814819335938, 1.3253631591796875, 8.096138000488281, 8.995201110839844, 2.7593307495117188, 3.6258163452148438, 1.1357345581054688, 2.8630142211914062, 2.1124801635742188, 0.6242179870605469, 3.0829238891601562, 0.6143798828125, -2.1156387329101562, 5.536712646484375, 5.346923828125, 0.0068683624267578125, 3.8850440979003906, 2.5509185791015625, 0.28487396240234375, 6.6511688232421875, 3.1863555908203125, 9.274314880371094, 0.1725921630859375, 4.463233947753906, 4.457611083984375, 0.7593994140625, 6.014984130859375, 4.424999237060547, 0.3113594055175781, 17.396255493164062, 19.810455322265625, 5.9120635986328125, 0.3621063232421875, 6.580223083496094, 1.6147918701171875, 0.3137550354003906, 3.38580322265625, 1.5453948974609375, -0.6142349243164062, 1.5986213684082031, 4.1940155029296875, 10.174995422363281, 10.588409423828125, 0.9702377319335938, -1.2435379028320312, 2.85430908203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000071.npy"}
{"epoch": 0.10425844346549193, "step": 72, "batch_size": 64, "mean": 2.9328010082244873, "std": 3.3681561946868896, "min": -2.756195068359375, "p10": -0.40322990417480453, "median": 2.1379928588867188, "p90": 8.23767547607422, "max": 13.8997802734375, "pos_frac": 0.84375, "sample": [3.0389671325683594, 4.311969757080078, -1.8791580200195312, 0.6857185363769531, 3.7061691284179688, -1.3936004638671875, 2.078826904296875, 6.994808197021484, -2.756195068359375, -1.049102783203125, 0.047893524169921875, 0.29885292053222656, 2.5923843383789062, 8.449493408203125, 5.444469451904297, 1.0382041931152344, 2.7004852294921875, 5.972953796386719, 0.6312789916992188, 3.5697479248046875, 3.453521728515625, 1.8980255126953125, 0.9625091552734375, 3.0179405212402344, 2.08984375, 2.4649887084960938, 1.0717048645019531, 2.1616744995117188, 2.2421493530273438, 13.8997802734375, 1.454437255859375, 1.7325363159179688, 1.1654205322265625, 3.4076385498046875, 1.316497802734375, 11.488204956054688, 9.945953369140625, 2.1143112182617188, 0.697998046875, 8.787361145019531, 1.660430908203125, 8.186843872070312, 0.1638641357421875, -0.47913360595703125, -0.4659309387207031, 5.604217529296875, 8.25946044921875, 2.4053573608398438, -0.256927490234375, 8.910675048828125, 2.29144287109375, 3.2005958557128906, 0.7431907653808594, -0.0789642333984375, 1.3165283203125, 7.402107238769531, 4.326385498046875, 4.818977355957031, 6.4344482421875, 1.6817283630371094, 2.4884071350097656, 1.7919387817382812, -2.403106689453125, -0.15993881225585938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000072.npy"}
{"epoch": 0.10572687224669604, "step": 73, "batch_size": 64, "mean": 3.0887367725372314, "std": 4.935232162475586, "min": -3.6962928771972656, "p10": -2.004920196533203, "median": 1.6999683380126953, "p90": 10.109751129150391, "max": 18.556182861328125, "pos_frac": 0.765625, "sample": [2.2887496948242188, 0.5099716186523438, 0.9507293701171875, 1.2326202392578125, 1.627828598022461, 5.3805084228515625, -3.6962928771972656, 0.1525421142578125, 4.5290069580078125, 1.4276313781738281, 18.556182861328125, 7.617351531982422, 3.640045166015625, 0.06906509399414062, -3.1343994140625, -2.0244369506835938, 16.86199951171875, 3.5988922119140625, 1.7147789001464844, 0.68603515625, 6.425132751464844, 2.9717330932617188, 1.7863502502441406, 0.7510051727294922, -0.6572265625, 2.3369712829589844, 3.038127899169922, 4.484653472900391, 4.600379943847656, 1.62158203125, 0.8169517517089844, 0.07120513916015625, 11.772735595703125, 4.453987121582031, -3.5515289306640625, 4.910186767578125, 0.986663818359375, -0.019519805908203125, -0.5773067474365234, 0.23656082153320312, -3.5125732421875, 1.891204833984375, -0.562713623046875, -0.10953140258789062, 9.853034973144531, 3.50445556640625, 1.4138202667236328, 0.23860549926757812, 7.703792572021484, 10.219772338867188, 2.4412155151367188, 4.907814025878906, 14.37762451171875, -0.4320716857910156, 1.6851577758789062, -1.959381103515625, 12.648284912109375, 7.8323974609375, -1.634246826171875, 15.497268676757812, 2.2055416107177734, 6.034454345703125, -2.16064453125, -2.8515777587890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000073.npy"}
{"epoch": 0.10719530102790015, "step": 74, "batch_size": 64, "mean": 3.5217089653015137, "std": 4.403268814086914, "min": -2.4807281494140625, "p10": -1.0010311126708982, "median": 2.473268508911133, "p90": 11.128604125976562, "max": 16.630233764648438, "pos_frac": 0.75, "sample": [4.3123779296875, 2.3863677978515625, 3.0195846557617188, 0.3232078552246094, 9.105171203613281, 2.0903472900390625, 2.560169219970703, 12.806648254394531, -0.7243385314941406, -0.33062744140625, 11.1285400390625, -0.7981948852539062, 12.107208251953125, 5.1880340576171875, 0.156219482421875, 11.846099853515625, 3.3938827514648438, 3.3087387084960938, 1.6577606201171875, -0.17181396484375, 1.7599983215332031, 16.630233764648438, -2.4429931640625, 4.952857971191406, 2.2215652465820312, 3.560150146484375, -0.1490192413330078, 8.057479858398438, -0.08266448974609375, 3.2592315673828125, 3.1440963745117188, -1.1900634765625, 0.3322582244873047, 11.95635986328125, -1.59417724609375, 5.744964599609375, -2.4807281494140625, 0.9957122802734375, 4.004741668701172, 0.8275375366210938, -1.0705986022949219, 1.8105697631835938, 4.794075012207031, 11.145721435546875, 6.7279052734375, 4.6802978515625, 0.2531280517578125, -0.5640869140625, 8.81964111328125, 0.6275444030761719, 4.163383483886719, 11.128631591796875, -1.4161148071289062, 7.23211669921875, 6.805229187011719, 1.2809181213378906, 3.8795318603515625, 4.2271881103515625, -0.308685302734375, 8.791290283203125, -0.8387069702148438, 1.1109161376953125, -2.4560890197753906, 1.692657470703125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000074.npy"}
{"epoch": 0.10866372980910426, "step": 75, "batch_size": 64, "mean": 4.542590141296387, "std": 5.499380588531494, "min": -3.92608642578125, "p10": -0.10924911499023438, "median": 3.0102062225341797, "p90": 13.163059997558594, "max": 23.316322326660156, "pos_frac": 0.875, "sample": [0.05048942565917969, 13.81597900390625, 6.1326446533203125, 1.8690261840820312, -3.515625, 4.1540985107421875, 3.416759490966797, 0.34991455078125, 2.128936767578125, 13.306060791015625, 4.188880920410156, 1.6140689849853516, 5.393867492675781, 2.1456069946289062, 8.475105285644531, 3.3582839965820312, 4.036346435546875, 4.989410400390625, 0.04026031494140625, 1.1123046875, 9.567451477050781, 2.631591796875, 1.5451812744140625, -0.46773529052734375, 8.144439697265625, 2.4991302490234375, -1.761749267578125, 0.2479400634765625, 2.9497947692871094, 10.987556457519531, 7.138877868652344, 0.284088134765625, 5.65948486328125, 16.516067504882812, 1.0075225830078125, 3.6602020263671875, 18.4293212890625, -3.92608642578125, 2.2876663208007812, 1.7144775390625, 0.27203369140625, 7.865039825439453, 3.9341659545898438, 5.573028564453125, -0.1107025146484375, 5.2303466796875, 1.2062149047851562, 3.07061767578125, 1.9005584716796875, 10.448318481445312, -0.5938796997070312, 4.929595947265625, -0.6515884399414062, 4.497802734375, 0.1790771484375, 0.08353805541992188, 3.9680938720703125, 12.829391479492188, -0.10585784912109375, 1.1892166137695312, 23.316322326660156, 15.0625, 17.83587646484375, 2.6184234619140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000075.npy"}
{"epoch": 0.11013215859030837, "step": 76, "batch_size": 64, "mean": 3.059915542602539, "std": 4.680630207061768, "min": -6.3543548583984375, "p10": -1.514984130859375, "median": 1.9332361221313477, "p90": 7.324028778076175, "max": 19.875732421875, "pos_frac": 0.78125, "sample": [-4.279567718505859, 1.9446678161621094, 0.7947711944580078, 19.519317626953125, 1.8785171508789062, 1.4575347900390625, 5.7036285400390625, 7.67413330078125, 3.1938552856445312, 3.219593048095703, 4.223716735839844, -0.4470176696777344, -3.600788116455078, 4.0830841064453125, 2.7215118408203125, 1.1305656433105469, 4.2256317138671875, 19.875732421875, 1.315948486328125, 1.8852386474609375, 5.642860412597656, 3.8218278884887695, -0.24912643432617188, 1.3327560424804688, -1.6934967041015625, 6.070465087890625, 0.5064401626586914, 4.229667663574219, -1.021820068359375, -6.3543548583984375, 5.197731018066406, 4.684051513671875, 1.92962646484375, 1.2882308959960938, -4.668792724609375, 0.5944576263427734, 5.790290832519531, 2.9942398071289062, -0.8498172760009766, 0.7056427001953125, 1.9368457794189453, 4.816864013671875, -2.1737289428710938, 0.910491943359375, 12.575027465820312, 6.507118225097656, 9.859146118164062, 3.090484619140625, 6.471652984619141, 1.5676803588867188, -1.4362640380859375, -1.5487213134765625, 1.3460540771484375, -0.0765228271484375, 12.16815185546875, 0.3649177551269531, -0.02245330810546875, 8.988311767578125, 4.2023162841796875, 5.5643157958984375, 1.44134521484375, 6.05963134765625, 5.3904571533203125, 1.3605194091796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000076.npy"}
{"epoch": 0.11160058737151249, "step": 77, "batch_size": 64, "mean": 3.3754987716674805, "std": 5.0583343505859375, "min": -9.644073486328125, "p10": -0.8510635375976562, "median": 2.0216827392578125, "p90": 9.58958206176758, "max": 18.460418701171875, "pos_frac": 0.75, "sample": [1.9698600769042969, 13.734825134277344, 1.5024261474609375, 5.406440734863281, 2.7202529907226562, -3.1371688842773438, 14.126663208007812, 6.065757751464844, 1.3708362579345703, 5.490638732910156, -0.6232109069824219, 4.903892517089844, 6.145259857177734, 0.9462165832519531, 1.3158111572265625, 3.2419586181640625, -9.644073486328125, 8.170524597167969, -0.8663482666015625, 9.659599304199219, 3.8214187622070312, -0.0997467041015625, 0.12736129760742188, -0.0689697265625, 2.4147491455078125, 5.976593017578125, -0.0762939453125, 8.684005737304688, 0.2464122772216797, 2.0609970092773438, 10.331497192382812, 11.625244140625, 0.7284202575683594, 0.3002471923828125, 6.5628509521484375, 1.9823684692382812, 6.483856201171875, 18.460418701171875, -0.24840545654296875, 5.7828216552734375, -2.9447479248046875, 1.7036170959472656, -7.4000244140625, -0.18587112426757812, 5.006557464599609, -0.815399169921875, 9.42620849609375, 9.110923767089844, 1.5455169677734375, 12.57568359375, 0.7678375244140625, 0.67950439453125, -0.5505714416503906, 1.0491714477539062, 5.66156005859375, 4.995208740234375, 0.019544601440429688, -5.1728363037109375, 8.924285888671875, 7.606914520263672, -0.7922554016113281, 2.9926223754882812, 5.235084533691406, -1.00262451171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000077.npy"}
{"epoch": 0.1130690161527166, "step": 78, "batch_size": 64, "mean": 3.670267105102539, "std": 4.297895431518555, "min": -5.821432113647461, "p10": -0.6410486221313475, "median": 3.3539905548095703, "p90": 8.623616027832032, "max": 18.663833618164062, "pos_frac": 0.828125, "sample": [7.2322845458984375, -0.987823486328125, 7.407623291015625, -0.7644424438476562, 2.1760787963867188, 11.087677001953125, 3.6090011596679688, 15.383941650390625, 8.331680297851562, 3.5302505493164062, 4.212451934814453, 8.370964050292969, -0.5092391967773438, -5.821432113647461, 3.9616737365722656, 3.650249481201172, 1.501556396484375, 4.475826263427734, 3.8815689086914062, 4.6050262451171875, 0.3620586395263672, 1.7446765899658203, 5.469398498535156, 14.828964233398438, 2.8717117309570312, 0.77117919921875, -0.26100921630859375, 5.260223388671875, 9.899276733398438, 3.1777305603027344, 0.18839263916015625, 1.271881103515625, -1.9311485290527344, 3.6411590576171875, 4.641441345214844, 11.45343017578125, 3.802886962890625, 1.4143867492675781, 2.110504150390625, 6.40155029296875, 6.434688568115234, 4.698455810546875, 8.731895446777344, 4.326171875, 4.550682067871094, 2.344371795654297, -1.2606964111328125, 1.2621269226074219, -0.6975383758544922, 3.7141494750976562, 0.9925136566162109, 0.6171112060546875, 0.9808769226074219, -0.47682952880859375, 2.5196685791015625, -1.6984176635742188, 18.663833618164062, 1.7871837615966797, 1.7752456665039062, 5.036430358886719, -0.015167236328125, 6.33935546875, 1.1317596435546875, 0.6856155395507812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000078.npy"}
{"epoch": 0.1145374449339207, "step": 79, "batch_size": 64, "mean": 4.710599422454834, "std": 5.815639972686768, "min": -8.17572021484375, "p10": -0.8262283325195312, "median": 3.6321659088134766, "p90": 11.265379333496094, "max": 25.759597778320312, "pos_frac": 0.78125, "sample": [-5.157142639160156, 9.822818756103516, 1.2298774719238281, 10.446784973144531, -0.41888427734375, 2.44207763671875, -1.0240516662597656, 1.8378257751464844, 9.525917053222656, 12.90350341796875, 10.83355712890625, -8.17572021484375, 2.7582168579101562, 25.759597778320312, 0.9030876159667969, 12.279869079589844, 5.096405029296875, -0.82611083984375, 3.386301040649414, 13.026473999023438, 17.09656524658203, 5.654956817626953, 5.659614562988281, -2.308807373046875, 9.53924560546875, -1.9704780578613281, 2.7011032104492188, 6.407958984375, 4.659202575683594, 7.419708251953125, 8.969497680664062, 3.0883941650390625, 8.597648620605469, 6.098636627197266, -0.6775054931640625, 3.8326263427734375, 3.4317054748535156, -0.8262786865234375, 21.18865966796875, 11.34625244140625, 5.3703460693359375, 2.6032028198242188, 4.0222625732421875, 3.039632797241211, 8.411056518554688, -0.3366737365722656, 6.4733734130859375, 2.174579620361328, 1.5225944519042969, -0.101806640625, 7.7316741943359375, 0.08362579345703125, 2.714008331298828, 5.4916229248046875, 1.11444091796875, 4.79779052734375, 4.453887939453125, -0.22579193115234375, -3.0076828002929688, 0.8556900024414062, 4.510036468505859, 11.076675415039062, -0.1379852294921875, 2.282684326171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000079.npy"}
{"epoch": 0.11600587371512482, "step": 80, "batch_size": 64, "mean": 3.7351717948913574, "std": 4.969053268432617, "min": -6.10028076171875, "p10": -1.0269485473632811, "median": 2.448251724243164, "p90": 10.719165802001955, "max": 22.421630859375, "pos_frac": 0.828125, "sample": [2.2236328125, 3.2608909606933594, 3.437103271484375, -6.10028076171875, 2.239238739013672, -0.12720108032226562, 1.4725875854492188, 0.8417739868164062, 8.967514038085938, -2.642425537109375, 1.1349372863769531, 4.1776123046875, -1.638448715209961, 1.954742431640625, 1.5835342407226562, 0.5601730346679688, 22.421630859375, 3.578411102294922, 10.873947143554688, 5.37030029296875, 18.249954223632812, 1.7039680480957031, 5.656578063964844, -2.6910476684570312, 3.8244552612304688, 2.065959930419922, 0.37421607971191406, 11.533782958984375, 2.6572647094726562, 5.717864990234375, 0.8494186401367188, -1.00042724609375, 2.238506317138672, 8.901199340820312, 4.677642822265625, -2.2881927490234375, 3.231231689453125, 6.311820983886719, -0.9532546997070312, 13.988479614257812, 0.8257293701171875, 6.8850860595703125, 2.0693283081054688, 11.247650146484375, 10.358009338378906, 3.1695823669433594, 3.1788558959960938, 4.331268310546875, 1.8475627899169922, 1.4356803894042969, 1.0430068969726562, -1.0383148193359375, 0.04650115966796875, 3.8114166259765625, 1.1203994750976562, 3.5630569458007812, 1.0855255126953125, -2.0898208618164062, 4.387596130371094, 3.995208740234375, 8.239463806152344, 9.041061401367188, -0.1412200927734375, 11.999267578125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000080.npy"}
{"epoch": 0.11747430249632893, "step": 81, "batch_size": 64, "mean": 5.311590194702148, "std": 7.012706756591797, "min": -8.842041015625, "p10": -0.6339717864990234, "median": 4.4473419189453125, "p90": 12.76997985839844, "max": 35.55570983886719, "pos_frac": 0.859375, "sample": [6.566093444824219, 15.7935791015625, 12.183349609375, 5.418792724609375, 2.1805171966552734, 12.050933837890625, 0.009159088134765625, 0.6434707641601562, -0.6594657897949219, 4.6727752685546875, 5.20367431640625, -8.842041015625, 1.4722251892089844, 4.7478485107421875, 8.903106689453125, 0.9746437072753906, 2.48687744140625, 6.2294158935546875, 13.021392822265625, -1.0897140502929688, 0.3405570983886719, 7.085685729980469, -0.39302825927734375, 5.3287200927734375, -1.3171539306640625, 1.9245986938476562, 9.508026123046875, 8.521137237548828, 2.550233840942383, 4.899017333984375, -0.5744857788085938, 0.3949432373046875, 0.016386032104492188, -4.846519470214844, 7.2809295654296875, 22.9708251953125, 2.063690185546875, 0.0740966796875, -3.58355712890625, 35.55570983886719, 5.2241058349609375, 13.102783203125, 5.061798095703125, 5.402412414550781, 2.0285072326660156, 3.0326614379882812, -1.4900054931640625, 3.79669189453125, 7.0167083740234375, 21.572830200195312, 4.14946174621582, 0.05138397216796875, 2.902172088623047, 2.1927566528320312, 6.6446685791015625, 9.171977996826172, 22.859283447265625, 2.1565704345703125, 4.373664855957031, 5.685630798339844, 4.521018981933594, 6.3763275146484375, 3.9589385986328125, 10.382965087890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000081.npy"}
{"epoch": 0.11894273127753303, "step": 82, "batch_size": 64, "mean": 3.593234062194824, "std": 4.969600677490234, "min": -7.2838287353515625, "p10": -1.0666419982910156, "median": 2.81195068359375, "p90": 8.73261184692383, "max": 17.5682373046875, "pos_frac": 0.78125, "sample": [1.7102890014648438, -0.38983154296875, 5.299507141113281, 3.0342941284179688, 1.4553947448730469, 6.879997253417969, 2.1748733520507812, 0.6534919738769531, 4.452766418457031, 17.415733337402344, 8.775955200195312, -0.5459976196289062, 1.0973129272460938, 5.001335144042969, 1.3804893493652344, 15.978851318359375, 4.5193939208984375, -3.1424407958984375, 4.2908935546875, 4.009613037109375, -1.0161895751953125, 7.223968505859375, 8.631477355957031, 7.298576354980469, -0.7682876586914062, 1.3083419799804688, 2.1278152465820312, 3.1331329345703125, -4.7174835205078125, 2.36627197265625, 7.102264404296875, 1.71441650390625, 0.1121673583984375, -0.28617000579833984, 13.332901000976562, 3.010242462158203, 2.4636993408203125, 5.547313690185547, 3.52325439453125, -0.8769378662109375, 1.8526115417480469, 5.099754333496094, 14.212852478027344, 1.2620697021484375, 0.08600234985351562, 1.6762008666992188, 5.379371643066406, 5.167625427246094, -1.0882644653320312, -4.8758544921875, -1.123870849609375, -3.8857421875, -7.2838287353515625, 7.359825134277344, 6.028099060058594, 5.846813201904297, 1.9548721313476562, 10.7911376953125, 2.613658905029297, 17.5682373046875, 8.218360900878906, 3.2881240844726562, -0.23169708251953125, 4.767917633056641], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000082.npy"}
{"epoch": 0.12041116005873716, "step": 83, "batch_size": 64, "mean": 4.125782012939453, "std": 6.356613636016846, "min": -7.728790283203125, "p10": -2.3411972045898435, "median": 3.3282394409179688, "p90": 13.209295654296875, "max": 22.327850341796875, "pos_frac": 0.703125, "sample": [13.235626220703125, 0.5177459716796875, -1.4121284484863281, 11.224700927734375, 5.0746917724609375, 1.9791536331176758, 0.9489021301269531, 2.890106201171875, 13.147857666015625, 2.361621856689453, 8.211868286132812, 5.012563705444336, -0.697967529296875, -4.774299621582031, -0.7768707275390625, 13.559432983398438, 0.145843505859375, -0.406585693359375, 21.91828155517578, 9.344253540039062, 10.643478393554688, 3.0394439697265625, -2.1840667724609375, -1.7244873046875, -0.7896957397460938, 4.1096343994140625, 10.64569091796875, -2.408538818359375, 3.414529800415039, 8.052169799804688, -5.6163330078125, 4.6837615966796875, 0.9216728210449219, -1.8062973022460938, 4.827857971191406, 8.448898315429688, 8.475502014160156, -1.407308578491211, 4.002433776855469, 1.9041290283203125, 5.198581695556641, -0.3097686767578125, 7.036834716796875, 22.327850341796875, 2.5293960571289062, 11.149955749511719, -5.2064208984375, -2.0991744995117188, -4.71942138671875, -2.088207244873047, -7.728790283203125, 4.0345306396484375, 3.312408447265625, 13.762748718261719, 11.190166473388672, 13.621994018554688, 3.491363525390625, -2.5923843383789062, 6.006008148193359, 15.576240539550781, 0.668365478515625, 6.015861511230469, 3.3440704345703125, 0.7905616760253906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000083.npy"}
{"epoch": 0.12187958883994127, "step": 84, "batch_size": 64, "mean": 2.5271925926208496, "std": 5.077273845672607, "min": -10.973419189453125, "p10": -2.51197452545166, "median": 1.7410621643066406, "p90": 9.235419464111335, "max": 19.243087768554688, "pos_frac": 0.671875, "sample": [1.1585693359375, 5.522125244140625, 2.4610443115234375, -0.22464561462402344, 17.984130859375, -0.792633056640625, 3.7305679321289062, 3.1472854614257812, 0.013376235961914062, 3.3103790283203125, -0.14849090576171875, 2.57635498046875, -1.851593017578125, -1.3407058715820312, -2.905975341796875, -3.6170883178710938, 3.7495193481445312, 3.7940673828125, 3.132171630859375, 3.8107147216796875, 2.3687305450439453, 5.285346984863281, 19.243087768554688, -0.26997947692871094, -0.11226463317871094, -1.6316680908203125, 2.7037582397460938, -1.839111328125, -10.973419189453125, 2.936006546020508, 2.1500511169433594, 0.30716705322265625, 14.601516723632812, -2.3040618896484375, 1.18670654296875, 7.454246520996094, 11.591339111328125, -3.350738525390625, -0.483978271484375, -3.627899169921875, -0.3547821044921875, 4.0118255615234375, 0.8550949096679688, -2.6010799407958984, 12.2257080078125, 3.8809432983398438, 3.585346221923828, 2.1035079956054688, 6.2230377197265625, 7.0872955322265625, -0.11408233642578125, 1.2557830810546875, 9.998779296875, 6.040287017822266, 1.7652435302734375, -0.2480316162109375, 4.9812469482421875, 0.7028083801269531, 0.7471771240234375, 10.767822265625, 1.0257148742675781, -2.917530059814453, 1.7168807983398438, 0.25731849670410156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000084.npy"}
{"epoch": 0.12334801762114538, "step": 85, "batch_size": 64, "mean": 3.3762965202331543, "std": 6.0323405265808105, "min": -8.230949401855469, "p10": -4.45703887939453, "median": 2.844646453857422, "p90": 9.577185821533204, "max": 23.022628784179688, "pos_frac": 0.703125, "sample": [13.89229965209961, 7.983917236328125, 14.277229309082031, 0.9252948760986328, -8.230949401855469, -2.3063812255859375, 1.2689132690429688, -2.3208389282226562, 23.022628784179688, -3.6432647705078125, 0.4326515197753906, -0.2698516845703125, 9.056106567382812, 8.803672790527344, -1.4688739776611328, 3.201416015625, -7.490234375, 6.290107727050781, 2.02691650390625, -3.85595703125, 0.4748649597167969, 7.5149078369140625, 0.8154411315917969, -0.5816001892089844, -0.052886962890625, -6.5498046875, 7.142784118652344, 1.9161224365234375, 13.471675872802734, 3.8641281127929688, 9.690750122070312, -5.46563720703125, -7.0432586669921875, 2.4878768920898438, -4.7146453857421875, -0.3503246307373047, 11.953231811523438, 8.898012161254883, 1.50335693359375, 0.9487152099609375, 3.620361328125, 6.187202453613281, 3.278533935546875, 3.4604721069335938, 9.042892456054688, 3.9877243041992188, 2.4415245056152344, 14.783966064453125, 8.92877197265625, 3.734201431274414, 7.5057830810546875, 9.065303802490234, 1.4876251220703125, 4.005657196044922, -0.4757232666015625, 4.29058837890625, -0.0572509765625, 0.306365966796875, 9.259605407714844, 9.312202453613281, -4.870765686035156, 3.9036865234375, -0.20293045043945312, 5.56866455078125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000085.npy"}
{"epoch": 0.12481644640234948, "step": 86, "batch_size": 64, "mean": 4.338800430297852, "std": 6.9741435050964355, "min": -8.499465942382812, "p10": -1.2370521545410151, "median": 2.0147485733032227, "p90": 15.356173706054689, "max": 32.66340637207031, "pos_frac": 0.796875, "sample": [-2.4671897888183594, 8.796981811523438, 15.471466064453125, 4.847042083740234, -0.6644783020019531, -0.01934814453125, 4.728553771972656, -0.8442955017089844, 3.777557373046875, 2.5351028442382812, 0.3207550048828125, 3.2729110717773438, -8.499465942382812, 5.000593185424805, 8.825965881347656, 5.3352813720703125, 17.880111694335938, 3.5714569091796875, 1.3864059448242188, 13.419609069824219, 0.2621612548828125, 3.5714683532714844, 1.9642562866210938, 1.7577438354492188, 8.843338012695312, 0.1844005584716797, 1.3186798095703125, 15.823749542236328, 0.5164146423339844, -0.271331787109375, 6.737907409667969, -2.5438919067382812, 1.7177047729492188, -4.2938995361328125, 9.394920349121094, 13.920501708984375, 0.9612884521484375, -7.3024749755859375, 17.550750732421875, 1.0296058654785156, 15.087158203125, -2.9674911499023438, 2.1213531494140625, 2.797504425048828, -1.4053764343261719, 20.977569580078125, 1.321603775024414, 32.66340637207031, 15.66094970703125, 4.322540283203125, 5.2556304931640625, -0.12708663940429688, 6.8126068115234375, 2.1966590881347656, 1.9320602416992188, 2.0114517211914062, 1.508819580078125, 2.018045425415039, -0.0544281005859375, 1.5396480560302734, 1.828765869140625, 1.0106124877929688, 2.11663818359375, 1.2362899780273438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000086.npy"}
{"epoch": 0.1262848751835536, "step": 87, "batch_size": 64, "mean": 4.626861572265625, "std": 7.310774803161621, "min": -22.76019287109375, "p10": -1.0353492736816405, "median": 3.9515113830566406, "p90": 14.80957946777344, "max": 28.4710693359375, "pos_frac": 0.828125, "sample": [-0.3473625183105469, 8.211898803710938, 1.6470451354980469, 4.806545257568359, 4.533416748046875, 3.3628997802734375, 5.9666290283203125, -0.23773765563964844, -1.0448684692382812, -3.7300949096679688, 4.3081207275390625, 4.831268310546875, -2.688812255859375, 15.096954345703125, 6.779296875, 7.637321472167969, 7.098785400390625, 0.7894821166992188, 20.7142333984375, 3.649017333984375, 1.6371383666992188, 1.0768547058105469, 2.210010528564453, 9.505626678466797, 4.8993988037109375, 0.15851593017578125, 8.885604858398438, 28.4710693359375, 5.6897735595703125, 6.322776794433594, -6.160633087158203, 13.192390441894531, 17.187965393066406, 15.108108520507812, 7.244056701660156, -0.8003349304199219, 2.0397567749023438, 3.704784393310547, 14.1390380859375, 5.88128662109375, 0.3174095153808594, 15.899421691894531, 0.9414901733398438, 11.521453857421875, -22.76019287109375, 1.6378364562988281, 13.885986328125, -4.137905120849609, 4.198238372802734, 4.912750244140625, 0.5992622375488281, 1.6935615539550781, 2.892345428466797, -7.72576904296875, -1.0131378173828125, 15.951858520507812, 4.81109619140625, 6.685600280761719, 6.5296630859375, 2.2768478393554688, 0.3019256591796875, 0.26006317138671875, 3.1986770629882812, 1.4634132385253906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000087.npy"}
{"epoch": 0.1277533039647577, "step": 88, "batch_size": 64, "mean": 3.7355780601501465, "std": 6.295097827911377, "min": -12.679962158203125, "p10": -2.697212219238281, "median": 2.9680557250976562, "p90": 11.362622070312502, "max": 23.32806396484375, "pos_frac": 0.75, "sample": [0.501983642578125, -3.6534881591796875, 4.751914978027344, 3.7435989379882812, 7.553562164306641, 1.86090087890625, 7.116802215576172, 23.32806396484375, -2.144622802734375, 0.9144401550292969, 15.306686401367188, 5.405467987060547, 3.0461959838867188, -0.4851646423339844, -12.679962158203125, 5.2633209228515625, 6.163421630859375, 2.8899154663085938, -3.6162033081054688, 2.846038818359375, -0.7616920471191406, 10.9637451171875, 9.000083923339844, 0.6405448913574219, 3.1329879760742188, -7.395050048828125, 14.96417236328125, 3.726318359375, 4.033061981201172, 8.039993286132812, 6.097259521484375, 16.35118865966797, 0.3645477294921875, 7.372703552246094, -2.1428985595703125, 20.154693603515625, -1.765045166015625, 9.98699951171875, 0.5347404479980469, 14.405487060546875, 3.1611709594726562, 1.949310302734375, 2.5813655853271484, 2.158445358276367, 0.29476165771484375, -1.3437957763671875, -1.837789535522461, 1.1238479614257812, 11.5335693359375, 10.126068115234375, 5.524467468261719, 2.5300979614257812, -1.8371162414550781, -0.723419189453125, -2.9498977661132812, 10.596672058105469, -2.9340362548828125, 0.36126136779785156, 4.3927001953125, 2.2448959350585938, 3.5711593627929688, -4.6258087158203125, 3.586578369140625, 3.7757644653320312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000088.npy"}
{"epoch": 0.12922173274596183, "step": 89, "batch_size": 64, "mean": 3.892774820327759, "std": 6.565749645233154, "min": -8.316226959228516, "p10": -1.2254650115966796, "median": 2.6815109252929688, "p90": 10.06211624145508, "max": 32.405548095703125, "pos_frac": 0.765625, "sample": [4.84259033203125, 1.9370613098144531, 1.613687515258789, 1.7071285247802734, -2.9675331115722656, 2.9511642456054688, 3.3387603759765625, 8.844169616699219, 2.6832427978515625, 10.131149291992188, 6.651371002197266, 14.431201934814453, 8.875274658203125, -1.0779571533203125, 1.37078857421875, 3.1352081298828125, 0.2694854736328125, 0.28101348876953125, -0.8333587646484375, 7.250804901123047, 2.857881546020508, -0.7244529724121094, 5.747051239013672, 2.6279983520507812, 5.636627197265625, -0.2370452880859375, -1.135986328125, 1.4331207275390625, 8.700370788574219, 3.185821533203125, 2.8500137329101562, 26.722686767578125, 2.755523681640625, 6.946407318115234, 5.662242889404297, 6.800682067871094, 1.402669906616211, 32.405548095703125, 0.5547904968261719, -1.2638130187988281, 13.987903594970703, -0.9222412109375, -0.07970428466796875, 3.379924774169922, -8.316226959228516, -7.900733947753906, 1.1126022338867188, 0.6791343688964844, 4.207366943359375, 9.901039123535156, 6.983589172363281, 6.6884613037109375, -1.3874359130859375, 2.132741928100586, 16.871490478515625, 0.831512451171875, -0.35540771484375, 0.13195037841796875, -4.0767822265625, 2.679779052734375, 10.849929809570312, -1.5013504028320312, 3.80029296875, 1.0763626098632812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000089.npy"}
{"epoch": 0.13069016152716592, "step": 90, "batch_size": 64, "mean": 5.050920009613037, "std": 6.956821918487549, "min": -10.985504150390625, "p10": -1.6071523666381835, "median": 3.3217926025390625, "p90": 15.073947143554689, "max": 32.9669189453125, "pos_frac": 0.828125, "sample": [3.985137939453125, -3.7305831909179688, 0.7732009887695312, 17.39190673828125, 5.283882141113281, 3.9707794189453125, 0.36293792724609375, 1.0071487426757812, 13.057022094726562, 0.7935352325439453, 15.249595642089844, -2.0579566955566406, 3.4288253784179688, 5.684761047363281, 3.2147598266601562, 6.253631591796875, 1.6126365661621094, 17.51763916015625, 2.4420928955078125, 1.2014579772949219, 4.524682998657227, 1.9255752563476562, 11.954299926757812, 2.8919219970703125, 32.9669189453125, 2.157184600830078, 12.160888671875, 10.221832275390625, -1.6366443634033203, -1.5383377075195312, 15.172210693359375, 6.217681884765625, -3.9420166015625, 2.9597349166870117, 6.6941680908203125, -10.985504150390625, 1.3975791931152344, 4.309711456298828, 13.593948364257812, 0.160125732421875, 8.788337707519531, -0.9657363891601562, -1.1213912963867188, 1.0091171264648438, -1.793121337890625, 2.075439453125, 1.1753387451171875, -5.380950927734375, -0.4441070556640625, 2.1770095825195312, 7.655315399169922, 2.863636016845703, 4.306724548339844, 14.084030151367188, 15.173416137695312, 4.2524566650390625, 1.811513900756836, 9.669261932373047, 16.73016357421875, 5.97808837890625, 6.508842468261719, 1.6420516967773438, 14.84466552734375, 3.5704269409179688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000090.npy"}
{"epoch": 0.13215859030837004, "step": 91, "batch_size": 64, "mean": 4.449386119842529, "std": 6.5148396492004395, "min": -5.6904754638671875, "p10": -2.4090988159179685, "median": 2.8404273986816406, "p90": 11.934561157226565, "max": 28.07080078125, "pos_frac": 0.75, "sample": [1.5589981079101562, 11.542648315429688, 0.6193008422851562, 1.9737625122070312, 28.07080078125, 0.7496929168701172, 0.9625091552734375, -3.097869873046875, 5.502925872802734, 6.997459411621094, 5.7805023193359375, 7.762828826904297, 5.1271514892578125, 6.357872009277344, 3.0702438354492188, 20.290603637695312, 2.8279647827148438, 6.062431335449219, -1.06329345703125, 14.361381530761719, 6.555274963378906, 3.951221466064453, 9.98468017578125, 2.1660079956054688, 8.779144287109375, 2.7242507934570312, 1.9422760009765625, -0.5819168090820312, -1.1439323425292969, -2.4837875366210938, 4.8507537841796875, 2.7187538146972656, -1.113494873046875, 3.297149658203125, 3.8175392150878906, 5.460430145263672, 3.8160629272460938, -2.9640960693359375, 0.2452850341796875, 1.8192253112792969, -3.8629608154296875, -3.042694091796875, 2.1054916381835938, -2.815143585205078, -0.655853271484375, 15.644515991210938, 1.1845741271972656, 11.619552612304688, -5.6904754638671875, 8.372352600097656, 2.8528900146484375, -0.7963485717773438, 0.16400146484375, 21.413734436035156, -1.0453681945800781, 10.853164672851562, -2.2348251342773438, 12.069564819335938, 7.3886566162109375, 3.3953208923339844, 17.308029174804688, -2.004486083984375, 11.279312133789062, 1.958953857421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000091.npy"}
{"epoch": 0.13362701908957417, "step": 92, "batch_size": 64, "mean": 3.7344515323638916, "std": 5.915489673614502, "min": -11.76458740234375, "p10": -1.1760097503662108, "median": 2.888916015625, "p90": 12.243345642089844, "max": 26.528411865234375, "pos_frac": 0.734375, "sample": [-5.062061309814453, -0.32816314697265625, 1.554931640625, 12.815185546875, 1.6338157653808594, 3.4197463989257812, 5.002166748046875, -0.6145668029785156, 1.0559768676757812, -0.7942543029785156, 10.973873138427734, -1.0151138305664062, 3.8043289184570312, 0.363616943359375, -11.76458740234375, 12.313575744628906, 7.847194671630859, 26.528411865234375, -4.946197509765625, 0.57696533203125, 4.523712158203125, -0.3665008544921875, 5.594970703125, -0.9900627136230469, 0.4177398681640625, 3.721527099609375, 4.208240509033203, 4.806243896484375, 7.0023193359375, 3.847322463989258, 15.240436553955078, -1.5453739166259766, 0.5368118286132812, -1.2079582214355469, 4.523384094238281, -0.33180809020996094, 4.714714050292969, 12.676177978515625, -1.1014633178710938, 16.180641174316406, 12.079475402832031, 10.844146728515625, 1.0888214111328125, 3.4607086181640625, 0.6956253051757812, 3.481386184692383, 3.2249298095703125, 10.649734497070312, 2.3645706176757812, 4.125776290893555, -0.3389759063720703, -1.8233318328857422, 12.492828369140625, 0.9949531555175781, 0.3964500427246094, -0.35040283203125, 1.6937141418457031, -2.6028366088867188, 9.260604858398438, 3.7442264556884766, 4.818229675292969, 2.1284255981445312, 8.207012176513672, 2.5529022216796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000092.npy"}
{"epoch": 0.13509544787077826, "step": 93, "batch_size": 64, "mean": 3.639509439468384, "std": 6.37657356262207, "min": -10.095710754394531, "p10": -4.03123550415039, "median": 2.773676872253418, "p90": 12.103754806518559, "max": 23.032577514648438, "pos_frac": 0.71875, "sample": [-8.390472412109375, 0.7215461730957031, 8.798820495605469, 9.261314392089844, 5.472332000732422, -2.333465576171875, 2.8543701171875, 0.8910255432128906, 12.532119750976562, -1.5502777099609375, 9.127182006835938, 3.3264083862304688, 2.1003570556640625, -0.9294548034667969, 14.103424072265625, 11.104236602783203, 3.0403289794921875, -2.993865966796875, -10.095710754394531, 13.453987121582031, -2.1805267333984375, 4.799282073974609, 10.129981994628906, -5.8193359375, 0.80242919921875, 2.3003387451171875, 16.7091064453125, 15.434211730957031, -0.8939876556396484, 4.576099395751953, 3.7631874084472656, -1.8506011962890625, 0.7824363708496094, 6.209651947021484, 9.085464477539062, 23.032577514648438, -4.779815673828125, 5.195075988769531, -0.76171875, -5.0897064208984375, 5.035835266113281, 1.6233062744140625, 6.615234375, 1.681051254272461, 4.432277679443359, 5.409832000732422, -0.8321380615234375, 1.1766166687011719, 11.077499389648438, 10.110336303710938, -4.475822448730469, 13.73537826538086, 2.5345230102539062, 4.006248474121094, 2.692983627319336, 6.778053283691406, -1.74261474609375, 7.030914306640625, 2.2402725219726562, 8.576774597167969, 1.7907485961914062, -2.08966064453125, -7.657112121582031, 1.2397098541259766], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000093.npy"}
{"epoch": 0.13656387665198239, "step": 94, "batch_size": 64, "mean": 5.4602861404418945, "std": 7.104740142822266, "min": -11.650375366210938, "p10": -2.616008377075195, "median": 4.808502197265625, "p90": 14.283865356445315, "max": 27.00579833984375, "pos_frac": 0.828125, "sample": [4.650245666503906, 3.4345703125, 6.960662841796875, -1.355936050415039, -9.557998657226562, 1.2838592529296875, 1.1208076477050781, 17.28514862060547, 1.5988922119140625, 3.1984176635742188, 1.7303848266601562, -2.1328277587890625, 6.441017150878906, 8.611137390136719, -0.5206451416015625, 0.3983001708984375, 13.577415466308594, 9.795494079589844, 5.729331970214844, 11.383255004882812, -2.8230857849121094, 4.504150390625, 7.937126159667969, 4.5289154052734375, 11.523681640625, 7.5465087890625, -3.510578155517578, 5.264007568359375, 6.478912353515625, 1.4804306030273438, -4.099666595458984, 4.786277770996094, 3.2928237915039062, 19.7396240234375, 5.2022552490234375, 1.9171142578125, 27.00579833984375, 15.984909057617188, 5.1366729736328125, 4.830726623535156, 1.0938339233398438, 0.6706504821777344, -11.650375366210938, 2.0108604431152344, 9.211639404296875, 10.121627807617188, -7.241977691650391, 10.82110595703125, 9.737686157226562, 7.580238342285156, 13.9234619140625, 5.5386962890625, -0.4116363525390625, 7.3970794677734375, 3.1333541870117188, 14.438323974609375, 0.8314208984375, -3.330078125, 19.991371154785156, 1.9451370239257812, 9.032234191894531, 9.785675048828125, 20.936279296875, 3.5335845947265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000094.npy"}
{"epoch": 0.13803230543318648, "step": 95, "batch_size": 64, "mean": 4.245328426361084, "std": 6.29216194152832, "min": -5.72314453125, "p10": -1.8522934913635252, "median": 2.686629295349121, "p90": 12.744176483154298, "max": 25.901962280273438, "pos_frac": 0.71875, "sample": [1.2699508666992188, 3.9853286743164062, 6.459388732910156, -1.9449729919433594, 6.301414489746094, 16.63897705078125, 2.2518768310546875, 1.4876060485839844, -0.7217140197753906, 15.131744384765625, -0.20449066162109375, 3.0161056518554688, 7.0269775390625, 21.206573486328125, 16.891071319580078, -1.132415771484375, 5.780937194824219, -0.4932212829589844, -1.3469467163085938, 3.1839523315429688, 9.726394653320312, 3.7466964721679688, 3.0330238342285156, 0.349212646484375, -1.9134435653686523, -1.7096099853515625, 0.35408782958984375, 15.224075317382812, -0.6447639465332031, 7.842884063720703, -4.639610290527344, 5.4776458740234375, 11.169204711914062, 9.050727844238281, -5.72314453125, 12.307258605957031, 9.272911071777344, 1.1624679565429688, 0.7572174072265625, 8.5096435546875, 7.250572204589844, 25.901962280273438, 5.783241271972656, 5.8472900390625, 1.536123275756836, 0.5874767303466797, 0.3724937438964844, 4.707550048828125, -2.9731979370117188, -4.7593994140625, -1.9373035430908203, 0.8941097259521484, -0.2691650390625, 1.5758743286132812, 8.690879821777344, -0.361724853515625, 12.931427001953125, 5.61553955078125, 2.6820449829101562, 7.374664306640625, -1.461883544921875, 2.5517005920410156, 2.691213607788086, -1.6715087890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000095.npy"}
{"epoch": 0.1395007342143906, "step": 96, "batch_size": 64, "mean": 5.382932662963867, "std": 6.877300262451172, "min": -12.182693481445312, "p10": -0.7323768615722656, "median": 3.7761917114257812, "p90": 14.502820587158206, "max": 24.987869262695312, "pos_frac": 0.828125, "sample": [12.733665466308594, 3.673877716064453, 13.7000732421875, 1.5493087768554688, 8.31298828125, 22.355941772460938, -12.182693481445312, 0.5421676635742188, -1.4544181823730469, 6.0030517578125, 24.987869262695312, 5.3801727294921875, 6.390869140625, -0.27219390869140625, 3.3565406799316406, 4.135856628417969, 2.1588382720947266, 14.846855163574219, 0.6078720092773438, 16.07292938232422, -0.644134521484375, 8.851665496826172, 10.465927124023438, 22.34027099609375, 13.4200439453125, 5.7769775390625, 7.634254455566406, -2.6840057373046875, 15.930831909179688, 3.9728622436523438, -1.4896583557128906, 11.06268310546875, 1.65948486328125, 2.45452880859375, 2.7411651611328125, 1.353607177734375, -0.7701950073242188, 3.161418914794922, -7.460052490234375, 1.8076057434082031, 3.7051773071289062, 4.104022979736328, 8.210693359375, 3.0138702392578125, 0.40447235107421875, -0.2733955383300781, 5.753715515136719, 1.8926315307617188, 0.10570144653320312, 12.124244689941406, 4.4545745849609375, 8.611263275146484, -1.5578594207763672, -0.1676177978515625, 22.031219482421875, 4.649463653564453, 2.743518829345703, 10.090255737304688, 6.700164794921875, 5.33648681640625, 1.8204536437988281, 3.8472061157226562, 2.6325531005859375, 1.7900238037109375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000096.npy"}
{"epoch": 0.14096916299559473, "step": 97, "batch_size": 64, "mean": 4.833523750305176, "std": 5.580826759338379, "min": -5.7410888671875, "p10": -0.4514078140258782, "median": 3.1170272827148438, "p90": 12.72415008544922, "max": 20.078521728515625, "pos_frac": 0.890625, "sample": [0.8517303466796875, 8.271774291992188, 3.119598388671875, -2.9960174560546875, 0.7234764099121094, 0.24283981323242188, 9.588260650634766, 1.0054702758789062, 2.8507614135742188, 3.1337432861328125, 17.29339599609375, 13.013351440429688, -0.7356624603271484, 2.0595054626464844, 16.95147705078125, 17.56891632080078, -3.777984619140625, 6.7185211181640625, 2.1045379638671875, 2.9073143005371094, 0.23825836181640625, -1.6966514587402344, 1.6272048950195312, 1.7515716552734375, 9.37060546875, 5.440773010253906, 3.1144561767578125, 0.6612319946289062, 12.049346923828125, 7.998920440673828, 1.06072998046875, -1.11370849609375, 11.566474914550781, 1.6018714904785156, 9.690635681152344, 5.5811767578125, 11.049476623535156, 5.545604705810547, -5.7410888671875, 0.6983757019042969, 4.669708251953125, 1.1835479736328125, -4.1238250732421875, 0.21185302734375, 14.743431091308594, 7.453178405761719, 6.662178039550781, 2.3116302490234375, 5.349819183349609, 0.2281494140625, 2.8982772827148438, 1.414459228515625, 2.3281784057617188, 4.252449035644531, 2.8665771484375, 20.078521728515625, 0.36595916748046875, 7.93072509765625, 5.003303527832031, 8.314376831054688, 9.299297332763672, 6.108203887939453, 3.498321533203125, 14.906944274902344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000097.npy"}
{"epoch": 0.14243759177679882, "step": 98, "batch_size": 64, "mean": 5.328701972961426, "std": 5.886159420013428, "min": -6.8651123046875, "p10": -0.3794681549072266, "median": 3.929464340209961, "p90": 12.775247573852544, "max": 30.87750244140625, "pos_frac": 0.859375, "sample": [-0.005786895751953125, 4.0585784912109375, 13.317337036132812, 15.779685974121094, -2.2063369750976562, 3.7287139892578125, 8.63616943359375, 10.918445587158203, 2.230438232421875, 1.6714401245117188, 4.740962982177734, 4.848052978515625, 2.987030029296875, 15.514717102050781, 6.120918273925781, 10.103439331054688, 7.852149963378906, 4.748809814453125, 0.07305908203125, 3.8003501892089844, 9.157676696777344, 2.8249130249023438, -0.53265380859375, 5.2525787353515625, 14.658557891845703, 2.5320396423339844, 6.167938232421875, 11.510372161865234, 9.342391967773438, 3.5707130432128906, 1.8282699584960938, 5.451957702636719, 8.727230072021484, 7.39129638671875, 5.89239501953125, 18.4359130859375, 2.6589202880859375, -6.8651123046875, -1.4596710205078125, 7.125038146972656, -3.8790245056152344, 7.85273551940918, 0.0399322509765625, 7.5301971435546875, 3.5900726318359375, 2.31671142578125, 1.8132362365722656, 2.694732666015625, 2.335174560546875, 13.498184204101562, 7.4642486572265625, 9.940643310546875, 3.425628662109375, 30.87750244140625, -0.9986572265625, 4.07977294921875, -0.37429046630859375, 0.39186668395996094, -0.3816871643066406, 1.5506134033203125, 8.86053466796875, 1.4933013916015625, 1.692312240600586, 2.634246826171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000098.npy"}
{"epoch": 0.14390602055800295, "step": 99, "batch_size": 64, "mean": 5.719097137451172, "std": 7.499436855316162, "min": -3.5971527099609375, "p10": -0.3551267623901367, "median": 3.1196937561035156, "p90": 15.807807922363285, "max": 32.14276123046875, "pos_frac": 0.84375, "sample": [1.2214164733886719, -1.1680068969726562, 0.6190834045410156, 0.3515739440917969, -0.2766304016113281, 6.175510406494141, 9.902057647705078, 7.000404357910156, 16.373245239257812, 0.8099441528320312, 3.4997634887695312, 11.712570190429688, 9.912506103515625, -3.5971527099609375, 16.257217407226562, 5.7984771728515625, 5.893791198730469, 4.256690979003906, 1.9421844482421875, -0.2305450439453125, 14.759185791015625, -3.5710220336914062, 1.1915321350097656, 25.24432373046875, 1.1271095275878906, 10.082565307617188, 3.7855682373046875, -1.552459716796875, 0.06866836547851562, -3.1150856018066406, 2.101428985595703, 3.4456253051757812, 5.416797637939453, 6.343799591064453, 8.68194580078125, 21.960800170898438, 7.324676513671875, 1.1611442565917969, 12.060138702392578, 13.750152587890625, 3.7403411865234375, 8.178192138671875, 1.410736083984375, 0.31882476806640625, 32.14276123046875, 3.1076583862304688, 2.8184967041015625, 7.246040344238281, -0.3028144836425781, 2.4992523193359375, 16.493438720703125, 2.913360595703125, -0.3775463104248047, -1.4603805541992188, 11.780838012695312, 2.1218719482421875, 2.6922550201416016, 0.030458450317382812, 30.388534545898438, 3.6241912841796875, 2.786489486694336, 3.1317291259765625, 2.4181442260742188, 1.5983428955078125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000099.npy"}
{"epoch": 0.14537444933920704, "step": 100, "batch_size": 64, "mean": 4.430019378662109, "std": 5.0128984451293945, "min": -3.6832008361816406, "p10": -0.9729431152343749, "median": 3.6098670959472656, "p90": 9.691142654418947, "max": 21.733428955078125, "pos_frac": 0.84375, "sample": [2.3483047485351562, 1.4129524230957031, -1.3805694580078125, 5.005496978759766, 0.5963287353515625, -1.01837158203125, 2.3165664672851562, 6.561023712158203, -3.6832008361816406, 11.063446044921875, 3.633697509765625, 0.02059173583984375, 8.6182861328125, 1.4783668518066406, 0.5744705200195312, 1.7874755859375, 3.7300262451171875, 6.030059814453125, -1.96380615234375, 7.1985321044921875, 4.883808135986328, 5.2764129638671875, 2.3487777709960938, 1.3383293151855469, 8.630908966064453, 13.747276306152344, 1.0878143310546875, 1.7890777587890625, -0.4571704864501953, -1.884298324584961, 5.814537048339844, 8.738994598388672, 1.356536865234375, 5.195930480957031, 20.274742126464844, 9.45669937133789, 5.753366470336914, 5.445915222167969, 7.567085266113281, 6.549072265625, 14.479354858398438, 0.24813079833984375, 4.6480560302734375, 6.933021545410156, 5.370326995849609, 5.547840118408203, 4.3553009033203125, -0.866943359375, 3.0917816162109375, 2.648387908935547, 9.289756774902344, 14.592544555664062, 5.6147003173828125, 2.1209869384765625, 21.733428955078125, -0.3376731872558594, -2.0147552490234375, 0.708160400390625, 3.5860366821289062, -1.470458984375, 9.791618347167969, 1.6798667907714844, 2.644878387451172, 1.883392333984375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000100.npy"}
{"epoch": 0.14684287812041116, "step": 101, "batch_size": 64, "mean": 3.881521224975586, "std": 6.279211521148682, "min": -15.06201171875, "p10": -1.9889333724975584, "median": 3.2871761322021484, "p90": 12.963885498046876, "max": 21.0072021484375, "pos_frac": 0.71875, "sample": [18.126846313476562, 16.089935302734375, 1.5475387573242188, 2.267528533935547, 5.425975799560547, 12.747314453125, 15.994209289550781, 3.2396812438964844, 13.05670166015625, 14.256355285644531, -15.06201171875, 4.7503814697265625, 2.2062225341796875, 8.75374984741211, -0.2866334915161133, 0.28073883056640625, -0.4363250732421875, 3.4861068725585938, 6.637718200683594, 4.587196350097656, -8.904739379882812, 7.84869384765625, 8.846443176269531, 2.6806182861328125, 7.108585357666016, 1.1153488159179688, -0.5825881958007812, 21.0072021484375, 11.084442138671875, 4.992950439453125, -1.5149078369140625, -1.2195920944213867, -1.8954505920410156, 6.707817077636719, 5.875846862792969, 3.5272750854492188, 4.25579833984375, 15.391693115234375, 3.512542724609375, -2.8294219970703125, -2.0289974212646484, 2.8826255798339844, -0.20027732849121094, 6.64239501953125, 1.01824951171875, -0.2139129638671875, 11.84381103515625, 6.276447296142578, 4.434962272644043, 2.035797119140625, 3.4341812133789062, -1.7073516845703125, 5.37060546875, -3.3814773559570312, 3.3346710205078125, 5.2715911865234375, 1.746246337890625, -4.949760437011719, -2.9626083374023438, 0.4151268005371094, 2.7882041931152344, -0.4244060516357422, 3.0779342651367188, -0.9644775390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000101.npy"}
{"epoch": 0.14831130690161526, "step": 102, "batch_size": 64, "mean": 3.3603553771972656, "std": 6.158831596374512, "min": -16.960479736328125, "p10": -2.51846923828125, "median": 2.841916084289551, "p90": 10.629591369628908, "max": 26.37054443359375, "pos_frac": 0.78125, "sample": [-1.1584587097167969, 0.37835693359375, 12.668594360351562, 5.539375305175781, -16.960479736328125, 1.7409858703613281, 0.1721649169921875, 7.4969024658203125, 3.5952072143554688, -0.05999755859375, -4.080810546875, 13.035057067871094, 5.503955841064453, 0.6552505493164062, 3.0125579833984375, -0.09625244140625, 1.53717041015625, 8.258678436279297, -10.319610595703125, 1.665618896484375, 4.3368377685546875, 0.31465911865234375, 8.462257385253906, -0.050628662109375, 5.8120269775390625, 3.574441909790039, 3.000232696533203, 13.835296630859375, 10.806732177734375, 2.7738113403320312, 9.233657836914062, 0.3797340393066406, 5.356426239013672, 4.981433868408203, 2.8734302520751953, -2.8866043090820312, 2.6976966857910156, -2.4376983642578125, 6.7141265869140625, -2.3200950622558594, 1.2603282928466797, 2.0736083984375, 5.425273895263672, -1.2226028442382812, 11.612617492675781, 26.37054443359375, 2.7760543823242188, 14.663116455078125, 0.32401275634765625, -7.26739501953125, 10.216262817382812, 2.3399429321289062, 6.1064453125, 1.5414199829101562, 5.5247955322265625, -2.5530853271484375, 4.470432281494141, 4.030479431152344, 4.740779876708984, 2.8104019165039062, -4.374809265136719, 8.892814636230469, 3.745281219482422, 1.5139904022216797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000102.npy"}
{"epoch": 0.14977973568281938, "step": 103, "batch_size": 64, "mean": 5.488382816314697, "std": 6.507261276245117, "min": -13.367752075195312, "p10": -1.5169609069824213, "median": 4.477504730224609, "p90": 14.952468872070312, "max": 23.718292236328125, "pos_frac": 0.8125, "sample": [3.29986572265625, 1.6251220703125, 0.5733757019042969, -0.33003997802734375, -4.8030242919921875, 5.1268157958984375, 1.6025848388671875, 10.674930572509766, 1.8310470581054688, 4.245777130126953, -0.846923828125, 3.835407257080078, -0.13940811157226562, 9.615402221679688, -3.0365447998046875, 7.638446807861328, 15.819358825683594, 13.204601287841797, 8.490455627441406, 8.819488525390625, 4.68017578125, 19.570785522460938, 0.225372314453125, -13.367752075195312, 2.774169921875, 9.644210815429688, 9.281875610351562, -0.9693222045898438, 5.478778839111328, 4.131324768066406, 2.3976898193359375, 14.896392822265625, 7.718177795410156, -1.7516632080078125, 10.099510192871094, 4.274833679199219, 4.743400573730469, 1.1818313598632812, -1.9232292175292969, 1.4780731201171875, -3.66143798828125, 8.380043029785156, 10.225563049316406, -4.2865753173828125, 10.6002197265625, 15.7882080078125, 1.3678550720214844, 2.518035888671875, 23.718292236328125, 14.988960266113281, 14.97650146484375, 10.167381286621094, 7.403343200683594, 11.870330810546875, 1.9181976318359375, -0.5226707458496094, 5.345849990844727, 7.701023101806641, 2.7822341918945312, 1.92852783203125, 16.529129028320312, 7.641138076782227, 1.96429443359375, 10.100685119628906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000103.npy"}
{"epoch": 0.1512481644640235, "step": 104, "batch_size": 64, "mean": 5.866588592529297, "std": 7.2995452880859375, "min": -7.448577880859375, "p10": -0.16437225341796863, "median": 4.19340705871582, "p90": 14.74966278076172, "max": 35.332550048828125, "pos_frac": 0.875, "sample": [1.126312255859375, 4.25677490234375, 0.3085784912109375, 5.65692138671875, 15.139122009277344, 1.2728652954101562, 0.07946014404296875, 0.2973060607910156, 2.450897216796875, 10.332138061523438, 0.6547355651855469, -3.5101242065429688, 17.773834228515625, 5.7156982421875, 14.291473388671875, -1.0882568359375, 11.923858642578125, 10.964042663574219, 2.80059814453125, 7.596282958984375, 0.84368896484375, 3.591259002685547, 6.985668182373047, 3.1443023681640625, -1.7569293975830078, 2.0233840942382812, 25.917236328125, 3.2428436279296875, 8.814811706542969, 8.926490783691406, 14.946029663085938, 15.330780029296875, 1.6204376220703125, 5.008003234863281, 0.6553993225097656, 6.075618743896484, 5.217700958251953, 10.366600036621094, 35.332550048828125, -0.03166961669921875, 10.3189697265625, -2.73065185546875, 14.07257080078125, -1.57452392578125, 4.490234375, 5.547599792480469, 12.074951171875, 4.130039215087891, 2.7365875244140625, 2.47271728515625, 0.4706401824951172, 0.9947967529296875, 1.547943115234375, 8.880615234375, 8.543083190917969, 25.021888732910156, 2.342082977294922, 8.19533920288086, -0.22124481201171875, 0.7116546630859375, 4.925449371337891, 1.2573471069335938, -7.448577880859375, 4.405447006225586], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000104.npy"}
{"epoch": 0.1527165932452276, "step": 105, "batch_size": 64, "mean": 5.706800937652588, "std": 7.030991554260254, "min": -15.322029113769531, "p10": -1.5749732971191401, "median": 4.994524002075195, "p90": 15.822612762451174, "max": 28.37493896484375, "pos_frac": 0.84375, "sample": [-4.3126983642578125, 2.6265411376953125, 5.500133514404297, 2.1313323974609375, 5.923194885253906, 6.760963439941406, 3.9895172119140625, -15.322029113769531, -2.7468795776367188, -5.2068023681640625, 4.664493560791016, 8.412254333496094, 6.600975036621094, 5.928234100341797, 0.155364990234375, 7.975074768066406, 0.5651931762695312, 3.2371597290039062, -2.3489837646484375, -0.256683349609375, 5.917572021484375, 16.095565795898438, 3.7566680908203125, 0.5278778076171875, 2.3320083618164062, 11.758949279785156, 10.318069458007812, 4.067039489746094, 1.3199024200439453, 7.152656555175781, 11.833198547363281, 13.038825988769531, 0.5948104858398438, 16.33660888671875, 5.906745910644531, 13.497550964355469, 18.626079559326172, 13.763580322265625, 1.8415679931640625, 5.987457275390625, 7.449687957763672, 11.327659606933594, 4.439266204833984, 1.4610023498535156, 5.324554443359375, 1.5348587036132812, 1.9076271057128906, 3.0693359375, -1.1425094604492188, 7.7759246826171875, 7.544891357421875, -0.5959701538085938, -1.76031494140625, 2.6351547241210938, 17.395668029785156, 5.438446044921875, 1.5227298736572266, 28.37493896484375, 15.185722351074219, 20.399749755859375, 9.97283935546875, -2.4612064361572266, 2.254701614379883, 17.231399536132812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000105.npy"}
{"epoch": 0.15418502202643172, "step": 106, "batch_size": 64, "mean": 5.641180038452148, "std": 6.918649673461914, "min": -6.363311767578125, "p10": -1.0966915130615233, "median": 4.035204887390137, "p90": 15.004597473144532, "max": 31.00048828125, "pos_frac": 0.828125, "sample": [7.347198486328125, 1.8655681610107422, -0.9452438354492188, -1.824747085571289, 7.565250396728516, 4.376987457275391, 1.8891372680664062, -6.363311767578125, 7.1570892333984375, 10.018653869628906, 7.084312438964844, 1.9341239929199219, 1.3647289276123047, 10.70638656616211, 5.3913726806640625, 20.823928833007812, -0.9894981384277344, 2.888734817504883, 15.048263549804688, 0.47472476959228516, -1.1426315307617188, 10.981090545654297, -0.6775283813476562, 22.2056884765625, 3.776683807373047, 3.8550071716308594, 1.4055023193359375, 2.4464187622070312, 16.413604736328125, 2.5262527465820312, 0.08109283447265625, 0.88775634765625, 7.9123992919921875, 7.657825469970703, 4.026494979858398, 4.229545593261719, 1.7044448852539062, 2.0630950927734375, 7.752265930175781, -4.88427734375, 15.827346801757812, 6.196689605712891, -0.7735443115234375, 2.1845016479492188, 31.00048828125, 14.489913940429688, 5.957862854003906, -2.023956298828125, 18.319839477539062, 8.443538665771484, -1.7742748260498047, 8.1361083984375, 0.0848236083984375, 4.043914794921875, 14.706634521484375, 6.6911468505859375, 6.020294189453125, 14.9027099609375, 4.7138214111328125, 12.798229217529297, 0.5876312255859375, 0.32898712158203125, -2.4136199951171875, 3.552021026611328], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000106.npy"}
{"epoch": 0.15565345080763582, "step": 107, "batch_size": 64, "mean": 6.456604480743408, "std": 9.834009170532227, "min": -9.2374267578125, "p10": -2.1858215332031232, "median": 5.022954940795898, "p90": 14.783343505859376, "max": 63.426177978515625, "pos_frac": 0.875, "sample": [2.751312255859375, 17.632217407226562, 0.517730712890625, 4.126705169677734, 3.310699462890625, -2.8349761962890625, 5.406829833984375, 1.7923460006713867, -3.529205322265625, -6.960964202880859, 1.8838577270507812, 5.0903167724609375, 4.617572784423828, 5.110851287841797, 2.888813018798828, 0.30181884765625, 4.955593109130859, 6.178718566894531, 0.12335586547851562, 2.7671432495117188, 14.906784057617188, 14.21710205078125, 11.314361572265625, 3.1669845581054688, -5.699981689453125, 5.183742523193359, -9.2374267578125, 5.306861877441406, 63.426177978515625, 8.309440612792969, 2.8072738647460938, 7.220344543457031, 5.928092956542969, 5.787910461425781, 13.136604309082031, 15.334938049316406, 1.2549381256103516, 4.525722503662109, 5.513500213623047, 4.946434020996094, 9.861236572265625, 3.366424560546875, 6.433708190917969, 14.495315551757812, 4.058586120605469, 3.6976699829101562, -0.6711273193359375, 25.8402099609375, 7.0277557373046875, 8.752059936523438, 4.4818267822265625, 2.0737380981445312, 23.14093017578125, 6.7353515625, -3.904205322265625, 7.2302703857421875, 1.6033248901367188, 5.736148834228516, 9.201431274414062, 0.833770751953125, 8.706764221191406, 26.045852661132812, -3.3466949462890625, 8.341796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000107.npy"}
{"epoch": 0.15712187958883994, "step": 108, "batch_size": 64, "mean": 5.848907470703125, "std": 7.176861763000488, "min": -10.902114868164062, "p10": -0.46485176086425783, "median": 4.631828308105469, "p90": 15.951907348632814, "max": 31.559097290039062, "pos_frac": 0.8125, "sample": [3.0787887573242188, 2.1237030029296875, 5.788063049316406, 0.23773193359375, -10.902114868164062, 7.7036285400390625, -1.3201980590820312, -0.8088760375976562, 15.87109375, -4.888648986816406, 0.3233795166015625, 15.986541748046875, 1.4042816162109375, 0.7600021362304688, -0.009197235107421875, 4.8881683349609375, 0.8539237976074219, 23.171661376953125, 31.559097290039062, 9.381412506103516, 18.350311279296875, 10.093070983886719, 3.642881393432617, 1.6235847473144531, 2.415822982788086, 3.2418861389160156, -0.4631614685058594, 2.7956619262695312, 16.809326171875, 5.443355560302734, 6.451442718505859, -1.4846572875976562, 15.416374206542969, 8.03375244140625, 19.3001708984375, -0.1167755126953125, 7.873054504394531, 4.659511566162109, 15.499885559082031, 8.56936264038086, 7.641777038574219, 6.995086669921875, 1.40850830078125, 6.0959930419921875, 4.89691162109375, -0.34960365295410156, 9.140068054199219, 18.861480712890625, 3.340597152709961, 9.463302612304688, -4.299369812011719, 12.760093688964844, 2.544189453125, 7.1715087890625, -0.4001197814941406, 1.7176589965820312, 10.38010025024414, 1.9644050598144531, 5.78729248046875, 2.002178192138672, 5.412078857421875, -0.465576171875, 4.604145050048828, 4.300075531005859], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000108.npy"}
{"epoch": 0.15859030837004406, "step": 109, "batch_size": 64, "mean": 7.345666408538818, "std": 8.442955017089844, "min": -12.68603515625, "p10": -1.5132408142089844, "median": 6.433704376220703, "p90": 19.572405242919935, "max": 31.630035400390625, "pos_frac": 0.84375, "sample": [8.734199523925781, 5.901924133300781, 7.741668701171875, 3.324371337890625, 4.728118896484375, 8.54913330078125, 6.7875213623046875, 1.1752166748046875, -7.440765380859375, 10.632484436035156, 24.228057861328125, 10.023136138916016, 1.5013427734375, 3.299285888671875, 12.232799530029297, 3.2952117919921875, 2.52960205078125, 0.26197242736816406, -2.3903274536132812, -1.531351089477539, 0.6930084228515625, 31.630035400390625, -1.4709835052490234, 4.0504608154296875, 7.369270324707031, 1.109100341796875, 6.340110778808594, 0.3163623809814453, 5.503963470458984, -2.6197052001953125, 11.848548889160156, 23.195388793945312, 0.05329132080078125, 6.5272979736328125, 20.738372802734375, 9.689979553222656, 8.050819396972656, 15.1829833984375, 11.866355895996094, 16.85181427001953, -1.6175613403320312, -2.178131103515625, -12.68603515625, 5.986202239990234, 1.82501220703125, 28.167293548583984, 8.9473876953125, 3.4645233154296875, 1.9375038146972656, 23.245323181152344, 6.8997802734375, 9.867507934570312, 3.5783920288085938, 7.239166259765625, 25.333908081054688, -1.05010986328125, 3.983673095703125, 14.306800842285156, 16.243820190429688, 13.263153076171875, 13.381027221679688, 9.601509094238281, -0.4686870574951172, 10.341094970703125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000109.npy"}
{"epoch": 0.16005873715124816, "step": 110, "batch_size": 64, "mean": 4.551311492919922, "std": 6.276803970336914, "min": -10.257568359375, "p10": -0.8085147857666014, "median": 4.027435302734375, "p90": 13.352336120605472, "max": 23.946731567382812, "pos_frac": 0.84375, "sample": [14.7767333984375, 0.62518310546875, 7.9567108154296875, 7.1303863525390625, 6.3413543701171875, 4.1179962158203125, 5.3795166015625, 5.854413986206055, 0.7854461669921875, 15.375648498535156, 1.4577713012695312, 0.04271697998046875, -10.257568359375, 0.038356781005859375, 10.133079528808594, 0.2657318115234375, 2.561399459838867, 22.839523315429688, 3.101226806640625, 6.2296142578125, -0.8685035705566406, 3.9368743896484375, 3.3080291748046875, 15.071052551269531, 4.708351135253906, 15.0902099609375, 8.776931762695312, 5.3550872802734375, 0.564544677734375, 8.176010131835938, -2.5365676879882812, -0.19503021240234375, 2.2025299072265625, 0.1357574462890625, -3.6914596557617188, 12.468887329101562, 11.596107482910156, 13.73095703125, 4.5631561279296875, 0.8103036880493164, 3.4770545959472656, 5.392862319946289, 7.550258636474609, -0.012359619140625, 0.866119384765625, 7.188232421875, -0.6685409545898438, -7.287445068359375, 6.794609069824219, 0.32926177978515625, 5.4488067626953125, 0.7461376190185547, 5.126213073730469, 3.243358612060547, -1.5704345703125, 6.446266174316406, 6.31877326965332, 0.30132293701171875, 1.0493431091308594, 11.01739501953125, -7.277313232421875, 0.7526283264160156, 4.14617919921875, 23.946731567382812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000110.npy"}
{"epoch": 0.16152716593245228, "step": 111, "batch_size": 64, "mean": 8.312643051147461, "std": 8.44849681854248, "min": -8.10479736328125, "p10": -0.5433965682983397, "median": 7.920326232910156, "p90": 18.73370819091797, "max": 36.257293701171875, "pos_frac": 0.796875, "sample": [27.269760131835938, 14.478012084960938, -8.10479736328125, 18.3167724609375, 4.558197021484375, 8.787483215332031, -4.100776672363281, 5.954784393310547, -0.7411422729492188, 12.861312866210938, 11.702537536621094, 9.261680603027344, 11.828079223632812, 18.38471221923828, 15.251670837402344, 5.534454345703125, 1.5049667358398438, 9.883148193359375, 20.280288696289062, 2.5263595581054688, 2.3922653198242188, -0.13884735107421875, 17.881256103515625, -1.482879638671875, 8.339706420898438, 13.859161376953125, 2.5320281982421875, 6.5510101318359375, -0.4131011962890625, 7.708282470703125, 8.86273193359375, 3.746976852416992, 13.806121826171875, 9.650947570800781, 18.883277893066406, 2.858856201171875, -0.3604888916015625, 7.8795623779296875, 36.257293701171875, 2.7501373291015625, 3.0621566772460938, -0.2908935546875, 2.7866897583007812, 9.505271911621094, 12.069259643554688, 21.418853759765625, 8.0531005859375, 3.9866180419921875, 16.69538116455078, 3.0532493591308594, 8.004898071289062, 6.913434982299805, 15.213363647460938, 12.928943634033203, 27.61163330078125, -0.5992374420166016, -4.5787353515625, 8.419441223144531, 4.870445251464844, 7.961090087890625, -0.1800975799560547, 21.699066162109375, -3.26947021484375, -0.32715606689453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000111.npy"}
{"epoch": 0.16299559471365638, "step": 112, "batch_size": 64, "mean": 4.4774169921875, "std": 5.754289627075195, "min": -7.44854736328125, "p10": -2.074073410034179, "median": 3.56201171875, "p90": 13.390823745727543, "max": 18.81049346923828, "pos_frac": 0.75, "sample": [2.5156402587890625, 12.528152465820312, 11.181838989257812, 1.4583053588867188, -1.2502174377441406, 1.4928131103515625, -0.93218994140625, -2.9913177490234375, 6.2192535400390625, 2.300548553466797, 10.068611145019531, 4.229259490966797, 0.19285202026367188, -4.2718353271484375, 14.890312194824219, 9.541305541992188, -1.2050361633300781, 8.034774780273438, 4.208404541015625, 2.1948623657226562, 2.5923538208007812, 9.29903793334961, 8.070465087890625, -1.167144775390625, 5.4723052978515625, 13.891517639160156, 3.120330810546875, 3.9079856872558594, -0.10999298095703125, -0.5540504455566406, 8.566764831542969, 3.9996490478515625, 4.8249969482421875, 13.760540008544922, 6.609405517578125, -2.427154541015625, 17.992584228515625, 0.92718505859375, 8.668594360351562, 0.7092685699462891, -7.44854736328125, 6.774299621582031, 8.036155700683594, -2.6517410278320312, -2.6336517333984375, 12.314849853515625, 18.81049346923828, 1.4586429595947266, 15.786415100097656, 13.770301818847656, -0.0558013916015625, 1.715545654296875, 6.384166717529297, 0.9697113037109375, -0.6859226226806641, 3.5606231689453125, -1.1124725341796875, -2.748523712158203, 5.817150115966797, 3.5634002685546875, 1.8265953063964844, 5.103794097900391, 0.12957763671875, 9.308647155761719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000112.npy"}
{"epoch": 0.1644640234948605, "step": 113, "batch_size": 64, "mean": 4.703007698059082, "std": 5.806593418121338, "min": -10.250396728515625, "p10": -1.9257076263427724, "median": 4.250659942626953, "p90": 10.266051483154296, "max": 25.87939453125, "pos_frac": 0.796875, "sample": [1.9441146850585938, 6.0007781982421875, 0.7613849639892578, 25.87939453125, 10.56707763671875, -2.3228759765625, 6.6886749267578125, 9.48110580444336, -0.5113449096679688, 1.2551345825195312, 4.256500244140625, 5.802528381347656, 4.2404632568359375, 3.934539794921875, 6.887754440307617, -0.5199699401855469, 1.4392127990722656, -2.5204696655273438, 4.244819641113281, 4.817939758300781, -3.7905731201171875, -2.9982070922851562, 10.24310302734375, -10.250396728515625, 6.6235809326171875, 7.0540924072265625, 5.302280426025391, 4.9058685302734375, 8.465736389160156, 7.847877502441406, 5.693279266357422, 7.2454833984375, 3.566089630126953, 9.971969604492188, 9.62152099609375, -6.5797576904296875, 1.85638427734375, -0.37216949462890625, 14.534957885742188, 6.7595977783203125, 1.7843856811523438, 3.3914413452148438, -0.8947982788085938, 3.722869873046875, 8.340667724609375, 5.698417663574219, 5.94317626953125, 10.275886535644531, -2.8592185974121094, 2.6837940216064453, 22.504989624023438, 3.0502548217773438, 4.141505241394043, 2.744464874267578, 4.974647521972656, 10.654380798339844, 8.627449035644531, 14.746604919433594, -0.9989814758300781, 2.9744644165039062, -0.69195556640625, 5.428493499755859, 2.8168067932128906, 3.9052886962890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000113.npy"}
{"epoch": 0.16593245227606462, "step": 114, "batch_size": 64, "mean": 6.411297798156738, "std": 8.750577926635742, "min": -11.213165283203125, "p10": -1.6720108032226557, "median": 4.762718200683594, "p90": 18.9809196472168, "max": 38.994720458984375, "pos_frac": 0.828125, "sample": [38.994720458984375, 19.321136474609375, 17.777942657470703, -7.3194580078125, 2.0928001403808594, 12.168388366699219, 1.9368324279785156, 8.445465087890625, 1.5779266357421875, 3.111217498779297, 1.2463932037353516, 5.358795166015625, 15.367462158203125, 7.2109832763671875, 8.678443908691406, 7.0796966552734375, 4.420265197753906, -1.8699798583984375, -0.03771209716796875, 20.84564208984375, 0.15320587158203125, 1.9263992309570312, 20.111129760742188, 7.782112121582031, 0.30568695068359375, 18.18708038330078, 0.5667266845703125, -0.9644699096679688, -1.2100830078125, 9.662635803222656, 3.9752750396728516, 3.630535125732422, -5.6493377685546875, 5.559658050537109, -11.213165283203125, 0.6326904296875, 3.6065731048583984, 0.7043914794921875, 13.951385498046875, 20.64641571044922, 9.335798263549805, 12.579681396484375, 1.4953498840332031, 14.739261627197266, 5.197120666503906, -4.1138458251953125, 25.026565551757812, 3.4146156311035156, 5.105171203613281, 1.0536346435546875, 0.5114974975585938, 5.699005126953125, 5.53125, 4.134178161621094, 11.25885009765625, 22.20724105834961, -0.42215538024902344, 16.43194580078125, 7.8102264404296875, -6.0402374267578125, 6.88800048828125, 1.828277587890625, -5.543487548828125, 7.423301696777344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000114.npy"}
{"epoch": 0.16740088105726872, "step": 115, "batch_size": 64, "mean": 6.658008098602295, "std": 7.573609352111816, "min": -9.457534790039062, "p10": -0.8760185241699214, "median": 4.82768440246582, "p90": 15.541539382934575, "max": 30.37591552734375, "pos_frac": 0.84375, "sample": [-1.5788459777832031, -1.0560455322265625, 12.160423278808594, 10.154388427734375, 10.219711303710938, 6.300041198730469, 4.4964599609375, 3.3516597747802734, -0.45595550537109375, 14.298362731933594, 3.950389862060547, 0.48663330078125, 2.5440006256103516, 12.67315673828125, 5.439304351806641, 22.102859497070312, 0.24202728271484375, 4.299354553222656, 9.00018310546875, 1.5857353210449219, 9.381027221679688, 0.15155029296875, 13.793319702148438, 19.890918731689453, 11.731536865234375, 7.74420166015625, 2.0556182861328125, 16.074329376220703, 1.587118148803711, 28.82049560546875, 11.72039794921875, 0.23651123046875, 4.279205322265625, -0.29010772705078125, 4.920665740966797, -6.879119873046875, 5.577358245849609, 8.377986907958984, 13.937419891357422, 16.45214080810547, 6.5618743896484375, 9.833847045898438, 11.883491516113281, -2.710613250732422, 30.37591552734375, 3.3886260986328125, 2.268085479736328, -1.4659843444824219, 4.734703063964844, 5.979454040527344, 4.028160095214844, 13.140625, 4.093421936035156, 18.063453674316406, 0.11420249938964844, 6.8480377197265625, 14.129722595214844, -0.18107891082763672, 1.472442626953125, -2.428131103515625, 11.245086669921875, 4.335845947265625, 0.08244705200195312, -9.457534790039062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000115.npy"}
{"epoch": 0.16886930983847284, "step": 116, "batch_size": 64, "mean": 5.421794414520264, "std": 6.419466972351074, "min": -5.618827819824219, "p10": -1.187667655944824, "median": 3.7029285430908203, "p90": 14.428906250000002, "max": 22.16320037841797, "pos_frac": 0.796875, "sample": [3.4703521728515625, 7.7093658447265625, 0.5840072631835938, 14.603767395019531, 3.2324981689453125, 5.105293273925781, -2.4060592651367188, 1.2857379913330078, 2.56121826171875, -0.7333221435546875, 0.09246826171875, -2.3196849822998047, 12.185386657714844, -1.1200332641601562, 4.867382049560547, -1.216653823852539, 5.749824523925781, -3.8091201782226562, 12.004676818847656, 22.16320037841797, 5.8868408203125, 7.843513488769531, 1.2783050537109375, 6.67022705078125, 13.76275634765625, 1.3925399780273438, 5.72113037109375, 18.230690002441406, 2.5950889587402344, -2.708526611328125, 10.704574584960938, 7.2165985107421875, 3.9405269622802734, 6.427482604980469, 0.09503555297851562, 3.2734756469726562, -5.618827819824219, 5.440727233886719, 2.9219589233398438, 2.96453857421875, -0.8701591491699219, 19.816009521484375, -1.3206024169921875, 21.087631225585938, 3.8499984741210938, 0.1901397705078125, 15.619598388671875, 11.750457763671875, 2.012820243835449, 7.0294189453125, 4.607444763183594, -0.4286537170410156, 13.015945434570312, 1.25347900390625, 13.00802993774414, -0.7851676940917969, 3.369495391845703, 9.019298553466797, 0.2744102478027344, 3.555858612060547, -0.8232536315917969, 14.92864990234375, 10.764129638671875, 14.020896911621094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000116.npy"}
{"epoch": 0.17033773861967694, "step": 117, "batch_size": 64, "mean": 4.804106712341309, "std": 6.546362400054932, "min": -13.99603271484375, "p10": -1.7158374786376949, "median": 4.607305526733398, "p90": 12.440623474121095, "max": 25.831588745117188, "pos_frac": 0.8125, "sample": [0.5531730651855469, 0.7403373718261719, 19.884002685546875, 2.74639892578125, 7.475959777832031, 2.4605560302734375, 8.073028564453125, -1.3930931091308594, 6.218902587890625, 2.0799713134765625, 4.688327789306641, 10.753089904785156, 10.995277404785156, -13.99603271484375, 4.8913116455078125, 1.4304466247558594, 7.4553375244140625, 7.521980285644531, 0.7280731201171875, -5.8784332275390625, 3.08837890625, 12.345443725585938, 5.8386383056640625, -0.7760372161865234, 12.967430114746094, -0.12728118896484375, -4.949371337890625, 0.6536321640014648, -0.5638427734375, -3.0832786560058594, 6.5643110275268555, 10.054237365722656, 7.9408721923828125, 6.898895263671875, 12.481414794921875, 4.227901458740234, 25.831588745117188, 10.64373779296875, 0.32982635498046875, 12.32022476196289, 4.454139709472656, 0.4452705383300781, 2.7878341674804688, -3.3981246948242188, -6.00115966796875, 1.2735595703125, 10.26504135131836, 6.588035583496094, 6.176746368408203, 1.0596809387207031, -1.854156494140625, 4.526283264160156, 6.973529815673828, 5.865211486816406, 17.517593383789062, 12.961624145507812, -0.3831768035888672, 6.978351593017578, 17.169448852539062, 2.3904571533203125, 5.367794036865234, 0.19359970092773438, 0.46124267578125, 5.528656005859375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000117.npy"}
{"epoch": 0.17180616740088106, "step": 118, "batch_size": 64, "mean": 6.291032791137695, "std": 6.336599826812744, "min": -9.908248901367188, "p10": -0.36952896118164047, "median": 5.973016738891602, "p90": 14.102191162109374, "max": 25.006622314453125, "pos_frac": 0.859375, "sample": [1.7112007141113281, 3.0777244567871094, 13.357795715332031, -0.2321319580078125, 7.568294525146484, 10.193550109863281, 1.556793212890625, 7.042716979980469, 7.099809646606445, 8.510887145996094, 4.3106536865234375, 3.2841033935546875, 20.715805053710938, 0.3344230651855469, 2.0498275756835938, 9.950450897216797, 2.6782760620117188, 7.518821716308594, 9.754573822021484, 15.435569763183594, -1.6110153198242188, 1.0977020263671875, 0.280914306640625, 3.3401412963867188, -0.8619842529296875, 2.5422325134277344, 0.7393970489501953, 5.833057403564453, 4.3378143310546875, 9.046890258789062, 11.651159286499023, 6.487037658691406, -2.1082534790039062, 6.964916229248047, 18.812088012695312, 14.118583679199219, 2.124906539916992, 8.732070922851562, 19.061080932617188, 7.73504638671875, -0.42841339111328125, -0.08709907531738281, -9.908248901367188, 5.243217468261719, 25.006622314453125, 11.32440185546875, 9.252227783203125, 14.063941955566406, 7.216976165771484, -3.821870803833008, 5.476116180419922, 14.393714904785156, 8.940475463867188, 9.017814636230469, 6.11297607421875, 5.6248626708984375, 5.809202194213867, 4.109104156494141, 2.856231689453125, 12.932861328125, 6.8580322265625, -6.580081939697266, 12.28173828125, 2.6883544921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000118.npy"}
{"epoch": 0.17327459618208516, "step": 119, "batch_size": 64, "mean": 6.448603630065918, "std": 8.676790237426758, "min": -20.339340209960938, "p10": -2.290019226074219, "median": 5.634644508361816, "p90": 16.895091247558597, "max": 29.966575622558594, "pos_frac": 0.828125, "sample": [5.824777603149414, 11.63916015625, 3.7600059509277344, 22.628982543945312, 17.720733642578125, 11.107955932617188, -3.0343551635742188, 0.177337646484375, 1.0570602416992188, 9.322433471679688, -4.064506530761719, 6.2044525146484375, 21.198089599609375, 8.406417846679688, 0.3484039306640625, 12.650009155273438, 4.5108489990234375, 7.6014251708984375, 5.28515625, -0.8853607177734375, 8.57806396484375, 13.26327896118164, 14.763069152832031, 11.373794555664062, 5.444511413574219, 5.004302978515625, 17.031761169433594, 3.909862518310547, 12.167343139648438, 9.221435546875, -1.4161148071289062, -2.2928848266601562, 1.1380462646484375, 3.6961212158203125, 22.8323974609375, -5.3587493896484375, 11.973625183105469, 28.20611572265625, 3.6338233947753906, 0.6911964416503906, -10.636856079101562, 5.009803771972656, 1.0026397705078125, 29.966575622558594, 3.520477294921875, 7.464729309082031, 6.9161376953125, 10.943374633789062, 6.180580139160156, 7.854087829589844, -1.559112548828125, -20.339340209960938, 3.3267440795898438, 4.9649200439453125, 11.589401245117188, 4.885059356689453, -2.2833328247070312, 2.0400753021240234, 9.031814575195312, 0.46296119689941406, -10.099014282226562, 6.39923095703125, 14.173454284667969, 16.576194763183594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000119.npy"}
{"epoch": 0.17474302496328928, "step": 120, "batch_size": 64, "mean": 8.636420249938965, "std": 10.786287307739258, "min": -14.224853515625, "p10": -2.5138713836669924, "median": 6.646198272705078, "p90": 25.035916137695313, "max": 38.4864501953125, "pos_frac": 0.828125, "sample": [25.175003051757812, 16.378738403320312, 9.631362915039062, 11.536026000976562, 6.733924865722656, 6.609703063964844, -6.61669921875, 27.72357940673828, 9.791252136230469, 2.43536376953125, 17.140060424804688, 13.81109619140625, 8.101776123046875, 8.567474365234375, 4.91996955871582, -14.224853515625, 10.129425048828125, 2.5281410217285156, 12.74200439453125, -2.076324462890625, -14.068756103515625, 24.217819213867188, 14.673553466796875, 13.610496520996094, 3.313262939453125, -5.006538391113281, 0.94921875, 9.856067657470703, 21.45935821533203, -1.251220703125, -3.6051025390625, 30.143829345703125, 28.352432250976562, 10.798759460449219, 24.711380004882812, 3.5167770385742188, 12.712600708007812, 4.1665143966674805, 4.989109039306641, -2.5270423889160156, 3.7037506103515625, 6.6826934814453125, 1.5797500610351562, 38.4864501953125, 29.34210968017578, 15.0438232421875, 29.642440795898438, 3.8781967163085938, 9.466705322265625, 10.961708068847656, 1.4038658142089844, 3.1488571166992188, -4.1378173828125, 8.927547454833984, -0.6984176635742188, -2.4831390380859375, 0.223785400390625, 2.0184173583984375, 23.696502685546875, 3.3177642822265625, 5.8402557373046875, 2.3996620178222656, 6.0623016357421875, 2.1741409301757812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000120.npy"}
{"epoch": 0.1762114537444934, "step": 121, "batch_size": 64, "mean": 7.4496049880981445, "std": 7.590559482574463, "min": -5.221462249755859, "p10": -0.9544036865234374, "median": 6.174854278564453, "p90": 19.06370697021485, "max": 32.362579345703125, "pos_frac": 0.859375, "sample": [1.4257583618164062, 7.7144927978515625, 3.1228179931640625, 19.650802612304688, -2.3445892333984375, 7.538581848144531, 11.885307312011719, 2.4587059020996094, 2.2196044921875, 11.950538635253906, 1.3926849365234375, -2.2412261962890625, 1.500579833984375, 8.662101745605469, 11.49713134765625, 4.294364929199219, -0.9986419677734375, 4.73638916015625, 8.578258514404297, 5.384967803955078, 6.5463104248046875, 1.7023963928222656, 4.933021545410156, 7.4925384521484375, 11.333526611328125, 1.0479965209960938, 7.8396148681640625, 8.501258850097656, 14.948783874511719, 3.3814735412597656, 7.1548004150390625, -0.8511810302734375, 6.114532470703125, 24.43853759765625, 1.49420166015625, 3.76470947265625, 9.938796997070312, 22.219329833984375, -1.5648841857910156, 32.362579345703125, 2.1372299194335938, 13.724349975585938, 6.235176086425781, -2.042083740234375, 3.2336273193359375, 8.22308349609375, 20.467575073242188, 0.7984161376953125, 12.300628662109375, 16.019912719726562, 3.4697036743164062, 5.638725280761719, 17.693817138671875, 6.43865966796875, 14.329345703125, -0.2122955322265625, -4.654266357421875, 20.054718017578125, 11.715744018554688, 16.418426513671875, 21.430618286132812, 5.159807205200195, -5.221462249755859, 2.188262939453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000121.npy"}
{"epoch": 0.1776798825256975, "step": 122, "batch_size": 64, "mean": 8.238998413085938, "std": 8.114653587341309, "min": -13.992080688476562, "p10": -0.920191192626953, "median": 7.725990295410156, "p90": 19.22617568969727, "max": 27.314712524414062, "pos_frac": 0.8125, "sample": [13.672470092773438, -0.7908477783203125, 7.699913024902344, 5.81549072265625, 11.190254211425781, -4.614326477050781, -0.13275146484375, 4.02392578125, 9.390960693359375, 8.819717407226562, 9.360231399536133, -13.992080688476562, 14.815704345703125, 15.753997802734375, 8.636802673339844, 13.977569580078125, 7.8125, -0.502349853515625, 27.314712524414062, 6.408447265625, -1.026580810546875, 7.752067565917969, 6.644615173339844, 7.463592529296875, 7.060829162597656, 3.5048828125, 10.246593475341797, 16.118087768554688, 13.576751708984375, 12.551872253417969, 20.638248443603516, -6.091373443603516, 5.619071960449219, 1.0298995971679688, 0.4484405517578125, 11.9801025390625, 10.759418487548828, 9.238380432128906, 25.140243530273438, 21.332263946533203, -0.5778579711914062, 26.196441650390625, 2.1804161071777344, 19.647613525390625, -0.9756240844726562, 21.80823516845703, 0.20619964599609375, 13.362266540527344, 5.310455322265625, 7.38116455078125, 4.563270568847656, -1.48828125, 14.14273452758789, -0.7400722503662109, 12.795501708984375, 6.706062316894531, 18.036956787109375, 18.242820739746094, -1.2810440063476562, 1.1070213317871094, 9.923927307128906, 4.9296417236328125, 3.913135528564453, 13.257186889648438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000122.npy"}
{"epoch": 0.17914831130690162, "step": 123, "batch_size": 64, "mean": 6.361550331115723, "std": 7.584120750427246, "min": -8.245567321777344, "p10": -2.085336303710937, "median": 6.00701904296875, "p90": 14.4600944519043, "max": 32.34425354003906, "pos_frac": 0.8125, "sample": [7.1550445556640625, 7.048805236816406, 6.607513427734375, 4.522674560546875, 7.036155700683594, 6.727684020996094, 14.741470336914062, 13.136581420898438, 5.347053527832031, 4.196502685546875, -0.8958683013916016, 4.5091705322265625, -2.1482467651367188, 12.636016845703125, 1.1146011352539062, 7.147377014160156, 4.403434753417969, 18.418624877929688, -4.6384429931640625, 10.493995666503906, 3.662872314453125, 32.34425354003906, 8.239852905273438, -0.792144775390625, 2.329509735107422, 0.418548583984375, 23.499954223632812, 3.1997318267822266, 18.909591674804688, 7.9821929931640625, 10.393157958984375, 8.428787231445312, 1.5216140747070312, -1.9385452270507812, 13.6424560546875, 12.039970397949219, 12.5440673828125, 10.038734436035156, 5.406524658203125, 1.9479751586914062, 5.1103057861328125, 13.803550720214844, 0.0464935302734375, -4.5912628173828125, 13.219161987304688, -1.3135986328125, 0.006412506103515625, -5.217555999755859, -3.7348785400390625, 21.05511474609375, 12.761688232421875, 11.011138916015625, 0.6051788330078125, 6.8326873779296875, 16.088241577148438, -1.743682861328125, 7.781978607177734, 0.9182415008544922, -8.245567321777344, 4.290046691894531, 12.843360900878906, -6.290679931640625, 1.8615131378173828, 8.662090301513672], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000123.npy"}
{"epoch": 0.18061674008810572, "step": 124, "batch_size": 64, "mean": 7.628255844116211, "std": 10.740174293518066, "min": -8.420127868652344, "p10": -2.6602031707763665, "median": 4.813720703125, "p90": 22.798506927490237, "max": 45.623191833496094, "pos_frac": 0.703125, "sample": [9.096084594726562, -1.7562789916992188, 18.885543823242188, -1.931243896484375, -1.2136669158935547, 12.564376831054688, -0.6454315185546875, 1.9850807189941406, -3.285369873046875, 45.623191833496094, 1.5290908813476562, 4.267887115478516, -0.18561553955078125, 11.159759521484375, 4.202919006347656, 26.796051025390625, 29.853378295898438, 4.15057373046875, 3.4890823364257812, 1.651214599609375, -0.934417724609375, -2.972614288330078, 26.892013549804688, -8.420127868652344, 22.209884643554688, 15.212574005126953, 14.758163452148438, 0.6193618774414062, 9.311538696289062, 11.0863037109375, -8.044675827026367, 1.6939144134521484, -0.244476318359375, 5.625518798828125, 12.427711486816406, 33.89410400390625, 11.236000061035156, 15.3839111328125, 10.249992370605469, 4.970428466796875, 9.791824340820312, 7.5389556884765625, 4.71710205078125, -3.8243408203125, 7.619636535644531, -1.270599365234375, 10.141326904296875, 4.91033935546875, -0.7701778411865234, -6.2959747314453125, -5.364501953125, 3.7674484252929688, 7.267303466796875, 9.093292236328125, 13.53564453125, 31.760284423828125, 8.00482177734375, 23.05077362060547, -0.5508213043212891, -0.23286056518554688, -0.564697265625, 4.35479736328125, 18.537593841552734, 1.79949951171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000124.npy"}
{"epoch": 0.18208516886930984, "step": 125, "batch_size": 64, "mean": 5.784401893615723, "std": 8.120938301086426, "min": -15.220291137695312, "p10": -2.9383602142333975, "median": 4.494514465332031, "p90": 16.648927307128908, "max": 26.854217529296875, "pos_frac": 0.765625, "sample": [5.766757965087891, 6.816375732421875, 6.5228729248046875, -0.4915771484375, -1.0701255798339844, -5.335613250732422, 15.517013549804688, 1.1156158447265625, 18.12255096435547, 4.304168701171875, 0.9568099975585938, -1.1978034973144531, -0.6812705993652344, -15.220291137695312, 12.654552459716797, 1.1727523803710938, 5.6107940673828125, 6.2777099609375, 11.041988372802734, 0.6625747680664062, 6.8079376220703125, 0.86767578125, -3.934417724609375, -4.591156005859375, 4.746654510498047, 26.854217529296875, -0.9546585083007812, 3.402334213256836, 11.533790588378906, 8.941535949707031, 4.692096710205078, 0.47344970703125, -0.7117500305175781, 1.1460838317871094, 18.824634552001953, 14.189292907714844, -3.5035018920898438, 24.606536865234375, 15.738418579101562, 11.01666259765625, 3.266082763671875, 25.195568084716797, 4.1357421875, 14.61492919921875, 11.370147705078125, -2.2473297119140625, 4.6848602294921875, 5.5951080322265625, 3.8729019165039062, 11.855024337768555, 2.2560958862304688, 3.5905609130859375, 12.372764587402344, -3.234516143798828, 16.332359313964844, 5.586250305175781, -0.8760223388671875, 16.78459930419922, 4.157386779785156, 5.588226318359375, -6.618743896484375, 18.393173217773438, 0.7240753173828125, 0.11076164245605469], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000125.npy"}
{"epoch": 0.18355359765051396, "step": 126, "batch_size": 64, "mean": 8.273946762084961, "std": 7.179688453674316, "min": -8.11968994140625, "p10": -0.25641784667968726, "median": 7.933647155761719, "p90": 19.598834609985353, "max": 26.1270751953125, "pos_frac": 0.875, "sample": [26.1270751953125, -2.078948974609375, 3.049589157104492, 8.737091064453125, 14.723983764648438, 19.800704956054688, 12.433944702148438, -1.148284912109375, 6.5390167236328125, 3.54217529296875, 4.0867156982421875, 12.16302490234375, 13.82293701171875, 10.917152404785156, 3.1442642211914062, -0.9464073181152344, 4.4134368896484375, 7.0582122802734375, 7.787147521972656, 0.29352569580078125, 4.6078643798828125, 4.736326217651367, 0.8174266815185547, -1.1245269775390625, 5.785312652587891, 13.54376220703125, 19.127803802490234, 21.584686279296875, 14.052501678466797, 10.098838806152344, 3.410724639892578, -0.016754150390625, 0.34799957275390625, 4.111732482910156, 20.04681396484375, 2.12481689453125, 10.051483154296875, -3.8995513916015625, 15.803314208984375, 8.728103637695312, -0.359130859375, 12.7945556640625, 10.168701171875, 12.870536804199219, 4.675209045410156, 8.091758728027344, 8.55624771118164, 8.331083297729492, 8.982528686523438, 5.508026123046875, 4.120597839355469, 13.379142761230469, 20.41899871826172, 21.470046997070312, 8.080146789550781, 1.4756622314453125, 13.7393798828125, 4.813732147216797, 6.14715576171875, 14.078628540039062, 4.743690490722656, 13.14691162109375, -8.11968994140625, 24.013641357421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000126.npy"}
{"epoch": 0.18502202643171806, "step": 127, "batch_size": 64, "mean": 6.407971382141113, "std": 8.58238410949707, "min": -13.912887573242188, "p10": -2.369062805175781, "median": 5.606569290161133, "p90": 16.572801589965824, "max": 33.16847229003906, "pos_frac": 0.796875, "sample": [-0.8974647521972656, 20.855690002441406, -2.575176239013672, 0.7586288452148438, 4.970794677734375, -2.20855712890625, 4.650238037109375, 1.0768814086914062, 7.096923828125, 11.05389404296875, 1.8797893524169922, 8.505908966064453, 18.757064819335938, -8.72976303100586, 6.949228286743164, 2.2200164794921875, 9.082164764404297, 2.2287673950195312, 4.6750640869140625, 10.888107299804688, 8.999755859375, 28.532958984375, -1.7893295288085938, 8.377937316894531, 8.24099349975586, 11.938911437988281, 6.5226287841796875, 12.845916748046875, -8.153335571289062, 8.818138122558594, 25.761341094970703, 19.36219024658203, 10.530353546142578, 1.2896318435668945, -13.912887573242188, 0.0958709716796875, -0.29052066802978516, 5.476367950439453, 1.178079605102539, -0.36414337158203125, 4.7877197265625, 15.453857421875, 0.6914215087890625, 7.552406311035156, 3.9873046875, 13.021568298339844, 5.7367706298828125, 11.55804443359375, -5.6669769287109375, 10.497230529785156, 1.8334121704101562, 2.6032867431640625, 7.710088729858398, 33.16847229003906, 1.2602500915527344, 14.353553771972656, -1.7129440307617188, 14.725326538085938, -2.7319564819335938, 0.881072998046875, 17.052349090576172, 15.243385314941406, -2.4378509521484375, 5.843315124511719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000127.npy"}
{"epoch": 0.18649045521292218, "step": 128, "batch_size": 64, "mean": 6.505819320678711, "std": 9.265839576721191, "min": -32.2301025390625, "p10": -0.4746509552001952, "median": 4.330841064453125, "p90": 18.260627746582035, "max": 38.353240966796875, "pos_frac": 0.859375, "sample": [3.279682159423828, -0.36397552490234375, 8.985343933105469, 13.499267578125, 16.929813385009766, 1.4233818054199219, 19.781993865966797, 20.733436584472656, 1.2563705444335938, 2.142120361328125, 6.951530456542969, 6.016666412353516, 0.606201171875, 3.8689651489257812, 1.7820281982421875, 17.06781005859375, 1.3478240966796875, 4.395477294921875, -0.131927490234375, 1.0815505981445312, -3.7515335083007812, 3.7534656524658203, 13.744293212890625, 20.243637084960938, 0.3831787109375, 0.8767204284667969, 38.353240966796875, 18.771835327148438, 21.499107360839844, 8.037837982177734, 9.341552734375, 0.6414871215820312, 10.40113639831543, -1.97430419921875, 1.5215644836425781, 11.906551361083984, -32.2301025390625, 11.240829467773438, 6.951896667480469, 0.223297119140625, 9.463943481445312, 2.778280258178711, 0.7968826293945312, -0.5220832824707031, 2.027118682861328, 12.3558349609375, -3.676553726196289, 1.1610870361328125, 7.379133224487305, 3.605367660522461, 9.895523071289062, 5.94403076171875, 9.379974365234375, -1.1291618347167969, 4.266204833984375, 9.25848388671875, 1.5052223205566406, 12.789390563964844, 16.925369262695312, -3.1050357818603516, 10.755584716796875, 10.235774993896484, 22.685531616210938, 1.0072689056396484], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000128.npy"}
{"epoch": 0.18795888399412627, "step": 129, "batch_size": 64, "mean": 6.681199073791504, "std": 8.62960433959961, "min": -6.77618408203125, "p10": -2.4564064025878904, "median": 4.259195327758789, "p90": 19.390327072143556, "max": 30.091506958007812, "pos_frac": 0.765625, "sample": [0.25476837158203125, -0.26171112060546875, -0.470611572265625, 19.285526275634766, -3.2162857055664062, 14.928543090820312, 0.5500335693359375, 1.9272079467773438, 18.727218627929688, -1.0354537963867188, 19.43524169921875, 10.275840759277344, 0.24578285217285156, 23.244705200195312, -0.44556427001953125, 0.7421493530273438, 6.3343353271484375, 1.26483154296875, 5.4066314697265625, 4.2461700439453125, 12.388580322265625, 15.601089477539062, 10.12164306640625, 7.165779113769531, -2.6261062622070312, -6.77618408203125, -2.0604400634765625, 4.852775573730469, 25.92205810546875, 30.091506958007812, 2.033536911010742, 27.687957763671875, 21.610443115234375, 5.67254638671875, 12.23443603515625, 0.0572052001953125, -0.5675048828125, 3.0753860473632812, 11.736213684082031, 3.1467819213867188, -2.9967117309570312, 0.98681640625, 10.243904113769531, 10.284477233886719, 20.609359741210938, 0.663787841796875, 14.31344985961914, 3.6462440490722656, -4.493385314941406, -2.9295101165771484, 8.818359375, 9.435195922851562, 2.1734142303466797, 8.786834716796875, 4.272220611572266, 0.8034820556640625, 11.690662384033203, 1.3577728271484375, -1.2428512573242188, -3.48406982421875, 18.310546875, 8.533023834228516, 6.3251953125, -1.3185310363769531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000129.npy"}
{"epoch": 0.1894273127753304, "step": 130, "batch_size": 64, "mean": 8.605558395385742, "std": 10.034758567810059, "min": -5.891632080078125, "p10": -2.1711488723754875, "median": 7.354499816894531, "p90": 22.52716941833497, "max": 45.05894470214844, "pos_frac": 0.78125, "sample": [5.828163146972656, 6.360980987548828, -0.6254997253417969, 27.815475463867188, -2.51318359375, 11.230392456054688, 10.282379150390625, 12.535411834716797, 27.902633666992188, -1.2426166534423828, 8.349098205566406, 25.469696044921875, 7.1272735595703125, 13.083282470703125, 9.374588012695312, -4.176513671875, 7.6285552978515625, -2.455167770385742, 15.098655700683594, 9.647106170654297, 1.8588027954101562, -1.4902877807617188, 1.17584228515625, 20.14242935180664, 23.391826629638672, -4.512603759765625, -1.5084381103515625, 9.331581115722656, 2.452686309814453, 19.10179901123047, -3.477428436279297, 6.9534454345703125, -4.023097991943359, 4.699432373046875, 8.095733642578125, 15.41006851196289, 8.599723815917969, 3.4794998168945312, 7.58172607421875, -0.7489700317382812, 9.3896484375, -0.04372978210449219, 20.50963592529297, 13.191848754882812, 5.379524230957031, 0.11450004577636719, 45.05894470214844, 5.478782653808594, 2.2018566131591797, 3.68963623046875, 8.16162109375, -0.908050537109375, 15.361480712890625, -5.891632080078125, 9.514915466308594, 1.7745933532714844, 16.41864013671875, 2.5212888717651367, 27.619384765625, 12.87411117553711, 33.115447998046875, 4.752655029296875, 3.7091827392578125, 13.526931762695312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000130.npy"}
{"epoch": 0.19089574155653452, "step": 131, "batch_size": 64, "mean": 7.350835800170898, "std": 9.192497253417969, "min": -12.479339599609375, "p10": -2.140960884094238, "median": 6.775690078735352, "p90": 21.088252258300784, "max": 35.33854675292969, "pos_frac": 0.734375, "sample": [-1.566680908203125, -0.541290283203125, 7.826244354248047, -1.2116622924804688, 28.366012573242188, -12.479339599609375, -1.83587646484375, 3.3826751708984375, 11.591285705566406, 6.845634460449219, 35.33854675292969, 11.358612060546875, -3.5596160888671875, 1.306539535522461, 1.0301513671875, -0.1495819091796875, 4.047206878662109, -2.2717113494873047, 0.5359954833984375, 7.812934875488281, -0.6140098571777344, 10.086090087890625, -3.9163246154785156, 0.9590053558349609, 16.094589233398438, 3.57421875, 2.670581817626953, 4.539926528930664, 20.755630493164062, 7.6617889404296875, -1.7635669708251953, 13.458877563476562, -0.22876739501953125, 2.375530242919922, 13.622360229492188, -0.2221813201904297, 15.338584899902344, 8.183704376220703, 25.89874267578125, 4.935359954833984, 6.705745697021484, 10.754308700561523, 15.501945495605469, 8.107688903808594, -2.5068740844726562, 13.343109130859375, 8.863197326660156, 7.197917938232422, -3.147329330444336, 9.002056121826172, 7.337352752685547, -1.0876617431640625, -4.25274658203125, 21.230804443359375, 18.930564880371094, 21.395156860351562, 2.0034866333007812, 4.965229034423828, 0.6050281524658203, 22.395523071289062, 15.621063232421875, 10.573184967041016, 25.143600463867188, 12.534919738769531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000131.npy"}
{"epoch": 0.19236417033773862, "step": 132, "batch_size": 64, "mean": 8.008447647094727, "std": 8.619790077209473, "min": -22.358001708984375, "p10": 0.6321670532226563, "median": 5.846588134765625, "p90": 20.620607757568358, "max": 28.552536010742188, "pos_frac": 0.921875, "sample": [6.790454864501953, 1.7085342407226562, 10.400810241699219, 3.9841384887695312, 3.8074874877929688, 19.33930206298828, 3.992321014404297, 26.123886108398438, 20.974105834960938, 4.015972137451172, 3.5623626708984375, 7.364986419677734, 4.1684112548828125, 3.1229400634765625, 0.653411865234375, 10.27471923828125, 20.58648681640625, 2.7840042114257812, 9.617721557617188, 4.807853698730469, -4.356267929077148, 5.841651916503906, 20.635231018066406, 1.90863037109375, 2.9681835174560547, 4.258941650390625, 3.7057247161865234, 25.039100646972656, 6.5616912841796875, 7.090911865234375, -4.009452819824219, -22.358001708984375, 0.6230621337890625, 16.988712310791016, 5.851524353027344, 28.552536010742188, 13.234256744384766, 6.759754180908203, 5.456047058105469, 13.980892181396484, 21.304363250732422, 5.126853942871094, 14.72214126586914, 14.85791015625, -1.8773574829101562, 5.357246398925781, 16.96442413330078, 3.9695892333984375, -0.5232276916503906, 4.871498107910156, 0.11163711547851562, 17.001304626464844, 5.976226806640625, 5.2031402587890625, 13.629226684570312, 14.322509765625, 3.260406494140625, 1.0081024169921875, 7.6796722412109375, 8.776518821716309, 5.997772216796875, 1.2561111450195312, 9.075431823730469, 27.656112670898438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000132.npy"}
{"epoch": 0.19383259911894274, "step": 133, "batch_size": 64, "mean": 8.29056167602539, "std": 8.849544525146484, "min": -5.7142181396484375, "p10": -0.5786712646484374, "median": 6.05980110168457, "p90": 19.42713317871094, "max": 36.77244567871094, "pos_frac": 0.84375, "sample": [7.0269622802734375, 13.351585388183594, -5.7142181396484375, 4.70172119140625, 4.132234573364258, -3.2732696533203125, 17.199935913085938, -3.1081695556640625, 1.2818145751953125, 13.315521240234375, 9.79376220703125, 6.430839538574219, 0.1884307861328125, 32.04084014892578, 2.5169906616210938, 18.545623779296875, 2.5439300537109375, 1.2397918701171875, 18.794769287109375, 4.9288177490234375, 9.689308166503906, 15.179000854492188, 6.1368255615234375, 6.79949951171875, 7.955451965332031, 17.42510223388672, -0.10451126098632812, 8.231769561767578, 16.645767211914062, -0.95281982421875, 13.070075988769531, 6.201107025146484, 4.184226989746094, 4.017463684082031, 2.6680221557617188, 7.9059295654296875, 3.3719940185546875, 8.260482788085938, 4.3685302734375, 8.506065368652344, 4.16943359375, -0.6177825927734375, 2.611032485961914, 36.77244567871094, -0.4874114990234375, 9.450523376464844, 20.4609375, -1.04815673828125, 19.654403686523438, 2.69757080078125, 5.982776641845703, 15.680538177490234, 1.2944717407226562, 5.4990234375, 28.258895874023438, 22.64031982421875, 12.320503234863281, 25.137481689453125, 18.896835327148438, 5.644157409667969, 2.10968017578125, -0.3974189758300781, 3.008119583129883, -4.6396484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000133.npy"}
{"epoch": 0.19530102790014683, "step": 134, "batch_size": 64, "mean": 8.948599815368652, "std": 8.768939018249512, "min": -6.370826721191406, "p10": -0.4589515686035151, "median": 7.28483772277832, "p90": 20.81937713623047, "max": 31.62225341796875, "pos_frac": 0.890625, "sample": [1.74993896484375, 0.05743408203125, -3.4911727905273438, 11.966064453125, 31.62225341796875, 7.130237579345703, 0.5369720458984375, 7.369441986083984, -3.8915481567382812, 11.82830810546875, 6.764892578125, 8.959014892578125, 8.173676490783691, 1.7677688598632812, 0.9912567138671875, 2.829986572265625, 0.390167236328125, 8.048065185546875, 13.730331420898438, 1.4568519592285156, 4.427455902099609, 6.350582122802734, -4.588600158691406, 5.522590637207031, 7.344684600830078, 6.865753173828125, 16.148040771484375, 12.049636840820312, 14.97662353515625, 19.660369873046875, 6.780580520629883, 20.96758270263672, 3.6071548461914062, 13.054454803466797, 14.135650634765625, 17.352035522460938, 13.215065002441406, 1.619110107421875, -2.985809326171875, 7.2249908447265625, 19.71453857421875, 7.87750244140625, 9.178703308105469, 1.5195465087890625, 27.630294799804688, 15.594234466552734, 21.960845947265625, -0.6802597045898438, 21.893325805664062, 3.8217382431030273, -6.370826721191406, 3.16455078125, -5.477302551269531, 28.55658721923828, 13.54486083984375, 7.199089050292969, 6.377326965332031, 2.303874969482422, 9.24102783203125, 15.111358642578125, 2.2408370971679688, 26.92223358154297, 20.47356414794922, 19.194808959960938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000134.npy"}
{"epoch": 0.19676945668135096, "step": 135, "batch_size": 64, "mean": 7.988539695739746, "std": 10.4102783203125, "min": -14.414642333984375, "p10": -2.5267944335937496, "median": 5.672313690185547, "p90": 18.614122772216795, "max": 58.15087890625, "pos_frac": 0.859375, "sample": [1.0104141235351562, 11.016647338867188, 7.0972442626953125, 15.323455810546875, -4.55584716796875, 18.109649658203125, 18.63263702392578, 1.5366363525390625, 10.3128662109375, 18.5709228515625, 11.621551513671875, 2.1278343200683594, 21.6661376953125, -4.64373779296875, 9.81793212890625, 2.2514915466308594, 16.235851287841797, 13.112236022949219, 6.345436096191406, 1.4646492004394531, 4.3778076171875, 16.394134521484375, 3.6772308349609375, -2.0478515625, 3.7781124114990234, 24.252197265625, 2.3385772705078125, 58.15087890625, -5.216178894042969, 30.260391235351562, 3.4556655883789062, 6.269691467285156, -3.7712020874023438, 1.4275894165039062, 4.359416961669922, 12.682880401611328, 3.980466842651367, 12.675271987915039, -2.7860870361328125, -1.6507339477539062, 0.04296112060546875, 0.8716201782226562, 1.5285186767578125, 3.5370864868164062, -14.414642333984375, 9.21114730834961, 6.346382141113281, 4.170722961425781, 4.156059265136719, 6.334568023681641, 4.305971145629883, 5.0749359130859375, 14.98189926147461, 3.3624725341796875, 14.179374694824219, 15.646041870117188, 10.474365234375, 18.867919921875, 8.650276184082031, -2.7320556640625, 3.0585174560546875, 27.041259765625, 8.628021240234375, 8.280891418457031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000135.npy"}
{"epoch": 0.19823788546255505, "step": 136, "batch_size": 64, "mean": 8.791913986206055, "std": 8.245768547058105, "min": -6.409881591796875, "p10": -0.30046882629394517, "median": 7.741918563842773, "p90": 21.49640121459961, "max": 29.361785888671875, "pos_frac": 0.875, "sample": [3.7967605590820312, 17.200035095214844, 10.326507568359375, 9.381141662597656, 4.406181335449219, -0.8078842163085938, 24.0440673828125, 9.173099517822266, 5.173408508300781, 4.346891403198242, 10.563858032226562, 2.0859527587890625, 6.2493133544921875, 0.9496364593505859, 7.761257171630859, 10.752426147460938, -0.3595695495605469, 3.3447608947753906, 10.461074829101562, 29.361785888671875, 7.3916168212890625, 21.734413146972656, 28.511962890625, 5.858394622802734, 3.3290557861328125, 18.423690795898438, 22.72467041015625, 2.0536537170410156, 27.5577392578125, 2.209686279296875, 10.615386962890625, 5.699939727783203, 4.77984619140625, -6.409881591796875, 3.60772705078125, -0.162567138671875, 9.5755615234375, 1.6481399536132812, 12.037353515625, 9.879962921142578, 2.21160888671875, 9.191558837890625, 0.3289642333984375, 21.902008056640625, -1.9886932373046875, 10.249265670776367, 2.80010986328125, 15.942825317382812, -4.531791687011719, -4.2132720947265625, 20.058570861816406, 14.9068603515625, 14.301990509033203, 11.8255615234375, 11.368698120117188, 7.7225799560546875, 14.130569458007812, 3.003284454345703, 7.140228271484375, -2.469388961791992, 12.331558227539062, 13.489265441894531, 20.9410400390625, 2.7620086669921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000136.npy"}
{"epoch": 0.19970631424375918, "step": 137, "batch_size": 64, "mean": 13.00966739654541, "std": 11.852656364440918, "min": -10.486358642578125, "p10": 1.5428287506103517, "median": 9.42998218536377, "p90": 29.68571929931641, "max": 47.5279541015625, "pos_frac": 0.921875, "sample": [3.7753448486328125, 14.102293014526367, 11.316024780273438, 6.5846099853515625, 16.869850158691406, 20.388565063476562, 8.640190124511719, 38.57090759277344, 6.467216491699219, 19.125720977783203, 1.9458999633789062, 6.905265808105469, 44.4742431640625, 8.608917236328125, 7.148689270019531, 5.157867431640625, 11.301116943359375, 14.447334289550781, 6.376141548156738, 12.593658447265625, 28.77574920654297, 8.335350036621094, 9.47142219543457, 47.5279541015625, 30.075706481933594, 14.14398193359375, 18.498001098632812, 12.858001708984375, -1.5865478515625, 11.130672454833984, 8.74991226196289, 11.113616943359375, 35.353363037109375, 4.633415222167969, 34.92327880859375, 6.547740936279297, 13.285511016845703, 11.31036376953125, 28.758804321289062, 9.388542175292969, 7.372104644775391, 8.582954406738281, -0.13777923583984375, -10.486358642578125, 3.437255859375, -0.23368072509765625, 39.52325439453125, -1.1605606079101562, 21.00763702392578, 21.5250244140625, 8.991485595703125, 1.7617950439453125, 4.108808517456055, 13.461463928222656, 1.4489860534667969, 0.3900604248046875, 4.1574249267578125, 5.8613433837890625, 3.6184844970703125, 23.147171020507812, 25.077255249023438, 2.0650482177734375, 16.224285125732422, 24.780563354492188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000137.npy"}
{"epoch": 0.2011747430249633, "step": 138, "batch_size": 64, "mean": 8.464805603027344, "std": 9.200545310974121, "min": -6.090007781982422, "p10": -1.32060375213623, "median": 6.408845901489258, "p90": 21.456632232666017, "max": 35.346832275390625, "pos_frac": 0.859375, "sample": [7.7128753662109375, 3.20526123046875, 16.271759033203125, 20.1689453125, 7.400047302246094, 19.681182861328125, 2.11077880859375, 2.690929412841797, 7.016693115234375, 27.19629669189453, 1.3128032684326172, -4.4789581298828125, -1.5540008544921875, 1.1148033142089844, 3.5260772705078125, 3.70294189453125, 9.643693923950195, 2.934131622314453, 0.9879493713378906, -4.0063018798828125, 15.490234375, 25.4095458984375, -0.7760105133056641, 4.7598419189453125, 26.204742431640625, 17.346908569335938, -1.7218551635742188, 6.524829864501953, 8.031936645507812, 0.89898681640625, 2.841400146484375, 2.175374984741211, 5.479522705078125, 19.352066040039062, 19.97766876220703, 27.00701904296875, 15.690658569335938, 12.180923461914062, -1.9091720581054688, 21.04412078857422, 6.8512115478515625, 9.856231689453125, 0.4964447021484375, 1.8361234664916992, 4.2848968505859375, -6.090007781982422, 18.975723266601562, 6.705078125, -2.0451812744140625, 9.711177825927734, 10.285842895507812, 3.6730098724365234, 1.7831954956054688, 3.7728805541992188, 0.6532192230224609, 8.53292465209961, 12.521045684814453, 23.6224365234375, 7.551597595214844, 35.346832275390625, 3.077190399169922, 21.6334228515625, -0.2272491455078125, 6.2928619384765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000138.npy"}
{"epoch": 0.2026431718061674, "step": 139, "batch_size": 64, "mean": 9.755860328674316, "std": 10.752673149108887, "min": -33.073333740234375, "p10": -1.2163764953613274, "median": 9.715988159179688, "p90": 22.81911239624024, "max": 34.37115478515625, "pos_frac": 0.875, "sample": [-1.8888473510742188, 9.607208251953125, 12.905014038085938, 19.957046508789062, 16.14654541015625, 10.899200439453125, 33.18914794921875, 3.9137496948242188, 14.898948669433594, 5.536170959472656, -33.073333740234375, 11.986404418945312, 9.82476806640625, 23.69866943359375, 23.258018493652344, 8.370006561279297, 11.354637145996094, 26.087387084960938, 16.85643768310547, -1.8166313171386719, 21.794998168945312, 4.371242523193359, 3.0009536743164062, 4.721660614013672, 6.0059814453125, 1.468292236328125, 12.754695892333984, 17.42919921875, -4.592916488647461, 2.8042373657226562, 20.069992065429688, 12.710256576538086, 0.0955352783203125, -1.4967498779296875, 12.857902526855469, 9.881793975830078, 8.699275970458984, 3.0396194458007812, 0.5748844146728516, 21.528526306152344, 3.5297279357910156, 8.985740661621094, 9.926288604736328, 6.1932525634765625, 9.19512939453125, 9.137176513671875, 0.29450225830078125, 12.870674133300781, 0.7677536010742188, -3.6065673828125, 33.56598663330078, 10.976882934570312, 5.195407867431641, 5.541919708251953, 34.37115478515625, -2.764312744140625, 31.325515747070312, 14.332305908203125, 20.513282775878906, 2.647430419921875, 11.852706909179688, 10.766815185546875, 9.888553619384766, -0.5621719360351562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000139.npy"}
{"epoch": 0.20411160058737152, "step": 140, "batch_size": 64, "mean": 9.047286987304688, "std": 9.42868423461914, "min": -7.497772216796875, "p10": -2.1322471618652337, "median": 6.966470718383789, "p90": 22.98143692016602, "max": 29.70166778564453, "pos_frac": 0.84375, "sample": [6.36773681640625, 5.576959609985352, 25.862548828125, 17.951316833496094, -2.4500885009765625, 1.5233192443847656, 4.498329162597656, 13.642509460449219, 19.482778549194336, 23.22088623046875, 19.189369201660156, -4.669410705566406, 10.566780090332031, 3.1508712768554688, 9.999134063720703, 7.406917572021484, 18.478012084960938, 3.2413368225097656, 9.373050689697266, 21.75466537475586, -1.3906173706054688, 1.5699729919433594, 20.439071655273438, 22.569107055664062, -0.377105712890625, 6.8107452392578125, 4.05169677734375, 8.269973754882812, 5.779930114746094, 3.0612030029296875, 2.2942886352539062, 4.0731353759765625, 7.082653045654297, 24.463302612304688, -1.06658935546875, 23.15814971923828, -2.9290542602539062, 16.66834259033203, 13.159225463867188, 9.669380187988281, 4.140556335449219, 0.31597900390625, 29.70166778564453, -7.497772216796875, 6.850288391113281, 7.504722595214844, 0.38869476318359375, 29.686767578125, 13.923538208007812, -4.930320739746094, -6.70367431640625, 0.23598480224609375, 0.8167514801025391, 5.143348693847656, 6.707324981689453, 11.742271423339844, 7.256927490234375, -2.946563720703125, 26.09625244140625, 20.821701049804688, 7.992946624755859, 13.596046447753906, 6.534912109375, 20.124130249023438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000140.npy"}
{"epoch": 0.2055800293685756, "step": 141, "batch_size": 64, "mean": 10.606623649597168, "std": 10.983049392700195, "min": -16.658660888671875, "p10": -0.5000884056091307, "median": 9.77092170715332, "p90": 27.669227600097663, "max": 44.63312530517578, "pos_frac": 0.859375, "sample": [2.732574462890625, 6.399658203125, 8.612625122070312, 10.666694641113281, 13.322509765625, 2.0159378051757812, 13.096366882324219, 3.016498565673828, 1.258514404296875, 2.2062644958496094, 0.12609100341796875, 33.2647705078125, -16.658660888671875, 7.8082427978515625, -0.8731460571289062, 26.03228759765625, -0.07614326477050781, 4.213592529296875, 30.974639892578125, 5.116294860839844, 28.370773315429688, 30.918045043945312, 16.140893936157227, 10.550819396972656, 20.013076782226562, 2.4563217163085938, 16.755653381347656, 9.922943115234375, 4.5892333984375, -0.36296844482421875, 13.59526252746582, 12.361053466796875, 6.593299865722656, -1.8157463073730469, 32.43658447265625, 9.618900299072266, 12.100822448730469, 4.277870178222656, 4.201295852661133, 7.530529022216797, 10.013198852539062, 14.067367553710938, 0.15280914306640625, 44.63312530517578, 5.413677215576172, 11.502388000488281, 14.487861633300781, -1.323089599609375, -0.5588541030883789, -7.41326904296875, 19.346946716308594, 16.95307159423828, 6.72991943359375, 1.7044677734375, 16.724288940429688, 13.155517578125, 33.950439453125, 13.943756103515625, 5.8921661376953125, 16.378814697265625, 17.39240264892578, -3.29803466796875, 19.571670532226562, 15.892986297607422], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000141.npy"}
{"epoch": 0.20704845814977973, "step": 142, "batch_size": 64, "mean": 9.91337776184082, "std": 10.945347785949707, "min": -6.050712585449219, "p10": -1.9028289794921875, "median": 7.4779205322265625, "p90": 21.23755416870118, "max": 51.6678466796875, "pos_frac": 0.84375, "sample": [8.4998779296875, 51.6678466796875, 5.676752090454102, 7.4723358154296875, 14.968849182128906, 6.3170166015625, 12.12591552734375, 11.521156311035156, 17.080917358398438, 7.3386993408203125, 6.600830078125, 13.662445068359375, 7.785888671875, -1.9000091552734375, 25.879005432128906, 34.211029052734375, 1.9715766906738281, 4.62908935546875, 0.8426513671875, 1.9508209228515625, 10.862632751464844, 22.078880310058594, 5.95068359375, 6.46661376953125, 15.625518798828125, 8.754447937011719, 2.6913070678710938, 8.06495475769043, -1.9040374755859375, -1.3266582489013672, 39.97540283203125, 9.967422485351562, 18.575424194335938, 18.96527862548828, -4.846506118774414, 28.10028076171875, 14.027030944824219, 5.659191131591797, -3.5081634521484375, 2.1878013610839844, 6.6503448486328125, 8.248485565185547, -1.8678398132324219, 6.302642822265625, 3.0085525512695312, 17.275108337402344, 7.45130729675293, 7.4835052490234375, 19.274459838867188, 7.341552734375, 11.729812622070312, -6.050712585449219, -2.883708953857422, 11.451751708984375, 35.997100830078125, 18.434112548828125, -2.3724498748779297, 10.46084213256836, 15.3839111328125, 0.4709014892578125, 5.683311462402344, 13.171600341796875, 1.7291831970214844, -4.5877532958984375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000142.npy"}
{"epoch": 0.20851688693098386, "step": 143, "batch_size": 64, "mean": 8.626742362976074, "std": 10.699813842773438, "min": -20.11151123046875, "p10": -2.2713417053222655, "median": 7.807348251342773, "p90": 20.86485824584961, "max": 47.65617370605469, "pos_frac": 0.8125, "sample": [10.98935317993164, 10.512008666992188, 2.7626800537109375, -11.938064575195312, 17.75946044921875, 11.832290649414062, -2.1645050048828125, 20.87543487548828, 15.931343078613281, 6.507528305053711, 24.937957763671875, -2.1909713745117188, 7.950889587402344, 11.683990478515625, -0.6939620971679688, -5.163444519042969, 1.4094963073730469, -1.1369552612304688, -6.15130615234375, 0.5871429443359375, 7.126255035400391, 14.303726196289062, -3.0949020385742188, 25.063766479492188, 7.18896484375, 3.4038238525390625, 2.518035888671875, 16.366317749023438, 7.98687744140625, 15.835689544677734, 9.844345092773438, 4.080575942993164, 28.17535400390625, 3.570699691772461, 11.255813598632812, 3.6719894409179688, 6.668922424316406, 12.645854949951172, 20.840179443359375, 17.113990783691406, 12.512802124023438, -2.3057861328125, 0.551910400390625, 11.176437377929688, -0.4829397201538086, 19.642982482910156, 3.0172119140625, 13.44964599609375, 0.841644287109375, 10.138809204101562, 14.816726684570312, 47.65617370605469, 8.260696411132812, 5.82720947265625, 31.161720275878906, 7.663806915283203, 11.651878356933594, 4.5076141357421875, 28.075767517089844, -20.11151123046875, 3.3516769409179688, 10.141975402832031, -3.0739974975585938, 4.7724456787109375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000143.npy"}
{"epoch": 0.20998531571218795, "step": 144, "batch_size": 64, "mean": 9.117193222045898, "std": 12.287757873535156, "min": -20.552093505859375, "p10": -3.8847267150878904, "median": 8.235647201538086, "p90": 22.443763732910163, "max": 46.712005615234375, "pos_frac": 0.828125, "sample": [-3.9947891235351562, 9.675121307373047, 2.8484878540039062, 5.1402587890625, -7.002433776855469, 4.6963348388671875, 32.16215515136719, 7.9927520751953125, 9.420242309570312, -9.979446411132812, 46.712005615234375, 9.339775085449219, 16.674606323242188, 29.2049560546875, 8.148784637451172, 20.845542907714844, 15.443668365478516, 4.417808532714844, 4.728889465332031, 34.505741119384766, 6.224609375, 13.48995590209961, -3.6279144287109375, -4.657012939453125, 13.457565307617188, 4.695343017578125, 4.96180534362793, 10.805328369140625, 6.710868835449219, 0.15726661682128906, 13.285255432128906, 10.539161682128906, 15.574783325195312, 7.634307861328125, -20.552093505859375, 10.21820068359375, 0.3835411071777344, 3.9951934814453125, -3.439922332763672, 9.531700134277344, 7.204200744628906, 8.371551513671875, 35.43596649169922, 17.240005493164062, 6.677589416503906, 15.188323974609375, -1.9563312530517578, -13.732566833496094, 23.12871551513672, 13.041763305664062, 5.0662078857421875, 18.802146911621094, 8.322509765625, 9.2078857421875, -13.573493957519531, 4.132743835449219, 43.70343780517578, 9.66822624206543, 4.766914367675781, 13.005500793457031, 18.30145263671875, -1.8913803100585938, 10.331443786621094, 2.6891403198242188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000144.npy"}
{"epoch": 0.21145374449339208, "step": 145, "batch_size": 64, "mean": 10.206480979919434, "std": 10.889290809631348, "min": -17.237205505371094, "p10": -1.813096618652343, "median": 9.946128845214844, "p90": 23.5028549194336, "max": 46.030006408691406, "pos_frac": 0.828125, "sample": [9.07635498046875, 13.018913269042969, 22.202606201171875, 37.07679748535156, 12.241447448730469, 19.990646362304688, 16.341232299804688, -1.083648681640625, 11.884941101074219, 18.350692749023438, -6.16656494140625, 21.0126953125, 11.718696594238281, 2.128021240234375, 6.752424240112305, 5.313812255859375, 24.15227508544922, 9.777381896972656, -7.782878875732422, 4.509555816650391, 0.7933425903320312, -5.7765045166015625, 0.8544349670410156, 4.274715423583984, 12.886268615722656, 5.453386306762695, 13.573410034179688, -5.856315612792969, -0.0498046875, 24.060104370117188, 4.829813003540039, 15.326446533203125, 17.491424560546875, -2.2926864624023438, 16.35162353515625, 21.712448120117188, 11.780319213867188, 4.110997200012207, 0.9679718017578125, 5.09625244140625, -17.237205505371094, 4.129032135009766, 28.80740737915039, 3.4743576049804688, 11.245719909667969, 46.030006408691406, 25.158966064453125, -2.1257171630859375, 9.79853630065918, 29.237075805664062, 15.26712417602539, 16.40438461303711, -1.064208984375, 12.328449249267578, 9.334064483642578, 4.796985626220703, 5.163047790527344, 12.050010681152344, 11.400909423828125, 9.838302612304688, 13.454803466796875, 20.302902221679688, -0.7371673583984375, 10.053955078125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000145.npy"}
{"epoch": 0.21292217327459617, "step": 146, "batch_size": 64, "mean": 11.474971771240234, "std": 10.936463356018066, "min": -14.28350830078125, "p10": 0.9985355377197271, "median": 9.836820602416992, "p90": 22.653860473632815, "max": 41.66340637207031, "pos_frac": 0.90625, "sample": [23.712806701660156, 18.453407287597656, 21.327606201171875, 0.7297172546386719, 3.5985050201416016, -3.2325439453125, 19.46849822998047, 12.525344848632812, 3.695281982421875, 16.264209747314453, 19.006591796875, 22.058555603027344, 1.630044937133789, 3.0049209594726562, 3.634532928466797, 7.37127685546875, 4.63739013671875, 17.55907440185547, 40.26795959472656, 7.672931671142578, 3.07965087890625, 4.040802001953125, 9.424095153808594, 17.227005004882812, -14.28350830078125, 21.059677124023438, -1.8541107177734375, 12.504104614257812, 17.756526947021484, 28.1600341796875, 1.6257781982421875, 3.162944793701172, 7.876811981201172, 22.256500244140625, 35.16083526611328, -8.084861755371094, 2.39801025390625, 5.135740280151367, 11.63125228881836, 8.54803466796875, 22.82415771484375, 12.12908935546875, 17.96619415283203, 9.183109283447266, 3.0814590454101562, 17.671127319335938, 18.88393783569336, -9.626327514648438, 13.212203979492188, 14.315742492675781, 33.446746826171875, 41.66340637207031, 12.706550598144531, 8.967544555664062, 3.9455718994140625, 22.132369995117188, 5.795856475830078, 9.564094543457031, 13.260025024414062, 6.734062194824219, 9.704757690429688, 9.968883514404297, -4.430084228515625, 11.086311340332031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000146.npy"}
{"epoch": 0.2143906020558003, "step": 147, "batch_size": 64, "mean": 12.052690505981445, "std": 10.99620532989502, "min": -8.22336196899414, "p10": -2.1637592315673824, "median": 10.78602409362793, "p90": 24.65445327758789, "max": 46.924041748046875, "pos_frac": 0.84375, "sample": [31.097373962402344, 6.022621154785156, 21.4859619140625, 19.60826873779297, 8.212516784667969, 1.3824539184570312, 8.4202880859375, 17.915081024169922, -3.3475494384765625, 5.009361267089844, 10.637712478637695, 22.816848754882812, 26.24520492553711, 10.352622985839844, 19.444156646728516, 33.96601104736328, 17.372116088867188, 15.401447296142578, -2.3722763061523438, 1.5636367797851562, 20.485260009765625, -7.992835998535156, -8.22336196899414, 10.777721405029297, 35.719139099121094, -0.23921966552734375, 16.743797302246094, 20.708698272705078, 13.927408218383789, -5.611427307128906, 6.234066009521484, 10.36966323852539, 6.343807220458984, 1.8950271606445312, 10.794326782226562, 20.2958984375, 5.157123565673828, 46.924041748046875, 8.41042709350586, 24.82056427001953, 13.385452270507812, 7.5633392333984375, -1.6772193908691406, 0.34021759033203125, -3.54132080078125, 17.57982635498047, 9.726699829101562, 21.672975540161133, 24.266860961914062, 0.28672027587890625, -0.684906005859375, 17.978118896484375, 19.114398956298828, 19.918594360351562, 16.78079605102539, -2.559947967529297, 25.366943359375, 10.938232421875, 9.735618591308594, 12.037261962890625, 17.722991943359375, 4.889839172363281, 9.699562072753906, 12.057151794433594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000147.npy"}
{"epoch": 0.21585903083700442, "step": 148, "batch_size": 64, "mean": 10.167755126953125, "std": 12.163925170898438, "min": -10.489364624023438, "p10": -1.9673877716064447, "median": 7.614574432373047, "p90": 26.212902832031254, "max": 47.059326171875, "pos_frac": 0.8125, "sample": [-4.302726745605469, 5.786319732666016, 4.99114990234375, 26.742874145507812, 28.339080810546875, -2.7697906494140625, 3.2653350830078125, 6.7100830078125, 3.51910400390625, 43.55705261230469, 11.946678161621094, 24.976303100585938, 4.6015625, 0.49853515625, 20.60095977783203, 30.077911376953125, 5.250972747802734, 2.619171142578125, 12.003917694091797, 7.549858093261719, 7.679290771484375, 16.48772430419922, 4.750804901123047, 9.131393432617188, 41.530982971191406, 5.196399688720703, 6.371368408203125, -10.489364624023438, 22.0087890625, -2.2133636474609375, 36.05938720703125, 10.151458740234375, 11.302921295166016, -0.93072509765625, -3.50469970703125, -0.8917446136474609, 8.886848449707031, -0.40692138671875, 17.583770751953125, -10.378746032714844, 10.040237426757812, 15.89834976196289, -1.3934440612792969, 10.52783203125, 7.983039855957031, 10.250778198242188, 17.995101928710938, 0.3222084045410156, 8.059669494628906, 17.33513641357422, 12.169723510742188, 12.819091796875, 16.850662231445312, 5.485328674316406, -2.8818511962890625, 1.9188041687011719, 21.4951171875, 24.540313720703125, 47.059326171875, 1.6197738647460938, -0.9043769836425781, 0.8072586059570312, 6.880535125732422, 1.567758560180664], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000148.npy"}
{"epoch": 0.2173274596182085, "step": 149, "batch_size": 64, "mean": 9.989310264587402, "std": 12.999919891357422, "min": -9.695472717285156, "p10": -1.7084003448486325, "median": 7.532186508178711, "p90": 27.38125152587891, "max": 54.301422119140625, "pos_frac": 0.828125, "sample": [38.072059631347656, -1.4252243041992188, 44.124755859375, 6.496246337890625, -0.998992919921875, 10.764991760253906, 0.5465011596679688, 9.366494178771973, 3.8464279174804688, 2.223480224609375, 3.856708526611328, 15.816474914550781, 10.611675262451172, -8.29440689086914, 17.639564514160156, 7.386589050292969, 16.647727966308594, 9.62225341796875, 10.324615478515625, 2.155670166015625, 11.130386352539062, -2.053058624267578, 0.7004356384277344, 0.24544525146484375, 8.760726928710938, 8.560436248779297, 5.882678985595703, 6.2728118896484375, 11.89577865600586, 28.566177368164062, -9.662612915039062, 0.2944221496582031, 26.000892639160156, -1.8297615051269531, 0.5433425903320312, 16.427337646484375, 54.301422119140625, 8.508373260498047, 4.023384094238281, 27.736251831054688, 7.283393859863281, 26.06934356689453, 7.677783966064453, 9.513130187988281, 0.1820068359375, 18.588035583496094, 10.131160736083984, 26.55291748046875, -6.489501953125, 3.05975341796875, 33.076324462890625, 22.12057113647461, 3.6208877563476562, 4.6740570068359375, 1.1309776306152344, 1.327972412109375, -0.41937732696533203, 15.809165954589844, -0.5334930419921875, 41.13865661621094, 14.607498168945312, -9.695472717285156, 9.954578399658203, -5.153007507324219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000149.npy"}
{"epoch": 0.21879588839941264, "step": 150, "batch_size": 64, "mean": 10.968360900878906, "std": 12.854928970336914, "min": -13.70068359375, "p10": -0.6434082031249998, "median": 8.427745819091797, "p90": 23.493191909790042, "max": 60.42402648925781, "pos_frac": 0.875, "sample": [16.072662353515625, 45.02537536621094, 10.171401977539062, 8.137619018554688, 19.401397705078125, -13.70068359375, 7.073097229003906, 18.302818298339844, 11.858139038085938, 0.5105667114257812, 60.42402648925781, -2.272176742553711, 20.207454681396484, 2.3506393432617188, 6.880035400390625, 36.60655212402344, 7.4473114013671875, 4.91627311706543, 13.299339294433594, 17.25855255126953, 9.70590591430664, 33.526519775390625, 8.282203674316406, 12.987054824829102, 22.87592315673828, 9.254318237304688, 17.461822509765625, 23.6168212890625, 1.6840591430664062, 21.441390991210938, 3.257720947265625, 8.573287963867188, 0.6615676879882812, 32.46124267578125, 3.162689208984375, 1.6174278259277344, 7.383781433105469, 14.074649810791016, 30.190391540527344, -10.781379699707031, 22.72130584716797, 19.40013885498047, 12.687154769897461, -0.44936370849609375, -6.0458221435546875, 2.0068187713623047, -11.939292907714844, 8.616840362548828, 9.742538452148438, 5.889202117919922, -2.935089111328125, 18.25530242919922, 7.563312530517578, 3.5264854431152344, 23.204723358154297, 13.192497253417969, 5.382877349853516, 0.9692802429199219, 2.204986572265625, 2.8592300415039062, 5.552055358886719, 3.1216163635253906, -0.7265701293945312, 15.767036437988281], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000150.npy"}
{"epoch": 0.22026431718061673, "step": 151, "batch_size": 64, "mean": 10.404455184936523, "std": 12.844982147216797, "min": -14.784210205078125, "p10": -4.118913269042968, "median": 8.373592376708984, "p90": 27.016635894775394, "max": 59.377197265625, "pos_frac": 0.8125, "sample": [-8.482025146484375, 8.571212768554688, 16.528045654296875, 6.03485107421875, -2.0957908630371094, 25.460220336914062, -2.4339599609375, 3.6172409057617188, -8.717636108398438, 3.9912109375, 16.17346954345703, -4.544273376464844, -4.196220397949219, 3.269725799560547, 11.473594665527344, -3.400836944580078, 2.7051162719726562, 12.750389099121094, 12.213485717773438, 27.3330078125, 59.377197265625, 7.886745452880859, 9.422401428222656, 1.6960983276367188, -3.9385299682617188, 24.028560638427734, 7.02044677734375, 3.97576904296875, -0.1539306640625, 30.992950439453125, 27.342750549316406, 16.902137756347656, 7.447414398193359, 20.590147018432617, 0.11279296875, 10.766399383544922, 7.138416290283203, 2.322582244873047, 9.287857055664062, 30.371185302734375, 10.537525177001953, 19.710556030273438, 33.658538818359375, -4.7770233154296875, 5.88128662109375, 21.33289337158203, 29.110671997070312, -8.838157653808594, 21.81032943725586, -14.784210205078125, 3.1975555419921875, 3.696949005126953, 11.494178771972656, 8.820602416992188, 26.27843475341797, 0.3977489471435547, 8.175971984863281, 12.612274169921875, 23.792510986328125, 6.117218017578125, 11.586410522460938, 25.276920318603516, 0.3791389465332031, 21.576583862304688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000151.npy"}
{"epoch": 0.22173274596182085, "step": 152, "batch_size": 64, "mean": 12.427543640136719, "std": 12.479103088378906, "min": -22.537078857421875, "p10": -0.8618831634521483, "median": 11.328914642333984, "p90": 27.163172149658205, "max": 51.30279541015625, "pos_frac": 0.84375, "sample": [3.1305694580078125, 10.931243896484375, 45.10204315185547, 26.000381469726562, 5.436058044433594, 13.452239990234375, 3.5864944458007812, 13.36297607421875, 51.30279541015625, -5.5145416259765625, 16.06562042236328, 8.16400146484375, 11.7884521484375, 11.080596923828125, 8.32855224609375, 11.577232360839844, 6.4549560546875, 23.97037124633789, 13.595802307128906, -1.8053207397460938, 19.490692138671875, 6.202091217041016, 3.800203323364258, 12.809783935546875, 4.112213134765625, 23.379898071289062, 14.289588928222656, 28.40528106689453, 7.804534912109375, 6.442657470703125, -1.0721893310546875, 16.86968994140625, 26.73448944091797, -5.094215393066406, 9.259977340698242, 11.773021697998047, 7.2191619873046875, 16.158950805664062, 3.266754150390625, -2.7284393310546875, 27.35186767578125, 10.972206115722656, 7.088865280151367, 27.346893310546875, -0.8027229309082031, -22.537078857421875, 16.66925048828125, 3.0771141052246094, 14.392337799072266, 47.499603271484375, 8.933242797851562, 7.9968719482421875, 20.172714233398438, 6.960334777832031, 33.3701171875, -0.707916259765625, 12.571395874023438, -0.0570831298828125, 16.018882751464844, 24.339195251464844, 16.464740753173828, -0.887237548828125, 17.74066162109375, 16.253860473632812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000152.npy"}
{"epoch": 0.22320117474302498, "step": 153, "batch_size": 64, "mean": 9.064017295837402, "std": 12.185799598693848, "min": -18.808868408203125, "p10": -4.5902458190917965, "median": 6.993373870849609, "p90": 24.844557189941405, "max": 38.9884033203125, "pos_frac": 0.765625, "sample": [6.759250640869141, -4.6591339111328125, 8.854377746582031, 6.418800354003906, -10.310997009277344, 23.676151275634766, -1.5517845153808594, 38.43829345703125, 10.660079956054688, 13.242828369140625, 6.709442138671875, -4.581268310546875, 10.140911102294922, -4.594093322753906, 10.840087890625, 2.5605201721191406, -1.8039398193359375, 5.051551818847656, 2.536226272583008, 1.239837646484375, 9.530853271484375, 30.31207275390625, 21.945449829101562, 13.613370895385742, 11.951927185058594, 4.993927001953125, 5.142913818359375, 5.52001953125, 38.9884033203125, 27.540557861328125, 17.214859008789062, 1.3508377075195312, 31.584609985351562, -2.057262420654297, 0.10068702697753906, -14.506217956542969, 24.855712890625, 22.101806640625, 11.121749877929688, -3.395709991455078, 21.04320526123047, 24.818527221679688, 7.5290069580078125, 19.090286254882812, -5.523571014404297, 1.8818893432617188, -5.331539154052734, 6.876617431640625, 30.968475341796875, -18.808868408203125, 9.883430480957031, 19.994873046875, 20.773380279541016, 3.3652820587158203, 8.107027053833008, 3.720357894897461, 23.709182739257812, 7.110130310058594, -2.2572784423828125, 2.9739227294921875, -0.9364585876464844, -1.129608154296875, 12.376075744628906, 12.325080871582031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000153.npy"}
{"epoch": 0.22466960352422907, "step": 154, "batch_size": 64, "mean": 14.486139297485352, "std": 12.64872932434082, "min": -8.140121459960938, "p10": 0.024214363098144953, "median": 13.726978302001953, "p90": 33.15961875915528, "max": 51.46437072753906, "pos_frac": 0.890625, "sample": [0.4469757080078125, 6.871969223022461, 3.4061431884765625, 15.243837356567383, 33.6170654296875, 18.931236267089844, -0.1569690704345703, 27.52239990234375, 38.56788635253906, 7.634090423583984, 28.122093200683594, 34.92971420288086, 15.4996337890625, 14.011726379394531, 14.314735412597656, 12.343719482421875, -0.4201650619506836, 15.52734375, 3.3702564239501953, -6.176982879638672, 26.31707000732422, 27.970672607421875, -1.8002090454101562, 4.101459503173828, 1.116241455078125, 11.163063049316406, 26.179443359375, 42.25663757324219, -0.7978057861328125, 11.502456665039062, 8.534271240234375, 21.380775451660156, -3.596221923828125, 17.681842803955078, 2.6804428100585938, 11.702171325683594, 35.444366455078125, 13.442230224609375, 6.979461669921875, 27.98662567138672, 19.979095458984375, 14.710830688476562, 12.879631042480469, 21.155120849609375, 51.46437072753906, 14.460250854492188, 14.337814331054688, 21.68435287475586, 8.068580627441406, 15.359676361083984, 8.503875732421875, 20.00737762451172, 4.098793029785156, 2.426025390625, 7.3978271484375, -8.140121459960938, 32.09224319458008, 39.05897521972656, 20.643630981445312, 2.6531753540039062, 9.247879028320312, 14.29669189453125, 0.6575546264648438, 6.217529296875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000154.npy"}
{"epoch": 0.2261380323054332, "step": 155, "batch_size": 64, "mean": 11.656644821166992, "std": 15.44191837310791, "min": -49.02978515625, "p10": -4.768494701385498, "median": 10.806154251098633, "p90": 32.749745559692386, "max": 46.55297088623047, "pos_frac": 0.8125, "sample": [3.2000579833984375, -10.674072265625, -8.293342590332031, 22.221145629882812, 10.757591247558594, 0.14986801147460938, -3.075031280517578, -6.3118896484375, 11.592973709106445, 4.955522537231445, 5.71746826171875, 5.577930450439453, 6.214134216308594, -49.02978515625, 14.714675903320312, 8.998397827148438, 33.22982406616211, 19.81427764892578, -5.0692291259765625, 18.560501098632812, 35.74583435058594, 13.1585693359375, 3.1452789306640625, 31.629562377929688, 44.042755126953125, 4.425256729125977, 10.378089904785156, 20.390609741210938, 9.097145080566406, 14.542449951171875, 5.58442497253418, 19.592079162597656, 14.923622131347656, 38.54652404785156, 29.40715789794922, -7.229705810546875, 46.55297088623047, 39.51470947265625, -15.154693603515625, 23.939266204833984, -2.370014190673828, 7.629066467285156, 13.136756896972656, 10.944305419921875, 22.014923095703125, 13.716083526611328, 27.970115661621094, 6.635459899902344, 19.054412841796875, 9.671417236328125, 18.87523651123047, 13.164161682128906, 33.68964385986328, 8.912609100341797, 20.635101318359375, -2.788116455078125, 22.96912384033203, 3.9806289672851562, 10.854717254638672, 7.57177734375, 11.030891418457031, 10.446706771850586, -4.066781044006348, -3.1358795166015625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000155.npy"}
{"epoch": 0.2276064610866373, "step": 156, "batch_size": 64, "mean": 10.137334823608398, "std": 13.316658020019531, "min": -13.651016235351562, "p10": -5.748318481445312, "median": 8.609823226928711, "p90": 25.060391235351563, "max": 49.05548095703125, "pos_frac": 0.765625, "sample": [-5.859092712402344, 30.96013641357422, 49.05548095703125, 24.58301544189453, -2.16632080078125, 5.93701171875, 13.878913879394531, -0.6565628051757812, -12.931121826171875, 17.310516357421875, 2.886474609375, 16.361671447753906, -5.489845275878906, 7.78271484375, 1.0319290161132812, 0.5245590209960938, 13.612733840942383, 19.409305572509766, 40.5860595703125, 11.51483154296875, -6.58306884765625, 31.555084228515625, 33.894439697265625, 12.535881042480469, 7.099180221557617, 0.5605545043945312, 5.647527694702148, 14.959281921386719, 39.17091369628906, 0.66156005859375, 20.524826049804688, 22.585655212402344, 19.931976318359375, 18.036766052246094, 14.411848068237305, 2.607572555541992, 4.314453125, -13.651016235351562, 10.389358520507812, -8.347145080566406, 16.881214141845703, -1.6188201904296875, 17.589393615722656, 23.795055389404297, -0.4572601318359375, 25.12506866455078, 24.90947723388672, 12.60578727722168, 9.935409545898438, 8.643444061279297, 0.5728549957275391, -1.8076438903808594, -1.6128387451171875, 21.412233352661133, -6.3502197265625, 18.89691162109375, 5.48114013671875, 0.45446014404296875, 5.548393249511719, 5.12567138671875, 8.576202392578125, -12.622421264648438, -2.7029495239257812, 11.770832061767578], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000156.npy"}
{"epoch": 0.2290748898678414, "step": 157, "batch_size": 64, "mean": 13.453116416931152, "std": 12.527877807617188, "min": -13.13275146484375, "p10": -0.9315231323242181, "median": 11.565454483032227, "p90": 28.139126586914067, "max": 48.27386474609375, "pos_frac": 0.859375, "sample": [14.258537292480469, 19.115951538085938, -11.15386962890625, 15.574081420898438, 15.899070739746094, 5.2176971435546875, 11.815521240234375, 3.349853515625, 7.6547698974609375, 48.27386474609375, 24.622817993164062, 27.135482788085938, 9.860668182373047, 28.569259643554688, 33.384033203125, 13.509124755859375, 23.894569396972656, 5.6011505126953125, 17.251991271972656, 26.96148681640625, 9.551826477050781, -1.4756202697753906, 31.80206298828125, 2.896331787109375, 16.490692138671875, 6.0269012451171875, 7.5509490966796875, 22.03341293334961, 9.118927001953125, 26.582008361816406, -4.75018310546875, 19.447322845458984, -0.28179931640625, -1.2099761962890625, 9.271369934082031, 26.803627014160156, 22.796096801757812, -0.20671844482421875, 11.315387725830078, 13.087093353271484, 6.6956634521484375, 26.717620849609375, 5.792118072509766, 6.148216247558594, 2.955821990966797, 13.198223114013672, 13.542633056640625, -4.234977722167969, 9.373146057128906, 18.005111694335938, 43.33647155761719, 10.119110107421875, 2.70794677734375, 4.536872863769531, 22.91645050048828, 19.983139038085938, 42.667999267578125, 0.998138427734375, 9.856273651123047, 8.357280731201172, 31.378387451171875, 14.167610168457031, -2.7328596115112305, -13.13275146484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000157.npy"}
{"epoch": 0.2305433186490455, "step": 158, "batch_size": 64, "mean": 14.018547058105469, "std": 12.948092460632324, "min": -15.2454833984375, "p10": 1.4150703430175782, "median": 11.219675064086914, "p90": 31.185766983032238, "max": 47.07891845703125, "pos_frac": 0.90625, "sample": [5.966711044311523, 2.4069252014160156, 11.251747131347656, 11.4493408203125, 8.015460968017578, 3.387035369873047, 6.365766525268555, 16.003082275390625, 8.349937438964844, 27.943126678466797, 6.24969482421875, 39.332550048828125, 39.42315673828125, 5.655055999755859, 11.448554992675781, -15.2454833984375, -8.380044937133789, 21.92443084716797, -8.685157775878906, 17.731929779052734, 20.623001098632812, -2.5088653564453125, 8.5308837890625, 19.614425659179688, 24.557342529296875, 15.425559997558594, 15.048309326171875, 11.187602996826172, 8.968132019042969, 1.3851852416992188, 19.949947357177734, 9.553024291992188, 12.575103759765625, 4.4298858642578125, 11.07107925415039, 24.924087524414062, 24.16345977783203, 9.793983459472656, 15.53887939453125, 45.743377685546875, 16.106910705566406, 6.725433349609375, 6.109031677246094, 40.794891357421875, 13.597724914550781, 32.45101547241211, 6.403413772583008, 1.48480224609375, 26.285507202148438, 10.325889587402344, 24.561279296875, 25.951583862304688, -1.102935791015625, 36.31010437011719, 5.059535980224609, 4.3558807373046875, 28.2335205078125, -2.743764877319336, 17.757041931152344, 8.161117553710938, 23.227752685546875, 1.982025146484375, 47.07891845703125, 6.902069091796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000158.npy"}
{"epoch": 0.23201174743024963, "step": 159, "batch_size": 64, "mean": 13.204719543457031, "std": 14.550576210021973, "min": -23.112876892089844, "p10": -3.283097839355468, "median": 11.321962356567383, "p90": 32.27444496154787, "max": 56.32380676269531, "pos_frac": 0.8125, "sample": [22.813156127929688, 41.97499084472656, 10.264938354492188, 0.41083526611328125, 3.3227691650390625, 24.499664306640625, -9.338218688964844, 8.211902618408203, 23.251502990722656, 21.254425048828125, 12.323455810546875, -2.329132080078125, -0.10161590576171875, -8.543319702148438, 8.32645034790039, 1.1003646850585938, 34.08500671386719, 19.859207153320312, 10.26205825805664, 28.049800872802734, 56.32380676269531, 15.166011810302734, -10.02825927734375, 7.5780792236328125, 3.793825149536133, 19.248001098632812, 6.852386474609375, -23.112876892089844, 9.513893127441406, 12.148040771484375, 11.881595611572266, 16.043922424316406, -6.9492034912109375, 14.273483276367188, 20.48676300048828, 5.787239074707031, 18.199302673339844, 5.5733795166015625, -0.9009227752685547, 20.537155151367188, 27.066131591796875, 41.86126708984375, 10.087688446044922, 15.365432739257812, 4.3819427490234375, 39.72071838378906, 19.178050994873047, -0.05937767028808594, -3.6919403076171875, 27.244216918945312, 19.40040397644043, -1.5467147827148438, 7.845703125, -3.87286376953125, 7.4978485107421875, 39.57699203491211, 5.500293731689453, 26.928115844726562, 6.455730438232422, 41.657379150390625, 10.7623291015625, 18.524913787841797, 16.163223266601562, 16.940715789794922], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000159.npy"}
{"epoch": 0.23348017621145375, "step": 160, "batch_size": 64, "mean": 12.633888244628906, "std": 12.779650688171387, "min": -19.330997467041016, "p10": -2.695479583740233, "median": 14.112674713134766, "p90": 28.552902984619152, "max": 54.401947021484375, "pos_frac": 0.859375, "sample": [18.644866943359375, 18.23040008544922, 15.999855041503906, 17.14483642578125, -3.5395240783691406, 6.6984405517578125, 16.79883575439453, 20.206634521484375, 6.7671966552734375, -1.2238845825195312, -5.830778121948242, 12.449676513671875, 15.914894104003906, 17.41034698486328, 18.16924285888672, 16.611785888671875, 2.154949188232422, 25.690391540527344, 2.2877197265625, 4.034576416015625, 34.6053466796875, 10.247100830078125, 15.288894653320312, 15.5970458984375, 14.143394470214844, -12.187171936035156, 5.404136657714844, 24.151641845703125, 54.401947021484375, 24.74871826171875, 1.1165847778320312, 7.567279815673828, 17.161460876464844, 23.272323608398438, -19.330997467041016, 14.356681823730469, -9.752315521240234, 10.255905151367188, 32.927886962890625, 10.877166748046875, 7.395580291748047, 20.31433868408203, 14.081954956054688, 19.61602783203125, 10.931167602539062, 13.050514221191406, 4.450401306152344, 2.2260799407958984, -3.2435760498046875, 29.779693603515625, 24.022014617919922, 33.329345703125, 20.894668579101562, 0.29584503173828125, 17.753692626953125, 7.094490051269531, 1.6817817687988281, 0.06463432312011719, -8.665679931640625, 33.04637145996094, -1.4165878295898438, 31.534500122070312, 18.598876953125, 12.25925064086914], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000160.npy"}
{"epoch": 0.23494860499265785, "step": 161, "batch_size": 64, "mean": 11.77223014831543, "std": 14.242280960083008, "min": -17.458641052246094, "p10": -4.874143981933593, "median": 11.778844833374023, "p90": 31.534665679931642, "max": 48.44136047363281, "pos_frac": 0.78125, "sample": [-2.41021728515625, 15.647171020507812, 10.877073287963867, 37.83692169189453, 34.33612060546875, 7.7976531982421875, 8.266860961914062, -4.94073486328125, 31.57513427734375, -7.5067901611328125, 17.112335205078125, 30.8153076171875, 3.4836158752441406, 11.705009460449219, 16.438526153564453, 2.1373825073242188, 30.296844482421875, 20.797134399414062, 14.262489318847656, 48.44136047363281, -9.656768798828125, -3.6204757690429688, 21.630069732666016, -1.4791889190673828, 4.911994934082031, -1.6748180389404297, 20.88323211669922, 16.26544189453125, 31.44023895263672, 24.971572875976562, 16.61890411376953, -17.458641052246094, 5.90245246887207, -4.7187652587890625, 24.991607666015625, 25.669769287109375, 10.092521667480469, -8.197090148925781, 28.03314208984375, 8.319450378417969, -17.0703125, 3.8547897338867188, -13.794258117675781, 16.676998138427734, 7.0073394775390625, 3.0626602172851562, 5.081169128417969, 19.01364517211914, -1.6024169921875, 14.257843017578125, 0.2168731689453125, 12.018165588378906, 16.20135498046875, 33.103912353515625, 15.190971374511719, 34.08116149902344, 4.328571319580078, 35.480003356933594, 11.852680206298828, -4.662830352783203, 8.211040496826172, 16.034706115722656, 11.86850357055664, 3.1162796020507812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000161.npy"}
{"epoch": 0.23641703377386197, "step": 162, "batch_size": 64, "mean": 12.671504974365234, "std": 13.572266578674316, "min": -33.74876403808594, "p10": -1.1553512573242186, "median": 11.458650588989258, "p90": 29.06806411743164, "max": 49.713165283203125, "pos_frac": 0.84375, "sample": [-1.2391357421875, 7.163768768310547, 27.276611328125, 17.857147216796875, 2.633026123046875, 25.487945556640625, 16.782470703125, 21.51519012451172, 15.738140106201172, 4.877510070800781, -8.67116928100586, 3.872711181640625, 18.34259033203125, 6.104682922363281, 29.79230499267578, 33.205360412597656, 14.728973388671875, -0.9598541259765625, 0.52276611328125, 23.102798461914062, 24.624710083007812, 4.893680572509766, 26.2586669921875, 1.9174957275390625, 10.029966354370117, 15.866989135742188, 20.901878356933594, -0.2259521484375, -33.74876403808594, 36.19139862060547, 9.756492614746094, 19.377593994140625, 4.05925178527832, 0.07764053344726562, 35.29853820800781, 10.77069091796875, 29.002166748046875, 17.359130859375, 9.634239196777344, 0.3434295654296875, 18.8692626953125, 19.460281372070312, 29.09630584716797, 12.822067260742188, 6.454319000244141, 8.28741455078125, 14.539878845214844, 7.3799591064453125, -2.69061279296875, 8.898017883300781, 9.575332641601562, 21.759506225585938, 8.955787658691406, -3.3067092895507812, 49.713165283203125, 24.310508728027344, 13.901412963867188, -5.2964935302734375, 5.485828399658203, 12.146610260009766, -8.696846008300781, -0.43094635009765625, 17.99661636352539, 41.22257995605469], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000162.npy"}
{"epoch": 0.23788546255506607, "step": 163, "batch_size": 64, "mean": 15.766294479370117, "std": 16.151165008544922, "min": -10.789459228515625, "p10": -2.840146446228025, "median": 12.361799240112305, "p90": 38.64751510620118, "max": 77.022705078125, "pos_frac": 0.875, "sample": [7.253143310546875, 9.671394348144531, 28.755699157714844, 42.677528381347656, 3.6237869262695312, 1.1277351379394531, -3.8227081298828125, 23.505386352539062, 5.503955841064453, 40.58387756347656, 18.93280792236328, 12.180023193359375, 14.26763916015625, 35.931495666503906, 27.548885345458984, -5.487037658691406, 21.72557258605957, 39.8115234375, 5.669593811035156, 19.80754852294922, 2.8182373046875, 17.04869842529297, 10.95916748046875, 22.883697509765625, -10.789459228515625, 1.522064208984375, 15.286861419677734, 4.351207733154297, 4.7479248046875, 12.734039306640625, 50.445526123046875, -4.358379364013672, 22.765541076660156, 4.780261993408203, -7.66650390625, -4.249183654785156, 0.7066268920898438, 8.603607177734375, 15.210311889648438, 18.65789794921875, 26.869041442871094, 4.7711944580078125, 14.68902587890625, 17.798095703125, 33.638240814208984, 12.528739929199219, 0.934783935546875, 48.53759765625, 77.022705078125, -0.5475025177001953, 12.19485855102539, 8.293525695800781, 31.696426391601562, 40.20093536376953, 28.768760681152344, 19.140914916992188, 9.420547485351562, 10.746879577636719, -5.262550354003906, 10.242515563964844, 26.150909423828125, 9.432998657226562, 30.22161102294922, 5.826534271240234], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000163.npy"}
{"epoch": 0.2393538913362702, "step": 164, "batch_size": 64, "mean": 10.468820571899414, "std": 13.043806076049805, "min": -27.22216033935547, "p10": -5.482753753662109, "median": 9.560314178466797, "p90": 26.63110389709473, "max": 45.60968017578125, "pos_frac": 0.78125, "sample": [-0.6097869873046875, 18.724639892578125, 25.04083251953125, 13.273445129394531, 6.1559295654296875, -8.05169677734375, 21.942264556884766, 28.818939208984375, -9.456897735595703, 8.895225524902344, 0.8150177001953125, -9.224617004394531, 3.547382354736328, 10.98686408996582, 18.02336883544922, 6.93218994140625, 14.558769226074219, 24.734214782714844, 8.51577377319336, 8.425506591796875, -4.114891052246094, 6.87628173828125, 8.409286499023438, 26.781951904296875, 6.078121185302734, -7.355278015136719, 4.571910858154297, 22.179969787597656, -1.0638351440429688, -0.5549945831298828, 1.2404251098632812, -5.2666473388671875, 13.292465209960938, 1.6663131713867188, 5.079776763916016, 14.025711059570312, 11.620223999023438, 32.82862854003906, -5.575370788574219, 45.60968017578125, -0.8444976806640625, -27.22216033935547, -9.229625701904297, 12.346839904785156, 2.317537307739258, 5.404991149902344, 32.14929962158203, 12.393325805664062, 7.957061767578125, 11.753459930419922, 18.226116180419922, 26.279125213623047, 10.22540283203125, 14.896484375, 38.67942810058594, 13.403831481933594, 13.31292724609375, 22.452713012695312, 24.987380981445312, 6.118492126464844, -2.7942352294921875, 27.860214233398438, 20.822708129882812, 20.130599975585938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000164.npy"}
{"epoch": 0.24082232011747431, "step": 165, "batch_size": 64, "mean": 15.461935997009277, "std": 16.854267120361328, "min": -12.407455444335938, "p10": -0.9542243957519528, "median": 13.897102355957031, "p90": 31.02137184143068, "max": 95.80654907226562, "pos_frac": 0.875, "sample": [8.12057876586914, 9.47445297241211, -1.072723388671875, 10.539466857910156, 16.470458984375, 2.805788040161133, 21.496551513671875, -2.4124603271484375, 17.6295166015625, 8.623416900634766, 17.7479248046875, 1.003173828125, 32.6142578125, 22.705425262451172, 16.85903549194336, 14.969696044921875, 1.1583290100097656, 23.55841064453125, 8.281356811523438, 53.30135726928711, 14.755645751953125, 0.33094024658203125, 3.867706298828125, 95.80654907226562, 19.05780029296875, 42.71173095703125, -1.6489944458007812, -12.407455444335938, 19.094947814941406, 26.578155517578125, 40.91136932373047, 5.378063201904297, 34.887725830078125, 24.312652587890625, -3.1199951171875, 3.10479736328125, 13.082145690917969, 1.5477981567382812, 3.6567916870117188, -0.6777267456054688, 13.286567687988281, 3.7130584716796875, 14.507637023925781, -7.354740142822266, 25.287132263183594, 19.183578491210938, 25.28342056274414, 7.718421936035156, 11.98516845703125, 2.5563926696777344, 18.568115234375, 25.05865478515625, 10.164230346679688, -7.043052673339844, 16.240402221679688, 16.22284698486328, 25.752243041992188, 10.693511962890625, 53.296142578125, 27.304637908935547, 5.554592132568359, 25.064308166503906, 6.0483551025390625, 25.36760711669922], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000165.npy"}
{"epoch": 0.2422907488986784, "step": 166, "batch_size": 64, "mean": 14.792806625366211, "std": 17.738494873046875, "min": -8.850948333740234, "p10": -1.943518829345703, "median": 11.483381271362305, "p90": 35.75091590881348, "max": 72.63909912109375, "pos_frac": 0.84375, "sample": [38.89366149902344, 41.48738098144531, -7.965358734130859, 72.63909912109375, 12.067123413085938, 36.16439437866211, 4.522518157958984, 14.380226135253906, 0.7732048034667969, 10.7469482421875, 23.863662719726562, 9.164745330810547, 5.689350128173828, 23.332275390625, 13.002937316894531, 6.361545562744141, 6.76348876953125, 14.33099365234375, 14.34286880493164, 16.99298095703125, 15.570987701416016, 49.79827880859375, 1.8182144165039062, 2.614166259765625, -6.039201736450195, -6.430665969848633, 18.505271911621094, 2.4871749877929688, -1.28045654296875, 69.81536865234375, 23.4705810546875, 71.0743408203125, 15.70269775390625, 22.12957763671875, -1.9852371215820312, 34.7861328125, -7.858055114746094, 5.578094482421875, 6.81573486328125, 2.97735595703125, 16.504608154296875, 5.527721405029297, 1.9259185791015625, 15.374107360839844, 12.022907257080078, 10.943855285644531, 17.346778869628906, 25.70724868774414, 10.718215942382812, 29.42364501953125, 20.68950653076172, 6.651256561279297, -7.348335266113281, 1.6643867492675781, 3.430572509765625, -8.850948333740234, -1.2631645202636719, 27.397476196289062, 28.574546813964844, 19.803665161132812, 19.603038787841797, 5.429901123046875, -1.8461761474609375, 10.204444885253906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000166.npy"}
{"epoch": 0.24375917767988253, "step": 167, "batch_size": 64, "mean": 16.228336334228516, "std": 14.540733337402344, "min": -10.889892578125, "p10": 0.010390472412110219, "median": 13.664106369018555, "p90": 39.553747558593756, "max": 60.0548095703125, "pos_frac": 0.890625, "sample": [17.857467651367188, 4.542715072631836, 15.044570922851562, 21.516738891601562, 35.8990478515625, 28.609981536865234, 7.26751708984375, 14.172103881835938, 29.98834228515625, 13.156108856201172, 40.016693115234375, 42.46931457519531, 14.785396575927734, -10.889892578125, 5.586822509765625, 17.19384002685547, 30.75179672241211, 12.440475463867188, 24.78070068359375, 20.78680419921875, -0.6077728271484375, 3.8872604370117188, 24.728805541992188, 5.1829681396484375, 9.927173614501953, 22.75292205810547, 44.85029602050781, 14.314933776855469, 4.127716064453125, 9.7403564453125, -2.2588510513305664, 0.8430557250976562, 42.63816833496094, 7.51995849609375, 11.795196533203125, 18.634510040283203, 60.0548095703125, 12.036792755126953, 52.26238250732422, 4.99298095703125, 13.082504272460938, 8.141510009765625, 15.302543640136719, 4.8507232666015625, 38.473541259765625, 19.671035766601562, 16.062381744384766, 23.032005310058594, 44.29188537597656, 14.70794677734375, 12.068916320800781, 11.098739624023438, 14.689750671386719, -2.033367156982422, 3.0287017822265625, 29.450286865234375, 9.552604675292969, 3.1379737854003906, -2.5923004150390625, 6.646186828613281, 14.881034851074219, -4.242012023925781, 12.257133483886719, -0.346466064453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000167.npy"}
{"epoch": 0.24522760646108663, "step": 168, "batch_size": 64, "mean": 13.73760986328125, "std": 14.747223854064941, "min": -18.248340606689453, "p10": -0.5246599197387691, "median": 12.528919219970703, "p90": 30.787287139892584, "max": 71.83332824707031, "pos_frac": 0.875, "sample": [14.527790069580078, 16.3067626953125, -18.248340606689453, 11.012187957763672, -0.7054805755615234, 11.0836181640625, 26.614761352539062, 11.866434097290039, -16.464195251464844, 11.105361938476562, -0.10274505615234375, -11.371349334716797, 20.8409423828125, 14.018928527832031, 6.089508056640625, 21.367202758789062, 22.195045471191406, 24.94513702392578, 12.448921203613281, 35.24070739746094, 27.318038940429688, 17.73064422607422, 12.608917236328125, 14.33245849609375, 49.75726318359375, 31.571273803710938, -1.6355113983154297, 36.45884704589844, 8.934608459472656, 18.267852783203125, -11.316764831542969, 13.45489501953125, -10.609054565429688, 15.057777404785156, 8.022468566894531, 7.220623016357422, 3.9525299072265625, 3.7227020263671875, 7.4464263916015625, 3.708984375, 3.98944091796875, 31.83486557006836, 28.957984924316406, 1.8034210205078125, 6.7808837890625, 4.226194381713867, 11.067157745361328, 14.986335754394531, 21.477279663085938, 18.35511016845703, 7.2609100341796875, 13.384452819824219, 5.046772003173828, 8.94873046875, 37.928131103515625, 12.346038818359375, 14.936847686767578, 14.724052429199219, 22.941814422607422, 0.5965499877929688, 71.83332824707031, 7.38812255859375, 26.516403198242188, 23.10002899169922], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000168.npy"}
{"epoch": 0.24669603524229075, "step": 169, "batch_size": 64, "mean": 15.592907905578613, "std": 15.965651512145996, "min": -10.159332275390625, "p10": -2.577341842651367, "median": 14.055479049682617, "p90": 35.86542053222657, "max": 67.63455200195312, "pos_frac": 0.84375, "sample": [-2.6971969604492188, 16.716594696044922, 2.0430259704589844, 7.5659027099609375, 6.6248779296875, 22.418163299560547, 36.911094665527344, 30.40570068359375, 12.4249267578125, -4.412012100219727, 6.4681549072265625, 39.18232727050781, -7.294044494628906, -1.5682258605957031, 13.647655487060547, 26.404083251953125, 8.698787689208984, 10.201202392578125, -0.3018341064453125, 4.060356140136719, 18.341930389404297, 0.2994537353515625, 17.662460327148438, -7.7486724853515625, 33.425514221191406, 28.354766845703125, 9.914913177490234, 20.86383819580078, 4.3560333251953125, 2.2630109786987305, 28.382431030273438, 14.463302612304688, 1.6340179443359375, 1.1929702758789062, 24.962806701660156, -2.297679901123047, 22.24085235595703, -8.779993057250977, 17.97797393798828, 40.21544647216797, 6.17677116394043, 60.462982177734375, 12.562740325927734, 15.439773559570312, 29.24518585205078, 9.76211929321289, 14.942924499511719, 12.255584716796875, 39.49537658691406, 16.57708740234375, 55.30720520019531, 8.824966430664062, 18.81629180908203, -3.9869766235351562, 67.63455200195312, 10.010635375976562, 12.908634185791016, -10.159332275390625, 19.669631958007812, 24.71285629272461, 16.64739990234375, 17.056358337402344, 27.694812774658203, 20.66356658935547], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000169.npy"}
{"epoch": 0.24816446402349487, "step": 170, "batch_size": 64, "mean": 13.957527160644531, "std": 13.312704086303711, "min": -15.958637237548828, "p10": -2.9763561248779293, "median": 14.25131607055664, "p90": 29.627386474609384, "max": 49.072505950927734, "pos_frac": 0.84375, "sample": [14.262321472167969, 18.60626220703125, 10.13494873046875, 17.424564361572266, 14.240310668945312, 3.041606903076172, 0.315216064453125, -2.5820960998535156, 19.850772857666016, 5.5117950439453125, 30.422027587890625, 6.479885101318359, 3.4643688201904297, 8.664066314697266, 0.9011631011962891, -5.566520690917969, 26.75737762451172, 49.072505950927734, 42.02691650390625, 16.695755004882812, 9.753641128540039, 17.30636215209961, 19.944137573242188, 21.968759536743164, -1.7147216796875, 1.8072357177734375, -8.256179809570312, 12.518959045410156, -6.91131591796875, 17.653797149658203, 22.542831420898438, 45.821044921875, 10.499725341796875, 27.773223876953125, 27.268016815185547, -0.009765625, 12.574424743652344, -3.1843299865722656, 9.297813415527344, 22.225128173828125, 31.237396240234375, 13.695396423339844, 16.18585205078125, 17.676639556884766, 37.86524963378906, 17.75836181640625, 22.801761627197266, 8.995952606201172, 22.90087890625, 15.454072952270508, 14.277816772460938, 20.2900390625, -3.14532470703125, 19.93365478515625, 39.533226013183594, 13.794269561767578, 13.7130126953125, -9.119186401367188, 3.0696563720703125, -15.958637237548828, 17.930953979492188, 2.4959640502929688, 22.331283569335938, 10.961442947387695], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000170.npy"}
{"epoch": 0.24963289280469897, "step": 171, "batch_size": 64, "mean": 15.739529609680176, "std": 20.830446243286133, "min": -27.328323364257812, "p10": -4.299437713623046, "median": 11.308773040771484, "p90": 37.61578369140625, "max": 97.11642456054688, "pos_frac": 0.84375, "sample": [0.01071929931640625, 21.215965270996094, 37.95452880859375, 2.8204803466796875, 10.54153060913086, -8.342750549316406, 8.260150909423828, 3.3880462646484375, -14.582839965820312, 26.114471435546875, 21.532779693603516, 23.18557357788086, 4.390106201171875, 5.8903045654296875, 18.508682250976562, -15.841934204101562, 8.850013732910156, 15.238388061523438, 17.03716278076172, -2.8940200805664062, 25.5096435546875, 30.702064514160156, 29.562156677246094, 4.667606353759766, 38.16889953613281, 12.866493225097656, 9.210411071777344, 69.59463500976562, 4.580471038818359, 38.98422622680664, 11.215576171875, -27.328323364257812, 78.55532836914062, 4.541160583496094, 24.964466094970703, -8.46044921875, 21.390602111816406, 30.108020782470703, 7.886945724487305, 36.82537841796875, -3.5555648803710938, 3.9321823120117188, 32.919921875, 2.107341766357422, -0.5575218200683594, 17.1820068359375, 16.603900909423828, 27.954055786132812, 0.879608154296875, 10.9169921875, -6.509742736816406, -4.6182403564453125, 41.741798400878906, 33.85895538330078, 7.574737548828125, 6.189430236816406, 97.11642456054688, 11.478973388671875, 13.651046752929688, 2.9869537353515625, 11.401969909667969, 0.9033222198486328, 21.951614379882812, 34.39702606201172], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000171.npy"}
{"epoch": 0.2511013215859031, "step": 172, "batch_size": 64, "mean": 14.471284866333008, "std": 11.200230598449707, "min": -10.757064819335938, "p10": 0.5214935302734378, "median": 13.424636840820312, "p90": 27.35130615234375, "max": 42.04859161376953, "pos_frac": 0.90625, "sample": [12.32535171508789, 19.646984100341797, -0.43620872497558594, 1.5003318786621094, 25.993614196777344, 5.820152282714844, 13.878562927246094, 7.3788604736328125, 17.014251708984375, 0.812896728515625, 11.67535400390625, 14.79452133178711, -10.757064819335938, 21.8687744140625, 9.539634704589844, 25.250808715820312, 29.749755859375, 27.351539611816406, 7.627498626708984, 11.35626220703125, 2.985706329345703, 19.179370880126953, 24.607383728027344, 39.07215881347656, 9.122962951660156, 5.816679000854492, 27.35076141357422, 14.766304016113281, -2.1397552490234375, 35.160064697265625, 13.089393615722656, 0.3966064453125, 11.819515228271484, 8.993560791015625, 7.34234619140625, 31.103897094726562, 19.408981323242188, 27.20469093322754, 3.7493057250976562, 13.759880065917969, -7.471334457397461, 20.185245513916016, 42.04859161376953, 18.963211059570312, -2.0521316528320312, 10.617866516113281, -1.5884857177734375, 4.6059722900390625, 12.309539794921875, 18.548988342285156, 16.334625244140625, 21.996177673339844, 11.571624755859375, 18.916366577148438, 22.669418334960938, 23.97943115234375, 25.5025634765625, 16.176368713378906, 7.25079345703125, 13.041015625, 8.287223815917969, 1.1591644287109375, 37.284576416015625, 20.643699645996094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000172.npy"}
{"epoch": 0.2525697503671072, "step": 173, "batch_size": 64, "mean": 12.28467082977295, "std": 13.322362899780273, "min": -13.021984100341797, "p10": -4.1558593749999995, "median": 11.24014663696289, "p90": 30.34558868408203, "max": 44.06073760986328, "pos_frac": 0.8125, "sample": [-3.41546630859375, 0.2726173400878906, 2.4724502563476562, 16.253082275390625, 3.172832489013672, 43.363189697265625, 23.882102966308594, 10.439071655273438, -4.3209381103515625, -0.5310535430908203, 15.662445068359375, 9.855705261230469, 1.4568367004394531, -1.9820938110351562, 20.7030029296875, 24.34302520751953, 17.381309509277344, 15.948526382446289, 6.733463287353516, 39.30180358886719, -6.676055908203125, -3.0375747680664062, 8.700668334960938, 12.041221618652344, 25.27947998046875, 17.851242065429688, 2.33551025390625, 1.9445323944091797, 20.350566864013672, 21.035873413085938, 3.040721893310547, 3.8933448791503906, 4.3408966064453125, 26.63629913330078, 17.3560791015625, 7.1511993408203125, 30.77812957763672, 21.744384765625, 9.531022071838379, -8.092254638671875, 28.777389526367188, 29.974899291992188, 13.69927978515625, 31.42668914794922, 15.635513305664062, -6.673248291015625, 44.06073760986328, 13.736129760742188, -10.22003173828125, 15.778907775878906, 19.99822425842285, 5.461551666259766, 10.065437316894531, 26.301986694335938, -13.021984100341797, 30.50445556640625, 0.43036842346191406, -6.501314163208008, 14.72775650024414, 6.189983367919922, -3.7706756591796875, 9.919525146484375, 31.924339294433594, 20.595802307128906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000173.npy"}
{"epoch": 0.2540381791483113, "step": 174, "batch_size": 64, "mean": 16.303455352783203, "std": 16.49365997314453, "min": -27.97502899169922, "p10": -3.4567844390869125, "median": 14.507892608642578, "p90": 33.91682052612305, "max": 84.80804443359375, "pos_frac": 0.875, "sample": [28.777633666992188, 1.1880569458007812, 15.234088897705078, 13.11825180053711, -12.108108520507812, 9.551315307617188, 6.785697937011719, 23.181671142578125, 28.372692108154297, 42.381805419921875, 13.502433776855469, -6.08038330078125, 13.127628326416016, 8.20869255065918, 28.85729217529297, 28.82172393798828, 32.879276275634766, 14.518966674804688, 15.843120574951172, -10.111419677734375, 23.50653839111328, 29.25130844116211, 29.456932067871094, 10.67125129699707, 38.856475830078125, -27.97502899169922, 18.239463806152344, 24.072998046875, 1.6451568603515625, 20.675138473510742, 7.890110015869141, 7.953713417053223, 14.496818542480469, -6.2440338134765625, 44.355224609375, 11.204292297363281, 21.972808837890625, 10.001056671142578, -4.1881866455078125, 38.743858337402344, 28.27813720703125, 33.99462890625, 22.045679092407227, -5.1873779296875, -1.7501792907714844, 7.6154327392578125, 8.78853988647461, 34.90332794189453, 8.069320678710938, 16.308700561523438, 14.906097412109375, 13.220602035522461, 15.639976501464844, 33.735267639160156, 13.023681640625, 19.5919189453125, 12.60565185546875, 4.958984375, 3.3577041625976562, 0.2975616455078125, 84.80804443359375, 30.758697509765625, 11.720836639404297, 21.093549728393555], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000174.npy"}
{"epoch": 0.2555066079295154, "step": 175, "batch_size": 64, "mean": 16.133861541748047, "std": 14.593435287475586, "min": -21.19305419921875, "p10": -0.2101621627807611, "median": 13.643177032470703, "p90": 35.93314971923829, "max": 51.754119873046875, "pos_frac": 0.890625, "sample": [11.937000274658203, 23.56698226928711, 3.252399444580078, 18.843505859375, 6.9517364501953125, 8.9935302734375, 15.359672546386719, 8.548667907714844, 4.543092727661133, 31.954864501953125, 25.02483367919922, -3.859405517578125, -3.0352325439453125, 51.754119873046875, 50.695526123046875, 29.0908203125, -0.47084999084472656, 6.003349304199219, 14.786354064941406, 1.0298004150390625, 27.579811096191406, 12.363105773925781, 42.62542724609375, 30.125091552734375, 13.216339111328125, 16.32159423828125, 27.430862426757812, 29.20030975341797, 19.608352661132812, 14.640193939208984, 14.513771057128906, 7.160835266113281, 2.0892181396484375, 23.705039978027344, 11.487178802490234, 16.093046188354492, -7.016361236572266, 36.16796875, 7.545839309692383, -1.5018424987792969, 28.910507202148438, 14.062042236328125, 17.51820945739746, 11.632352828979492, 6.068901062011719, 45.37078857421875, 28.407241821289062, 0.39810943603515625, 6.6584625244140625, 41.9813232421875, 13.224311828613281, 29.75128936767578, 11.684398651123047, 6.01336669921875, 9.102800369262695, 8.013999938964844, 21.348487854003906, -4.650409698486328, -21.19305419921875, 35.38523864746094, 38.753013610839844, 20.689102172851562, 3.163330078125, 11.94677734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000175.npy"}
{"epoch": 0.25697503671071953, "step": 176, "batch_size": 64, "mean": 16.27203369140625, "std": 18.5620059967041, "min": -18.862030029296875, "p10": -4.6938011169433596, "median": 13.309370040893555, "p90": 42.40686798095704, "max": 58.773834228515625, "pos_frac": 0.796875, "sample": [18.800884246826172, 12.503158569335938, 16.730812072753906, 56.966522216796875, 35.09693145751953, 16.215484619140625, 7.603832244873047, 5.64520263671875, -2.452228546142578, -2.0863876342773438, 7.29766845703125, 41.486419677734375, 3.255451202392578, 19.23796844482422, 32.2210693359375, 10.871177673339844, 21.276412963867188, 31.217498779296875, 9.448013305664062, -5.816722869873047, 42.80134582519531, 12.881393432617188, 34.41987609863281, 0.6079139709472656, -18.862030029296875, -6.671957015991211, -0.7941436767578125, 51.10472869873047, 21.56561279296875, -4.713569641113281, 6.4531707763671875, 29.570037841796875, 34.566650390625, 1.5252151489257812, 16.036354064941406, 0.28971099853515625, 14.852424621582031, 9.38427734375, -4.567230224609375, 17.23517608642578, 28.342697143554688, 6.290872573852539, 28.604164123535156, 2.4701919555664062, 8.108341217041016, 47.351783752441406, 33.015541076660156, 13.737346649169922, 36.00406265258789, 53.54412841796875, 30.959266662597656, -13.903892517089844, 24.216773986816406, -4.475067138671875, -4.647674560546875, -8.8916015625, -12.270378112792969, 7.976280212402344, 31.40334701538086, 5.515083312988281, 58.773834228515625, 49.20191955566406, 7.025243759155273, 19.853729248046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000176.npy"}
{"epoch": 0.25844346549192365, "step": 177, "batch_size": 64, "mean": 19.08730125427246, "std": 20.287240982055664, "min": -5.280204772949219, "p10": -1.4671527862548828, "median": 14.394723892211914, "p90": 41.880217742919925, "max": 97.10746765136719, "pos_frac": 0.859375, "sample": [9.968978881835938, 27.794403076171875, 24.037445068359375, 6.763435363769531, -3.0734329223632812, 35.87242889404297, 11.559616088867188, -1.5204238891601562, 13.383602142333984, 37.78611755371094, 85.40776062011719, 6.451286315917969, 25.36470603942871, 20.978683471679688, 17.801788330078125, 17.589874267578125, -0.67449951171875, 72.57684326171875, 7.225921630859375, 36.277984619140625, 4.693935394287109, 18.52056121826172, 13.562568664550781, 18.686790466308594, -4.592062950134277, 10.349466323852539, 54.48350524902344, -1.4496650695800781, -3.0057373046875, 43.89113235473633, 18.820972442626953, 14.208354949951172, 24.095962524414062, 14.581092834472656, 23.153823852539062, 0.9435882568359375, -1.6962738037109375, 20.522382736206055, 17.22334861755371, 6.255834579467773, 5.4439849853515625, 52.55035400390625, 15.769634246826172, 9.071147918701172, 11.880081176757812, 21.55634307861328, 23.546058654785156, 3.7931289672851562, 2.993560791015625, 9.325248718261719, 26.799068450927734, 11.773483276367188, 16.13910675048828, 0.0018901824951171875, 42.1077880859375, 11.1124267578125, 9.619564056396484, 5.999408721923828, 34.67521667480469, -1.4746475219726562, 97.10746765136719, 41.349220275878906, 30.9058837890625, -5.280204772949219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000177.npy"}
{"epoch": 0.2599118942731278, "step": 178, "batch_size": 64, "mean": 22.489788055419922, "std": 19.6046085357666, "min": -13.6402587890625, "p10": 2.4850418090820323, "median": 19.463991165161133, "p90": 52.53569717407228, "max": 79.00822448730469, "pos_frac": 0.9375, "sample": [27.027427673339844, 19.41130828857422, 17.75183868408203, -5.6851654052734375, 30.246109008789062, 4.536159515380859, 5.393932342529297, 5.218921661376953, 3.4853477478027344, 25.0838623046875, 3.8919715881347656, 23.0919189453125, 36.873451232910156, 23.618515014648438, 25.494918823242188, 25.84677505493164, 71.4801025390625, 23.62700653076172, 47.579071044921875, 5.94287109375, 79.00822448730469, 7.475614547729492, 3.606048583984375, 25.090255737304688, 30.147785186767578, 54.65996551513672, 57.66972351074219, 16.200729370117188, -5.970062255859375, 18.352813720703125, 22.27216339111328, 65.81956481933594, 2.0563392639160156, 17.05689239501953, 29.405853271484375, 36.2188720703125, 23.533157348632812, 1.8242568969726562, 19.098533630371094, 41.537384033203125, 6.382122039794922, 0.5761566162109375, 37.975929260253906, 18.742103576660156, 19.516674041748047, 25.14423370361328, 20.974769592285156, 29.455108642578125, 14.279895782470703, 63.62538146972656, 9.254451751708984, 36.530982971191406, 18.703323364257812, 10.703651428222656, 4.831878662109375, 22.41839599609375, -3.662006378173828, 15.502410888671875, -13.6402587890625, 18.765567779541016, 69.70941162109375, 7.1926727294921875, 22.641864776611328, 18.741172790527344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000178.npy"}
{"epoch": 0.26138032305433184, "step": 179, "batch_size": 64, "mean": 15.058500289916992, "std": 20.25447654724121, "min": -27.354095458984375, "p10": -7.962351608276366, "median": 12.157962799072266, "p90": 43.62276306152345, "max": 60.755828857421875, "pos_frac": 0.734375, "sample": [-3.7944717407226562, 36.10523986816406, 25.220436096191406, 30.03857421875, 7.826887130737305, 21.83307647705078, 29.011611938476562, -0.3482475280761719, -8.239425659179688, -2.1628456115722656, 47.250282287597656, 14.507373809814453, 3.5086612701416016, 0.6641769409179688, 2.2879486083984375, 29.18645477294922, -12.7047119140625, 11.867889404296875, 1.7583999633789062, 25.687774658203125, 30.0343017578125, -6.35662841796875, 28.563812255859375, 2.5731124877929688, 35.354469299316406, 16.86016845703125, 9.07891845703125, 41.04735565185547, 10.334884643554688, 23.451889038085938, 2.457103729248047, 54.03936767578125, 60.755828857421875, 12.448036193847656, -7.315845489501953, 25.92571258544922, -10.422800064086914, 30.95513153076172, -3.12408447265625, -2.3011398315429688, 8.63058853149414, -27.354095458984375, 4.110675811767578, -2.00732421875, 24.77941131591797, 59.036865234375, 24.797637939453125, 24.363143920898438, 47.369842529296875, -3.783721923828125, 18.290122985839844, 54.693878173828125, -9.547866821289062, 40.42936706542969, 44.72650909423828, 28.820514678955078, -6.8979644775390625, 18.228416442871094, -17.57842254638672, 1.1122245788574219, -17.094390869140625, 22.145278930664062, 2.22357177734375, 10.385047912597656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000179.npy"}
{"epoch": 0.26284875183553597, "step": 180, "batch_size": 64, "mean": 18.714359283447266, "std": 17.7919979095459, "min": -14.414344787597656, "p10": -0.08143005371093648, "median": 14.751317977905273, "p90": 39.49424591064454, "max": 95.68656921386719, "pos_frac": 0.890625, "sample": [18.27630615234375, 31.24071502685547, 17.881805419921875, -14.414344787597656, 11.94921875, 95.68656921386719, 34.96553421020508, 11.257461547851562, 37.25239181518555, 33.378448486328125, -4.155426025390625, 10.626869201660156, -13.01318359375, 8.592891693115234, 5.043205261230469, 43.371429443359375, 7.7543487548828125, 16.763919830322266, 16.33154296875, 14.176544189453125, 10.439281463623047, 14.426109313964844, 15.076526641845703, 31.55542755126953, 40.092369079589844, 37.591827392578125, -9.424758911132812, 21.45211410522461, 18.607627868652344, -0.5118789672851562, 42.66343688964844, 2.7726707458496094, 29.568115234375, 29.264381408691406, 27.31000518798828, 12.100334167480469, 9.566520690917969, 28.96331787109375, 20.497116088867188, 42.117027282714844, 19.049571990966797, 24.159957885742188, 38.09862518310547, 12.457847595214844, -4.693641662597656, 4.9052886962890625, 23.498031616210938, 21.830078125, 8.579666137695312, 5.6793212890625, 0.9229507446289062, 31.31586456298828, 9.497859954833984, 59.59873962402344, 7.70458984375, 4.270011901855469, 13.075225830078125, 9.910476684570312, 14.389884948730469, 9.788368225097656, 42.76104736328125, 13.23919677734375, -2.812114715576172, 23.398361206054688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000180.npy"}
{"epoch": 0.2643171806167401, "step": 181, "batch_size": 64, "mean": 14.614219665527344, "std": 17.25667953491211, "min": -13.765052795410156, "p10": -2.6832614898681637, "median": 11.170440673828125, "p90": 35.776615524292, "max": 70.14384460449219, "pos_frac": 0.796875, "sample": [11.228164672851562, -0.7498550415039062, 14.700986862182617, 37.1534423828125, 13.724784851074219, -2.782238006591797, 0.34246063232421875, -0.10031509399414062, 0.5991058349609375, 33.61065673828125, 28.248252868652344, 15.599740982055664, -2.4523162841796875, 28.12933349609375, 6.2801513671875, 5.460468292236328, 6.751800537109375, 14.848953247070312, 20.48248291015625, -1.0493240356445312, 8.436637878417969, -13.765052795410156, 38.26441955566406, 26.724227905273438, 5.5235595703125, 11.112716674804688, -10.796234130859375, 56.244911193847656, 36.70488357543945, 21.451904296875, 4.826042175292969, 22.638900756835938, -7.0225372314453125, 26.699935913085938, 15.528450012207031, 30.712230682373047, 31.094470977783203, 5.734809875488281, 25.41216278076172, 7.72998046875, 5.397432327270508, -9.83465576171875, 43.79308319091797, 15.56705093383789, 70.14384460449219, 21.688413619995117, -8.131759643554688, 10.929737091064453, 20.368553161621094, 9.947696685791016, 30.608551025390625, 66.29379272460938, -7.359962463378906, 11.955726623535156, 7.696407318115234, -1.195444107055664, 6.587671279907227, 22.46893310546875, 18.21918487548828, 17.815933227539062, 4.838531494140625, 5.1323699951171875, 0.5944137573242188, -1.4985504150390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000181.npy"}
{"epoch": 0.2657856093979442, "step": 182, "batch_size": 64, "mean": 18.840679168701172, "std": 21.053495407104492, "min": -23.89116668701172, "p10": -4.499365329742429, "median": 15.8697509765625, "p90": 47.59921607971194, "max": 88.00273132324219, "pos_frac": 0.875, "sample": [27.47418975830078, 16.128082275390625, 49.71879577636719, 32.06451416015625, 28.974998474121094, 41.21288299560547, 68.35392761230469, 15.86163330078125, 88.00273132324219, 19.555206298828125, 10.4224853515625, 21.875823974609375, -12.690925598144531, -1.8405027389526367, 35.87162780761719, -22.60931396484375, 32.14965057373047, 30.447738647460938, 3.576582908630371, 13.716087341308594, 16.116104125976562, -14.943525314331055, 39.03078842163086, 22.059581756591797, 13.07625961303711, 1.3252601623535156, 15.87786865234375, 1.95501708984375, -6.012607574462891, 20.204391479492188, 14.979801177978516, 15.05804443359375, 39.18225860595703, 21.65618896484375, 22.628448486328125, 25.973106384277344, 10.136672973632812, -23.89116668701172, 5.8809967041015625, 50.115753173828125, 1.2697601318359375, 16.247955322265625, 7.0571441650390625, 11.59283447265625, 51.4610595703125, 15.426376342773438, 15.262493133544922, 42.65353012084961, 15.11920166015625, -5.638877868652344, 57.83894348144531, 22.097036361694336, 9.362628936767578, 2.346485137939453, 9.947677612304688, 3.301271438598633, -16.98990249633789, 2.3308944702148438, 52.976287841796875, 0.8562660217285156, 39.817535400390625, 6.314228057861328, 32.51176834106445, 23.96546173095703], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000182.npy"}
{"epoch": 0.26725403817914833, "step": 183, "batch_size": 64, "mean": 19.054080963134766, "std": 18.059663772583008, "min": -12.4300537109375, "p10": -1.432065200805662, "median": 17.29257869720459, "p90": 40.983351135253905, "max": 64.45872497558594, "pos_frac": 0.890625, "sample": [39.514404296875, 32.352943420410156, 3.5136451721191406, 13.978702545166016, 4.425731658935547, 36.441017150878906, 45.72532653808594, -12.4300537109375, 17.31365966796875, -9.1671142578125, 18.2169189453125, 63.43254089355469, 16.579689025878906, 3.882587432861328, -5.41436767578125, 15.806320190429688, 64.45872497558594, 37.83921813964844, 12.959320068359375, 4.293813705444336, 7.10052490234375, 20.036392211914062, 17.580734252929688, 20.167892456054688, 3.5468597412109375, 1.099996566772461, 48.54423522949219, 35.408416748046875, 40.05300521850586, 2.625823974609375, 53.87512969970703, 10.946701049804688, 17.27149772644043, 2.637073516845703, 30.8048095703125, 2.0227508544921875, 17.68259620666504, 34.12879943847656, 21.644573211669922, 40.935585021972656, -4.492767333984375, -6.335906982421875, 35.049530029296875, 26.218402862548828, 15.414260864257812, 56.25675964355469, 11.083419799804688, -2.328857421875, 17.350383758544922, 24.039703369140625, 26.849098205566406, 6.7617645263671875, 27.081939697265625, 16.44689178466797, 4.036003112792969, 41.003822326660156, 7.402778625488281, 19.690460205078125, 7.5019073486328125, 0.6604499816894531, 34.577613830566406, -10.948417663574219, 22.48150634765625, 11.823989868164062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000183.npy"}
{"epoch": 0.2687224669603524, "step": 184, "batch_size": 64, "mean": 12.560145378112793, "std": 19.5296688079834, "min": -60.243865966796875, "p10": -6.772196197509765, "median": 14.092329025268555, "p90": 40.94805984497071, "max": 53.08543395996094, "pos_frac": 0.734375, "sample": [23.9024658203125, 14.726036071777344, 1.478790283203125, 31.50262451171875, 47.45124053955078, 3.01092529296875, 14.446487426757812, 0.612548828125, 51.28678894042969, -3.395854949951172, 16.762680053710938, 4.0688323974609375, 17.122936248779297, 15.854019165039062, -5.270637512207031, 33.22010040283203, 23.213905334472656, 34.6983642578125, 41.74513626098633, 53.08543395996094, 2.202254295349121, 9.584648132324219, -60.243865966796875, 15.802547454833984, -1.77685546875, 31.328754425048828, 14.293949127197266, -1.0007247924804688, -8.655166625976562, 17.789539337158203, -1.3766021728515625, -14.10150146484375, 19.60126495361328, 41.160972595214844, -6.4696044921875, 24.34101104736328, 21.476516723632812, 4.478187561035156, 23.287216186523438, 1.7108535766601562, 28.69244384765625, -6.901878356933594, 8.116247177124023, -7.718528747558594, 15.276130676269531, 13.890708923339844, -0.10163116455078125, 5.213886260986328, 23.41350555419922, -5.360481262207031, -5.729167938232422, 7.485118865966797, 0.7505912780761719, 17.230274200439453, -2.06768798828125, -17.96373748779297, 45.742431640625, 44.517539978027344, 10.045524597167969, 23.855697631835938, 4.6063232421875, -14.558212280273438, 22.006759643554688, 40.451263427734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000184.npy"}
{"epoch": 0.2701908957415565, "step": 185, "batch_size": 64, "mean": 15.299050331115723, "std": 20.367162704467773, "min": -24.602081298828125, "p10": -8.668293857574463, "median": 15.003044128417969, "p90": 40.40948677062988, "max": 78.46998596191406, "pos_frac": 0.796875, "sample": [-23.844236373901367, -10.204139709472656, 5.645576477050781, -7.9034423828125, 4.703910827636719, 4.300048828125, -4.094350814819336, 0.6462326049804688, 39.61994934082031, 16.75958251953125, 19.159374237060547, 60.916015625, 14.848175048828125, 20.273277282714844, 15.157913208007812, 20.651702880859375, 16.184452056884766, -3.387542724609375, 34.941123962402344, 44.66233825683594, -8.794249534606934, 24.978195190429688, 7.34747314453125, 2.2581787109375, -8.374397277832031, -13.958908081054688, 27.454509735107422, 33.660457611083984, 11.522621154785156, 14.62005615234375, -19.76776123046875, 1.4367256164550781, 25.2015380859375, 15.744186401367188, -17.399307250976562, 11.549171447753906, 19.734268188476562, 24.37181854248047, 52.16368103027344, 8.959281921386719, 20.407604217529297, 40.747859954833984, 6.230110168457031, 32.449562072753906, 8.094093322753906, 3.182281494140625, 31.433578491210938, 19.05493927001953, 23.58966064453125, 12.28117561340332, 78.46998596191406, 20.30178451538086, 17.992855072021484, -1.9444351196289062, -2.0808486938476562, 38.985591888427734, 13.62173080444336, 8.798088073730469, -24.602081298828125, 54.335662841796875, 16.93128204345703, 53.401084899902344, 23.567520141601562, 2.1465911865234375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000185.npy"}
{"epoch": 0.27165932452276065, "step": 186, "batch_size": 64, "mean": 17.03476905822754, "std": 18.460416793823242, "min": -27.202545166015625, "p10": -3.013885498046875, "median": 16.29493522644043, "p90": 42.74762496948242, "max": 66.47494506835938, "pos_frac": 0.8125, "sample": [33.44560241699219, 20.740798950195312, 18.282546997070312, 22.038427352905273, 12.844970703125, 42.23492431640625, 15.28851318359375, 25.196983337402344, 66.47494506835938, -10.286544799804688, 26.594635009765625, 21.407821655273438, 0.690765380859375, -4.577079772949219, 20.78040313720703, 32.95598602294922, 1.6422233581542969, 1.9248428344726562, -2.8976211547851562, 3.322376251220703, 37.49552917480469, 26.20843505859375, -27.202545166015625, 23.228591918945312, 15.139747619628906, 15.295318603515625, 2.5039443969726562, 44.96887969970703, 6.8498382568359375, 3.0059585571289062, -2.466846466064453, -11.720916748046875, 42.96735382080078, -1.542449951171875, 9.272537231445312, 20.624305725097656, 53.42628479003906, 26.836318969726562, 50.14027404785156, 7.0709381103515625, 23.939010620117188, 12.250965118408203, 36.47434997558594, 53.075592041015625, -6.096595764160156, -3.0637130737304688, -1.64373779296875, 24.051925659179688, 4.1930389404296875, 13.534233093261719, 38.3433837890625, 22.699127197265625, 18.241378784179688, 22.25490951538086, -14.794891357421875, 49.54931640625, 3.9160003662109375, -1.4760665893554688, 16.02712631225586, 27.83721923828125, 16.562744140625, 26.475936889648438, 6.453704833984375, 11.213241577148438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000186.npy"}
{"epoch": 0.27312775330396477, "step": 187, "batch_size": 64, "mean": 15.587631225585938, "std": 20.497446060180664, "min": -30.48619842529297, "p10": -9.091557693481445, "median": 11.950546264648438, "p90": 42.94272994995118, "max": 81.15353393554688, "pos_frac": 0.796875, "sample": [-9.75079345703125, 40.69298553466797, 2.1582393646240234, 5.112430572509766, -0.513519287109375, 16.470916748046875, 40.50090789794922, 45.813812255859375, 23.251930236816406, 15.499992370605469, -0.8324127197265625, 2.182260513305664, 47.02217102050781, 2.920074462890625, 31.937088012695312, 5.822654724121094, 29.8458251953125, 10.204177856445312, 3.2981338500976562, -14.174938201904297, 4.690216064453125, -6.370582580566406, 40.01429748535156, 0.2690887451171875, 5.822746276855469, 21.42397689819336, 81.15353393554688, -13.211009979248047, -4.421970367431641, 10.674697875976562, 11.878982543945312, 38.304542541503906, 17.30469512939453, -7.553340911865234, 1.9881706237792969, 34.40962600708008, 48.15172576904297, 9.61007308959961, 0.35150909423828125, 10.791580200195312, 43.90690612792969, 23.71839141845703, 31.489295959472656, 48.818824768066406, 6.592437744140625, -16.934890747070312, -1.8608474731445312, 2.536022186279297, -30.48619842529297, -19.674522399902344, 13.614830017089844, 32.56507110595703, 43.92070007324219, 20.658676147460938, 26.79962921142578, 31.26580810546875, 34.27341842651367, -10.574928283691406, 25.130661010742188, 33.476844787597656, 12.022109985351562, 16.149005889892578, 11.577919006347656, 15.878679275512695], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000187.npy"}
{"epoch": 0.2745961820851689, "step": 188, "batch_size": 64, "mean": 18.150962829589844, "std": 18.409303665161133, "min": -42.17799377441406, "p10": -3.5512163162231443, "median": 19.445972442626953, "p90": 34.78171844482422, "max": 68.89852905273438, "pos_frac": 0.859375, "sample": [30.790809631347656, 23.12108612060547, 53.60303497314453, 5.993873596191406, 17.817955017089844, 27.678123474121094, 20.98540496826172, 21.284103393554688, 19.50493621826172, 30.728145599365234, 9.323375701904297, 22.89850616455078, 17.118270874023438, 8.906272888183594, 14.26220703125, 9.272079467773438, 12.627090454101562, 35.00348663330078, 6.193416595458984, 2.8108530044555664, 42.10731506347656, 16.259143829345703, 25.976478576660156, 29.175764083862305, 26.356842041015625, -11.833549499511719, 33.354366302490234, 2.707927703857422, 34.00465774536133, -3.3818893432617188, 68.89852905273438, -42.17799377441406, 25.217880249023438, 18.71178436279297, 54.07660675048828, 25.531509399414062, -14.690391540527344, 22.705078125, 6.480497360229492, 26.097122192382812, 34.264259338378906, -18.193031311035156, 18.925765991210938, 22.821075439453125, -2.5005455017089844, -5.620002746582031, 3.3604507446289062, 8.747814178466797, 17.00579833984375, 19.387008666992188, 19.97796630859375, 27.25524139404297, 23.487930297851562, -3.790283203125, 15.776412963867188, 18.985824584960938, 28.899303436279297, 60.00456237792969, 45.047271728515625, 22.265621185302734, 25.10723876953125, -3.6237850189208984, 7.135749816894531, 1.4332313537597656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000188.npy"}
{"epoch": 0.27606461086637296, "step": 189, "batch_size": 64, "mean": 18.695587158203125, "std": 22.070262908935547, "min": -18.647708892822266, "p10": -3.8970008850097653, "median": 16.156188011169434, "p90": 44.42926712036133, "max": 95.50765991210938, "pos_frac": 0.8125, "sample": [-2.7187347412109375, 6.620674133300781, 23.130599975585938, 49.615692138671875, 3.04632568359375, -14.986251831054688, 26.73661994934082, -4.004966735839844, 6.344936370849609, 19.20117950439453, 24.60765838623047, 80.18408966064453, 12.185195922851562, 34.65739440917969, 25.935462951660156, 28.840057373046875, -8.100700378417969, 11.72549057006836, 2.7141265869140625, 6.1278533935546875, -11.087223052978516, 44.600738525390625, -3.4881324768066406, 36.647369384765625, 25.624576568603516, 28.053451538085938, -3.64508056640625, 19.258424758911133, 13.254524230957031, 39.46214294433594, 11.617721557617188, 18.6683292388916, 39.88080978393555, 73.88130950927734, 19.59918212890625, 27.975650787353516, 2.0652942657470703, 4.5249481201171875, -18.647708892822266, 26.184436798095703, -4.801033020019531, 6.818397521972656, 22.9957275390625, 15.486251831054688, 9.962263107299805, 36.17910385131836, 56.121337890625, 95.50765991210938, 2.7352066040039062, 23.071754455566406, 51.586090087890625, 3.1308441162109375, 16.82612419128418, 13.872016906738281, -3.5286903381347656, 2.7075958251953125, 20.9166259765625, -0.17679595947265625, 44.02916717529297, -9.08823013305664, 3.3888092041015625, 26.556594848632812, 26.77173614501953, 9.155563354492188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000189.npy"}
{"epoch": 0.2775330396475771, "step": 190, "batch_size": 64, "mean": 21.843786239624023, "std": 19.140316009521484, "min": -15.311172485351562, "p10": 3.2481109619140627, "median": 19.245132446289062, "p90": 46.25160598754883, "max": 80.79206848144531, "pos_frac": 0.90625, "sample": [4.349617004394531, 17.645137786865234, 3.2631072998046875, 12.494270324707031, 7.180908203125, 28.928855895996094, 37.13304901123047, -9.514968872070312, 4.774745941162109, 45.37396240234375, 22.325942993164062, 19.128738403320312, 40.22706604003906, 20.747711181640625, 40.965538024902344, 15.456573486328125, -13.392250061035156, 19.338150024414062, 39.57273864746094, 34.405609130859375, 6.112226486206055, 62.11784362792969, 9.605712890625, 28.078414916992188, 48.5364990234375, 19.152114868164062, 9.5189208984375, 42.596588134765625, 7.63494873046875, 20.66857147216797, -15.311172485351562, 46.62773895263672, -4.414703369140625, 25.77989959716797, 52.75178527832031, 40.057106018066406, 13.308212280273438, 33.018951416015625, 10.632499694824219, -13.120819091796875, 53.30021667480469, 3.2416839599609375, 19.90960693359375, 44.18147277832031, 6.290412902832031, 7.6715087890625, 33.988563537597656, 20.022705078125, 50.80706787109375, 35.257667541503906, 28.701271057128906, 80.79206848144531, 17.88201141357422, 26.247356414794922, 17.50518035888672, 13.312948226928711, -8.307777404785156, 18.295364379882812, 7.086783409118652, 29.650115966796875, 10.437667846679688, 27.559654235839844, 15.680667877197266, 4.7322998046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000190.npy"}
{"epoch": 0.2790014684287812, "step": 191, "batch_size": 64, "mean": 24.244056701660156, "std": 22.62301254272461, "min": -16.397003173828125, "p10": -0.4143474578857418, "median": 21.35775375366211, "p90": 62.50825347900391, "max": 85.98939514160156, "pos_frac": 0.875, "sample": [62.9908447265625, -2.6419830322265625, 77.20216369628906, 55.675323486328125, 28.79302978515625, 9.743911743164062, -1.1641921997070312, 25.54827880859375, 2.7007789611816406, 61.81529235839844, 17.811370849609375, 15.404708862304688, 44.920684814453125, 56.589630126953125, 8.494911193847656, 6.33099365234375, 7.109143257141113, 21.10382080078125, 26.543075561523438, 2.176593780517578, 23.063201904296875, 32.122955322265625, -16.397003173828125, 36.5556640625, 64.42543029785156, 20.54327392578125, 15.422891616821289, 62.80523681640625, 8.14385986328125, 0.7192535400390625, 18.11334228515625, 5.506525039672852, 9.71255111694336, -0.578125, 19.13360595703125, 19.9061279296875, 21.61168670654297, 22.435699462890625, 63.13569641113281, 4.106450080871582, 0.9095964431762695, 24.747413635253906, -3.002330780029297, 5.851287841796875, 4.326774597167969, 65.94140625, -0.6104984283447266, 16.638629913330078, 12.951515197753906, 38.615875244140625, -15.168716430664062, 33.08531188964844, 37.5632438659668, -0.032199859619140625, 34.65290832519531, 32.45094299316406, 44.30027770996094, 25.206096649169922, 24.540504455566406, 42.95930480957031, 85.98939514160156, 29.42288589477539, 23.21786880493164, 29.42548370361328], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000191.npy"}
{"epoch": 0.28046989720998533, "step": 192, "batch_size": 64, "mean": 16.961894989013672, "std": 21.141773223876953, "min": -31.3768310546875, "p10": -9.409215545654295, "median": 17.26596450805664, "p90": 40.76945953369142, "max": 77.92776489257812, "pos_frac": 0.796875, "sample": [21.50878143310547, 17.477676391601562, -16.629722595214844, 11.857376098632812, 62.46824264526367, 34.44693374633789, 4.355201721191406, -5.492206573486328, -15.618186950683594, 12.399444580078125, 17.57244873046875, 22.62723159790039, 12.494575500488281, 7.335968017578125, -10.206253051757812, 2.4748992919921875, 23.775657653808594, 22.102367401123047, -4.507293701171875, 36.906551361083984, -11.830276489257812, 35.81982421875, -13.471317291259766, 9.647666931152344, -10.56536865234375, 58.452667236328125, 5.425895690917969, 77.92776489257812, -1.6050491333007812, 69.39013671875, -5.013862609863281, 22.404510498046875, 63.50897216796875, 23.115631103515625, 17.833023071289062, 11.63437271118164, 46.48814392089844, 31.425704956054688, 33.346466064453125, 17.05425262451172, 27.952659606933594, 22.399017333984375, 12.469573974609375, 14.604019165039062, 25.370460510253906, 18.44110107421875, 17.905075073242188, 41.994293212890625, -1.9206924438476562, 25.805313110351562, 15.740043640136719, 8.607177734375, 18.40631103515625, 6.5048370361328125, 2.827345848083496, 23.204978942871094, -7.549461364746094, 24.98015594482422, 4.1328125, 37.91151428222656, 15.84237289428711, 21.551197052001953, -31.3768310546875, 1.419097900390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000192.npy"}
{"epoch": 0.28193832599118945, "step": 193, "batch_size": 64, "mean": 14.43603515625, "std": 22.56719207763672, "min": -46.075836181640625, "p10": -11.160963821411134, "median": 16.983434677124023, "p90": 41.11897964477539, "max": 63.376434326171875, "pos_frac": 0.703125, "sample": [20.842052459716797, -11.222225189208984, 48.69054412841797, -16.359840393066406, -46.075836181640625, 7.80792236328125, 19.430252075195312, 0.20296478271484375, -0.687255859375, 26.933334350585938, 28.53563690185547, 19.84830093383789, 48.66645050048828, 24.193756103515625, 40.643577575683594, -4.910728454589844, 26.10521697998047, 17.725521087646484, 16.085037231445312, 63.376434326171875, -4.221773147583008, 38.15251159667969, 26.56353187561035, 31.980117797851562, 20.180755615234375, 21.357707977294922, 33.79174041748047, 9.449867248535156, -2.886993408203125, 33.74976348876953, -5.21160888671875, 41.322723388671875, 51.813690185546875, 10.677749633789062, -3.938140869140625, -30.945472717285156, 3.8274688720703125, 4.1829376220703125, -11.018020629882812, -3.6595306396484375, -9.977493286132812, 8.897865295410156, 17.83849334716797, 31.4349365234375, 25.03223419189453, -8.352325439453125, 18.676925659179688, -21.47686767578125, 40.63498306274414, 8.136844635009766, 0.0816497802734375, 39.918373107910156, -22.661766052246094, 16.241348266601562, 41.732303619384766, 0.06032562255859375, 35.352943420410156, 58.745948791503906, -15.231704711914062, 3.6189231872558594, 33.6732177734375, -6.7718963623046875, 35.58952331542969, -2.2886810302734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000193.npy"}
{"epoch": 0.2834067547723935, "step": 194, "batch_size": 64, "mean": 16.809913635253906, "std": 20.978618621826172, "min": -25.346832275390625, "p10": -4.425393676757812, "median": 15.344955444335938, "p90": 46.79412422180176, "max": 72.94981384277344, "pos_frac": 0.78125, "sample": [25.946224212646484, -2.8435440063476562, 31.867347717285156, 10.717147827148438, 21.589763641357422, 44.487091064453125, 0.7845306396484375, 9.649646759033203, 26.259796142578125, -11.472057342529297, 2.881450653076172, 21.616676330566406, 16.251441955566406, 24.547119140625, 4.774070739746094, 14.438468933105469, 20.794532775878906, 23.678829193115234, 22.864154815673828, 41.34272003173828, 3.2042007446289062, 7.124755859375, -23.655174255371094, -4.3949737548828125, 11.640220642089844, 21.022151947021484, -0.44646644592285156, 46.052059173583984, 2.4488601684570312, 58.60245895385742, 72.94981384277344, 47.112152099609375, 50.410667419433594, -20.393054962158203, -1.4686698913574219, -19.595176696777344, 9.082069396972656, 5.939769744873047, 18.05237579345703, 5.864270210266113, 13.579124450683594, 26.95110321044922, -25.346832275390625, 12.408050537109375, 17.042970657348633, 29.924171447753906, 41.79820251464844, 19.86656951904297, -0.5546340942382812, -4.4384307861328125, -0.8147354125976562, 23.985733032226562, 21.87645721435547, 50.898109436035156, 9.869264602661133, 62.840179443359375, -3.194000244140625, 30.317447662353516, 57.51739501953125, 5.975700378417969, 24.16088104248047, -7.30474853515625, 20.279136657714844, 8.469581604003906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000194.npy"}
{"epoch": 0.28487518355359764, "step": 195, "batch_size": 64, "mean": 21.749523162841797, "std": 23.05379867553711, "min": -35.66586685180664, "p10": -5.529186248779293, "median": 22.789731979370117, "p90": 52.9353874206543, "max": 81.21783447265625, "pos_frac": 0.84375, "sample": [27.678348541259766, 3.165435791015625, 23.125774383544922, 24.01361846923828, 35.85442352294922, 53.610321044921875, 8.687881469726562, 56.3779296875, 17.409576416015625, 2.111429214477539, 22.453689575195312, 34.15085220336914, 10.019821166992188, 33.76781463623047, 38.336090087890625, 20.816978454589844, 22.133193969726562, -2.1515121459960938, -35.66586685180664, 26.587890625, 27.50920867919922, 13.14923095703125, 4.8417816162109375, 40.827880859375, 28.966259002685547, 47.853797912597656, 57.39939880371094, 36.23570251464844, 11.43209457397461, 11.265174865722656, -21.03323745727539, 32.86256408691406, 26.434513092041016, 33.99021911621094, -7.193992614746094, -10.5638427734375, 6.128288269042969, 23.71429443359375, 7.313514709472656, 35.357696533203125, -34.831443786621094, 40.18389892578125, 23.427555084228516, 4.462028503417969, 69.94343566894531, 62.22181701660156, 4.897064208984375, 61.00059509277344, -7.499122619628906, 26.833450317382812, 13.386177062988281, -0.688232421875, 81.21783447265625, 51.36054229736328, 20.61315155029297, -6.9767608642578125, 22.068063735961914, 12.640342712402344, 38.46680450439453, 27.065269470214844, 6.702911376953125, 5.494998931884766, 42.76469421386719, -1.759817123413086], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000195.npy"}
{"epoch": 0.28634361233480177, "step": 196, "batch_size": 64, "mean": 20.915809631347656, "std": 19.226377487182617, "min": -18.797378540039062, "p10": -5.047117233276367, "median": 21.07666015625, "p90": 46.82874298095703, "max": 66.17826080322266, "pos_frac": 0.84375, "sample": [38.613277435302734, 48.82830047607422, 46.69325256347656, 36.75633239746094, 20.897293090820312, 16.03812026977539, 4.0009002685546875, 43.73370361328125, 37.987281799316406, 31.820648193359375, -0.7819976806640625, 10.506153106689453, 27.739097595214844, 31.23973846435547, 23.197845458984375, 22.014802932739258, 8.123830795288086, 28.194259643554688, -4.7172698974609375, 5.00433349609375, 13.578323364257812, -8.548017501831055, -18.797378540039062, 14.255352020263672, 22.0063419342041, 19.9632568359375, 7.357318878173828, -2.99261474609375, 29.987823486328125, 2.2600021362304688, 50.83806610107422, 17.262622833251953, 46.886810302734375, 38.58094787597656, 3.8331260681152344, 38.716697692871094, 12.342784881591797, 40.146141052246094, 6.670772552490234, 32.17829895019531, 8.597274780273438, 40.089332580566406, 51.55119705200195, -6.499990463256836, 40.21116638183594, 6.994697570800781, 13.025932312011719, 17.168304443359375, 9.012045860290527, 21.256027221679688, -7.568794250488281, -9.865657806396484, 28.217769622802734, 44.81269073486328, 47.92118835449219, 24.362220764160156, 41.199493408203125, -5.188480377197266, 0.126251220703125, 47.6024169921875, 66.17826080322266, 22.120906829833984, -6.2476806640625, 1.1186599731445312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000196.npy"}
{"epoch": 0.2878120411160059, "step": 197, "batch_size": 64, "mean": 12.843008995056152, "std": 18.127635955810547, "min": -40.982147216796875, "p10": -6.175810623168943, "median": 11.90545654296875, "p90": 30.95368041992188, "max": 57.081932067871094, "pos_frac": 0.828125, "sample": [1.92626953125, 43.180419921875, 18.701343536376953, 5.007835388183594, 6.7787322998046875, 12.069290161132812, 17.00577163696289, 13.78341293334961, 7.3128814697265625, 0.6043319702148438, 53.27454376220703, 57.081932067871094, -1.2586174011230469, 31.52593994140625, 9.289299011230469, 26.028200149536133, -18.2740478515625, 29.618408203125, 11.121589660644531, 11.080764770507812, 16.316082000732422, 24.24817657470703, 5.142459869384766, 5.767608642578125, 11.741622924804688, 5.133152008056641, 18.94713592529297, 13.1441650390625, 26.555435180664062, 14.076004028320312, -0.4434814453125, -9.691131591796875, -7.7012939453125, 25.124282836914062, 9.296661376953125, -10.957366943359375, 41.16551208496094, 40.905906677246094, 7.9071502685546875, -40.67647933959961, 0.5680351257324219, -40.982147216796875, 1.2357425689697266, 27.86260986328125, 1.1939163208007812, 25.86932373046875, 17.534393310546875, 17.027130126953125, 20.25476837158203, 28.169307708740234, -4.471790313720703, 26.64928436279297, -0.479461669921875, 12.755180358886719, 20.106605529785156, 56.04761505126953, 13.024063110351562, 7.319828033447266, 6.7850494384765625, 17.137481689453125, -6.906105041503906, 22.921966552734375, 8.967315673828125, 11.502517700195312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000197.npy"}
{"epoch": 0.28928046989721, "step": 198, "batch_size": 64, "mean": 20.13166046142578, "std": 20.8568172454834, "min": -20.946495056152344, "p10": -4.302590656280517, "median": 18.09285545349121, "p90": 47.80502548217773, "max": 91.59317016601562, "pos_frac": 0.8125, "sample": [-4.537315368652344, -5.509429931640625, 45.07661437988281, 55.86674499511719, 23.383987426757812, 12.440071105957031, 31.002899169921875, 6.816200256347656, 29.654037475585938, 16.583934783935547, 43.799072265625, -3.9181365966796875, -5.02685546875, 39.096717834472656, 29.612335205078125, -16.640785217285156, 37.12321853637695, 23.186843872070312, 19.912551879882812, 4.484649658203125, 30.030746459960938, 49.33984375, -1.8975601196289062, 32.64021301269531, 15.350473403930664, 2.625152587890625, 20.95114517211914, 9.542694091796875, 7.655250549316406, 54.243675231933594, 18.633609771728516, 3.6668853759765625, -1.933380126953125, 17.552101135253906, 0.4644012451171875, -2.528156280517578, -20.946495056152344, 4.586250305175781, 60.062355041503906, 47.5062255859375, 28.344024658203125, 47.933082580566406, 28.717506408691406, -5.506317138671875, 8.859905242919922, 12.3721923828125, 64.26249694824219, 9.738357543945312, 9.96316146850586, 15.14944076538086, -0.540191650390625, 32.10540771484375, 32.0623779296875, 21.892837524414062, 16.079456329345703, 29.955921173095703, 15.211784362792969, 27.068649291992188, -4.4673566818237305, 27.546737670898438, 22.76811981201172, 91.59317016601562, 6.776336669921875, 20.586326599121094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000198.npy"}
{"epoch": 0.2907488986784141, "step": 199, "batch_size": 64, "mean": 17.328765869140625, "std": 20.480369567871094, "min": -22.781402587890625, "p10": -6.03455467224121, "median": 18.58436679840088, "p90": 42.72649002075195, "max": 65.28776550292969, "pos_frac": 0.765625, "sample": [6.201728820800781, 24.624557495117188, -22.781402587890625, 30.500030517578125, 31.8231201171875, 31.895065307617188, -3.9952545166015625, 25.777542114257812, 20.247512817382812, 10.062713623046875, 65.28776550292969, 35.48808288574219, 1.836395263671875, -6.373870849609375, -2.5275955200195312, -16.484088897705078, -12.237560272216797, 29.544784545898438, 44.857574462890625, 35.23273849487305, -13.347267150878906, 14.150794982910156, 38.20503234863281, 12.194351196289062, -1.3216094970703125, 17.256019592285156, 0.5771560668945312, 22.43063735961914, 42.16361999511719, 42.96772003173828, 10.835533142089844, 25.65467071533203, 25.337066650390625, 57.200992584228516, -5.242816925048828, 42.03905487060547, 6.216026306152344, 3.2645263671875, -2.044872283935547, -1.6066741943359375, -5.18450927734375, 7.71356201171875, 33.36446762084961, 4.104896545410156, 62.15245056152344, 20.601272583007812, 3.4208297729492188, 2.584596633911133, 5.0963592529296875, -4.146541595458984, -11.903793334960938, 19.9127140045166, 20.96585464477539, 31.105850219726562, 41.22113037109375, 23.604507446289062, 7.331081390380859, 27.107086181640625, 21.30431365966797, -14.797019958496094, 37.03091049194336, 54.81138610839844, 43.9271240234375, 11.802703857421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000199.npy"}
{"epoch": 0.2922173274596182, "step": 200, "batch_size": 64, "mean": 20.37543296813965, "std": 24.052841186523438, "min": -28.190277099609375, "p10": -15.36745491027832, "median": 19.784912109375, "p90": 52.223716735839844, "max": 69.29779052734375, "pos_frac": 0.859375, "sample": [21.462295532226562, 65.54025268554688, 23.03751564025879, 52.53277587890625, 15.664756774902344, 2.2294692993164062, -16.732192993164062, 16.71830177307129, 58.529449462890625, -17.540546417236328, 20.56084442138672, 27.498504638671875, 5.321006774902344, 1.38427734375, 6.692525863647461, 34.515174865722656, 47.588340759277344, 62.4747314453125, 34.990318298339844, 49.13810729980469, 1.6020946502685547, 6.403257369995117, 20.665231704711914, 10.019020080566406, -23.588390350341797, 35.789527893066406, 19.00897979736328, 7.50146484375, 45.06431579589844, 3.080169677734375, 49.15482711791992, -22.027603149414062, 6.186256408691406, 16.403465270996094, 3.753580093383789, 55.347312927246094, 5.645660400390625, 34.83152770996094, 25.556480407714844, 61.94960021972656, 7.837860107421875, 51.50257873535156, 15.3687744140625, 23.42365264892578, 1.6706562042236328, 0.3964080810546875, 31.130611419677734, 20.704721450805664, 69.29779052734375, -15.404720306396484, -6.462434768676758, 44.51251220703125, -16.75640869140625, 30.690330505371094, 29.494110107421875, 4.596435546875, 47.75310516357422, 44.80274963378906, 8.041923522949219, 38.947906494140625, -15.280502319335938, 18.60607147216797, -28.190277099609375, 23.391136169433594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000200.npy"}
{"epoch": 0.2936857562408223, "step": 201, "batch_size": 64, "mean": 19.492534637451172, "std": 24.882966995239258, "min": -53.358612060546875, "p10": -8.637014007568357, "median": 17.832277297973633, "p90": 44.52776031494141, "max": 98.29296875, "pos_frac": 0.8125, "sample": [-5.4974212646484375, 20.638076782226562, 14.627891540527344, -53.358612060546875, 40.651119232177734, 35.870086669921875, 4.49513053894043, 3.3059158325195312, 7.318351745605469, 18.94757080078125, -16.746124267578125, 43.13824462890625, -9.67095947265625, 16.716983795166016, 48.102142333984375, 1.4014034271240234, 34.42158508300781, 2.237316131591797, 11.116477966308594, 27.881820678710938, 33.43122863769531, 41.145591735839844, 21.042388916015625, -2.27362060546875, 20.713546752929688, 52.996055603027344, -29.12532615661621, 72.47276306152344, -4.105754852294922, 9.518131256103516, 16.02459716796875, 30.71442413330078, 31.63060760498047, 26.86811065673828, -13.036209106445312, 26.392974853515625, 44.94548797607422, 10.89337158203125, 9.828409194946289, 33.04917907714844, 64.245849609375, 15.818840026855469, 43.553062438964844, 36.89967346191406, 3.9045028686523438, 39.36479187011719, -9.45904541015625, -5.460975646972656, 32.096282958984375, 1.8417129516601562, 65.04097747802734, 5.601310729980469, -6.718940734863281, 36.752159118652344, 26.780563354492188, 16.141586303710938, 16.238433837890625, 32.26846694946289, 1.7681999206542969, -17.42388916015625, 98.29296875, 25.743362426757812, 35.81361389160156, 9.695770263671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000201.npy"}
{"epoch": 0.29515418502202645, "step": 202, "batch_size": 64, "mean": 17.926525115966797, "std": 21.526979446411133, "min": -29.871871948242188, "p10": -4.491378402709961, "median": 17.331247329711914, "p90": 47.68553619384766, "max": 73.34463500976562, "pos_frac": 0.765625, "sample": [62.14678955078125, -0.7701339721679688, -4.442386627197266, -14.82098388671875, 1.3048038482666016, 37.25713348388672, 56.66569519042969, -3.6276378631591797, 54.96900177001953, 36.21412658691406, 20.55005645751953, 22.544525146484375, 15.538589477539062, 22.83702850341797, -4.377532958984375, 31.29212188720703, 10.945556640625, 46.76483154296875, 15.703472137451172, -6.448692321777344, 3.7401123046875, 10.967674255371094, -4.038719177246094, 27.981849670410156, 3.9807472229003906, -11.831008911132812, 31.712966918945312, 0.043689727783203125, 15.459978103637695, 26.53247833251953, 10.957977294921875, 34.422340393066406, 73.34463500976562, -11.736949920654297, 23.903457641601562, -29.871871948242188, 9.0718994140625, -4.5123748779296875, 55.797698974609375, 29.79266357421875, -0.23738861083984375, -1.9235343933105469, -6.922697067260742, 48.08012390136719, 5.612266540527344, 27.913280487060547, 18.959022521972656, 20.762680053710938, 22.306068420410156, 68.18296813964844, 2.5804481506347656, 26.639049530029297, 6.216651916503906, 0.8914871215820312, 5.2372894287109375, 26.448436737060547, 23.517452239990234, -2.4271011352539062, 37.77361297607422, 21.202835083007812, 31.838600158691406, 2.53131103515625, 43.67255401611328, 22.476604461669922], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000202.npy"}
{"epoch": 0.2966226138032305, "step": 203, "batch_size": 64, "mean": 20.671688079833984, "std": 20.7249813079834, "min": -24.259063720703125, "p10": -5.280146026611326, "median": 20.604225158691406, "p90": 43.3476547241211, "max": 74.72216796875, "pos_frac": 0.859375, "sample": [-6.18768310546875, 0.15969085693359375, 56.94652557373047, -7.7429351806640625, -18.751663208007812, 42.50163269042969, 0.7007102966308594, 35.581329345703125, 13.980234146118164, 22.35693359375, 6.21973991394043, 14.890588760375977, 29.170143127441406, 74.72216796875, 9.841203689575195, 20.92760467529297, 25.94226837158203, 6.19207763671875, 19.73657989501953, 2.645557403564453, 14.257164001464844, 48.69775390625, 3.6572418212890625, 6.853984832763672, 43.710235595703125, 4.881078720092773, 71.76676940917969, 41.246185302734375, -24.259063720703125, 24.59217071533203, 42.11772918701172, -3.1625595092773438, 45.366302490234375, 36.138099670410156, 38.98016357421875, 42.12139892578125, 54.126426696777344, 30.582603454589844, 20.280845642089844, 7.959648132324219, 19.317413330078125, 25.369720458984375, 15.487899780273438, 32.84832763671875, 5.1159820556640625, 24.294509887695312, -7.52008056640625, -16.541141510009766, 6.195365905761719, 10.13504409790039, 21.162498474121094, 29.49694061279297, 11.657012939453125, 13.526908874511719, 39.80229949951172, -3.025909423828125, 1.1030006408691406, 27.848587036132812, -7.902130126953125, 31.08380126953125, 32.50325012207031, 37.03266906738281, 37.66189956665039, 36.587345123291016], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000203.npy"}
{"epoch": 0.29809104258443464, "step": 204, "batch_size": 64, "mean": 17.66338348388672, "std": 22.85521125793457, "min": -22.218955993652344, "p10": -13.787820434570312, "median": 20.140052795410156, "p90": 45.75295181274414, "max": 86.94834899902344, "pos_frac": 0.765625, "sample": [15.734809875488281, 3.8333740234375, -6.8203582763671875, 0.4169654846191406, 22.19601058959961, 22.018152236938477, 58.545684814453125, 45.96935272216797, 17.662796020507812, -2.6369285583496094, -3.3043746948242188, 22.844757080078125, 20.495643615722656, -3.731700897216797, 29.062942504882812, 9.339874267578125, -12.789581298828125, 44.99475860595703, 52.15492248535156, 17.168455123901367, 86.94834899902344, -16.422164916992188, -11.510498046875, -9.07870864868164, 32.43858337402344, 14.399385452270508, 27.019180297851562, 62.59212112426758, 33.89707946777344, 27.49169158935547, 30.4267578125, -8.909248352050781, 6.53155517578125, 9.52203369140625, -19.697235107421875, 45.248016357421875, 25.389846801757812, -22.218955993652344, 43.55352020263672, -14.21563720703125, -21.9039306640625, 22.97162628173828, 12.6060791015625, 35.84133529663086, 2.3785247802734375, 27.430580139160156, 22.584007263183594, 23.63982391357422, 31.35431671142578, 26.073482513427734, -18.517471313476562, 20.360198974609375, 3.97015380859375, 2.5038223266601562, 17.10399627685547, 29.309494018554688, -17.766143798828125, 30.195354461669922, 16.370800018310547, 51.82908630371094, 21.454849243164062, 57.347259521484375, 16.83819007873535, 19.919906616210938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000204.npy"}
{"epoch": 0.29955947136563876, "step": 205, "batch_size": 64, "mean": 22.805147171020508, "std": 18.90988540649414, "min": -17.726791381835938, "p10": -2.9246030807495096, "median": 23.78825569152832, "p90": 43.744026947021496, "max": 74.60296630859375, "pos_frac": 0.859375, "sample": [5.4603729248046875, 34.86651611328125, 29.347442626953125, 20.561965942382812, 4.1727142333984375, 7.730873107910156, -1.039621353149414, 12.689498901367188, 40.02069091796875, 44.60009765625, -0.0295257568359375, 53.797271728515625, 10.723499298095703, 30.54631996154785, 10.164981842041016, 50.809268951416016, 22.823659896850586, 39.706024169921875, 57.46419143676758, 24.05648422241211, 11.862777709960938, 20.30968475341797, 1.4935302734375, 22.368789672851562, 34.05889129638672, 9.39508056640625, 35.30423355102539, -6.6496124267578125, 49.006507873535156, 32.50499725341797, -14.918996810913086, 24.260833740234375, -3.732452392578125, 15.095298767089844, 13.66796875, 10.249351501464844, 65.76806640625, 33.416259765625, 15.295219421386719, 23.52002716064453, -10.774600982666016, 22.385711669921875, 34.878883361816406, 16.265609741210938, 18.9705810546875, 19.947154998779297, 40.41741180419922, -4.726081848144531, 34.915809631347656, 41.74652862548828, 8.666114807128906, 33.13279724121094, 28.126827239990234, 25.026939392089844, 35.90522766113281, 74.60296630859375, 30.28398895263672, 36.80487060546875, -17.726791381835938, 27.329811096191406, -9.249580383300781, 25.278419494628906, 29.13885498046875, 27.432846069335938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000205.npy"}
{"epoch": 0.3010279001468429, "step": 206, "batch_size": 64, "mean": 21.025508880615234, "std": 18.287973403930664, "min": -19.11833953857422, "p10": -0.811692810058593, "median": 19.997833251953125, "p90": 46.4042106628418, "max": 70.36823272705078, "pos_frac": 0.890625, "sample": [17.780746459960938, 4.268463134765625, 15.495925903320312, 42.019004821777344, 47.4892578125, 47.73029327392578, 25.831871032714844, 7.6502838134765625, 6.48431396484375, 19.863189697265625, 34.09059524536133, -3.7299041748046875, 28.898597717285156, 16.328426361083984, -7.6237335205078125, 11.548431396484375, 21.967876434326172, 5.196014404296875, 5.967243194580078, 13.718893051147461, 1.6544265747070312, 14.798728942871094, 25.844635009765625, 45.980682373046875, 14.188423156738281, 3.9033203125, 7.174980163574219, 30.52362060546875, 46.45976257324219, 25.778438568115234, 34.31871032714844, -1.1821746826171875, 16.132312774658203, 15.342697143554688, 29.484424591064453, 24.897014617919922, 46.734039306640625, 26.42279815673828, 48.83238983154297, 24.280044555664062, -18.38147735595703, 32.1842041015625, -19.11833953857422, 10.125038146972656, 29.750747680664062, 21.95513916015625, -2.7334823608398438, 29.72605323791504, 0.052764892578125, 10.334911346435547, -1.8553504943847656, 37.73102569580078, 20.132476806640625, 14.423843383789062, 63.38726806640625, 43.10566711425781, 5.634922027587891, 28.011558532714844, 70.36823272705078, 26.621856689453125, 6.848243713378906, 9.304965019226074, 39.20252990722656, 46.27458953857422], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000206.npy"}
{"epoch": 0.302496328928047, "step": 207, "batch_size": 64, "mean": 22.868518829345703, "std": 28.837858200073242, "min": -34.6190185546875, "p10": -12.541234588623045, "median": 19.351612091064453, "p90": 56.4274627685547, "max": 115.88427734375, "pos_frac": 0.828125, "sample": [5.6149444580078125, 1.51068115234375, 31.3292236328125, 25.45825958251953, 33.577125549316406, -25.131755828857422, 63.82659149169922, 0.01148223876953125, -16.414627075195312, 35.885040283203125, -15.081451416015625, 4.2799224853515625, 36.066619873046875, 31.13622283935547, 1.6338653564453125, 32.42201614379883, 39.862998962402344, 50.08953857421875, 2.6076488494873047, 9.579256057739258, 3.064117431640625, 6.9875640869140625, -9.743568420410156, 9.649154663085938, 18.498210906982422, -13.740234375, 47.53803253173828, 18.521347045898438, -5.8096923828125, 13.992481231689453, 19.24163055419922, 75.85064697265625, 34.05430603027344, 14.04052734375, 41.6628303527832, 62.35334396362305, 49.87528991699219, 54.67942810058594, 19.461593627929688, -23.176589965820312, 34.49281311035156, 47.736324310302734, 35.26362609863281, 41.24555969238281, 41.8564453125, 8.565895080566406, 3.36175537109375, 35.638328552246094, 57.17662048339844, 40.704437255859375, 2.3801040649414062, 41.916526794433594, -16.780181884765625, 27.187522888183594, 98.26754760742188, -34.6190185546875, 3.3761730194091797, 2.2513275146484375, -2.313262939453125, 115.88427734375, 2.9581375122070312, 68.35592651367188, -0.040802001953125, 23.45501708984375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000207.npy"}
{"epoch": 0.3039647577092511, "step": 208, "batch_size": 64, "mean": 23.85171890258789, "std": 22.0360107421875, "min": -50.53094482421875, "p10": 1.5028705596923837, "median": 21.71733856201172, "p90": 52.88587112426759, "max": 84.93896484375, "pos_frac": 0.90625, "sample": [12.099296569824219, 7.333759307861328, 17.706809997558594, 12.209693908691406, 18.959552764892578, -5.100944519042969, 50.81935119628906, 3.56707763671875, 6.287258148193359, 53.771522521972656, 31.329566955566406, 41.830055236816406, 19.80042266845703, 29.787874221801758, 34.605567932128906, 22.289138793945312, 2.7479095458984375, -2.6603050231933594, 23.402359008789062, 45.278602600097656, 40.09239196777344, 27.43209457397461, 42.18168640136719, 16.669403076171875, 6.3723602294921875, 25.73987579345703, 58.06266784667969, 21.145538330078125, 47.25616455078125, 59.81781005859375, -7.452571868896484, 1.12359619140625, 9.087509155273438, 28.490394592285156, 41.87504959106445, 58.58891296386719, 10.353126525878906, 18.40460205078125, 10.483306884765625, 17.808944702148438, 84.93896484375, 2.3878440856933594, 42.93238830566406, 8.54638671875, 3.972179412841797, 40.65637969970703, 33.19304656982422, 59.79986572265625, -50.53094482421875, 54.719322204589844, -10.639678955078125, 10.443206787109375, 46.87792205810547, 8.814300537109375, 30.920433044433594, 33.73607635498047, 14.156166076660156, 22.457839965820312, 49.24540710449219, 13.37344741821289, 30.945903778076172, 16.196609497070312, 25.51714324951172, -5.747611999511719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000208.npy"}
{"epoch": 0.3054331864904552, "step": 209, "batch_size": 64, "mean": 20.891002655029297, "std": 23.672510147094727, "min": -24.332435607910156, "p10": -10.941960716247557, "median": 17.38774871826172, "p90": 51.68821411132812, "max": 76.26289367675781, "pos_frac": 0.84375, "sample": [20.176666259765625, 12.46933364868164, 61.041847229003906, 5.0208740234375, 57.79974365234375, 76.26289367675781, 10.617027282714844, -9.186098098754883, 51.75531768798828, 22.082481384277344, 32.738433837890625, 10.126441955566406, 41.9710807800293, 11.92608642578125, 46.976131439208984, 17.56432342529297, 60.85295867919922, 11.989143371582031, 11.740753173828125, 49.7561149597168, 21.2801513671875, 18.95232391357422, 4.166108131408691, 15.052680969238281, 17.21117401123047, -24.332435607910156, -14.427911758422852, 39.11399841308594, 20.175621032714844, 2.4521331787109375, 29.550674438476562, 43.54331970214844, 6.003959655761719, 5.541515350341797, 5.128929138183594, 47.168487548828125, -18.405363082885742, 20.367111206054688, 32.509613037109375, 64.89398193359375, 0.8435211181640625, -0.53717041015625, 8.493345260620117, 6.448265075683594, -20.503936767578125, 27.194595336914062, 41.23796081542969, -15.364601135253906, 51.531639099121094, 7.855876922607422, 20.549293518066406, 11.648086547851562, 20.306304931640625, -16.042335510253906, 47.39927673339844, 50.94342041015625, 44.15744400024414, 11.585472106933594, 37.61387634277344, -11.694473266601562, 16.582763671875, 61.15410614013672, 2.8880462646484375, -6.8941802978515625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000209.npy"}
{"epoch": 0.3069016152716593, "step": 210, "batch_size": 64, "mean": 20.090076446533203, "std": 22.747663497924805, "min": -19.3221435546875, "p10": -2.5382413864135716, "median": 13.077983856201172, "p90": 56.79489860534668, "max": 77.53533935546875, "pos_frac": 0.890625, "sample": [6.0854339599609375, 12.122764587402344, 57.16663360595703, 43.413658142089844, 5.4532623291015625, 2.6028900146484375, 22.67504119873047, 1.112360954284668, 9.571548461914062, -5.156196594238281, 61.484519958496094, 55.92751693725586, 4.811166763305664, 7.896121978759766, 49.03998947143555, -16.39806365966797, 4.253173828125, 37.26446533203125, 52.622169494628906, 13.217674255371094, 45.636314392089844, 11.81617546081543, 3.7726211547851562, 33.072486877441406, 0.5354766845703125, 6.84276008605957, 10.644247055053711, -18.928298950195312, 6.981414794921875, 23.023468017578125, 17.436168670654297, 61.305503845214844, -19.3221435546875, 40.287567138671875, 18.750274658203125, 7.40887451171875, 44.06829071044922, 0.9378890991210938, 11.122753143310547, -10.009462356567383, 23.346786499023438, 17.491424560546875, 2.4090423583984375, -13.24383544921875, 11.390373229980469, 61.04017639160156, 60.61457824707031, 0.10446929931640625, 21.03862762451172, -3.6708316802978516, 57.710899353027344, 77.53533935546875, 37.54947280883789, 37.038818359375, 29.444839477539062, 14.152290344238281, 21.628585815429688, 0.592315673828125, 1.4761571884155273, 12.93829345703125, 22.307167053222656, 7.2725830078125, 19.294677734375, 45.754058837890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000210.npy"}
{"epoch": 0.30837004405286345, "step": 211, "batch_size": 64, "mean": 19.919384002685547, "std": 23.884937286376953, "min": -27.365554809570312, "p10": -11.058187103271484, "median": 21.524468421936035, "p90": 49.11107025146485, "max": 106.99456787109375, "pos_frac": 0.796875, "sample": [31.513492584228516, 12.542657852172852, 35.709075927734375, -13.730415344238281, 38.20658874511719, 22.783058166503906, 44.02561950683594, 50.26185607910156, 74.71073913574219, 18.226058959960938, 28.296966552734375, -14.339971542358398, 7.3821563720703125, 30.320098876953125, -0.966033935546875, 59.18060302734375, 50.21974182128906, 4.129913330078125, 44.102561950683594, -22.025314331054688, 9.162546157836914, -27.365554809570312, -0.1894073486328125, 32.473304748535156, 25.582183837890625, -8.838775634765625, -11.118797302246094, 42.376373291015625, 0.9793548583984375, 30.119415283203125, 106.99456787109375, 22.420181274414062, 24.782958984375, 26.558738708496094, 50.147438049316406, 29.60943603515625, 8.8173828125, 34.86820983886719, 10.473800659179688, 33.42820739746094, 20.647624969482422, 22.426101684570312, 23.824440002441406, 8.595378875732422, 2.4990158081054688, 46.69287872314453, 18.117502212524414, 22.250667572021484, 1.9462604522705078, 25.513248443603516, -10.916763305664062, -17.260635375976562, -7.875267028808594, 8.0208740234375, 50.701263427734375, 14.021011352539062, 22.845787048339844, 14.606452941894531, -11.774103164672852, 20.798269271850586, 6.413566589355469, 43.23683166503906, -1.6065673828125, 9.285675048828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000211.npy"}
{"epoch": 0.30983847283406757, "step": 212, "batch_size": 64, "mean": 28.25250244140625, "std": 25.730186462402344, "min": -30.383514404296875, "p10": 0.5755126953125012, "median": 24.215595245361328, "p90": 64.45066528320314, "max": 98.38102722167969, "pos_frac": 0.90625, "sample": [21.493927001953125, 3.1771163940429688, 98.38102722167969, 78.24876403808594, 23.563186645507812, 15.366264343261719, -2.160064697265625, 5.193672180175781, 36.839942932128906, 9.037567138671875, 42.110595703125, -30.383514404296875, -2.5453109741210938, -8.240478515625, 21.541168212890625, 38.85346984863281, 59.473541259765625, 62.870452880859375, 89.139404296875, 43.298919677734375, 0.1140594482421875, 1.6522369384765625, 18.032852172851562, 30.062042236328125, 27.550643920898438, 60.185997009277344, 77.38976287841797, 3.9444961547851562, 34.775604248046875, 3.073028564453125, 24.868003845214844, 11.115711212158203, 21.37432861328125, 54.33973693847656, 12.962041854858398, 20.91765594482422, 33.78044128417969, 18.043716430664062, 38.776737213134766, 26.433807373046875, 33.11915588378906, 54.32904052734375, 23.045133590698242, 65.12789916992188, 36.338775634765625, 19.815170288085938, 8.567760467529297, -5.01788330078125, 67.03697204589844, -17.521228790283203, 27.015411376953125, 22.69366455078125, 26.07098388671875, 8.772689819335938, 31.626956939697266, 17.14923858642578, 37.73765563964844, 45.014896392822266, 30.779579162597656, 43.91573715209961, 7.00482177734375, 13.332775115966797, 8.515472412109375, 79.03704833984375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000212.npy"}
{"epoch": 0.31130690161527164, "step": 213, "batch_size": 64, "mean": 22.059898376464844, "std": 25.25223159790039, "min": -48.88848876953125, "p10": -5.426029586791992, "median": 22.655517578125, "p90": 53.62327270507814, "max": 88.3990478515625, "pos_frac": 0.828125, "sample": [40.511131286621094, 1.8199310302734375, 14.279228210449219, 40.97309112548828, 13.695304870605469, 18.21002197265625, 1.299407958984375, 57.44671630859375, 0.5818328857421875, 38.643035888671875, -2.5479736328125, 39.50830078125, 29.691482543945312, 5.74205207824707, 43.197689056396484, 27.348072052001953, -3.349353790283203, -5.484203338623047, 59.44959259033203, 80.33123779296875, 49.48182678222656, 22.708106994628906, 18.854583740234375, 65.46331024169922, 59.91912841796875, 23.94719696044922, 7.742645263671875, -22.3408203125, 15.868057250976562, -11.543464660644531, 9.804603576660156, 18.4366455078125, 25.607154846191406, 1.9251556396484375, 35.920745849609375, 28.821670532226562, 20.56127166748047, 34.647491455078125, 24.548614501953125, 22.602928161621094, 27.162246704101562, -10.720779418945312, 48.236122131347656, -37.70184326171875, -5.290290832519531, 28.683883666992188, 31.681255340576172, 88.3990478515625, -48.88848876953125, 44.32037353515625, 19.319381713867188, 55.39817810058594, 24.002700805664062, -0.15048599243164062, 7.366081237792969, -6.266138076782227, 45.87022399902344, 1.4835662841796875, 11.849050521850586, 17.235687255859375, 29.57651138305664, 7.240474700927734, 36.217655181884766, 42.48567199707031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000213.npy"}
{"epoch": 0.31277533039647576, "step": 214, "batch_size": 64, "mean": 20.002634048461914, "std": 28.418048858642578, "min": -40.49021530151367, "p10": -13.362104034423822, "median": 16.619998931884766, "p90": 61.71401748657227, "max": 110.71644592285156, "pos_frac": 0.796875, "sample": [28.026504516601562, 63.83417510986328, 2.8809280395507812, 3.6032562255859375, 34.96324920654297, -23.430105209350586, 4.000083923339844, -23.401168823242188, 23.85955810546875, 23.728755950927734, -20.364303588867188, 16.75318145751953, 4.772558212280273, -2.771219253540039, 44.25165557861328, 9.100669860839844, -0.7163848876953125, 14.20534896850586, 35.31840515136719, 45.238914489746094, 13.364738464355469, 18.470169067382812, 27.482521057128906, 10.670799255371094, 34.56169509887695, 44.44715118408203, 41.95532989501953, 3.6759090423583984, 15.477874755859375, -32.054847717285156, 36.93094253540039, 61.272239685058594, 23.611129760742188, 69.01480865478516, 8.60797119140625, 70.81011962890625, 73.75169372558594, 8.5404052734375, 28.790252685546875, 22.1727294921875, 28.5548095703125, 1.2244796752929688, 36.49425506591797, 110.71644592285156, -40.49021530151367, 70.13009643554688, 18.51667022705078, 6.533805847167969, 15.3580322265625, -4.8518524169921875, 16.48681640625, 30.131210327148438, 9.467609405517578, -1.4692764282226562, 2.967864990234375, -30.364723205566406, 20.154857635498047, 51.12525177001953, 41.08349609375, 2.024505615234375, -7.572059631347656, 61.903350830078125, -7.520963668823242, -15.843551635742188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000214.npy"}
{"epoch": 0.3142437591776799, "step": 215, "batch_size": 64, "mean": 26.492958068847656, "std": 24.538461685180664, "min": -13.222423553466797, "p10": -3.5983047485351554, "median": 21.575857162475586, "p90": 57.76095428466797, "max": 94.91761016845703, "pos_frac": 0.875, "sample": [40.27555847167969, 46.23943328857422, 12.040306091308594, 34.443382263183594, 13.375785827636719, 43.00494384765625, -13.222423553466797, 26.493431091308594, 36.02052307128906, 46.587242126464844, 94.91761016845703, 38.59735107421875, 33.98805236816406, 32.22245788574219, 57.96199035644531, 38.55082702636719, 8.338508605957031, 19.282981872558594, 93.35804748535156, 51.352840423583984, 1.3201560974121094, 57.2918701171875, 84.991943359375, 25.559799194335938, 20.585708618164062, -4.601112365722656, -4.530864715576172, 10.178497314453125, 49.99126434326172, 20.495468139648438, 9.820594787597656, 18.764278411865234, -2.9353256225585938, -5.414775848388672, 23.871604919433594, 19.243804931640625, -5.130775451660156, 36.07981872558594, 34.78092956542969, 17.267715454101562, -6.4730682373046875, 22.376785278320312, 65.60725402832031, 51.40086364746094, 44.03679275512695, 20.140426635742188, 61.68720245361328, 3.7654762268066406, 23.563858032226562, 70.33882141113281, 24.890380859375, 20.77492904663086, 32.420562744140625, 1.6338386535644531, 3.7475128173828125, 8.13177490234375, 8.804473876953125, 42.086265563964844, -3.8824386596679688, 12.608530044555664, 2.2188282012939453, 19.065818786621094, 1.5177879333496094, 3.62713623046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000215.npy"}
{"epoch": 0.315712187958884, "step": 216, "batch_size": 64, "mean": 22.996862411499023, "std": 23.500591278076172, "min": -23.721832275390625, "p10": -1.4813564300537108, "median": 19.25001335144043, "p90": 51.45785484313965, "max": 112.11553192138672, "pos_frac": 0.828125, "sample": [18.872413635253906, 37.81712341308594, 0.9099044799804688, 31.013839721679688, 0.78521728515625, 8.935546875, 36.527252197265625, 19.292224884033203, 36.22417449951172, 5.531455993652344, 32.2525634765625, 4.56707763671875, 27.65154266357422, -0.46044158935546875, 37.072532653808594, 29.129058837890625, -12.245231628417969, 56.90452575683594, 21.474353790283203, -23.721832275390625, -0.6513595581054688, 65.16891479492188, 13.98367691040039, 30.8785400390625, 50.520591735839844, 12.482559204101562, 44.99961853027344, 51.68214416503906, 59.48332214355469, 4.747234344482422, 47.36919403076172, 41.66779708862305, -4.732203483581543, 18.915573120117188, 24.49407196044922, 14.687217712402344, 8.512405395507812, 42.205238342285156, 6.020759582519531, -1.5242271423339844, 9.049564361572266, 6.447441101074219, -4.340568542480469, 20.5887451171875, 58.019710540771484, 20.144746780395508, 50.934513092041016, 29.362350463867188, -2.700531005859375, 47.91582489013672, 5.068389892578125, 19.207801818847656, -1.2376861572265625, 15.06509780883789, 13.962753295898438, 112.11553192138672, 39.122772216796875, 21.354888916015625, 64.79024505615234, 41.151947021484375, -1.654541015625, -1.3813247680664062, 2.3202857971191406, 7.046852111816406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000216.npy"}
{"epoch": 0.31718061674008813, "step": 217, "batch_size": 64, "mean": 19.994403839111328, "std": 25.955808639526367, "min": -31.211395263671875, "p10": -14.209741210937496, "median": 17.99483299255371, "p90": 57.36560821533203, "max": 92.82693481445312, "pos_frac": 0.8125, "sample": [61.112060546875, 35.6738395690918, 27.449554443359375, -18.320539474487305, 4.092166900634766, 30.16291046142578, 34.2539176940918, 12.22650146484375, 21.133888244628906, 39.2044677734375, 46.41996765136719, 63.50785827636719, 25.824073791503906, 72.5619888305664, 26.68161392211914, -20.809951782226562, 17.26120376586914, -15.82330322265625, 35.34422302246094, 92.82693481445312, -6.25189208984375, 3.132274627685547, 28.388992309570312, 16.340408325195312, -1.47039794921875, 38.804771423339844, 1.8120040893554688, -20.81198501586914, -10.44476318359375, 90.53541564941406, 61.06236267089844, 14.758415222167969, -19.29071044921875, 8.525505065917969, 56.748291015625, 19.697994232177734, 20.974960327148438, 10.144485473632812, -31.211395263671875, 34.835601806640625, 47.406768798828125, 18.632232666015625, 57.63017272949219, 13.215911865234375, 20.831207275390625, 20.266395568847656, 33.31629943847656, 12.692962646484375, 22.486492156982422, 18.97175407409668, -24.346893310546875, 24.1929931640625, 9.02386474609375, 17.357433319091797, 38.108238220214844, 7.3071746826171875, 0.6947784423828125, 5.619787216186523, 7.4953155517578125, 5.6876068115234375, 16.984657287597656, 5.070098876953125, -2.6746444702148438, -3.3924922943115234], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000217.npy"}
{"epoch": 0.3186490455212922, "step": 218, "batch_size": 64, "mean": 23.46440887451172, "std": 27.954572677612305, "min": -50.79789733886719, "p10": -7.976892852783203, "median": 24.25029754638672, "p90": 57.301823425292966, "max": 100.52725219726562, "pos_frac": 0.828125, "sample": [29.051483154296875, 42.81171417236328, 58.990318298339844, 18.02878189086914, 48.150390625, 5.311534881591797, 57.31632995605469, 35.26350402832031, 11.23675537109375, -2.6969833374023438, 28.08108901977539, 23.064666748046875, -10.990310668945312, 25.649024963378906, 36.9908447265625, 7.3465576171875, -25.417816162109375, 7.774909973144531, 38.46461486816406, 31.03925323486328, 12.02667236328125, 34.336029052734375, 27.0233154296875, -41.84617614746094, 6.661521911621094, -7.787147521972656, 13.731704711914062, 47.86211395263672, 46.415863037109375, 73.71808624267578, 43.76982116699219, 38.287445068359375, 75.09417724609375, 11.884796142578125, 57.267974853515625, 39.988319396972656, 43.25910186767578, -0.8543739318847656, 28.740406036376953, 12.983833312988281, 31.214542388916016, 1.5039329528808594, 32.940608978271484, 18.808090209960938, 10.507911682128906, -14.510581970214844, 100.52725219726562, 71.091796875, -15.06900405883789, 25.435928344726562, 7.4026947021484375, 39.85942077636719, 41.941650390625, 18.234416961669922, 5.946998596191406, 44.95447540283203, 80.66484832763672, -3.826873779296875, 18.16338348388672, -50.79789733886719, 2.683624267578125, 2.6458282470703125, -8.058212280273438, 11.427207946777344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000218.npy"}
{"epoch": 0.3201174743024963, "step": 219, "batch_size": 64, "mean": 21.319698333740234, "std": 28.959598541259766, "min": -69.66876220703125, "p10": -4.755837631225585, "median": 15.903549194335938, "p90": 60.04439353942872, "max": 100.68206787109375, "pos_frac": 0.828125, "sample": [45.227081298828125, 37.45948791503906, 34.31068801879883, 60.75254821777344, 24.7630672454834, 22.526275634765625, -69.66876220703125, 7.0349273681640625, 16.07818603515625, 61.90985107421875, 37.04456329345703, 5.140813827514648, 5.044715881347656, 82.096435546875, 93.80503845214844, 13.530834197998047, 3.4687252044677734, 49.39734649658203, -0.8662185668945312, 58.392032623291016, 40.55634307861328, 5.4547576904296875, -3.9401473999023438, 28.93889617919922, 29.859230041503906, -9.541603088378906, 43.87992858886719, 11.408485412597656, 14.491203308105469, 14.966972351074219, 42.07927703857422, 100.68206787109375, -6.8862152099609375, 0.5129356384277344, -14.002944946289062, 9.339347839355469, 39.60418701171875, 5.161613464355469, 15.728912353515625, 64.22608947753906, 35.33496856689453, 0.470703125, -2.2470932006835938, 17.57110595703125, 72.10223388671875, 19.81039047241211, 8.71090316772461, -5.105419158935547, 8.308675765991211, 40.05455780029297, -37.735504150390625, 37.47039794921875, 4.088356018066406, 5.1540069580078125, -23.5958251953125, 27.58791732788086, 0.16184616088867188, 27.104080200195312, 29.756553649902344, 14.746246337890625, 18.86279296875, 42.154937744140625, 5.150749206542969, -1.4239044189453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000219.npy"}
{"epoch": 0.32158590308370044, "step": 220, "batch_size": 64, "mean": 19.699235916137695, "std": 21.965740203857422, "min": -21.454265594482422, "p10": -10.20908851623535, "median": 21.710026741027832, "p90": 49.502929306030275, "max": 74.69232177734375, "pos_frac": 0.8125, "sample": [-16.239181518554688, 13.070003509521484, 13.687118530273438, -10.618602752685547, 64.94384765625, 56.700401306152344, 22.505844116210938, 6.324893951416016, -9.253555297851562, 42.8465576171875, 21.904441833496094, 0.126373291015625, 48.74324035644531, 27.060962677001953, 49.82851028442383, 34.992919921875, 15.948745727539062, -12.821660995483398, 47.686676025390625, 61.42564392089844, 74.69232177734375, 6.862424850463867, 50.997344970703125, 29.11151123046875, 1.597503662109375, 24.618942260742188, 30.33456802368164, 6.0581512451171875, -12.689693450927734, 10.490699768066406, 53.101707458496094, -13.479591369628906, 2.4467811584472656, -0.334716796875, 34.273529052734375, 28.115222930908203, 12.908737182617188, 5.58074951171875, 2.4042892456054688, 26.729904174804688, -2.469778060913086, 33.351261138916016, 21.5698184967041, -11.688079833984375, 5.058811187744141, 0.9767951965332031, 28.181304931640625, 27.423248291015625, 16.309452056884766, -1.9074325561523438, -3.5384368896484375, 45.62804412841797, 6.140449523925781, 21.850234985351562, -21.454265594482422, 27.220577239990234, 38.06708526611328, 33.153350830078125, 37.003692626953125, 33.822723388671875, 37.14588928222656, 3.2226219177246094, 25.0894775390625, 7.910671234130859], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000220.npy"}
{"epoch": 0.32305433186490456, "step": 221, "batch_size": 64, "mean": 29.375770568847656, "std": 26.48685073852539, "min": -16.78752899169922, "p10": -4.494091796874995, "median": 23.882125854492188, "p90": 66.53687210083008, "max": 101.6631088256836, "pos_frac": 0.890625, "sample": [2.5484771728515625, -9.320327758789062, -7.504035949707031, 8.81167984008789, 32.298500061035156, 67.84552001953125, 28.480056762695312, 24.270965576171875, 44.657501220703125, 101.6631088256836, 49.52727508544922, -12.034690856933594, 31.387866973876953, 57.44732666015625, 35.649349212646484, 12.783775329589844, 49.457000732421875, 42.74101257324219, 17.810508728027344, 53.63584899902344, 51.57330322265625, 0.545745849609375, 2.8622970581054688, 13.529533386230469, 22.306610107421875, 81.49727630615234, 49.85952377319336, 16.011016845703125, 12.881309509277344, -8.423141479492188, 48.81343078613281, 67.7426528930664, 26.344024658203125, 37.12938690185547, 10.06744384765625, 39.02647399902344, 13.930793762207031, 25.844127655029297, 24.841754913330078, 23.4932861328125, 21.17743682861328, 96.25885009765625, 79.45677185058594, 21.323623657226562, 21.936901092529297, 6.6176605224609375, 43.948936462402344, 48.04142761230469, 57.85016632080078, 26.485916137695312, 23.397865295410156, -9.473712921142578, 7.696319580078125, 4.3777618408203125, 21.615982055664062, 16.238746643066406, -16.78752899169922, 48.49153137207031, 21.338577270507812, -6.654022216796875, 21.951499938964844, 0.7458858489990234, 67.35791015625, 64.6211166381836], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000221.npy"}
{"epoch": 0.3245227606461087, "step": 222, "batch_size": 64, "mean": 24.117347717285156, "std": 32.253292083740234, "min": -67.994140625, "p10": -10.512348175048823, "median": 21.25606918334961, "p90": 64.72590408325198, "max": 111.83889770507812, "pos_frac": 0.796875, "sample": [6.9180908203125, 46.96307373046875, 20.415023803710938, 16.61557388305664, -15.661483764648438, 26.214141845703125, -5.457305908203125, 38.66059875488281, -67.994140625, 36.32569885253906, 31.611297607421875, -0.11597061157226562, 103.46990966796875, 55.40159225463867, 11.651176452636719, 67.71930694580078, 17.581939697265625, 12.567611694335938, 50.82139587402344, 42.43095016479492, 11.259368896484375, 13.04730224609375, -54.479644775390625, 55.09495544433594, 3.3614501953125, 19.04885482788086, 29.137298583984375, -12.678794860839844, 29.776084899902344, 26.931468963623047, 32.41404724121094, 20.39275360107422, 37.854705810546875, 8.650932312011719, -33.76686096191406, 17.353622436523438, -0.4506645202636719, 24.282875061035156, 2.251728057861328, 49.550048828125, 37.77984619140625, 17.241989135742188, 27.325817108154297, -35.94807434082031, 72.46980285644531, 12.036178588867188, 22.09711456298828, 48.85529327392578, 15.911750793457031, 6.096736907958984, 20.314224243164062, 44.3958740234375, 36.54316711425781, 70.96430206298828, 59.06878662109375, -13.85675048828125, 67.15038299560547, -3.082977294921875, -2.3317489624023438, -5.040351867675781, 111.83889770507812, 52.270355224609375, 77.134033203125, 29.105621337890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000222.npy"}
{"epoch": 0.32599118942731276, "step": 223, "batch_size": 64, "mean": 18.32587432861328, "std": 26.04753875732422, "min": -51.35015869140625, "p10": -11.631307983398436, "median": 16.440675735473633, "p90": 51.774182128906254, "max": 102.4132080078125, "pos_frac": 0.78125, "sample": [17.823097229003906, -9.461647033691406, 14.990501403808594, -5.5774688720703125, -1.6913070678710938, -10.7772216796875, 27.06243133544922, 17.983442306518555, 18.23452377319336, -25.832862854003906, -21.03006362915039, 32.12962341308594, 13.598358154296875, 12.445281982421875, 21.182357788085938, 16.28234100341797, 13.338462829589844, 21.405302047729492, 49.6832275390625, 6.934574127197266, 39.108489990234375, -23.25189208984375, 16.599010467529297, -51.35015869140625, -18.074363708496094, 55.850318908691406, -4.772071838378906, 42.5391845703125, 53.698699951171875, 2.1094589233398438, 18.54854965209961, 26.150943756103516, 18.971176147460938, 41.964622497558594, 46.312530517578125, 45.283538818359375, -11.997344970703125, 17.21303939819336, 13.489280700683594, 102.4132080078125, 39.26960754394531, -18.172222137451172, 29.497867584228516, 38.78584289550781, 50.439849853515625, -5.327606201171875, 5.31378173828125, 5.630767822265625, 35.02617645263672, 57.71639633178711, 4.625118255615234, 3.439708709716797, 12.943840026855469, 60.848663330078125, -2.7193336486816406, 59.11622619628906, 1.0181655883789062, 1.7674198150634766, 9.773086547851562, 8.326042175292969, 32.14854431152344, 44.21722412109375, 7.295539855957031, 52.346038818359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000223.npy"}
{"epoch": 0.3274596182085169, "step": 224, "batch_size": 64, "mean": 24.111446380615234, "std": 27.22838592529297, "min": -35.96806335449219, "p10": -12.475389099121093, "median": 21.595553398132324, "p90": 53.622992324829106, "max": 108.47079467773438, "pos_frac": 0.828125, "sample": [9.352294921875, -35.96806335449219, 35.37550354003906, 8.237838745117188, 2.217010498046875, 80.42682647705078, 8.108963012695312, 43.00930404663086, 15.150497436523438, 31.0003662109375, 22.88300132751465, 59.608909606933594, 38.081268310546875, 39.311187744140625, 44.11137390136719, -12.01748275756836, 18.114791870117188, 12.438810348510742, 53.90337371826172, 45.86809539794922, 49.50066375732422, 35.16156768798828, -16.986373901367188, 19.415878295898438, -5.35894775390625, 41.68412780761719, 9.560462951660156, 32.52181625366211, 35.60614013671875, -23.574825286865234, -4.06884765625, -15.905807495117188, 27.251331329345703, 108.47079467773438, 9.430450439453125, -18.938461303710938, 28.610755920410156, -21.732810974121094, 26.82199478149414, 10.973217010498047, 52.96876907348633, 40.788818359375, 12.129791259765625, 1.1231050491333008, 14.75115966796875, 25.69602394104004, -12.671634674072266, 18.53699493408203, 19.37972640991211, 17.789249420166016, 35.498435974121094, 18.845054626464844, 74.22222900390625, 40.683990478515625, -7.587154388427734, 16.168731689453125, 40.44300842285156, 20.30810546875, 10.19124984741211, 37.25996398925781, 37.553096771240234, 57.34181213378906, 89.8635025024414, 34.191654205322266], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000224.npy"}
{"epoch": 0.328928046989721, "step": 225, "batch_size": 64, "mean": 26.28819465637207, "std": 30.87232780456543, "min": -52.67084884643555, "p10": -4.649702072143554, "median": 22.78314781188965, "p90": 66.945516204834, "max": 129.70706176757812, "pos_frac": 0.8125, "sample": [18.975914001464844, 97.12249755859375, 14.262886047363281, 22.942554473876953, 47.277713775634766, 20.59835433959961, 4.5350189208984375, 28.01678466796875, -9.60748291015625, 42.07923889160156, 19.308929443359375, 34.98724365234375, -43.780181884765625, 9.882110595703125, 26.168716430664062, 63.892784118652344, -52.67084884643555, -4.116458892822266, -3.412109375, 15.325111389160156, 10.056991577148438, 71.1536636352539, 69.74856567382812, 77.12208557128906, -2.0974292755126953, 9.770790100097656, 88.03837585449219, 38.6121826171875, 59.33139419555664, 29.12762451171875, 14.969596862792969, 14.953495025634766, 16.785552978515625, 7.862937927246094, -4.87823486328125, 49.1756591796875, 35.39459228515625, 10.201377868652344, 3.1935348510742188, 32.99468231201172, 32.516082763671875, 22.623741149902344, 26.047386169433594, 45.09706497192383, 63.486045837402344, 22.606300354003906, 129.70706176757812, 68.25382995605469, 30.588150024414062, 35.40849304199219, 37.420745849609375, 22.335105895996094, -9.207931518554688, -0.7694091796875, -21.433002471923828, 50.720428466796875, 20.139236450195312, 38.99059295654297, 8.866046905517578, 35.90234375, -2.8639907836914062, 25.408554077148438, -13.4466552734375, 30.74200439453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000225.npy"}
{"epoch": 0.3303964757709251, "step": 226, "batch_size": 64, "mean": 24.35424041748047, "std": 24.587326049804688, "min": -19.69574737548828, "p10": -2.5485771179199217, "median": 19.789257049560547, "p90": 57.37981262207032, "max": 97.76974487304688, "pos_frac": 0.859375, "sample": [97.76974487304688, 17.64654541015625, -7.339775085449219, 74.72000122070312, 15.443622589111328, -2.61907958984375, 13.164764404296875, 58.24421691894531, 13.129486083984375, 11.921428680419922, 41.909210205078125, 37.96955871582031, 0.8106613159179688, 43.20817184448242, 11.662391662597656, 5.199762344360352, 39.54689025878906, 3.0267105102539062, 36.173099517822266, 11.075950622558594, 55.36286926269531, 45.22465515136719, 12.071523666381836, 26.529403686523438, 17.982383728027344, 3.4408416748046875, 18.885902404785156, 23.731231689453125, -19.69574737548828, -19.372238159179688, -1.448638916015625, 47.58718490600586, 46.2786865234375, 31.15407943725586, 28.945114135742188, 28.547271728515625, 47.39186096191406, 23.252227783203125, 13.90545654296875, 9.744888305664062, 30.703102111816406, 2.8164291381835938, 5.149326324462891, -2.3840713500976562, 64.12062072753906, 6.156730651855469, 31.190628051757812, 20.692611694335938, -8.495004653930664, 36.047943115234375, 50.93025207519531, -15.562202453613281, 30.999923706054688, 29.01795196533203, 1.0518074035644531, 68.15451049804688, 17.3817138671875, 7.624553680419922, 72.62063598632812, 11.714132308959961, 39.698211669921875, -11.362503051757812, 63.53459167480469, 44.68724060058594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000226.npy"}
{"epoch": 0.33186490455212925, "step": 227, "batch_size": 64, "mean": 24.84981346130371, "std": 29.821680068969727, "min": -37.983985900878906, "p10": -10.066793823242188, "median": 19.222179412841797, "p90": 62.33704071044922, "max": 95.5047607421875, "pos_frac": 0.78125, "sample": [19.573883056640625, 11.793006896972656, 10.25750732421875, 57.851715087890625, 57.10685729980469, 12.63058090209961, 51.11283493041992, 36.68132400512695, 40.21502685546875, 19.37499237060547, 6.517093658447266, 81.31050872802734, -10.038040161132812, 10.405492782592773, -4.890079498291016, 39.77873229980469, -8.75836181640625, 37.90015411376953, 55.891845703125, 95.5047607421875, 3.1647262573242188, 25.916717529296875, 44.45044708251953, 16.614608764648438, 11.304927825927734, -19.678878784179688, 53.814613342285156, -1.104461669921875, 13.679946899414062, 19.069366455078125, 57.740814208984375, 56.48152160644531, 33.671142578125, -7.896663665771484, -21.833297729492188, -19.528045654296875, 14.968437194824219, -8.021331787109375, 66.39120483398438, -37.983985900878906, 44.001346588134766, 61.92710876464844, -12.605720520019531, 69.43228149414062, 5.592796325683594, 20.86383056640625, 55.3028564453125, 6.712745666503906, 57.11750793457031, 19.701215744018555, 18.322093963623047, 67.21946716308594, 62.512725830078125, -33.53765869140625, -6.132116317749023, 43.02471160888672, 54.5179443359375, -10.079116821289062, 11.732597351074219, 18.427078247070312, 27.09005355834961, 15.520208358764648, 1.7454185485839844, 70.53701782226562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000227.npy"}
{"epoch": 0.3333333333333333, "step": 228, "batch_size": 64, "mean": 19.56426239013672, "std": 25.83993148803711, "min": -41.250709533691406, "p10": -12.36680221557617, "median": 19.17197036743164, "p90": 46.49508438110352, "max": 72.59910583496094, "pos_frac": 0.8125, "sample": [-12.806060791015625, -28.654327392578125, 36.21086120605469, 67.08970642089844, -34.47601318359375, 65.68647766113281, 0.9890670776367188, 12.152313232421875, 27.122573852539062, -2.0356903076171875, 41.537750244140625, 45.11749267578125, 42.55816650390625, 46.50849914550781, 22.83153533935547, 17.360504150390625, 61.88258361816406, -41.250709533691406, 13.498983383178711, 18.127315521240234, 4.536964416503906, 2.5253753662109375, 3.699920654296875, 62.95670700073242, 19.912353515625, 16.497512817382812, -6.617198944091797, 0.2521324157714844, 13.12030029296875, -24.7891845703125, 72.59910583496094, 19.750457763671875, 30.72164535522461, 66.60816955566406, 44.902915954589844, 15.321392059326172, 6.752838134765625, 18.593482971191406, 39.302886962890625, 40.628662109375, -11.341865539550781, 46.463783264160156, 26.072738647460938, 42.79469299316406, 4.857982635498047, 24.732383728027344, 4.996025085449219, -35.80442428588867, 32.56110382080078, 20.771690368652344, 18.39715576171875, 37.8216667175293, -8.899299621582031, 27.14966583251953, 12.396293640136719, -1.4419918060302734, 31.18798828125, -20.59100341796875, 16.604461669921875, 27.134078979492188, 40.6158447265625, 37.687591552734375, 7.897613525390625, 23.321075439453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000228.npy"}
{"epoch": 0.33480176211453744, "step": 229, "batch_size": 64, "mean": 31.885055541992188, "std": 31.485576629638672, "min": -29.82207489013672, "p10": -3.726880645751952, "median": 23.919848442077637, "p90": 75.4216896057129, "max": 120.79783630371094, "pos_frac": 0.859375, "sample": [64.64415740966797, 23.099016189575195, 16.387893676757812, 46.806800842285156, 19.180206298828125, 10.72064208984375, 35.24713134765625, 53.47568893432617, 15.803474426269531, 40.43385314941406, 74.49968719482422, 52.45774841308594, 22.445598602294922, 80.20243835449219, 88.50320434570312, 45.454681396484375, 21.79108428955078, 20.72246551513672, 44.700157165527344, 100.20364379882812, -16.576557159423828, 35.90589141845703, 16.411846160888672, 26.61571502685547, 17.822235107421875, 46.1404914855957, 75.81683349609375, 1.568572998046875, 65.59834289550781, 49.683982849121094, 30.36370086669922, 35.86830139160156, 11.042427062988281, 47.85435485839844, 120.79783630371094, 9.60000991821289, 106.32011413574219, 72.70623779296875, -4.68768310546875, 5.672393798828125, 53.495460510253906, -29.82207489013672, -1.6185073852539062, 4.232765197753906, 35.59836196899414, -7.8394622802734375, 19.18499755859375, 76.59205627441406, 11.476638793945312, -4.150382995605469, -9.656684875488281, 39.527767181396484, 14.327608108520508, 4.066806793212891, 24.740680694580078, 16.763900756835938, 13.459175109863281, 12.041305541992188, 42.31187438964844, 50.51567077636719, -21.687423706054688, 6.127098083496094, -2.73870849609375, 62.39002227783203], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000229.npy"}
{"epoch": 0.33627019089574156, "step": 230, "batch_size": 64, "mean": 31.624526977539062, "std": 27.805076599121094, "min": -32.35679626464844, "p10": 0.95164031982422, "median": 31.635725021362305, "p90": 69.41923522949219, "max": 105.37056732177734, "pos_frac": 0.90625, "sample": [12.278228759765625, 76.91215515136719, 19.476055145263672, 47.5306396484375, -8.894123077392578, 22.62080955505371, 26.573577880859375, 62.48553466796875, 39.98588180541992, 45.395782470703125, 15.356964111328125, 2.2185745239257812, -24.69324493408203, 31.56353759765625, 54.23980712890625, 79.50311279296875, -9.532012939453125, 43.67903137207031, 29.21551513671875, 18.880992889404297, 71.32347106933594, -20.859020233154297, 5.716423034667969, 29.900856018066406, 43.58393096923828, 46.948394775390625, 32.38593292236328, 32.858001708984375, 5.7744140625, 14.994438171386719, 6.32000732421875, -3.4485206604003906, 35.53564453125, 48.93939208984375, 74.21525573730469, 65.09982299804688, 22.913719177246094, 21.35326385498047, 31.70791244506836, 61.82679748535156, 5.263057708740234, 46.74101257324219, 45.181419372558594, 19.851486206054688, 7.437049865722656, 9.151359558105469, 90.56301879882812, 53.13043212890625, 70.00091552734375, 0.40866851806640625, 19.67367172241211, 44.99969482421875, 34.753395080566406, 6.179357528686523, 68.06198120117188, -32.35679626464844, 105.37056732177734, 32.79627990722656, 29.050613403320312, 32.37847137451172, 8.362041473388672, 18.52379608154297, 58.38177490234375, 38.179542541503906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000230.npy"}
{"epoch": 0.3377386196769457, "step": 231, "batch_size": 64, "mean": 26.768966674804688, "std": 24.490726470947266, "min": -25.767494201660156, "p10": -1.7461681365966792, "median": 24.05834197998047, "p90": 60.99456176757815, "max": 92.27513885498047, "pos_frac": 0.875, "sample": [92.27513885498047, 26.97742462158203, 65.9671630859375, 76.36257934570312, -1.2960243225097656, 40.859619140625, 38.876556396484375, 39.92717742919922, 0.7162647247314453, 24.347152709960938, 1.8133621215820312, 6.191184997558594, -6.40162467956543, 44.61668395996094, 80.72373962402344, 33.832908630371094, 32.68034362792969, 54.69654846191406, 14.806350708007812, -5.560516357421875, 39.45197296142578, 40.20337677001953, 19.189239501953125, 15.415393829345703, 19.273162841796875, 32.81608200073242, 46.804176330566406, -1.9390869140625, 18.9580135345459, 54.30912780761719, 43.98468017578125, 14.197372436523438, 21.183734893798828, 30.418193817138672, 23.597930908203125, 6.5731096267700195, 8.210731506347656, 40.994632720947266, 3.927337646484375, 3.90472412109375, 7.29632568359375, 23.543209075927734, 19.939163208007812, 0.3987998962402344, 42.556739807128906, 39.980201721191406, 33.93177032470703, -6.887187957763672, -25.767494201660156, 23.76953125, 81.09098052978516, 28.572757720947266, 11.923419952392578, 43.199485778808594, 41.546958923339844, 63.69371032714844, -12.315896987915039, 29.373432159423828, -4.204994201660156, 68.23905944824219, 11.706588745117188, 14.637863159179688, 7.194129943847656, 25.909469604492188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000231.npy"}
{"epoch": 0.3392070484581498, "step": 232, "batch_size": 64, "mean": 23.248353958129883, "std": 27.025495529174805, "min": -35.6890869140625, "p10": -8.927764129638671, "median": 22.648109436035156, "p90": 54.26534805297852, "max": 103.20088195800781, "pos_frac": 0.796875, "sample": [-31.914108276367188, 32.05458068847656, 0.8374233245849609, 31.384811401367188, 7.8313140869140625, 38.15869140625, 68.43753051757812, 37.16947937011719, -15.390945434570312, 52.611114501953125, -3.9542617797851562, 15.253807067871094, 74.19329833984375, 3.63006591796875, -7.1885223388671875, 5.15057373046875, -18.172813415527344, 0.4327583312988281, -7.2725372314453125, 30.00030517578125, 34.777503967285156, 64.28263854980469, 66.51518249511719, 23.233497619628906, 43.138572692871094, -9.593345642089844, 44.79443359375, 18.57823944091797, 9.462211608886719, 40.173500061035156, 44.95996856689453, -6.079597473144531, -35.6890869140625, 52.90516662597656, 8.101238250732422, 28.678207397460938, 44.496917724609375, 5.027072906494141, 33.31849670410156, 56.9403076171875, 40.23539733886719, 37.846160888671875, 41.55780792236328, 6.9766845703125, 10.589271545410156, 14.011999130249023, 30.341922760009766, -7.3747406005859375, 34.73722839355469, -5.199167251586914, 103.20088195800781, 4.0264892578125, 21.399459838867188, 22.062721252441406, 54.54644012451172, -10.503089904785156, 53.609466552734375, 13.177745819091797, 18.74749755859375, -10.120025634765625, 6.815528869628906, 38.51156997680664, 45.149696350097656, 42.27406311035156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000232.npy"}
{"epoch": 0.3406754772393539, "step": 233, "batch_size": 64, "mean": 31.44921112060547, "std": 30.602941513061523, "min": -37.91712188720703, "p10": -6.758025360107421, "median": 29.14676284790039, "p90": 75.64741744995118, "max": 96.66937255859375, "pos_frac": 0.8125, "sample": [4.857093811035156, 38.85376739501953, 43.56585693359375, -7.1859130859375, 25.58599090576172, 47.604305267333984, -22.105758666992188, 21.388446807861328, -1.993560791015625, -11.565925598144531, 11.528045654296875, 18.50754165649414, 32.12648010253906, 23.262741088867188, 96.66937255859375, 41.064170837402344, 30.089370727539062, -3.864501953125, 67.40605163574219, 28.20415496826172, 69.24819946289062, 69.54991912841797, -15.637275695800781, 92.51961517333984, 23.913223266601562, 22.159439086914062, 45.85618209838867, 14.326507568359375, -2.6858444213867188, 47.71936798095703, -8.557106018066406, 76.61176300048828, 9.421142578125, 58.87910461425781, 21.082420349121094, 87.35671997070312, 6.504762649536133, 51.184661865234375, -5.759620666503906, 26.246192932128906, 1.1795272827148438, 79.28559875488281, 32.526123046875, 14.853073120117188, -37.91712188720703, 30.589324951171875, -3.7507781982421875, -9.460311889648438, 7.441497802734375, 27.77105712890625, 8.620468139648438, 62.26757049560547, 45.62965393066406, 59.51506042480469, 73.39727783203125, 22.406661987304688, 32.52701950073242, 51.188758850097656, 40.281986236572266, 52.817840576171875, 46.41233825683594, 81.05702209472656, 82.341796875, 37.83100891113281], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000233.npy"}
{"epoch": 0.342143906020558, "step": 234, "batch_size": 64, "mean": 33.52787780761719, "std": 34.58265686035156, "min": -32.172393798828125, "p10": -8.768884277343746, "median": 30.73278045654297, "p90": 75.42983627319337, "max": 130.40907287597656, "pos_frac": 0.84375, "sample": [19.05123519897461, 42.24626159667969, 72.42654418945312, 63.89697265625, 35.51873779296875, 80.10509490966797, 42.385894775390625, 40.210960388183594, 36.448631286621094, 37.652740478515625, 21.420711517333984, -1.07049560546875, -18.93316650390625, -25.98165512084961, 16.00708770751953, 31.094650268554688, 3.3277359008789062, -2.827281951904297, -21.606521606445312, 31.839035034179688, 121.99310302734375, 63.300350189208984, 20.690011978149414, -10.7384033203125, 33.53358459472656, 68.23255157470703, 57.75823974609375, 31.294456481933594, 27.23651123046875, 130.40907287597656, 1.3533744812011719, 29.3258056640625, 55.797813415527344, 59.15347671508789, 81.80720520019531, -21.415847778320312, 30.37091064453125, 54.814998626708984, 22.544677734375, 76.4605712890625, 6.56060791015625, 11.024942398071289, 22.11707305908203, 5.969655990600586, 1.5611724853515625, -4.17333984375, 46.530921936035156, 20.187820434570312, 44.06951141357422, 23.893753051757812, 50.042503356933594, 95.8359146118164, 98.93927001953125, -15.395973205566406, 58.94646453857422, 22.537036895751953, 15.127601623535156, 73.02478790283203, 29.325942993164062, -32.172393798828125, 70.63720703125, 1.9747695922851562, 52.27207946777344, 9.811187744140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000234.npy"}
{"epoch": 0.3436123348017621, "step": 235, "batch_size": 64, "mean": 25.663057327270508, "std": 25.734933853149414, "min": -29.527984619140625, "p10": -4.6370652198791475, "median": 22.94188690185547, "p90": 67.24827041625977, "max": 76.96673583984375, "pos_frac": 0.859375, "sample": [26.98284149169922, 5.409648895263672, 6.352386474609375, 2.1839866638183594, 1.8421859741210938, 74.92936706542969, 53.45201873779297, 14.986454010009766, 17.863357543945312, 67.43489837646484, 5.676170349121094, 48.91931915283203, 72.25923156738281, 11.480316162109375, 15.8492431640625, -14.286941528320312, 32.71037292480469, -2.3284950256347656, 24.712444305419922, 40.99669647216797, -5.626452445983887, 48.350616455078125, -8.874893188476562, 25.65319061279297, 47.786346435546875, 76.96673583984375, 30.962806701660156, 37.80110168457031, 25.811065673828125, 34.140533447265625, -29.527984619140625, 21.764389038085938, 5.289161682128906, 30.988922119140625, -10.311637878417969, 68.0718002319336, 30.529747009277344, -1.0947265625, 18.5791015625, 68.3621826171875, 3.704479217529297, 12.213621139526367, 56.785888671875, 10.058128356933594, 69.65420532226562, 24.119384765625, 64.00167846679688, -6.4322509765625, 16.171730041503906, 59.149635314941406, 51.66749572753906, 66.81280517578125, 15.035240173339844, 3.0141448974609375, 11.610662460327148, 1.173288345336914, -11.723167419433594, 45.19867706298828, 4.6670074462890625, 28.70883560180664, 17.423263549804688, 24.584854125976562, 40.17829895019531, 11.610176086425781], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000235.npy"}
{"epoch": 0.34508076358296624, "step": 236, "batch_size": 64, "mean": 32.12920379638672, "std": 38.5870246887207, "min": -31.992172241210938, "p10": 1.0051200866699221, "median": 22.864750862121582, "p90": 82.34181900024416, "max": 198.39059448242188, "pos_frac": 0.90625, "sample": [19.704238891601562, 15.76806640625, 67.56333923339844, 16.118515014648438, 23.043489456176758, 12.202278137207031, 15.9996337890625, 15.438053131103516, 0.9037437438964844, -31.992172241210938, 131.52520751953125, 125.0445556640625, 26.696308135986328, 2.5956649780273438, 35.46266174316406, 39.157142639160156, 13.52920913696289, 12.504325866699219, 37.905128479003906, 26.5706787109375, 14.620231628417969, 22.686012268066406, 5.282384872436523, 53.89482116699219, 85.44485473632812, 39.42251968383789, 24.316253662109375, 198.39059448242188, 54.483489990234375, 17.427160263061523, 49.06852722167969, 37.64768981933594, 79.5392074584961, 46.55837631225586, 38.26995086669922, 35.363136291503906, 61.26041030883789, 117.74042510986328, 20.46240997314453, 18.315885543823242, 36.739322662353516, 6.178924560546875, 1.2416648864746094, -15.992240905761719, 2.6903533935546875, 29.89446258544922, -0.17663192749023438, 30.67083740234375, 4.700199127197266, -13.485898971557617, 20.326416015625, 83.54293823242188, 8.299667358398438, -29.78927230834961, 28.899986267089844, 40.77326202392578, 85.083740234375, 19.771312713623047, 19.578521728515625, -20.843856811523438, 15.813385009765625, 33.81330871582031, 8.198951721191406, 34.4053955078125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000236.npy"}
{"epoch": 0.3465491923641703, "step": 237, "batch_size": 64, "mean": 24.93755531311035, "std": 39.21628952026367, "min": -79.05138397216797, "p10": -18.030367660522458, "median": 18.67174530029297, "p90": 72.77611236572267, "max": 140.30987548828125, "pos_frac": 0.78125, "sample": [-18.830493927001953, 35.513790130615234, 100.2236099243164, 54.27953338623047, 2.1517982482910156, 46.72169494628906, 68.9927749633789, 27.62610626220703, 14.178825378417969, -3.9488143920898438, 21.81222915649414, 32.32659912109375, 56.52283477783203, -16.163406372070312, 7.506591796875, 38.904579162597656, 5.437999725341797, -27.87370491027832, 23.2611083984375, 64.03733825683594, 14.700302124023438, -14.162628173828125, 73.57778930664062, 140.30987548828125, 33.021583557128906, 62.992637634277344, -8.542945861816406, 81.88082885742188, 25.236217498779297, 16.72381591796875, 118.5931396484375, 16.367156982421875, 77.19577026367188, 70.90553283691406, 22.321502685546875, 1.0314178466796875, 20.619674682617188, -29.223968505859375, 9.90008544921875, 33.460350036621094, 108.72412109375, 15.616920471191406, 22.11155128479004, 61.296112060546875, 1.763336181640625, -20.252685546875, -29.607696533203125, 0.7602386474609375, -79.05138397216797, 66.33264923095703, 15.267223358154297, 4.7870330810546875, -33.15000915527344, 16.084259033203125, 23.805191040039062, 3.392822265625, 9.521354675292969, -13.247329711914062, -0.7749099731445312, 4.325508117675781, -4.9506683349609375, 70.21698760986328, 25.730682373046875, 27.713165283203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000237.npy"}
{"epoch": 0.34801762114537443, "step": 238, "batch_size": 64, "mean": 27.963947296142578, "std": 32.58026123046875, "min": -27.034912109375, "p10": -14.599525451660156, "median": 24.48663330078125, "p90": 74.30690994262696, "max": 114.48765563964844, "pos_frac": 0.78125, "sample": [83.82102966308594, 15.448772430419922, 8.787437438964844, 12.472412109375, 6.023948669433594, 25.84497833251953, -0.88983154296875, 54.28790283203125, -17.42902374267578, 76.71504211425781, 30.724201202392578, -4.367778778076172, 9.08780288696289, 23.176071166992188, 24.540660858154297, 16.21595001220703, 63.27777099609375, -18.13378143310547, -16.500324249267578, 8.328861236572266, 30.19878387451172, 74.72752380371094, 35.818572998046875, 34.642051696777344, -5.694873809814453, 114.48765563964844, 13.048728942871094, 30.01952362060547, 55.402076721191406, 47.08439636230469, -10.821807861328125, -14.313858032226562, 39.75914001464844, 25.5478515625, 67.23171997070312, 11.748878479003906, -14.721954345703125, 30.98959732055664, 108.11636352539062, 21.861175537109375, 7.949825286865234, 82.34967041015625, 62.358184814453125, -15.337783813476562, -13.824169158935547, 73.32547760009766, 15.677669525146484, 14.862380981445312, 16.477035522460938, 90.87351989746094, 34.04255676269531, 18.51846694946289, -6.4151763916015625, 50.83483123779297, -20.260154724121094, 37.88176345825195, 9.591476440429688, 24.432605743408203, 42.62114334106445, -27.034912109375, 42.287689208984375, 57.80440139770508, 37.416259765625, 56.69614028930664], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000238.npy"}
{"epoch": 0.34948604992657856, "step": 239, "batch_size": 64, "mean": 26.272315979003906, "std": 31.718360900878906, "min": -27.567838668823242, "p10": -12.656760406494138, "median": 24.762279510498047, "p90": 66.56861724853516, "max": 102.46235656738281, "pos_frac": 0.734375, "sample": [81.4190444946289, 31.870468139648438, 5.2839508056640625, 49.73760986328125, 40.79857635498047, 59.31427001953125, 52.123321533203125, -0.4193000793457031, -6.982551574707031, 29.60501480102539, 61.07012939453125, 92.69076538085938, -25.280834197998047, 46.3349723815918, 16.534095764160156, -2.6173171997070312, 102.46235656738281, 31.702880859375, -10.449836730957031, 66.40309143066406, 47.47370147705078, 39.79046630859375, -16.162155151367188, -2.8039112091064453, -7.398834228515625, -2.045001983642578, 14.318840026855469, 3.4338455200195312, 15.186492919921875, 16.776931762695312, 51.70375061035156, -26.47467041015625, 35.610435485839844, 18.929786682128906, 64.77081298828125, 25.424213409423828, -0.1994781494140625, 37.896026611328125, 39.923500061035156, 5.2920074462890625, -2.3545188903808594, 58.592498779296875, 50.40503692626953, 7.600868225097656, -13.602584838867188, 13.12337875366211, -25.411392211914062, 4.0410614013671875, -5.57794189453125, 24.100345611572266, 76.80999755859375, 6.654327392578125, 44.87194061279297, 45.58037567138672, 35.318023681640625, 19.14623260498047, 66.63955688476562, -19.87059783935547, 32.7060432434082, 28.70730972290039, 82.98109436035156, 15.067085266113281, 80.42041015625, -27.567838668823242], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000239.npy"}
{"epoch": 0.3509544787077827, "step": 240, "batch_size": 64, "mean": 23.62274932861328, "std": 29.06256866455078, "min": -37.320556640625, "p10": -12.599400329589843, "median": 23.65540313720703, "p90": 62.2723129272461, "max": 90.52760314941406, "pos_frac": 0.734375, "sample": [65.3543701171875, 46.26576614379883, 10.408180236816406, -4.0046234130859375, 10.428916931152344, -18.749252319335938, 20.286659240722656, 30.285263061523438, 31.593711853027344, -5.540126800537109, -9.021965026855469, -3.5460357666015625, 36.41111755371094, -37.320556640625, 53.16276550292969, -19.846290588378906, 4.578008651733398, 21.76679229736328, 46.55887222290039, 46.08155059814453, 27.85567855834961, 72.65924072265625, 60.833770751953125, 38.849544525146484, 29.798690795898438, -2.6945037841796875, 11.353492736816406, 16.0513916015625, 61.34733581542969, 40.38787078857422, 27.308914184570312, 51.820533752441406, 19.81122589111328, 5.8485870361328125, -30.567153930664062, 90.52760314941406, 31.700042724609375, 39.91683578491211, -7.8024749755859375, 24.03973388671875, 1.1965980529785156, 70.00901794433594, 52.96440124511719, 13.366958618164062, 58.18231964111328, 25.80638885498047, 62.668731689453125, -12.938026428222656, 71.95508575439453, -20.30522918701172, 46.429046630859375, 64.14274597167969, -11.809272766113281, -6.6065673828125, 20.823143005371094, 32.963478088378906, 50.77598190307617, 48.93325424194336, -2.09783935546875, 3.0910797119140625, -0.32018280029296875, 2.51934814453125, 23.271072387695312, -17.36511993408203], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000240.npy"}
{"epoch": 0.3524229074889868, "step": 241, "batch_size": 64, "mean": 41.317291259765625, "std": 37.149940490722656, "min": -25.687271118164062, "p10": -4.813184738159178, "median": 42.54226303100586, "p90": 78.00896377563478, "max": 170.96434020996094, "pos_frac": 0.859375, "sample": [79.49522399902344, 17.757347106933594, -14.947265625, 26.902175903320312, 14.367904663085938, 59.120140075683594, 47.207618713378906, 43.47135925292969, 60.56163024902344, 74.54102325439453, 105.0142822265625, 44.99253463745117, 29.895538330078125, 41.713233947753906, -5.469348907470703, 47.72842788696289, -13.614078521728516, 26.772171020507812, 71.60604095458984, 58.09710693359375, -25.687271118164062, 44.75984191894531, 26.258800506591797, -6.051605224609375, 134.89279174804688, 32.90495300292969, 8.655914306640625, 54.02284240722656, 73.65878295898438, 29.06798553466797, 170.96434020996094, 25.78559112548828, 51.773284912109375, 21.78437042236328, 68.91580200195312, 21.904083251953125, 50.026336669921875, 66.75299835205078, 4.901279449462891, 57.06904602050781, 74.48738098144531, 39.070919036865234, 5.4239654541015625, 32.960838317871094, 67.30805969238281, -3.282135009765625, 70.38641357421875, 47.71473693847656, 85.93870544433594, -1.16717529296875, 22.099708557128906, 72.04405212402344, 1.8198394775390625, 86.44775390625, 7.448451995849609, 18.23458480834961, 24.645721435546875, 64.5267333984375, 15.599380493164062, 54.656494140625, -22.960098266601562, 117.27059173583984, -7.312986373901367, 43.37129211425781], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000241.npy"}
{"epoch": 0.35389133627019087, "step": 242, "batch_size": 64, "mean": 29.135746002197266, "std": 30.864948272705078, "min": -53.226470947265625, "p10": -11.24853057861328, "median": 27.166261672973633, "p90": 72.72380447387697, "max": 93.9422607421875, "pos_frac": 0.84375, "sample": [-2.625988006591797, 26.834346771240234, -10.8126220703125, 68.50285339355469, 31.813308715820312, 43.306060791015625, 54.795230865478516, -11.493843078613281, 43.093849182128906, 25.200164794921875, 1.3264942169189453, 62.604705810546875, 82.06693267822266, -14.697380065917969, 13.806716918945312, 0.9423141479492188, 47.490966796875, 73.92755126953125, 86.98539733886719, 4.937541961669922, 91.36564636230469, 31.532333374023438, 51.32184600830078, 7.096870422363281, -27.271862030029297, 37.22401428222656, 44.341102600097656, 13.486038208007812, 30.943317413330078, 51.58526611328125, 20.532569885253906, 27.07000732421875, 12.283309936523438, 17.944412231445312, 18.83423614501953, -15.921714782714844, 9.80865478515625, 14.651046752929688, -3.833465576171875, 14.981536865234375, 25.930316925048828, 17.69823455810547, 55.12242126464844, 93.9422607421875, -11.435348510742188, 31.982933044433594, 69.04824829101562, 73.52538299560547, -25.244491577148438, 70.85345458984375, 42.01756286621094, 30.50023651123047, 26.358898162841797, 2.4301605224609375, -53.226470947265625, 34.41694641113281, 27.262516021728516, 18.155681610107422, 42.179595947265625, 28.6195068359375, 11.986286163330078, 58.983665466308594, 39.98505401611328, 77.61492156982422], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000242.npy"}
{"epoch": 0.355359765051395, "step": 243, "batch_size": 64, "mean": 28.77163314819336, "std": 35.328189849853516, "min": -49.742225646972656, "p10": -18.03455734252929, "median": 29.469310760498047, "p90": 76.0128112792969, "max": 108.50662994384766, "pos_frac": 0.75, "sample": [29.632308959960938, -34.409698486328125, -11.902641296386719, 62.010032653808594, 29.306312561035156, 56.47845458984375, -4.780963897705078, -6.19630241394043, 14.156564712524414, 44.32471466064453, 86.81744384765625, 18.571640014648438, 83.57684326171875, 28.014480590820312, 24.934906005859375, 82.8637924194336, -28.588653564453125, 50.42790985107422, -20.662521362304688, 9.422477722167969, -23.855865478515625, 12.927688598632812, 53.01374435424805, -9.786544799804688, -3.242708206176758, 90.48635864257812, 39.41572189331055, -30.700416564941406, 51.2319221496582, 21.255325317382812, 70.25099182128906, 0.9588470458984375, 31.104068756103516, 31.691299438476562, -1.1515426635742188, 104.15982818603516, 26.990585327148438, -5.042724609375, -5.357421875, 78.48216247558594, 50.794349670410156, 32.51348114013672, 48.49967956542969, 108.50662994384766, 67.00878143310547, 50.42706298828125, -49.742225646972656, 46.68330383300781, 22.65795135498047, -6.011453628540039, 66.59552001953125, 32.21240234375, 18.0074462890625, 20.498046875, 41.60719299316406, 0.8060455322265625, 49.83301544189453, 23.951705932617188, 57.61149215698242, 37.719764709472656, 29.903953552246094, 26.3133544921875, 53.26105499267578, -35.10246658325195], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000243.npy"}
{"epoch": 0.3568281938325991, "step": 244, "batch_size": 64, "mean": 30.495805740356445, "std": 33.93928909301758, "min": -43.78080368041992, "p10": -6.731819534301758, "median": 25.357921600341797, "p90": 79.32904357910158, "max": 110.85614013671875, "pos_frac": 0.84375, "sample": [18.038299560546875, 7.4192047119140625, 17.014930725097656, 47.344635009765625, -6.749504089355469, 17.14547348022461, 45.78174591064453, 53.489166259765625, 69.32893371582031, 81.57814025878906, 42.928043365478516, 0.03558349609375, 44.17475891113281, 33.971641540527344, 13.754669189453125, 49.229286193847656, 3.3979034423828125, 103.3494644165039, 30.4119873046875, 9.479721069335938, -6.690555572509766, 17.248741149902344, 51.87110900878906, 1.486703872680664, 49.79914855957031, 10.192789077758789, -43.78080368041992, 19.212520599365234, -4.554656982421875, -11.513824462890625, 20.63812255859375, 3.178508758544922, 91.55549621582031, 34.11436462402344, 110.85614013671875, 9.556198120117188, 5.5091552734375, 42.704734802246094, -7.393062591552734, 31.825088500976562, 60.017112731933594, -35.48773956298828, -22.201980590820312, 3.97015380859375, 19.062744140625, -21.58453369140625, 62.257144927978516, 17.663185119628906, 39.88533020019531, -2.1869659423828125, 76.04730224609375, 95.764404296875, 37.717681884765625, 27.97972869873047, 8.396141052246094, 30.180377960205078, 21.994396209716797, 80.73550415039062, 22.736114501953125, 109.39509582519531, 58.96263885498047, 52.37644958496094, 47.57769012451172, 53.53352355957031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000244.npy"}
{"epoch": 0.35829662261380324, "step": 245, "batch_size": 64, "mean": 33.14836883544922, "std": 31.645296096801758, "min": -38.67448425292969, "p10": -2.0537841796874985, "median": 29.56863021850586, "p90": 73.78248519897461, "max": 121.580322265625, "pos_frac": 0.875, "sample": [-0.6697845458984375, 51.57383728027344, 59.674835205078125, 24.145591735839844, 43.69892120361328, 21.21784210205078, 13.750219345092773, 20.829925537109375, 73.93441009521484, 73.42799377441406, 69.92984008789062, 7.097034454345703, 21.92224884033203, 63.124473571777344, 15.049736022949219, 100.39557647705078, 33.86431121826172, 36.189849853515625, 46.91557312011719, 9.772590637207031, 75.67486572265625, 52.01713562011719, 0.3831148147583008, 52.09080505371094, 6.270962715148926, 2.9054718017578125, 70.98001861572266, -5.853473663330078, 5.388393402099609, 12.490447998046875, 44.916168212890625, 14.834754943847656, 121.580322265625, 55.18455505371094, 51.1718635559082, 54.876121520996094, -25.034317016601562, 17.99040985107422, 26.0780029296875, 0.3330230712890625, 21.255952835083008, -4.858367919921875, 37.16288757324219, 52.868682861328125, -2.6469268798828125, 28.543190002441406, 32.24382781982422, 82.31291198730469, 17.499916076660156, 75.55604553222656, 58.58696746826172, -10.839096069335938, -12.605499267578125, 1.9333267211914062, -38.67448425292969, 93.48995971679688, 23.340923309326172, 52.55165100097656, 64.81616973876953, 30.594070434570312, 51.28827667236328, 32.47523498535156, 11.90475845336914, 2.571650505065918], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000245.npy"}
{"epoch": 0.35976505139500736, "step": 246, "batch_size": 64, "mean": 25.5677547454834, "std": 31.6236515045166, "min": -44.753570556640625, "p10": -12.081111145019525, "median": 26.658750534057617, "p90": 66.99872055053712, "max": 124.13874053955078, "pos_frac": 0.78125, "sample": [35.69525146484375, 57.334800720214844, 31.433914184570312, 60.60607147216797, 58.530059814453125, 28.747722625732422, 99.11982727050781, -3.3059005737304688, -17.094993591308594, -2.4874649047851562, 69.07215881347656, 36.925296783447266, 26.129655838012695, 16.328693389892578, 4.101940155029297, 47.73607635498047, -44.753570556640625, 26.836380004882812, 33.85759735107422, 7.204559326171875, 21.410499572753906, 37.40315246582031, 26.481121063232422, -0.21128082275390625, 32.19110870361328, 28.54730224609375, -14.69696044921875, -31.18841552734375, 124.13874053955078, -23.406518936157227, -5.9774627685546875, -3.768157958984375, 5.8257293701171875, 54.87471008300781, -24.847991943359375, 71.68196105957031, 12.978029251098633, 10.16876220703125, 62.306663513183594, 27.829139709472656, 68.25230407714844, 64.07369232177734, 29.603897094726562, -4.8316802978515625, 15.276496887207031, 38.60600280761719, 15.192710876464844, 68.56703186035156, -1.5895471572875977, 47.042755126953125, 74.91383361816406, 33.26359558105469, 29.138450622558594, 20.68189239501953, 7.894355773925781, 29.73181915283203, 3.4077930450439453, 35.1064453125, 49.81306457519531, 6.5218505859375, 23.47576141357422, 20.71597671508789, -34.82554626464844, 12.545101165771484], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000246.npy"}
{"epoch": 0.36123348017621143, "step": 247, "batch_size": 64, "mean": 40.07710647583008, "std": 38.41459274291992, "min": -47.028411865234375, "p10": -3.7086574554443343, "median": 36.007896423339844, "p90": 87.14533004760744, "max": 172.66952514648438, "pos_frac": 0.875, "sample": [-16.61156463623047, 29.422775268554688, -6.28546142578125, 44.092437744140625, 44.091217041015625, 51.588470458984375, 74.802001953125, 62.774803161621094, -7.771659851074219, 57.63903045654297, 46.230308532714844, 74.49887084960938, 60.72428894042969, 53.937896728515625, 9.615760803222656, 37.180198669433594, 48.714019775390625, 15.107070922851562, 99.23332214355469, 88.98432922363281, 2.3834075927734375, -2.3678016662597656, 25.541603088378906, 4.408870697021484, 58.89717102050781, 25.940750122070312, 5.427909851074219, 13.180526733398438, 48.1234016418457, 17.17290496826172, 90.50611877441406, 64.7467041015625, 20.857757568359375, 20.165069580078125, 28.820510864257812, 27.71295166015625, 172.66952514648438, 112.6405029296875, 34.30976867675781, -4.2833099365234375, 0.360626220703125, 59.13965606689453, -47.028411865234375, 64.93781280517578, -12.286128997802734, 3.5452499389648438, 40.695648193359375, 8.701728820800781, 133.83184814453125, 34.835594177246094, 42.118621826171875, 32.99359130859375, 63.46900939941406, 122.1697769165039, -5.731910705566406, 24.20840835571289, 44.100189208984375, 56.14696502685547, 49.119293212890625, 21.70024871826172, 82.85433197021484, 21.53597640991211, 73.31898498535156, 15.375289916992188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000247.npy"}
{"epoch": 0.36270190895741555, "step": 248, "batch_size": 64, "mean": 27.472002029418945, "std": 31.338394165039062, "min": -39.77024841308594, "p10": -8.441772460937498, "median": 26.318384170532227, "p90": 74.25207824707032, "max": 104.57977294921875, "pos_frac": 0.796875, "sample": [30.618423461914062, 78.19342041015625, -18.768566131591797, -11.137897491455078, -9.021461486816406, 14.566944122314453, -5.677955627441406, 51.75785827636719, 6.904895782470703, -28.44769287109375, 0.4430389404296875, 39.622589111328125, 26.02478790283203, 26.611980438232422, 104.57977294921875, 11.603429794311523, 4.66545295715332, 6.56903076171875, 38.390113830566406, -1.6641082763671875, -3.1399688720703125, 73.5355224609375, 13.052009582519531, 74.55917358398438, 36.29112243652344, -6.493877410888672, 54.33705520629883, 85.17923736572266, 39.15733337402344, 66.29581451416016, 7.643806457519531, 68.56358337402344, 44.812950134277344, 42.39532470703125, 46.366294860839844, 33.191139221191406, -39.77024841308594, 60.044921875, 9.315292358398438, -5.987445831298828, 11.950149536132812, 31.914634704589844, 38.57403564453125, 82.3180923461914, 31.22705841064453, 23.73604393005371, 33.861000061035156, 88.57056427001953, -15.532508850097656, 92.53079986572266, 10.569732666015625, 21.203914642333984, 50.93461227416992, 25.705909729003906, 44.49357604980469, 31.68749237060547, 7.759513854980469, 39.665611267089844, -9.6214599609375, 27.731082916259766, -7.089164733886719, 11.527839660644531, 11.257640838623047, 8.048919677734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000248.npy"}
{"epoch": 0.3641703377386197, "step": 249, "batch_size": 64, "mean": 25.36626434326172, "std": 35.72414779663086, "min": -46.72856140136719, "p10": -27.56751861572265, "median": 25.292587280273438, "p90": 72.8661865234375, "max": 105.823486328125, "pos_frac": 0.78125, "sample": [7.671901702880859, 73.84823608398438, -29.271438598632812, -33.18833541870117, 48.89861297607422, 6.861091613769531, 0.3977813720703125, 20.3992919921875, -23.591705322265625, 10.570579528808594, 28.05181884765625, 51.082183837890625, 10.122699737548828, 39.4984130859375, -38.92890167236328, -46.72856140136719, -10.237674713134766, 105.823486328125, 25.356647491455078, -10.326839447021484, 79.99681091308594, 57.1951904296875, -30.448204040527344, 39.37250900268555, 14.125984191894531, 31.757949829101562, 17.484996795654297, 2.05584716796875, 47.29414367675781, 36.15814971923828, -30.180618286132812, 18.107261657714844, 0.44989013671875, 34.62701416015625, 28.679622650146484, 14.264190673828125, 53.34101867675781, 33.801124572753906, 11.500396728515625, 48.13075256347656, 35.4771728515625, 11.222640991210938, 94.43316650390625, -17.174541473388672, 24.527938842773438, 19.32415771484375, 61.528892517089844, 10.33145523071289, 31.66680908203125, 31.117591857910156, -1.4724922180175781, 70.57473754882812, 32.12322998046875, 83.70205688476562, 48.30108642578125, 68.68489837646484, -7.690101623535156, -4.009002685546875, 83.01495361328125, -39.24957275390625, 67.00336456298828, 102.20597839355469, 48.544586181640625, 25.228527069091797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000249.npy"}
{"epoch": 0.3656387665198238, "step": 250, "batch_size": 64, "mean": 27.043155670166016, "std": 34.7724723815918, "min": -84.8760757446289, "p10": -8.641840362548828, "median": 27.79318618774414, "p90": 73.14586181640625, "max": 106.53012084960938, "pos_frac": 0.765625, "sample": [83.44255065917969, 57.77666473388672, -2.0886077880859375, -29.996959686279297, -7.28009033203125, -8.8599853515625, 82.08917999267578, 77.54118347167969, 18.474838256835938, 35.21375274658203, 15.934494018554688, 23.47784423828125, 54.822296142578125, 13.82977294921875, 4.7132415771484375, 15.484136581420898, 72.52554321289062, 33.26545715332031, 68.38106536865234, 40.626502990722656, 27.086212158203125, 11.797111511230469, 54.686492919921875, 64.97347259521484, 39.192073822021484, 51.34098434448242, 40.31163787841797, -7.80279541015625, 28.099708557128906, -43.927886962890625, -6.206916809082031, 9.246185302734375, -0.8343276977539062, 36.363067626953125, 2.1783180236816406, 106.53012084960938, 86.71247863769531, -7.950874328613281, 27.486663818359375, 75.77365112304688, 12.630905151367188, 56.58562469482422, 52.14088439941406, 39.56505584716797, 30.255828857421875, 36.845001220703125, 5.922264099121094, -15.938899993896484, 36.499420166015625, 27.13256072998047, 54.228546142578125, -9.572479248046875, 33.65636444091797, 73.41171264648438, -84.8760757446289, 3.6130409240722656, 14.024749755859375, 63.47697448730469, 28.399520874023438, -8.132835388183594, 15.619064331054688, -29.568065643310547, -2.0530776977539062, 52.46766662597656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000250.npy"}
{"epoch": 0.3671071953010279, "step": 251, "batch_size": 64, "mean": 25.410945892333984, "std": 36.356746673583984, "min": -44.94271469116211, "p10": -19.74501495361328, "median": 22.939163208007812, "p90": 80.3748748779297, "max": 120.41142272949219, "pos_frac": 0.734375, "sample": [22.197181701660156, -4.348684310913086, 6.5670928955078125, 52.67571258544922, 43.30940246582031, 13.276039123535156, 50.1566162109375, 90.0113525390625, 14.651649475097656, -17.571243286132812, 120.41142272949219, 9.3306884765625, 84.505615234375, -6.614814758300781, 25.883270263671875, 6.434333801269531, -31.692039489746094, 83.10292053222656, 31.444358825683594, 33.68482971191406, 81.55857849121094, 59.188194274902344, -2.7263870239257812, -2.6592483520507812, 51.98859405517578, -18.5361328125, -38.61873245239258, -44.94271469116211, 77.61289978027344, 28.80042266845703, 16.391952514648438, -4.6641082763671875, 67.9527587890625, 36.17230987548828, -7.550540924072266, 49.98533630371094, 36.23527526855469, 13.83975601196289, 12.150409698486328, 62.830631256103516, 67.8609619140625, -27.370914459228516, 10.50790023803711, 6.2799224853515625, 27.389999389648438, 49.77344512939453, 51.073699951171875, 96.20619201660156, 33.15959930419922, 44.41905212402344, -30.969501495361328, 42.08544921875, 91.31539916992188, 23.68114471435547, 31.705551147460938, 17.052213668823242, 11.28091812133789, 29.507781982421875, 8.998409271240234, 7.617431640625, -20.263107299804688, -20.738372802734375, -14.505952835083008, -12.191650390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000251.npy"}
{"epoch": 0.368575624082232, "step": 252, "batch_size": 64, "mean": 26.010202407836914, "std": 32.513607025146484, "min": -44.57080841064453, "p10": -17.65514907836914, "median": 26.41089630126953, "p90": 73.36482543945314, "max": 88.4842300415039, "pos_frac": 0.78125, "sample": [88.4842300415039, 84.61228942871094, -6.1402587890625, 24.318729400634766, 40.62971496582031, -44.57080841064453, -32.79892349243164, 86.13006591796875, 24.847061157226562, 70.70419311523438, 37.97996520996094, 17.52713394165039, 63.8168830871582, -0.3585052490234375, 41.88953399658203, 41.35028076171875, 39.309226989746094, 24.273582458496094, 0.6771926879882812, 28.576339721679688, 46.67547607421875, -35.56195068359375, 24.715099334716797, 43.18180847167969, 6.5304107666015625, 0.38555145263671875, 6.799802780151367, 42.721588134765625, 75.05088806152344, 18.721881866455078, 57.85490036010742, 43.0438232421875, 45.07972717285156, 9.410652160644531, 81.00653076171875, -18.947235107421875, 58.859397888183594, -37.50032043457031, 49.78058624267578, 40.039642333984375, -9.679193496704102, -28.29852294921875, 1.911712646484375, -5.802238464355469, -27.771774291992188, 59.26517105102539, 28.224655151367188, 42.28607940673828, -0.35092926025390625, 33.35075759887695, 41.14656066894531, -14.640281677246094, 21.032257080078125, 49.011695861816406, 27.9747314453125, 24.54906463623047, 31.1510066986084, 16.508560180664062, 76.89718627929688, 12.899757385253906, -6.141277313232422, 14.47894287109375, 74.50509643554688, 13.03765869140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000252.npy"}
{"epoch": 0.3700440528634361, "step": 253, "batch_size": 64, "mean": 24.389892578125, "std": 30.72547721862793, "min": -63.12171173095703, "p10": -8.41136646270752, "median": 25.595355987548828, "p90": 57.21836013793946, "max": 110.60295104980469, "pos_frac": 0.75, "sample": [-8.562894821166992, -33.00585174560547, 28.586105346679688, 38.265586853027344, 46.08304214477539, -0.48850250244140625, 37.18719482421875, 30.9197998046875, 34.40679931640625, 14.449188232421875, 86.04199981689453, 30.511444091796875, 49.281105041503906, 21.610321044921875, 47.16780090332031, 48.39459228515625, 46.27497863769531, 11.000572204589844, -8.05780029296875, 6.625308990478516, -63.12171173095703, -18.034088134765625, 65.24322509765625, 57.914588928222656, 25.991958618164062, 12.279359817504883, 78.44404602050781, -2.9793052673339844, 24.137901306152344, -2.2950668334960938, -3.3320770263671875, 44.30846405029297, 25.198753356933594, 61.76213073730469, 54.08464050292969, 53.652740478515625, 13.039253234863281, 20.059738159179688, -2.16693115234375, -6.2611083984375, 41.77149200439453, 42.82734680175781, 66.35121154785156, 110.60295104980469, 35.36138916015625, -1.9273529052734375, 4.892913818359375, 9.370956420898438, -19.287322998046875, 6.204708099365234, 53.23368835449219, 18.83385467529297, -46.556732177734375, -6.705593109130859, 26.62451934814453, 23.476863861083984, 47.303443908691406, -11.653228759765625, 45.279842376708984, 26.748443603515625, 12.019466400146484, 21.272613525390625, 34.696556091308594, 55.59382629394531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000253.npy"}
{"epoch": 0.37151248164464024, "step": 254, "batch_size": 64, "mean": 24.19228744506836, "std": 32.692222595214844, "min": -61.87091064453125, "p10": -17.639254760742187, "median": 25.38197898864746, "p90": 66.55721817016602, "max": 94.20521545410156, "pos_frac": 0.765625, "sample": [64.69757080078125, -51.532432556152344, 45.24717712402344, -3.197511672973633, 27.97068977355957, 66.90974426269531, -29.112533569335938, -0.39785194396972656, 44.42012023925781, 25.804702758789062, -19.350875854492188, 6.236534118652344, 29.913909912109375, 47.76410675048828, 17.699554443359375, -29.333816528320312, -11.89697265625, 34.412315368652344, 36.36677551269531, 61.577239990234375, -15.420074462890625, 80.02275848388672, 78.23109436035156, 94.20521545410156, 65.82560729980469, -61.87091064453125, 14.112968444824219, 4.0636749267578125, 10.751962661743164, 43.712886810302734, -9.810935974121094, 66.92647552490234, -1.3898162841796875, 16.856674194335938, -4.357273101806641, 34.84637451171875, 41.69915008544922, 67.86457824707031, 38.30292510986328, 51.522762298583984, 11.899887084960938, 0.4650726318359375, 5.151044845581055, 66.87076568603516, -18.59033203125, 56.648887634277344, 0.75640869140625, -7.046058654785156, 13.446826934814453, 47.848167419433594, 27.536048889160156, 4.7337188720703125, 52.961822509765625, 51.33860778808594, 24.95925521850586, 13.770843505859375, -24.32220458984375, 54.656410217285156, 49.373435974121094, 21.944656372070312, 37.768272399902344, 47.525177001953125, 7.9367523193359375, 20.378402709960938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000254.npy"}
{"epoch": 0.37298091042584436, "step": 255, "batch_size": 64, "mean": 34.674278259277344, "std": 34.94605255126953, "min": -38.10075378417969, "p10": -11.085088729858393, "median": 36.524972915649414, "p90": 75.83719329833986, "max": 133.82101440429688, "pos_frac": 0.84375, "sample": [76.89004516601562, 14.801727294921875, 4.7188568115234375, 82.22511291503906, 37.83738708496094, -25.274322509765625, 23.412940979003906, -38.10075378417969, 28.184539794921875, 47.761314392089844, 28.9954833984375, 47.312191009521484, 38.28395080566406, 1.1916618347167969, 63.03987121582031, 65.8695068359375, 19.791088104248047, 48.59068298339844, 44.03147888183594, 73.38053894042969, 14.120956420898438, 4.763820648193359, 9.50604248046875, 53.101985931396484, 17.29236602783203, 22.307472229003906, -25.984582901000977, 51.4400634765625, 6.553916931152344, 2.458099365234375, -13.4442138671875, 133.82101440429688, 67.13180541992188, 51.09441375732422, 7.8172454833984375, 44.85139465332031, 92.02153015136719, 42.542747497558594, 44.470977783203125, 72.85159301757812, 42.15174102783203, -27.10420036315918, 48.544517517089844, 20.86565399169922, 14.781688690185547, 35.21255874633789, 72.39778137207031, 89.6316909790039, 27.974098205566406, 62.5373420715332, 57.94950866699219, 13.725212097167969, -3.2740478515625, -14.069961547851562, -5.580463409423828, 67.45094299316406, 62.9281005859375, 87.96482849121094, 27.96031951904297, 34.40486145019531, -31.79553985595703, 68.62938690185547, -2.4705352783203125, 86.67655944824219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000255.npy"}
{"epoch": 0.3744493392070485, "step": 256, "batch_size": 64, "mean": 33.084007263183594, "std": 41.50894546508789, "min": -74.40388488769531, "p10": -14.196905899047849, "median": 33.664791107177734, "p90": 85.22252044677735, "max": 146.25160217285156, "pos_frac": 0.8125, "sample": [61.573265075683594, 83.6063232421875, 2.1250152587890625, 25.78515625, -3.1709060668945312, 71.71923828125, 50.89731979370117, 88.03880310058594, 10.913070678710938, 59.041961669921875, 63.62562561035156, 2.2233810424804688, 65.97967529296875, 10.328399658203125, 50.12184143066406, -64.23780059814453, 12.074382781982422, 76.45453643798828, 17.353111267089844, 7.3731889724731445, -1.5149993896484375, -21.702713012695312, 33.91844940185547, 57.875762939453125, 27.022998809814453, 40.12236785888672, 89.84890747070312, 37.74937438964844, 13.034042358398438, 18.2281494140625, 61.84174346923828, 41.92902374267578, 19.684226989746094, -74.40388488769531, -10.199333190917969, 69.7921142578125, 13.405204772949219, 75.50178527832031, 4.510711669921875, -38.78386688232422, 56.003631591796875, -32.267791748046875, 56.21824645996094, -15.219985961914062, 3.3188934326171875, -9.703277587890625, 78.90567016601562, 93.38059997558594, 61.91796875, -11.80971908569336, 20.65900421142578, 36.80628967285156, 63.90080261230469, 89.99798583984375, -22.06908416748047, 85.91517639160156, 58.60547637939453, 17.24410629272461, 104.09138488769531, 7.6082763671875, 33.4111328125, 6.052419662475586, 38.47223663330078, 146.25160217285156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000256.npy"}
{"epoch": 0.37591776798825255, "step": 257, "batch_size": 64, "mean": 32.34702682495117, "std": 37.66559600830078, "min": -49.89289093017578, "p10": -5.564356613159179, "median": 28.778423309326172, "p90": 87.3884376525879, "max": 119.09475708007812, "pos_frac": 0.8125, "sample": [119.09475708007812, 27.87298583984375, 35.85774230957031, 14.34286880493164, 39.445091247558594, 35.94414520263672, 85.22599792480469, 109.53416442871094, 73.7233657836914, -49.89289093017578, 29.425621032714844, -5.848091125488281, 73.45311737060547, 59.16016387939453, 65.7037124633789, 16.717788696289062, 24.291702270507812, 44.0678596496582, -0.9629287719726562, 29.17699432373047, 52.319908142089844, 93.18519592285156, 81.9871826171875, -47.92025375366211, 15.437458038330078, 23.925048828125, -0.90924072265625, 8.436721801757812, 31.893665313720703, 28.379852294921875, 40.46990203857422, 7.977630615234375, 86.80076599121094, 64.2879638671875, 7.639106750488281, -6.03179931640625, 29.90262794494629, -4.902309417724609, 62.829383850097656, 13.018775939941406, 69.45800018310547, 18.82337188720703, 15.524246215820312, 9.248279571533203, 11.307533264160156, 13.253082275390625, 5.1830596923828125, -6.34568977355957, 89.22920227050781, 87.64029693603516, 39.71052932739258, 29.844131469726562, 8.481536865234375, -4.7116851806640625, 35.71887969970703, 91.5701904296875, 48.14349365234375, -1.5452651977539062, 12.7257080078125, -31.836286544799805, -49.71562194824219, 55.915924072265625, 13.5072021484375, 94.01795196533203], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000257.npy"}
{"epoch": 0.37738619676945667, "step": 258, "batch_size": 64, "mean": 30.42020034790039, "std": 33.52629470825195, "min": -55.31230926513672, "p10": -7.358484649658199, "median": 35.6583137512207, "p90": 69.44961700439454, "max": 96.31015014648438, "pos_frac": 0.796875, "sample": [-1.023681640625, -1.3533611297607422, 51.709999084472656, 41.32017517089844, -1.5088119506835938, 38.08015441894531, 57.69166564941406, -2.06549072265625, 36.84490966796875, 4.4298248291015625, 0.3100318908691406, 19.480186462402344, -14.775703430175781, 63.10163116455078, 43.93214416503906, 45.529937744140625, 7.693195343017578, -27.952316284179688, 94.6670150756836, 55.74555969238281, 55.18024444580078, 36.13959503173828, 38.303558349609375, 35.177032470703125, 66.83506774902344, 71.71205139160156, 40.600616455078125, 12.360000610351562, 13.377143859863281, 46.92439651489258, 58.967002868652344, 9.164779663085938, 48.972137451171875, 33.26271057128906, -3.0420989990234375, 7.692958831787109, 44.31315231323242, -55.31230926513672, -3.4823532104492188, 4.705924987792969, 52.570274353027344, 0.8549919128417969, 84.52771759033203, 51.759910583496094, 8.771442413330078, -9.019683837890625, 83.65284729003906, 64.70317077636719, -17.963685989379883, -20.415794372558594, 57.74168395996094, 17.39609146118164, 24.075408935546875, 67.61221313476562, 12.493881225585938, 70.23707580566406, -46.32513427734375, 20.980087280273438, 96.31015014648438, 84.677490234375, 33.57049560546875, 15.622825622558594, 62.01924133300781, 57.331459045410156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000258.npy"}
{"epoch": 0.3788546255506608, "step": 259, "batch_size": 64, "mean": 25.496179580688477, "std": 38.742610931396484, "min": -76.64712524414062, "p10": -13.916218185424801, "median": 28.0269193649292, "p90": 67.53204879760743, "max": 151.29261779785156, "pos_frac": 0.8125, "sample": [35.94911193847656, 10.0233154296875, 63.05250549316406, -26.891769409179688, 69.21855163574219, -73.8548583984375, -28.01318359375, 151.29261779785156, 60.73374938964844, 90.86188507080078, 27.306249618530273, -76.64712524414062, 51.98279571533203, 3.6070022583007812, 19.878463745117188, -2.1813888549804688, 21.87457275390625, 11.556564331054688, 39.165504455566406, 24.50670623779297, 58.84510040283203, 34.0084228515625, 14.78875732421875, 36.44668960571289, 80.97930908203125, 21.109283447265625, 88.94400024414062, 32.14024353027344, 28.747589111328125, -73.12158203125, 65.36654663085938, 3.2060585021972656, 41.70826721191406, 64.601806640625, 30.045013427734375, 43.97349548339844, 60.66094970703125, 87.60089874267578, 39.11043930053711, 41.370399475097656, -6.970588684082031, 30.27716827392578, 34.60601043701172, 34.9635009765625, 1.5429840087890625, 23.57015609741211, -3.8204269409179688, 47.06291961669922, 4.0019683837890625, 32.36309814453125, 0.7031974792480469, 68.46012115478516, 53.39710998535156, 17.768404006958008, 10.929595947265625, -10.909732818603516, 30.12956428527832, -9.179603576660156, 8.651069641113281, -15.2047119140625, 0.8449249267578125, -17.48784637451172, 19.326095581054688, 2.7776260375976562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000259.npy"}
{"epoch": 0.3803230543318649, "step": 260, "batch_size": 64, "mean": 23.313533782958984, "std": 39.79875946044922, "min": -80.61396789550781, "p10": -31.247037506103513, "median": 22.843875885009766, "p90": 73.64548950195312, "max": 112.95790100097656, "pos_frac": 0.734375, "sample": [34.032928466796875, -9.516937255859375, 24.22040557861328, -40.5088996887207, 18.981761932373047, 47.805503845214844, 77.2265625, 44.050323486328125, 20.768646240234375, 9.547256469726562, 14.52425765991211, 49.6522331237793, 7.281200408935547, 43.96942138671875, 60.193450927734375, 84.1405029296875, 48.582942962646484, -68.22718048095703, 0.3350372314453125, 50.60572052001953, -80.61396789550781, -11.272438049316406, 18.357135772705078, 56.5197868347168, -14.7381591796875, -14.677154541015625, 36.43844223022461, 51.480735778808594, 15.9859619140625, 15.719244003295898, 41.32192611694336, 73.8388671875, 31.859466552734375, 70.04707336425781, 34.22653579711914, -14.918964385986328, 112.95790100097656, 78.11847686767578, 2.660755157470703, 15.255538940429688, -31.867584228515625, -22.4801025390625, -0.8929023742675781, -29.799095153808594, 27.991195678710938, -41.828025817871094, -7.47344970703125, -37.639163970947266, 66.0396728515625, 17.748062133789062, 58.657501220703125, 16.56208038330078, -51.57170867919922, 76.26615142822266, 28.776817321777344, 41.90752410888672, 16.055023193359375, 42.47021484375, 63.584415435791016, -9.716812133789062, 21.46734619140625, 73.19427490234375, 52.455101013183594, 85.92729949951172], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000260.npy"}
{"epoch": 0.38179148311306904, "step": 261, "batch_size": 64, "mean": 36.4267463684082, "std": 35.20768737792969, "min": -23.61432647705078, "p10": -10.112083435058594, "median": 36.30523681640625, "p90": 82.76702957153321, "max": 167.07763671875, "pos_frac": 0.84375, "sample": [36.225494384765625, 69.15957641601562, 60.28099060058594, 32.31221008300781, -1.9272003173828125, 167.07763671875, 38.678524017333984, 50.517120361328125, 7.671838760375977, -10.222015380859375, 52.15864562988281, 15.445594787597656, 37.46088409423828, -9.855575561523438, 83.83930206298828, 52.783409118652344, 24.249629974365234, -13.15716552734375, 75.12792205810547, 1.762969970703125, 71.08897399902344, -14.1451416015625, 25.287960052490234, 23.659988403320312, 42.25644302368164, 45.88274383544922, 59.86787414550781, 40.526702880859375, 105.41720581054688, -8.625022888183594, 8.183734893798828, 42.07830047607422, 18.409284591674805, 70.54582214355469, 42.389198303222656, 13.980403900146484, 47.8123664855957, 31.175331115722656, 61.4600830078125, 23.462936401367188, 86.22108459472656, 47.93183135986328, 14.03271484375, 36.384979248046875, -23.61432647705078, 63.37781524658203, 22.80719757080078, 48.16407775878906, 23.772178649902344, 84.37596893310547, 94.98724365234375, 44.079551696777344, 31.826812744140625, 8.519210815429688, -20.97964096069336, 85.10845184326172, 49.535484313964844, -11.361019134521484, 4.149726867675781, -22.20977783203125, 10.400482177734375, 30.713119506835938, 80.26506042480469, 22.518508911132812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000261.npy"}
{"epoch": 0.3832599118942731, "step": 262, "batch_size": 64, "mean": 33.875335693359375, "std": 35.92666244506836, "min": -52.9273681640625, "p10": -3.48924503326416, "median": 29.240020751953125, "p90": 83.95946502685547, "max": 138.43243408203125, "pos_frac": 0.859375, "sample": [7.260623931884766, 24.440505981445312, -52.9273681640625, 39.19422912597656, 33.46600341796875, 9.717514038085938, 100.29937744140625, 83.5001220703125, 34.109825134277344, 7.8356170654296875, -34.974761962890625, 23.107994079589844, 3.9533252716064453, 62.86199951171875, -7.5316162109375, 4.520561218261719, 68.64799499511719, 64.18763732910156, -3.0117053985595703, 75.7435302734375, 35.77781677246094, 47.423583984375, 15.988616943359375, 8.588714599609375, 16.923553466796875, 14.480010986328125, 14.843667984008789, 100.54239654541016, 30.743362426757812, 2.49945068359375, 10.415454864501953, 18.663005828857422, 27.736679077148438, 26.386032104492188, 22.53711700439453, -3.6939048767089844, 10.782218933105469, 69.44772338867188, 90.88548278808594, 33.377342224121094, 41.833038330078125, 38.57377624511719, 41.352020263671875, 47.962554931640625, 94.72058868408203, 88.22361755371094, 66.61088562011719, -37.96429443359375, 55.29917907714844, 49.45650100708008, -5.255149841308594, 75.01358795166016, 7.893333435058594, 65.33950805664062, -10.86087417602539, 84.15632629394531, 54.74774932861328, 35.025428771972656, 21.204368591308594, 25.72967529296875, 15.163299560546875, 38.8629150390625, -2.248504638671875, 138.43243408203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000262.npy"}
{"epoch": 0.38472834067547723, "step": 263, "batch_size": 64, "mean": 45.224769592285156, "std": 42.282264709472656, "min": -65.78169250488281, "p10": -14.44991645812988, "median": 48.58642578125, "p90": 92.4446144104004, "max": 172.73049926757812, "pos_frac": 0.84375, "sample": [56.058258056640625, -19.326385498046875, 7.629096984863281, 61.94329833984375, 43.359375, 13.154273986816406, 58.403411865234375, 36.327362060546875, 28.223052978515625, 54.09202575683594, -14.95452880859375, 105.48950958251953, 15.802938461303711, 60.16796875, 19.146041870117188, 27.042991638183594, 84.79410552978516, 83.33006286621094, 31.913345336914062, 94.92822265625, -15.746231079101562, 28.08538055419922, 82.00678253173828, -21.18152618408203, -13.27248764038086, 20.14946746826172, 32.66789245605469, 79.54035949707031, -17.278648376464844, 61.06964111328125, 40.44696807861328, 13.842025756835938, 59.822975158691406, 32.356117248535156, 47.14042663574219, 69.19964599609375, 88.60657501220703, 50.03242492675781, 93.92839813232422, 64.71466064453125, 25.57248306274414, 125.04608154296875, 63.12805938720703, 75.05943298339844, 54.41700744628906, 17.229331970214844, 55.63488006591797, 88.98245239257812, 62.41157531738281, 2.213653564453125, 5.3529815673828125, 63.59172821044922, 114.89460754394531, -65.78169250488281, 36.96736145019531, 35.76521301269531, 83.2199935913086, 80.08265686035156, -5.967597961425781, -5.931427001953125, 104.83678436279297, 172.73049926757812, 82.75086975097656, -21.476837158203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000263.npy"}
{"epoch": 0.38619676945668135, "step": 264, "batch_size": 64, "mean": 37.84281921386719, "std": 39.01469421386719, "min": -39.788482666015625, "p10": -12.73352832794189, "median": 36.74625015258789, "p90": 87.79898300170899, "max": 129.48233032226562, "pos_frac": 0.828125, "sample": [26.379222869873047, 43.359771728515625, 32.28063201904297, 71.88397216796875, 4.1393585205078125, 86.911865234375, 73.98455047607422, 129.48233032226562, 50.6884765625, 37.14555358886719, 73.12966918945312, 21.43341827392578, 22.420930862426758, -31.93744659423828, 57.48820877075195, 9.92470932006836, 94.71173095703125, 31.370819091796875, 93.23068237304688, -39.788482666015625, -6.792022705078125, 30.200454711914062, 42.755950927734375, 45.510398864746094, 22.321592330932617, 77.19184112548828, 88.1791763305664, 5.890144348144531, 0.10957717895507812, 19.198760986328125, 2.9277572631835938, 20.307159423828125, -14.602396011352539, 9.238922119140625, 9.243141174316406, 26.433937072753906, 23.832443237304688, 61.54168701171875, -5.505893707275391, 66.92952728271484, 69.03814697265625, 17.303985595703125, 75.75631713867188, -31.054290771484375, 36.346946716308594, 37.43479919433594, 40.893531799316406, -19.320037841796875, 76.86029052734375, -4.0907440185546875, 82.2138671875, -26.2193603515625, 40.511383056640625, 101.71382904052734, -8.37283706665039, 89.50434112548828, 49.62431335449219, 107.51359558105469, 70.81851959228516, 80.26943969726562, 72.61981964111328, 57.175132751464844, 25.036962509155273, -32.78953170776367], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000264.npy"}
{"epoch": 0.3876651982378855, "step": 265, "batch_size": 64, "mean": 35.99824523925781, "std": 42.08701705932617, "min": -54.070396423339844, "p10": -12.007386398315427, "median": 27.210494995117188, "p90": 93.08256912231445, "max": 134.61306762695312, "pos_frac": 0.8125, "sample": [51.535926818847656, 134.61306762695312, 60.748695373535156, 82.86842346191406, -4.215431213378906, 34.106483459472656, -46.099151611328125, 53.3970947265625, 91.78440856933594, 30.9144287109375, 15.277328491210938, 78.02096557617188, -4.230655670166016, 5.1898651123046875, 1.630950927734375, 6.140316009521484, 17.924766540527344, -18.420597076416016, 19.810184478759766, 14.522216796875, -1.519989013671875, 88.38381958007812, 68.80670166015625, 122.75729370117188, 35.25044250488281, 72.99951171875, 20.479347229003906, 73.16400909423828, 26.492088317871094, 93.63892364501953, 23.16627311706543, 3.592559814453125, 15.098678588867188, 3.944864273071289, 18.407615661621094, 44.50128173828125, 11.804481506347656, 69.76943969726562, 97.51353454589844, 66.99466705322266, 90.91175842285156, 28.526718139648438, -10.278911590576172, -54.070396423339844, 40.71120834350586, -25.92668914794922, 0.4581718444824219, 19.859973907470703, 16.465545654296875, 51.15913391113281, 58.54904556274414, -27.011016845703125, 103.70429229736328, 107.24467468261719, -6.217018127441406, 21.747102737426758, 103.88829040527344, 79.81620025634766, 65.06057739257812, -20.24726104736328, 51.719764709472656, 11.871200561523438, -12.748161315917969, 27.92890167236328], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000265.npy"}
{"epoch": 0.3891336270190896, "step": 266, "batch_size": 64, "mean": 31.03993034362793, "std": 37.54304504394531, "min": -50.45814895629883, "p10": -16.406770706176758, "median": 28.560962677001953, "p90": 80.33760299682619, "max": 103.4735107421875, "pos_frac": 0.78125, "sample": [12.602340698242188, 103.4735107421875, 56.42047119140625, 39.353065490722656, 74.5915756225586, -23.407867431640625, 7.865325927734375, 61.49909210205078, 45.69413757324219, 53.52893829345703, 39.88785934448242, 89.93559265136719, -8.228492736816406, 93.51085662841797, -6.910820007324219, 30.3289794921875, 102.53231811523438, 36.6585693359375, 74.30911254882812, -34.06707000732422, -10.416587829589844, -50.45814895629883, 74.17607116699219, 37.14250183105469, 69.89090728759766, 1.769378662109375, -15.007286071777344, 22.019134521484375, -7.246337890625, 64.22688293457031, 72.81307983398438, 11.687858581542969, 98.50506591796875, 17.14215087890625, 35.521690368652344, 15.320892333984375, 86.154296875, 82.80018615722656, 16.804588317871094, -31.331268310546875, 33.0091552734375, 28.675308227539062, 2.907012939453125, -11.795948028564453, 66.45732879638672, 27.623580932617188, 23.803482055664062, 34.64875793457031, -28.595680236816406, 23.84222412109375, 3.9648284912109375, 33.14008331298828, 65.34945678710938, 73.67686462402344, -4.0647735595703125, 28.446617126464844, 6.796815872192383, 21.6356201171875, 17.624893188476562, 59.97373962402344, 16.448516845703125, 63.09181213378906, -17.006549835205078, -24.190288543701172], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000266.npy"}
{"epoch": 0.39060205580029367, "step": 267, "batch_size": 64, "mean": 36.915672302246094, "std": 35.42518997192383, "min": -47.838722229003906, "p10": -2.3274452209472654, "median": 33.504356384277344, "p90": 82.60909271240236, "max": 154.10772705078125, "pos_frac": 0.859375, "sample": [48.605255126953125, 41.90602111816406, -2.9167633056640625, -47.838722229003906, 53.31993865966797, 27.160335540771484, 28.14221954345703, 34.44053649902344, 22.741790771484375, -18.688941955566406, 54.44483947753906, 49.933319091796875, 18.504348754882812, 16.661190032958984, 49.68528747558594, 13.940006256103516, 56.766571044921875, 18.808837890625, 57.908721923828125, 154.10772705078125, 11.020235061645508, -2.3965835571289062, 83.86199188232422, 22.157432556152344, 18.013839721679688, 38.146785736083984, 36.57525634765625, 0.5312099456787109, 32.56817626953125, 87.91832733154297, -7.67327880859375, 39.786346435546875, 112.45318603515625, 50.687713623046875, 63.19103240966797, 28.368927001953125, -11.46718978881836, 40.79224395751953, 22.25171661376953, 58.30561065673828, 85.35061645507812, -2.1661224365234375, 26.272937774658203, 48.04066467285156, 23.961517333984375, -0.1300048828125, 6.342315673828125, 79.68566131591797, 115.83155822753906, 22.34375, 29.354114532470703, 51.534080505371094, 8.987648010253906, 71.33334350585938, 105.33430480957031, 3.665496826171875, 30.828033447265625, -29.281158447265625, 10.709056854248047, 66.99139404296875, 70.34327697753906, 43.30374526977539, 47.83013916015625, 43.41109085083008], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000267.npy"}
{"epoch": 0.3920704845814978, "step": 268, "batch_size": 64, "mean": 40.33136749267578, "std": 37.055877685546875, "min": -36.35206604003906, "p10": -2.7281806945800775, "median": 38.55177116394043, "p90": 89.23130264282227, "max": 114.92935180664062, "pos_frac": 0.859375, "sample": [59.52799606323242, 72.22171020507812, 41.19469451904297, 18.4082088470459, 39.64387130737305, 25.513803482055664, 7.606292724609375, -0.9979476928710938, 42.642799377441406, 28.266311645507812, 18.872650146484375, -31.034805297851562, 27.467239379882812, -2.9676437377929688, 76.45603942871094, 47.281829833984375, 23.23824691772461, 38.7525749206543, 11.69378662109375, 57.47873306274414, 22.956787109375, 86.66158294677734, 57.573272705078125, 100.15977478027344, 107.29083251953125, 71.27047729492188, 57.0355224609375, 114.92935180664062, 1.0350265502929688, 102.98898315429688, 7.6372833251953125, 16.83007049560547, 80.24749755859375, 37.3427848815918, 54.69157409667969, 25.89105224609375, 90.33261108398438, 78.12396240234375, 51.05438232421875, 84.7176513671875, 104.67565155029297, 67.61264038085938, 46.869712829589844, -11.556844711303711, 35.83000946044922, -9.151351928710938, 6.465732574462891, 37.4853515625, -36.35206604003906, 112.70064544677734, 11.526687622070312, -9.688385009765625, 49.24784851074219, 27.211952209472656, 8.814140319824219, 74.58114624023438, 59.35221481323242, 60.54939270019531, 38.35096740722656, 80.41761779785156, -2.16943359375, -28.758697509765625, 4.760532379150391, 2.3951492309570312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000268.npy"}
{"epoch": 0.3935389133627019, "step": 269, "batch_size": 64, "mean": 41.10211944580078, "std": 40.262901306152344, "min": -34.36271667480469, "p10": -10.196672058105465, "median": 44.330142974853516, "p90": 91.15423583984378, "max": 148.79095458984375, "pos_frac": 0.8125, "sample": [25.322250366210938, 94.60458374023438, 27.839744567871094, 71.23345947265625, -34.36271667480469, 49.056434631347656, 6.247772216796875, 42.73918151855469, 67.51139068603516, 9.044075012207031, 109.45756530761719, -15.770082473754883, 78.7825927734375, 70.63600158691406, 100.26593017578125, 48.16693115234375, 74.4468994140625, -25.995986938476562, 18.925247192382812, -1.089447021484375, 69.759521484375, 43.888763427734375, -0.050750732421875, 47.202415466308594, 39.07112121582031, 22.565109252929688, 70.05368041992188, 4.039215087890625, 83.10342407226562, -11.535781860351562, 53.16682052612305, -4.5771026611328125, -25.06415557861328, 77.04232788085938, 17.489173889160156, 45.51988220214844, 22.473373413085938, 22.175804138183594, 56.315399169921875, 74.25534057617188, -17.958148956298828, 44.771522521972656, 58.27708435058594, -1.2040557861328125, 42.72414779663086, 148.79095458984375, 5.04217529296875, 8.434768676757812, 100.57562255859375, 53.7012939453125, -7.07208251953125, 23.739273071289062, 71.97956848144531, 115.73139953613281, 0.2423248291015625, 45.458534240722656, 80.18983459472656, 3.7469558715820312, 21.83863067626953, 77.00922393798828, 75.85953521728516, 65.4244155883789, -20.778846740722656, 110.0561294555664], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000269.npy"}
{"epoch": 0.39500734214390604, "step": 270, "batch_size": 64, "mean": 35.722171783447266, "std": 46.051998138427734, "min": -65.86968231201172, "p10": -24.082123565673825, "median": 39.315093994140625, "p90": 90.65823211669922, "max": 135.38345336914062, "pos_frac": 0.75, "sample": [-11.179275512695312, 84.47737121582031, 101.1512451171875, 13.084518432617188, -16.29534149169922, -29.499603271484375, 86.11116027832031, 76.15809631347656, 89.88121032714844, 125.86923217773438, 58.796470642089844, -0.988067626953125, 63.40411376953125, 38.623199462890625, 23.292938232421875, 54.68516540527344, 40.339385986328125, -32.62845993041992, -37.008056640625, -4.880157470703125, 32.9578857421875, 70.1902084350586, 77.48098754882812, 56.947547912597656, 37.710296630859375, 6.8091583251953125, 1.5151081085205078, 15.049522399902344, 74.91250610351562, 47.76911163330078, 44.42625427246094, 15.0985107421875, 107.99359130859375, -65.86968231201172, 82.90013122558594, 46.79926300048828, 66.56763458251953, -3.680004119873047, 40.006988525390625, 31.41752052307129, 78.40666198730469, 49.669288635253906, 90.99124145507812, -17.816390991210938, -25.724288940429688, 76.60236358642578, 100.1807632446289, 7.3326416015625, 30.749008178710938, 15.195426940917969, 63.91831970214844, 6.215080261230469, -4.495597839355469, -20.250404357910156, 67.73307800292969, 43.30445861816406, -63.55724334716797, 5.893497467041016, -46.092628479003906, 18.974777221679688, 57.060821533203125, 135.38345336914062, -1.3494148254394531, 107.49635314941406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000270.npy"}
{"epoch": 0.3964757709251101, "step": 271, "batch_size": 64, "mean": 43.856292724609375, "std": 43.8120002746582, "min": -69.40420532226562, "p10": -22.326221084594707, "median": 51.68010902404785, "p90": 96.70889892578126, "max": 117.84598541259766, "pos_frac": 0.859375, "sample": [43.59613037109375, 111.60658264160156, 21.696548461914062, 61.40015411376953, 38.811119079589844, -31.582462310791016, 29.125946044921875, 104.13845825195312, 60.404090881347656, 62.54838562011719, 26.697158813476562, -67.06340026855469, 85.35455322265625, 54.64198303222656, 51.75777053833008, 91.18226623535156, -37.6104736328125, 117.84598541259766, -4.580268859863281, 11.765461921691895, -50.10725402832031, 51.32786560058594, 95.28091430664062, 66.26652526855469, 51.2769775390625, 95.14154052734375, 31.612804412841797, 37.156654357910156, 51.56903839111328, 16.576271057128906, -29.931629180908203, 56.08906936645508, 55.59729766845703, 71.76824951171875, 97.32089233398438, 52.96614074707031, 30.565887451171875, 1.711343765258789, 55.77826690673828, 65.31908416748047, 79.05667114257812, 51.602447509765625, 23.104190826416016, 13.211984634399414, 22.59866714477539, 25.95719337463379, 2.21209716796875, -39.07252883911133, 101.1143798828125, 57.36083984375, 87.27607727050781, 105.19718170166016, 68.15670776367188, 9.311065673828125, 33.82698059082031, -69.40420532226562, -3.9622268676757812, 64.47908020019531, 73.27102661132812, 53.791595458984375, 92.7672119140625, 30.64984130859375, 89.89491271972656, 99.37959289550781], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000271.npy"}
{"epoch": 0.39794419970631423, "step": 272, "batch_size": 64, "mean": 41.335079193115234, "std": 44.898433685302734, "min": -50.47248840332031, "p10": -12.591604232788086, "median": 33.66281700134277, "p90": 105.15384292602542, "max": 127.56654357910156, "pos_frac": 0.84375, "sample": [9.590126037597656, -4.121971130371094, 63.39483642578125, -12.364322662353516, 15.240699768066406, 66.65811920166016, 91.5317611694336, 125.7936019897461, 72.41707611083984, 87.78456115722656, 35.54833221435547, 39.04042053222656, 4.192129135131836, 32.00929641723633, -37.65721130371094, 91.19950866699219, 81.47216796875, 38.311737060546875, 114.30325317382812, 108.58435821533203, -33.96809387207031, 30.74951934814453, 27.977577209472656, 119.71868896484375, -31.63763427734375, 10.405174255371094, 72.64691162109375, 127.56654357910156, 43.22743225097656, 112.75198364257812, 94.61427307128906, 21.34143829345703, 24.433094024658203, 36.094482421875, 36.061790466308594, 16.50621795654297, 83.16334533691406, -50.47248840332031, 21.034347534179688, 60.524024963378906, 123.13317108154297, 21.54217529296875, 4.8275909423828125, 28.834243774414062, 28.698333740234375, 15.724449157714844, 96.38629150390625, 26.233482360839844, 3.7039566040039062, 97.14930725097656, 4.033905029296875, 93.28779602050781, -23.191436767578125, -12.689010620117188, 12.252899169921875, 80.57681274414062, 68.07447052001953, -2.17388916015625, 35.31633758544922, 4.09492301940918, 6.942840576171875, 52.918907165527344, 52.044960021972656, -17.944427490234375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000272.npy"}
{"epoch": 0.39941262848751835, "step": 273, "batch_size": 64, "mean": 43.12675857543945, "std": 50.7337760925293, "min": -113.93143463134766, "p10": -16.86694297790527, "median": 43.84781455993652, "p90": 104.64853820800784, "max": 158.56515502929688, "pos_frac": 0.8125, "sample": [-12.342063903808594, 93.06752014160156, -49.773765563964844, 8.157737731933594, 135.56842041015625, 158.56515502929688, 22.12652587890625, 29.410598754882812, 70.062744140625, 34.686859130859375, -10.452003479003906, 31.5126953125, 62.94343566894531, 54.10210418701172, -21.983654022216797, 131.70765686035156, -37.178688049316406, 46.43659210205078, 100.04177856445312, 126.49859619140625, 76.73725891113281, 55.78532028198242, 8.867767333984375, 44.23049545288086, -17.541362762451172, 77.99134063720703, 55.91328430175781, 52.0532112121582, 48.91188049316406, 106.62286376953125, -52.46343994140625, 0.7489089965820312, 97.26868438720703, 84.11390686035156, 64.36258697509766, 110.07241821289062, 39.02540588378906, 52.956756591796875, 42.64815139770508, 86.19961547851562, -15.293296813964844, 77.7557373046875, 26.413780212402344, -2.7988662719726562, 41.26824951171875, 18.20545196533203, 18.772186279296875, -14.341217041015625, 19.221107482910156, 6.677680969238281, 77.42158508300781, 40.70325469970703, -21.76348114013672, 144.5481414794922, 60.57965087890625, 73.04481506347656, 29.57233428955078, 4.941257476806641, 62.677398681640625, 51.233978271484375, 92.58753967285156, -113.93143463134766, 43.46513366699219, 31.488235473632812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000273.npy"}
{"epoch": 0.4008810572687225, "step": 274, "batch_size": 64, "mean": 34.18390655517578, "std": 37.89019012451172, "min": -39.792762756347656, "p10": -13.539523506164542, "median": 24.89544677734375, "p90": 83.89529876708986, "max": 118.67347717285156, "pos_frac": 0.859375, "sample": [18.736541748046875, 20.07238006591797, 21.245407104492188, -39.792762756347656, 64.63169860839844, 45.47181701660156, 5.735221862792969, 5.2616119384765625, -17.29286003112793, 106.02818298339844, 16.940547943115234, 114.17913055419922, 6.0174713134765625, -23.233078002929688, 16.23700714111328, 82.21794128417969, 62.71057891845703, 39.773841857910156, -24.3759765625, -4.78173828125, 115.6850357055664, 31.717239379882812, 38.275169372558594, 15.638435363769531, -34.82544708251953, 40.535072326660156, 61.964149475097656, 41.10052490234375, 37.77909851074219, 63.750579833984375, 23.4421443939209, 74.74822998046875, 1.99298095703125, 45.411529541015625, 18.08115005493164, 73.42987060546875, 68.67478942871094, 24.704505920410156, 118.67347717285156, 65.53826904296875, 53.04145050048828, 23.38064956665039, 21.112289428710938, -33.41581344604492, -35.939735412597656, 19.132652282714844, 76.59989929199219, 18.2222900390625, 5.2427215576171875, 96.14301300048828, 84.61416625976562, 9.951019287109375, 25.811050415039062, 41.867897033691406, 96.28524780273438, 20.0989990234375, 17.30331802368164, 29.261280059814453, 17.848548889160156, 25.086387634277344, 68.91560363769531, -0.7295303344726562, 11.085899353027344, 54.750980377197266], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000274.npy"}
{"epoch": 0.4023494860499266, "step": 275, "batch_size": 64, "mean": 37.44886016845703, "std": 47.80410385131836, "min": -77.56024169921875, "p10": -26.619732666015622, "median": 38.553009033203125, "p90": 101.13041305541992, "max": 129.3086700439453, "pos_frac": 0.78125, "sample": [-34.399269104003906, -4.795757293701172, 16.416637420654297, 2.9280433654785156, 42.318817138671875, 73.096435546875, 54.01197052001953, -7.158927917480469, 70.30545806884766, 87.40376281738281, 82.23332977294922, 99.8912124633789, 46.85212707519531, 21.34596061706543, 11.212669372558594, 34.787200927734375, 25.052303314208984, 51.72406005859375, -77.56024169921875, -3.6931915283203125, 104.5833740234375, 72.28319549560547, 16.293106079101562, 19.957988739013672, -39.295021057128906, 43.01664733886719, -15.26318359375, -28.370834350585938, 65.1142349243164, -27.19085693359375, 21.4074649810791, 63.36563491821289, 88.80575561523438, 21.541168212890625, 49.64447021484375, 26.340728759765625, 3.98297119140625, 71.20039367675781, -0.05441474914550781, 22.628753662109375, -25.287109375, -25.137161254882812, -65.32860565185547, 77.87464904785156, 83.03169250488281, 111.03434753417969, 50.79161071777344, 105.21844482421875, 26.53670310974121, 26.506698608398438, 76.26991271972656, -71.15210723876953, 43.59580993652344, 111.18898010253906, 93.15129852294922, 7.6685028076171875, 43.50591278076172, 129.3086700439453, 33.74052429199219, 95.06266784667969, 101.90325164794922, 59.25245666503906, 101.6614990234375, 34.364166259765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000275.npy"}
{"epoch": 0.40381791483113066, "step": 276, "batch_size": 64, "mean": 37.754920959472656, "std": 46.52969741821289, "min": -67.61605834960938, "p10": -14.971034240722656, "median": 30.9661865234375, "p90": 98.63838653564454, "max": 176.1181640625, "pos_frac": 0.859375, "sample": [32.60289001464844, 94.08183288574219, 124.40341186523438, 72.77415466308594, 20.335067749023438, 44.778724670410156, 26.88282012939453, 99.64404296875, -24.68115997314453, 55.579620361328125, 53.303741455078125, 12.301101684570312, 13.978042602539062, 32.58812713623047, 38.85601806640625, 112.2380142211914, 1.7418136596679688, -14.454536437988281, 89.59788513183594, 54.661502838134766, 12.544429779052734, -45.57842254638672, 46.26560592651367, 27.173248291015625, 2.2074737548828125, 71.19601440429688, 8.444381713867188, 18.847930908203125, 50.055572509765625, 49.568119049072266, -9.941802978515625, -63.947235107421875, 34.891578674316406, 17.525482177734375, 71.56280517578125, 116.13029479980469, 28.076705932617188, 23.894622802734375, 5.971487045288086, 7.510860443115234, 36.06329345703125, 20.64946746826172, -37.27142333984375, 83.24420166015625, 15.473968505859375, -39.70936584472656, 2.2167739868164062, 42.15711975097656, 111.82611846923828, 102.68397521972656, 96.29185485839844, 20.466224670410156, 65.19953918457031, 78.11958312988281, -15.192390441894531, 85.01811218261719, 19.19796371459961, -67.61605834960938, 75.38017272949219, 19.031410217285156, 62.14947509765625, 176.1181640625, 29.34424591064453, 21.86041259765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000276.npy"}
{"epoch": 0.4052863436123348, "step": 277, "batch_size": 64, "mean": 31.51496124267578, "std": 39.171363830566406, "min": -66.0223159790039, "p10": -13.139705276489257, "median": 31.282318115234375, "p90": 83.81079864501955, "max": 110.0868148803711, "pos_frac": 0.75, "sample": [-6.102043151855469, 60.78771209716797, 22.588844299316406, 87.63348388671875, 89.81884765625, -12.37990951538086, -15.973480224609375, 72.0468521118164, -6.088661193847656, 33.826080322265625, 46.06910705566406, 37.803958892822266, -5.0883331298828125, -44.965885162353516, 90.13263702392578, 76.24636840820312, 13.783950805664062, 10.909896850585938, 51.56883239746094, -6.1658935546875, 41.70791244506836, -6.63458251953125, 86.26233673095703, 84.64976501464844, -10.75387954711914, 37.403900146484375, 19.603965759277344, 40.29518127441406, -1.4532012939453125, 37.634605407714844, 68.91162109375, 78.69136810302734, 24.80937957763672, 110.0868148803711, 70.76223754882812, 1.3095359802246094, -7.043174743652344, 28.834854125976562, 30.111114501953125, 32.453521728515625, -19.573715209960938, 81.85321044921875, 49.77241516113281, -13.46533203125, 6.642002105712891, 5.9580230712890625, 13.877983093261719, 74.11048889160156, 98.99563598632812, 40.15809631347656, 35.72975158691406, 34.19606018066406, 79.84934997558594, -46.69367980957031, 23.660064697265625, 19.88799285888672, -26.172454833984375, 20.030715942382812, 79.73391723632812, 62.44331359863281, 4.134300231933594, 29.492305755615234, -66.0223159790039, 64.26380920410156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000277.npy"}
{"epoch": 0.4067547723935389, "step": 278, "batch_size": 64, "mean": 36.9675178527832, "std": 44.116798400878906, "min": -99.01111602783203, "p10": -12.446231079101562, "median": 37.720890045166016, "p90": 89.55834197998047, "max": 118.94042205810547, "pos_frac": 0.8125, "sample": [34.77861022949219, 84.40208435058594, 73.7137680053711, 93.45986938476562, 40.66908264160156, 46.55938720703125, 59.859649658203125, -62.171478271484375, 117.64256286621094, 49.275787353515625, 11.182365417480469, 90.26771545410156, 68.27738189697266, 44.66229248046875, -1.1879768371582031, 33.26547622680664, -51.902191162109375, 118.94042205810547, 72.9102783203125, 5.4066009521484375, 26.753341674804688, 85.12014770507812, 65.09507751464844, -14.000839233398438, -10.681808471679688, 23.200347900390625, 63.35602569580078, 7.585498809814453, 14.587562561035156, 86.21868896484375, 87.90313720703125, 71.96967315673828, 62.992759704589844, -99.01111602783203, 40.663169860839844, 31.581748962402344, 41.4969596862793, 54.15380859375, -15.337852478027344, 63.166168212890625, 82.41743469238281, 12.294170379638672, 18.46492576599121, 30.054916381835938, -10.845428466796875, 57.69269561767578, 4.4973907470703125, 13.805145263671875, 21.94213104248047, 69.5958251953125, 25.67772674560547, 99.0997314453125, 1.5771484375, 45.10205841064453, 115.49317932128906, 113.42595672607422, -3.6282119750976562, 13.1185302734375, -12.526321411132812, 20.551368713378906, 46.96299743652344, -31.464813232421875, 28.047775268554688, -12.259353637695312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000278.npy"}
{"epoch": 0.40822320117474303, "step": 279, "batch_size": 64, "mean": 42.24311065673828, "std": 44.79942321777344, "min": -69.17387390136719, "p10": -11.744842529296875, "median": 36.450477600097656, "p90": 103.74026260375979, "max": 174.99832153320312, "pos_frac": 0.828125, "sample": [9.48341178894043, 50.45492935180664, -1.760345458984375, 5.523063659667969, -11.633544921875, 43.18206024169922, 38.46510314941406, 36.70533752441406, 7.778289794921875, -30.72643280029297, 61.70631408691406, 62.24836730957031, 106.02967834472656, 82.91337585449219, 92.69093322753906, 5.9922943115234375, -15.754077911376953, 55.84648132324219, 108.21556091308594, -69.17387390136719, 50.317230224609375, 109.71166229248047, 34.24753952026367, 74.6396255493164, 65.09455871582031, 83.90031433105469, 98.3982925415039, 20.53447723388672, 28.479591369628906, 79.21544647216797, -16.381591796875, 76.99253845214844, 26.074432373046875, 109.0615463256836, 34.98002243041992, 64.4887466430664, 21.04119873046875, 174.99832153320312, 51.65748596191406, 128.91490173339844, 16.54016876220703, -7.150909423828125, 34.85905456542969, 25.568756103515625, 4.460544586181641, 80.00593566894531, 31.30341339111328, 17.488956451416016, 85.0145034790039, 12.284717559814453, 36.19561767578125, 35.84300994873047, 117.816162109375, -11.79254150390625, 70.74293518066406, 19.01816177368164, 47.3775634765625, -14.149314880371094, -51.603851318359375, 57.34551239013672, 61.35478210449219, 33.47308349609375, -7.571136474609375, 54.58091735839844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000279.npy"}
{"epoch": 0.40969162995594716, "step": 280, "batch_size": 64, "mean": 45.219730377197266, "std": 44.12567901611328, "min": -71.59034729003906, "p10": -5.585295486450195, "median": 37.88130187988281, "p90": 103.52463836669922, "max": 145.71945190429688, "pos_frac": 0.859375, "sample": [-0.2884521484375, 41.670806884765625, -71.59034729003906, 91.27667236328125, -19.416419982910156, -20.03545379638672, 35.40520477294922, -14.23992919921875, 104.01966857910156, 92.33563232421875, -5.667064666748047, 2.9788665771484375, 118.09330749511719, 20.95160675048828, 39.025482177734375, 76.3759994506836, 61.389671325683594, 74.9781265258789, 65.39915466308594, 18.680011749267578, 5.487947463989258, 81.33363342285156, 73.45677185058594, 32.711246490478516, 102.36956787109375, 72.67631530761719, 32.87483215332031, 75.47267150878906, -22.25970458984375, 83.86431121826172, 91.95808410644531, 110.45982360839844, 10.896514892578125, 122.06712341308594, 100.95379638671875, 0.6800556182861328, 66.59251403808594, 145.71945190429688, 1.2061004638671875, 107.66435241699219, 82.078857421875, 72.55838012695312, -5.394500732421875, -16.797988891601562, 6.520069122314453, 36.73712158203125, 25.205177307128906, 42.27460479736328, 4.305267333984375, 112.44696807861328, 47.923095703125, 21.472442626953125, 16.5257568359375, 28.907737731933594, 71.90431213378906, 36.32292175292969, 13.825660705566406, 96.77654266357422, 23.4998779296875, 14.7406005859375, 48.309600830078125, 33.79753112792969, 58.839866638183594, 13.754730224609375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000280.npy"}
{"epoch": 0.4111600587371512, "step": 281, "batch_size": 64, "mean": 46.17839431762695, "std": 52.71879577636719, "min": -78.53013610839844, "p10": -6.9991516113281245, "median": 35.432918548583984, "p90": 124.4316703796387, "max": 182.93170166015625, "pos_frac": 0.859375, "sample": [-27.036605834960938, 160.95301818847656, 20.182212829589844, 94.46575927734375, 35.475013732910156, 13.792144775390625, 116.99103546142578, 27.49127197265625, 15.730621337890625, 4.839057922363281, 83.15933990478516, 72.62715911865234, 30.513397216796875, 17.4786376953125, 32.56269073486328, -78.53013610839844, 86.69816589355469, 12.180160522460938, 20.601211547851562, 55.65971374511719, 81.7062759399414, 127.62051391601562, 22.744178771972656, 2.7339553833007812, -17.37940216064453, 147.76072692871094, 35.77330017089844, 89.04045104980469, 35.017364501953125, 130.6660614013672, 33.85359191894531, 35.23067855834961, 1.0903816223144531, 74.53463745117188, 35.39082336425781, 29.9976806640625, 63.109779357910156, 38.48283386230469, 83.61569213867188, 60.22633361816406, 142.43978881835938, 16.051925659179688, 54.65727996826172, 66.36563873291016, 157.11956787109375, 59.22877883911133, 28.98578643798828, 102.54745483398438, 182.93170166015625, 37.14802551269531, -6.753997802734375, 40.16474914550781, -19.149559020996094, 11.252655029296875, -7.104217529296875, 40.81060791015625, 18.70594596862793, 102.53834533691406, -52.10127258300781, 59.09099197387695, 48.85591125488281, -66.29017639160156, -0.9816341400146484, 31.85302734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000281.npy"}
{"epoch": 0.41262848751835535, "step": 282, "batch_size": 64, "mean": 56.46161651611328, "std": 48.23524856567383, "min": -44.236328125, "p10": 3.75682830810547, "median": 47.71935272216797, "p90": 117.17050247192383, "max": 205.40048217773438, "pos_frac": 0.921875, "sample": [96.86906433105469, 38.201019287109375, 46.335811614990234, 109.36021423339844, 64.99761199951172, 100.3380355834961, 130.7165985107422, 107.52189636230469, -16.107757568359375, 85.22209167480469, 109.86361694335938, 110.45809936523438, 117.53108978271484, -35.06244659423828, 42.49329376220703, 29.384796142578125, 205.40048217773438, 79.14746856689453, -44.236328125, 6.298980712890625, 103.19625854492188, 116.32913208007812, 58.68021011352539, 21.473003387451172, 66.13140869140625, 139.5430450439453, 84.57111358642578, 81.38285064697266, 29.177398681640625, 52.54308319091797, 64.83599853515625, 84.1560287475586, 4.91162109375, 15.893632888793945, 20.654834747314453, 119.18437957763672, 105.26972961425781, 35.01451110839844, 30.211029052734375, 41.025386810302734, 22.2430419921875, 25.379135131835938, 51.88085174560547, 142.77096557617188, 36.89540100097656, 34.930938720703125, -27.790145874023438, 49.42284393310547, 13.337753295898438, 70.39654541015625, 31.777942657470703, 14.60174560546875, 42.804290771484375, 36.191925048828125, 3.2619171142578125, 48.80830383300781, 46.630401611328125, 49.361270904541016, 49.86469650268555, 154.00448608398438, 38.40650939941406, 21.710403442382812, -2.3706283569335938, 0.10455322265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000282.npy"}
{"epoch": 0.41409691629955947, "step": 283, "batch_size": 64, "mean": 39.232139587402344, "std": 53.171295166015625, "min": -76.51578521728516, "p10": -23.324740982055662, "median": 35.438232421875, "p90": 109.58715591430668, "max": 139.8792266845703, "pos_frac": 0.796875, "sample": [7.8377838134765625, 3.529083251953125, 67.70796966552734, 13.044231414794922, 30.36003875732422, 139.8792266845703, 29.736602783203125, 53.36302185058594, 91.01034545898438, -8.266132354736328, -9.264724731445312, 80.49464416503906, 0.822296142578125, 1.408355712890625, -38.409950256347656, 97.57609558105469, 35.034027099609375, 52.54026794433594, -11.45831298828125, 11.306650161743164, 35.842437744140625, 70.39537811279297, -76.51578521728516, 115.319091796875, 6.719474792480469, 88.26129150390625, 31.899608612060547, 113.00768280029297, 65.20233154296875, 130.1530303955078, 9.726593017578125, 29.12322235107422, 117.68815612792969, 43.09034729003906, 49.50495147705078, 40.524169921875, -44.79705810546875, 90.6870346069336, 3.8148345947265625, 14.887130737304688, -13.966659545898438, 83.23262786865234, 98.42096710205078, -73.6031265258789, -23.860836029052734, 86.2548599243164, 98.14820861816406, 58.46958923339844, 38.56781005859375, -64.6085205078125, 128.5771484375, 24.64764404296875, 101.60592651367188, 16.49207305908203, 77.8916015625, 58.17701721191406, 132.6759033203125, -10.990310668945312, 26.414764404296875, 64.81818389892578, -22.0738525390625, 92.7557373046875, -54.2989501953125, 4.323589324951172], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000283.npy"}
{"epoch": 0.4155653450807636, "step": 284, "batch_size": 64, "mean": 53.3905029296875, "std": 44.697547912597656, "min": -62.54035186767578, "p10": 3.0863010406494196, "median": 51.31819152832031, "p90": 108.31022109985355, "max": 199.36868286132812, "pos_frac": 0.921875, "sample": [56.91827392578125, 70.3225326538086, 51.08332824707031, 75.12527465820312, 33.891517639160156, 18.957908630371094, 35.92803192138672, 25.450607299804688, 61.005027770996094, 56.29156494140625, 66.08076477050781, 29.26616668701172, 70.99443817138672, -13.902885437011719, 46.154640197753906, 0.1424427032470703, -62.54035186767578, 87.17564392089844, 97.54985046386719, 53.94536590576172, 26.03832244873047, 155.7713623046875, 46.420501708984375, 121.39628601074219, 87.08035278320312, -6.9268798828125, 90.12069702148438, 32.311920166015625, 41.61067199707031, -30.45553207397461, -5.608245849609375, 199.36868286132812, 83.7051010131836, 51.55305480957031, 35.77342224121094, 58.61883544921875, 86.44225311279297, 8.991653442382812, 56.813133239746094, 165.5618896484375, 116.20161437988281, 39.011505126953125, 28.19317626953125, 38.777862548828125, 56.95451354980469, 9.92886734008789, 35.35223388671875, 26.863906860351562, 0.7919769287109375, 68.21186065673828, 50.769805908203125, 37.30622863769531, 114.10700988769531, 101.07379913330078, 111.41154479980469, 8.43972396850586, 15.586128234863281, 21.896957397460938, 22.509063720703125, 60.62887191772461, 86.07183837890625, 71.14073181152344, 79.43853759765625, 51.89695739746094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000284.npy"}
{"epoch": 0.4170337738619677, "step": 285, "batch_size": 64, "mean": 37.775997161865234, "std": 41.17247772216797, "min": -71.97068786621094, "p10": -15.771121978759759, "median": 39.97208023071289, "p90": 88.45811462402345, "max": 138.255615234375, "pos_frac": 0.859375, "sample": [91.9538803100586, 8.760528564453125, 39.58026123046875, 17.915420532226562, -33.65459060668945, 40.60512924194336, 40.36389923095703, -25.387840270996094, 74.94337463378906, 8.23822021484375, 10.862472534179688, 86.04566955566406, 75.32435607910156, 16.514787673950195, 58.54024124145508, 119.12845611572266, 70.59083557128906, 25.293426513671875, 138.255615234375, 62.081642150878906, 28.512466430664062, -37.831756591796875, 14.532699584960938, 56.50287628173828, 36.51582336425781, 69.12300109863281, 48.988075256347656, 45.54646301269531, 41.69630432128906, 38.15904235839844, 89.49201965332031, 51.92292022705078, -54.389404296875, 10.089073181152344, 46.61958312988281, 100.23262023925781, -5.424446105957031, -8.251296997070312, 49.56825256347656, 103.39239501953125, 35.210208892822266, 52.35411071777344, 41.15484619140625, 29.400497436523438, 42.90371322631836, 7.246837615966797, 6.875068664550781, 56.79120635986328, 76.97300720214844, 31.551368713378906, -47.787986755371094, 32.45627212524414, 48.65235900878906, 29.779022216796875, 27.654308319091797, 74.12104797363281, 123.03866577148438, -71.97068786621094, -18.99390411376953, 13.491287231445312, 44.89739990234375, 35.18791961669922, 56.63758850097656, 39.08721923828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000285.npy"}
{"epoch": 0.4185022026431718, "step": 286, "batch_size": 64, "mean": 49.17796325683594, "std": 49.04525375366211, "min": -72.28709411621094, "p10": -21.163096046447748, "median": 49.796287536621094, "p90": 107.24006958007813, "max": 167.87060546875, "pos_frac": 0.8125, "sample": [24.568336486816406, 54.201873779296875, 75.34538269042969, 50.41693878173828, 86.30845642089844, 65.92112731933594, 99.82923126220703, -10.739631652832031, 19.33771514892578, 38.97846984863281, 39.236568450927734, 55.9844970703125, 69.34922790527344, -11.30855941772461, 21.324981689453125, 116.63615417480469, 159.215576171875, 10.910659790039062, 20.700454711914062, 27.668760299682617, 135.3699188232422, -30.901573181152344, -23.95008087158203, 62.19076156616211, 45.406341552734375, 24.265987396240234, 59.60975646972656, 92.58749389648438, -1.767822265625, 108.18057250976562, 79.26998901367188, 90.28800964355469, 79.98136138916016, 88.60301208496094, 85.3441162109375, 81.27611541748047, 118.96141052246094, 38.728614807128906, 65.83386993408203, -23.259063720703125, 45.18096160888672, 58.98192596435547, 49.175636291503906, -12.844184875488281, -44.57460021972656, 72.58622741699219, 106.39256286621094, 41.73967742919922, -72.28709411621094, 167.87060546875, 16.681129455566406, 82.89476776123047, -16.272504806518555, 53.36810302734375, -34.89665222167969, 107.60328674316406, -26.942398071289062, 29.44623565673828, 48.597686767578125, 28.155471801757812, 96.25386810302734, 47.56609344482422, 88.35682678222656, 24.451080322265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000286.npy"}
{"epoch": 0.4199706314243759, "step": 287, "batch_size": 64, "mean": 30.320152282714844, "std": 51.54335021972656, "min": -84.25067901611328, "p10": -24.96230354309082, "median": 28.818394660949707, "p90": 84.37800903320314, "max": 196.47869873046875, "pos_frac": 0.6875, "sample": [0.7946395874023438, 31.717529296875, 67.76115417480469, -0.21903228759765625, 5.104713439941406, -21.914657592773438, 40.7740478515625, -25.09283447265625, 110.69903564453125, -18.267772674560547, 161.05575561523438, 87.41531372070312, 70.25239562988281, 69.4712905883789, 49.64110565185547, -2.3476333618164062, -24.99654769897461, 54.037109375, -24.882400512695312, -36.52104187011719, 27.581205368041992, 23.908504486083984, 78.87342834472656, 24.846405029296875, 196.47869873046875, 49.549896240234375, 8.844402313232422, -82.4329833984375, -11.4503173828125, 25.609352111816406, 15.186656951904297, 72.64781188964844, -1.2772331237792969, -0.6533966064453125, 26.401174545288086, 81.482177734375, 59.72123718261719, 63.16545104980469, 49.56250762939453, 6.809661865234375, 45.732147216796875, 64.71275329589844, -84.25067901611328, 30.055583953857422, 46.7493896484375, 13.76126480102539, 45.23280334472656, -13.140487670898438, 92.54817962646484, 76.44534301757812, -13.833200454711914, -7.966453552246094, 51.48423767089844, 54.05184555053711, -55.801483154296875, -7.765176773071289, -46.05470657348633, 85.61907958984375, 4.671026229858398, -4.020599365234375, 30.680252075195312, 44.059444427490234, 33.21546173095703, 144.96701049804688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000287.npy"}
{"epoch": 0.42143906020558003, "step": 288, "batch_size": 64, "mean": 51.22802734375, "std": 54.94649887084961, "min": -35.39804458618164, "p10": -14.29862937927246, "median": 40.48094940185547, "p90": 130.6542510986328, "max": 203.91268920898438, "pos_frac": 0.765625, "sample": [-30.717472076416016, 25.433456420898438, -22.83203125, 31.701210021972656, -12.522651672363281, 111.17100524902344, -7.139743804931641, 112.45028686523438, -14.189769744873047, 140.93173217773438, 134.5330352783203, 65.41705322265625, -35.39804458618164, 61.55632019042969, 20.677688598632812, -1.35882568359375, 16.250404357910156, 54.98462677001953, 69.443359375, 85.81150817871094, 7.795566558837891, 34.550994873046875, 83.5283203125, -21.100341796875, 87.9730453491211, 27.062026977539062, -0.80029296875, 7.240482330322266, 59.94703674316406, 31.262237548828125, -24.989532470703125, -14.345283508300781, 154.96392822265625, 119.83294677734375, 141.32711791992188, 5.4679718017578125, 11.890960693359375, 138.2969970703125, 37.27338409423828, 43.025230407714844, -10.390113830566406, 31.76239776611328, -10.436943054199219, 131.72573852539062, 128.15411376953125, 87.06576538085938, 34.083343505859375, -0.4206657409667969, 105.27220153808594, 66.78388977050781, 100.59801483154297, 65.21405029296875, 37.936668395996094, 95.83554077148438, 78.74674987792969, -29.957412719726562, 203.91268920898438, 55.95097351074219, 24.319961547851562, 97.2609634399414, 50.02674865722656, 117.09004211425781, 28.831634521484375, 52.82148361206055], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000288.npy"}
{"epoch": 0.42290748898678415, "step": 289, "batch_size": 64, "mean": 53.087974548339844, "std": 62.08970642089844, "min": -62.84619140625, "p10": -9.70083541870117, "median": 38.306766510009766, "p90": 143.78465423583984, "max": 210.26898193359375, "pos_frac": 0.765625, "sample": [33.948699951171875, 64.01934814453125, 182.60321044921875, 122.73467254638672, -17.163005828857422, 40.09193420410156, -2.559112548828125, 126.64893341064453, 1.88909912109375, 35.01513671875, 82.41917419433594, 68.86231994628906, 90.7629623413086, 187.540283203125, 66.12481689453125, 108.43075561523438, 143.56800842285156, 210.26898193359375, 16.388999938964844, 114.76787567138672, 44.63301086425781, 17.519744873046875, -62.84619140625, -7.147895812988281, 9.457575798034668, 9.388290405273438, 172.98353576660156, -23.809677124023438, 52.01689147949219, 10.002120971679688, 105.18521118164062, 117.31651306152344, -2.1516799926757812, 8.48044204711914, -17.000152587890625, -10.794952392578125, 150.12112426757812, 62.29716491699219, 4.0009765625, 5.9462890625, 8.045341491699219, 143.87750244140625, -3.885885238647461, 36.82323455810547, -6.350055694580078, 68.10880279541016, 147.46502685546875, 2.5317840576171875, -1.6480712890625, 47.49040222167969, 76.41017150878906, 116.4913330078125, -5.443523406982422, 39.79029846191406, 35.31358337402344, 15.818023681640625, 13.113729476928711, -17.892589569091797, -2.532257080078125, 128.01614379882812, -18.918197631835938, 106.05958557128906, 92.654541015625, 54.33009338378906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000289.npy"}
{"epoch": 0.4243759177679883, "step": 290, "batch_size": 64, "mean": 54.51033020019531, "std": 58.929656982421875, "min": -96.83722686767578, "p10": -2.8562292098999, "median": 48.76817512512207, "p90": 138.90937194824224, "max": 257.7351379394531, "pos_frac": 0.859375, "sample": [37.19232177734375, 147.39926147460938, 87.93244934082031, 34.788238525390625, 56.201629638671875, 10.868606567382812, -0.2421875, 6.092399597167969, 29.02630615234375, 10.625091552734375, 73.26828002929688, 52.80303955078125, 34.50361633300781, 103.45834350585938, 96.89574432373047, 76.12940979003906, -55.854705810546875, 27.32891082763672, -8.055717468261719, 55.51373291015625, 58.55592346191406, 75.51724243164062, 76.80322265625, 49.29734802246094, 49.099159240722656, -96.83722686767578, 143.1466064453125, 58.314910888671875, 257.7351379394531, 161.51992797851562, 29.245166778564453, 31.63812255859375, 32.61692810058594, 117.36973571777344, -52.129364013671875, -3.904010772705078, 44.54412078857422, 54.670021057128906, 13.746307373046875, 125.52922058105469, 69.35569763183594, 26.070995330810547, 42.37684631347656, 87.38318634033203, 37.623687744140625, 14.810592651367188, 84.54303741455078, 81.48258972167969, -34.14408874511719, 48.437191009521484, 58.5418701171875, 71.05911254882812, 33.16907501220703, 160.81167602539062, 12.176675796508789, -8.820053100585938, 175.190673828125, 22.332260131835938, -0.4114055633544922, 11.342321395874023, 43.43622970581055, 155.87454223632812, 129.02249145507812, 64.64260864257812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000290.npy"}
{"epoch": 0.42584434654919234, "step": 291, "batch_size": 64, "mean": 45.109642028808594, "std": 51.42903518676758, "min": -113.31184387207031, "p10": -13.998455047607422, "median": 40.60344696044922, "p90": 117.59396896362307, "max": 139.1095428466797, "pos_frac": 0.84375, "sample": [41.68730926513672, 10.87838363647461, 40.145721435546875, -0.43355560302734375, 31.26752471923828, 92.42330932617188, 122.5723876953125, 58.946372985839844, 128.60440063476562, 9.800262451171875, -48.43223571777344, 20.752044677734375, 129.49154663085938, 23.349132537841797, 17.847057342529297, 23.695388793945312, 87.88887023925781, 76.30770874023438, 61.49676513671875, 18.470916748046875, 139.1095428466797, -75.74871826171875, 80.99560546875, 83.13418579101562, 79.21539306640625, 105.55116271972656, 28.443645477294922, 87.04698181152344, 25.555343627929688, -14.093624114990234, 34.32020568847656, 73.07850646972656, 41.06117248535156, 14.89581298828125, 131.8109130859375, 98.65713500976562, -113.31184387207031, 61.66300964355469, 31.459671020507812, 55.156585693359375, 49.51567077636719, 55.444244384765625, 124.09992218017578, 23.740943908691406, 23.900327682495117, 24.79261589050293, -13.77639389038086, 78.00782775878906, 22.108348846435547, 74.74462890625, 15.148040771484375, -44.217529296875, 103.27352142333984, -9.4881591796875, 25.006362915039062, -16.814041137695312, 113.03209686279297, 23.57204818725586, 52.9599609375, -21.619888305664062, 119.54905700683594, 91.45071411132812, 56.470794677734375, 1.3559799194335938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000291.npy"}
{"epoch": 0.42731277533039647, "step": 292, "batch_size": 64, "mean": 49.889095306396484, "std": 44.92329406738281, "min": -45.197784423828125, "p10": -9.644384384155266, "median": 44.146026611328125, "p90": 111.20688552856448, "max": 189.35662841796875, "pos_frac": 0.859375, "sample": [44.67657470703125, 114.15162658691406, 33.67108154296875, 40.75721740722656, 58.730804443359375, 38.97966766357422, -45.197784423828125, 63.517486572265625, 52.2039794921875, 15.824020385742188, 24.387252807617188, -25.361751556396484, 63.953697204589844, 18.427566528320312, 50.443817138671875, 40.29706954956055, 34.837127685546875, 81.67640686035156, 104.09034729003906, 63.96375274658203, 104.33582305908203, 189.35662841796875, 36.02703857421875, 64.15657043457031, 30.134918212890625, 135.59364318847656, 125.88883972167969, 51.16517639160156, 67.78126525878906, 32.11924362182617, -23.116905212402344, -12.629180908203125, 3.367340087890625, 30.225440979003906, 18.94214630126953, 124.26368713378906, 26.384876251220703, 43.984981536865234, 90.0252685546875, -20.010391235351562, 91.89495849609375, 89.37030029296875, 77.8576431274414, -19.752490997314453, 26.34589385986328, 118.6692886352539, 82.77763366699219, 30.542526245117188, 84.61962890625, 44.307071685791016, -0.5106048583984375, 10.67034912109375, 53.8396110534668, -17.889808654785156, 63.952903747558594, 32.11280822753906, 15.550247192382812, 69.56415557861328, 100.11714935302734, 27.995872497558594, 126.5258560180664, 32.93476867675781, 62.059852600097656, -2.679859161376953], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000292.npy"}
{"epoch": 0.4287812041116006, "step": 293, "batch_size": 64, "mean": 38.51031494140625, "std": 55.76850509643555, "min": -71.05625915527344, "p10": -29.40729293823242, "median": 25.398714065551758, "p90": 108.66807861328125, "max": 192.02012634277344, "pos_frac": 0.765625, "sample": [43.41126251220703, 45.181007385253906, -20.31177520751953, 16.474342346191406, 5.546543121337891, 45.794151306152344, 95.80511474609375, -30.020294189453125, 64.33087158203125, 24.28830337524414, 36.819480895996094, 6.456634521484375, 43.18358612060547, -71.05625915527344, 192.02012634277344, 21.125831604003906, 0.256256103515625, 56.05047607421875, 40.009521484375, 67.96653747558594, -11.707138061523438, -60.51205062866211, 170.13917541503906, -0.19597244262695312, 23.539306640625, 17.047828674316406, 21.073410034179688, 133.2871856689453, -29.877120971679688, 107.96263122558594, 93.41165161132812, 96.0416030883789, 107.42518615722656, 18.097625732421875, 90.18179321289062, 32.67964172363281, 116.35884857177734, -5.221584320068359, 14.622779846191406, 12.547920227050781, 97.03076171875, -42.13123321533203, -28.31102752685547, -5.0176544189453125, 140.34669494628906, 94.87385559082031, -21.218645095825195, 117.66195678710938, 22.655197143554688, -62.24477767944336, 16.720680236816406, -30.395545959472656, 34.68334197998047, 26.509124755859375, 93.71737670898438, 3.5816993713378906, 43.081268310546875, 17.75164031982422, 15.86740493774414, 108.97041320800781, -3.9343032836914062, 38.886444091796875, 99.21356201171875, 56.12754821777344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000293.npy"}
{"epoch": 0.4302496328928047, "step": 294, "batch_size": 64, "mean": 32.374855041503906, "std": 58.75914764404297, "min": -100.4564208984375, "p10": -46.4485595703125, "median": 30.413593292236328, "p90": 109.83125152587893, "max": 223.92242431640625, "pos_frac": 0.765625, "sample": [-74.5139389038086, 130.63050842285156, 37.94158172607422, 143.35316467285156, 67.55572509765625, 33.624061584472656, 61.49635314941406, 25.485889434814453, 57.33604431152344, 42.846221923828125, 37.59173583984375, 39.105308532714844, -19.682376861572266, 71.30880737304688, -63.08283233642578, 26.78435516357422, -47.430023193359375, 30.951416015625, -24.715808868408203, 49.10618591308594, 15.473007202148438, -9.215072631835938, -62.38939666748047, 28.23011016845703, -33.74140930175781, -48.60887145996094, 75.27645874023438, 28.78382110595703, 51.611000061035156, 111.67030334472656, 29.875770568847656, 129.22238159179688, 25.29553985595703, 105.54013061523438, 39.38038635253906, -100.4564208984375, 223.92242431640625, 83.94959259033203, 21.1651611328125, 64.50896453857422, -15.005950927734375, 68.71182250976562, 9.24868392944336, 13.195499420166016, 94.3900375366211, 112.68997955322266, 48.156532287597656, 39.205604553222656, -0.7436370849609375, 5.128198623657227, -44.158477783203125, 9.61688232421875, -82.44441223144531, 14.748920440673828, 37.44176483154297, 87.21408081054688, 15.785167694091797, 22.49999237060547, -39.093017578125, 7.746707916259766, 101.88134765625, 36.694305419921875, 10.03057861328125, 113.86376953125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000294.npy"}
{"epoch": 0.43171806167400884, "step": 295, "batch_size": 64, "mean": 48.46015930175781, "std": 55.45048904418945, "min": -90.737060546875, "p10": -8.714472198486328, "median": 42.55775833129883, "p90": 114.02252883911133, "max": 194.94839477539062, "pos_frac": 0.796875, "sample": [-8.748573303222656, 100.64672088623047, 1.6025390625, 13.140365600585938, 90.10586547851562, 5.192237854003906, 30.951622009277344, 53.46992492675781, 65.37431335449219, 69.06565856933594, 37.490325927734375, -6.4335784912109375, 36.20155334472656, 54.65618133544922, 114.20429992675781, 72.57688903808594, -26.880538940429688, 113.59839630126953, 35.52834701538086, 105.70272827148438, 76.12936401367188, 0.21016693115234375, 19.638092041015625, 76.76642608642578, -9.02023696899414, -4.161186218261719, 82.78997802734375, 42.02224349975586, 92.36590576171875, 83.96983337402344, 17.968124389648438, 55.68232727050781, 0.78253173828125, 56.26533508300781, 43.0932731628418, 91.8831558227539, 107.73919677734375, -23.12697982788086, -35.202186584472656, 118.0418701171875, 3.0080909729003906, 153.6811065673828, -7.8220367431640625, -52.48020935058594, -7.215496063232422, -8.634902954101562, 36.01051330566406, 18.88378143310547, 68.3414306640625, 95.40174865722656, 33.570167541503906, 74.72100830078125, 15.499366760253906, 194.94839477539062, 154.9141082763672, 141.63124084472656, 59.5970573425293, 39.4107666015625, 41.91969299316406, -90.737060546875, -3.4018001556396484, 44.11229705810547, 181.43353271484375, 63.375091552734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000295.npy"}
{"epoch": 0.4331864904552129, "step": 296, "batch_size": 64, "mean": 52.22368240356445, "std": 54.02595520019531, "min": -77.24952697753906, "p10": -10.506370162963865, "median": 50.547645568847656, "p90": 114.38575744628906, "max": 193.31704711914062, "pos_frac": 0.828125, "sample": [-22.38041114807129, 47.15154266357422, 92.6005859375, 178.44827270507812, 93.10269165039062, 193.31704711914062, 14.784400939941406, 23.87169647216797, 66.48878479003906, -77.24952697753906, 113.68016052246094, -5.013313293457031, -49.138092041015625, 95.26119232177734, 4.7146759033203125, 3.5473403930664062, 86.49699401855469, 33.36602783203125, 99.85601043701172, 114.80984497070312, 43.81658935546875, 63.8702392578125, 21.946975708007812, 82.43325805664062, 7.5740814208984375, 73.64546203613281, 88.36825561523438, 70.14112854003906, 57.67987060546875, -8.747032165527344, 122.76730346679688, 114.68815612792969, 67.9791030883789, 95.73526000976562, -0.06304168701171875, 65.63510131835938, 80.42779541015625, 47.6314811706543, 0.7649307250976562, 31.089336395263672, -18.43932342529297, 70.86299133300781, -22.46918487548828, 40.15123748779297, 163.60638427734375, 0.350433349609375, -11.208976745605469, 99.46639251708984, 20.747787475585938, 18.637197494506836, 83.95793914794922, 33.888431549072266, 73.851318359375, 103.88166809082031, -44.80027770996094, 13.254081726074219, 45.1357421875, 89.81594848632812, 69.54336547851562, -8.866954803466797, 47.68719482421875, 53.40809631347656, 42.48640441894531, 142.26759338378906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000296.npy"}
{"epoch": 0.434654919236417, "step": 297, "batch_size": 64, "mean": 43.375144958496094, "std": 54.75285339355469, "min": -67.09541320800781, "p10": -19.886276626586913, "median": 34.30451583862305, "p90": 124.11790924072268, "max": 183.51116943359375, "pos_frac": 0.78125, "sample": [-25.472782135009766, 78.6051025390625, 4.72979736328125, 80.84966278076172, 31.620452880859375, 5.184169769287109, 65.12469482421875, 49.152923583984375, 63.72376251220703, -67.09541320800781, 77.09474182128906, 91.73094177246094, -18.9923095703125, 25.194549560546875, 60.1136474609375, -9.003509521484375, 13.011154174804688, 127.29510498046875, 51.05364990234375, -50.79157257080078, 34.45191955566406, -24.347196578979492, -6.189373016357422, 36.91793441772461, 1.6360626220703125, 62.623748779296875, 81.7435302734375, 9.953132629394531, 62.12958908081055, -1.434051513671875, 57.55492401123047, 15.378334045410156, 4.2802581787109375, 34.15711212158203, 51.65643310546875, -8.494831085205078, 116.11216735839844, 135.98480224609375, 150.33282470703125, 137.2230987548828, 64.13573455810547, 88.10908508300781, 28.29876708984375, 20.373092651367188, -12.397802352905273, -20.269405364990234, 38.922454833984375, 12.628150939941406, 116.70445251464844, 3.7386016845703125, 23.16825294494629, 74.44892120361328, 70.99594116210938, -5.7952880859375, -40.03303527832031, -31.222335815429688, 13.502132415771484, 94.7494888305664, 171.15467834472656, 183.51116943359375, 22.311527252197266, 146.63441467285156, 73.73469543457031, 33.80632781982422], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000297.npy"}
{"epoch": 0.43612334801762115, "step": 298, "batch_size": 64, "mean": 53.48368835449219, "std": 60.236045837402344, "min": -37.23987579345703, "p10": -13.713688278198239, "median": 44.06576728820801, "p90": 129.42779769897464, "max": 285.10906982421875, "pos_frac": 0.8125, "sample": [44.48945617675781, 92.7919921875, 17.786222457885742, 50.247406005859375, -19.081573486328125, 99.84088134765625, -10.189273834228516, 150.81524658203125, 142.7595977783203, -10.12469482421875, -24.403228759765625, 88.68649291992188, 87.74413299560547, 72.83285522460938, -27.818450927734375, 86.78341674804688, -37.23987579345703, 28.117218017578125, 49.06800842285156, 14.065792083740234, 94.39332580566406, -15.224151611328125, 60.92478942871094, -36.046905517578125, 131.91098022460938, 149.29010009765625, 28.49059295654297, 26.778823852539062, 35.336219787597656, 103.13522338867188, -8.618560791015625, 1.1774368286132812, 15.68170166015625, 1.5328254699707031, 0.9111328125, 74.07026672363281, -28.391876220703125, 108.67485046386719, 102.16238403320312, 48.50463104248047, 40.06801986694336, 23.947120666503906, 285.10906982421875, 15.062602996826172, 11.274978637695312, -9.266143798828125, 95.69853973388672, 172.96644592285156, 109.28559112548828, 50.355342864990234, 114.27987670898438, 62.04370880126953, 32.92903137207031, 123.63370513916016, 39.664703369140625, 82.86007690429688, 43.6420783996582, 160.91091918945312, 10.871337890625, 64.91303253173828, 27.328582763671875, 28.36346435546875, -2.826160430908203, 47.97499084472656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000298.npy"}
{"epoch": 0.43759177679882527, "step": 299, "batch_size": 64, "mean": 56.45828628540039, "std": 57.467926025390625, "min": -50.486968994140625, "p10": -12.9655647277832, "median": 58.635337829589844, "p90": 121.53477249145509, "max": 218.19418334960938, "pos_frac": 0.859375, "sample": [56.019859313964844, 6.078697204589844, 61.61180114746094, 62.95191955566406, 10.278297424316406, -17.67151641845703, 103.70759582519531, 90.7705078125, 14.366779327392578, 10.871593475341797, 110.399169921875, 64.87672424316406, 141.12152099609375, 85.932861328125, 112.28231811523438, 84.10896301269531, 48.881683349609375, 144.06985473632812, 37.010643005371094, 112.26785278320312, 41.35853958129883, 19.26905059814453, 24.362659454345703, -14.323440551757812, -41.98484802246094, 5.829170227050781, 31.558197021484375, 1.1421585083007812, -50.486968994140625, -5.527076721191406, 7.731334686279297, 64.70209503173828, 87.91136169433594, 28.97736358642578, 123.08020782470703, 77.52572631835938, 26.956329345703125, 91.09414672851562, 78.84890747070312, 75.4570083618164, 117.92875671386719, 39.05978775024414, 0.7581748962402344, -47.40606689453125, 128.6490478515625, 70.54698181152344, 20.937301635742188, 198.76437377929688, 94.44825744628906, 218.19418334960938, 115.84283447265625, 15.98801040649414, 42.37640380859375, -35.39820098876953, -9.797187805175781, 112.54951477050781, 65.28343200683594, 117.38729095458984, 50.06578063964844, 137.768798828125, -33.544189453125, 61.250816345214844, 11.871450424194336, 106.38565063476562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000299.npy"}
{"epoch": 0.4390602055800294, "step": 300, "batch_size": 64, "mean": 46.72724151611328, "std": 60.56221008300781, "min": -111.15657043457031, "p10": -28.47167892456054, "median": 41.48021697998047, "p90": 123.5546501159668, "max": 189.6581268310547, "pos_frac": 0.828125, "sample": [70.08892059326172, 30.937084197998047, 85.63763427734375, 157.97323608398438, 36.170372009277344, -21.893173217773438, 73.34597778320312, 106.64460754394531, 49.81686019897461, -96.08122253417969, -111.15657043457031, 12.471748352050781, 56.32295608520508, 1.623443603515625, -33.272335052490234, 35.385101318359375, 53.74753189086914, 30.30145263671875, 26.709745407104492, -2.184558868408203, 112.80224609375, 143.3466033935547, 0.71295166015625, 12.81915283203125, -31.291038513183594, 74.25025939941406, 11.349319458007812, 64.49287414550781, 97.62308502197266, 4.371360778808594, 37.42115783691406, 189.6581268310547, 45.539276123046875, -47.32782745361328, 91.64256286621094, 4.347537994384766, 115.57406616210938, -47.269981384277344, 84.65109252929688, 122.95584869384766, 52.73412322998047, 54.19920349121094, 1.49310302734375, 98.11138916015625, -38.00282287597656, 123.811279296875, 35.669857025146484, 27.066890716552734, 113.86457824707031, 80.43836975097656, 137.0438232421875, -4.104236602783203, 20.14202880859375, 16.357826232910156, 15.186211585998535, 31.253768920898438, 48.86248779296875, 22.15875244140625, -4.268684387207031, 171.5537567138672, 78.60018920898438, 152.9472198486328, 59.02457046508789, 46.14213180541992], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000300.npy"}
{"epoch": 0.44052863436123346, "step": 301, "batch_size": 64, "mean": 60.36054611206055, "std": 63.656803131103516, "min": -63.42627716064453, "p10": -7.089939498901367, "median": 49.05122947692871, "p90": 140.1036819458008, "max": 244.34927368164062, "pos_frac": 0.828125, "sample": [74.37980651855469, 112.65477752685547, 41.54631423950195, 140.41104125976562, 197.0833740234375, 139.66653442382812, 39.61505126953125, 93.06314849853516, 76.68042755126953, -19.764312744140625, 106.57962036132812, 132.66339111328125, -5.843528747558594, 54.01278305053711, -6.777027130126953, 41.13312530517578, -7.2240447998046875, 244.34927368164062, -2.02899169921875, 75.67579650878906, 95.21571350097656, 75.92781066894531, -39.345550537109375, 50.22784423828125, 2.9122161865234375, 53.95024108886719, 17.264671325683594, 96.58263397216797, 45.311214447021484, 70.93741607666016, 182.54580688476562, -53.73351287841797, -3.833953857421875, 109.30220031738281, 24.319255828857422, 80.80062103271484, 96.88337707519531, -25.381790161132812, 47.87461471557617, 19.296875, 21.932910919189453, 50.449729919433594, 33.83624267578125, 14.342941284179688, -63.42627716064453, 186.36911010742188, 168.5761260986328, -43.076194763183594, 11.0706787109375, 72.99488830566406, 98.89569091796875, 38.904075622558594, 46.023109436035156, 140.29103088378906, 114.147705078125, 133.68838500976562, 9.879425048828125, 127.01884460449219, 37.544586181640625, 45.18623352050781, 10.411720275878906, 11.381248474121094, 27.936382293701172, 93.76223754882812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000301.npy"}
{"epoch": 0.4419970631424376, "step": 302, "batch_size": 64, "mean": 49.0919189453125, "std": 58.93983459472656, "min": -79.47798156738281, "p10": -16.74231395721435, "median": 47.04438018798828, "p90": 123.9252250671387, "max": 192.01583862304688, "pos_frac": 0.796875, "sample": [117.52954864501953, 146.26461791992188, 4.0301361083984375, 70.11055755615234, 86.35386657714844, 87.822021484375, 133.54757690429688, 23.508995056152344, 54.33177185058594, -72.99705505371094, 46.61048889160156, 8.069311141967773, -23.95315933227539, 42.21269226074219, -70.65982055664062, -10.872781753540039, -0.4383544921875, 6.8876953125, 158.86013793945312, 59.933433532714844, -19.257827758789062, 117.0419921875, 100.06646728515625, 1.2481460571289062, 20.353374481201172, -68.54840087890625, 99.53605651855469, 62.688262939453125, 52.81988525390625, 52.78845977783203, 12.249992370605469, 71.59683990478516, 44.39311981201172, 21.886329650878906, 22.20294761657715, 95.12794494628906, 192.01583862304688, -4.0839385986328125, 90.02127075195312, -79.47798156738281, 80.74229431152344, 114.30779266357422, 76.02557373046875, 101.35720825195312, 21.027359008789062, 110.50666046142578, 64.08289337158203, 126.66622924804688, 139.61192321777344, -0.554962158203125, 19.47981071472168, 34.75605773925781, -1.8687820434570312, 40.37284851074219, 47.478271484375, 23.420635223388672, 53.76769256591797, 145.721435546875, -7.3321685791015625, 100.33148193359375, 26.907455444335938, 4.941131591796875, 95.55917358398438, -27.24591636657715], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000302.npy"}
{"epoch": 0.4434654919236417, "step": 303, "batch_size": 64, "mean": 55.669105529785156, "std": 57.64779281616211, "min": -64.10232543945312, "p10": -21.565549087524403, "median": 60.38042449951172, "p90": 121.62857894897462, "max": 201.1643829345703, "pos_frac": 0.828125, "sample": [108.7406005859375, -47.56489944458008, 76.95413970947266, 71.00163269042969, -25.620372772216797, 116.91581726074219, -12.104293823242188, 41.67921447753906, 13.37544059753418, 49.72090148925781, -10.369720458984375, -9.966819763183594, 116.4397201538086, 7.426002502441406, 147.21270751953125, 54.31934356689453, 24.466232299804688, 46.00600051879883, 8.044670104980469, 150.42701721191406, 60.910308837890625, 106.515869140625, -55.237030029296875, -28.065475463867188, 201.1643829345703, 59.85054016113281, 8.143516540527344, 123.4112319946289, 117.46905517578125, 111.41363525390625, 98.26475524902344, 65.25843048095703, 75.12640380859375, 28.094120025634766, 143.376953125, -64.10232543945312, -45.31116485595703, 54.13671875, 102.8612060546875, 41.90943908691406, 87.17147827148438, 29.392318725585938, 67.15394592285156, 98.86459350585938, 89.87519836425781, 112.06271362304688, 126.35645294189453, 15.742671966552734, 78.79216003417969, -34.754737854003906, 162.80084228515625, 12.424415588378906, 88.32261657714844, 69.67019653320312, 67.38204956054688, 71.54399871826172, 14.79339599609375, -10.66054916381836, 11.2357177734375, 32.48651123046875, 52.9556999206543, 77.25444793701172, 9.02577018737793, 100.63688659667969], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000303.npy"}
{"epoch": 0.44493392070484583, "step": 304, "batch_size": 64, "mean": 58.92473220825195, "std": 60.19404983520508, "min": -108.00748443603516, "p10": -5.077162361145016, "median": 54.74311065673828, "p90": 130.4914077758789, "max": 202.7227783203125, "pos_frac": 0.84375, "sample": [-6.632528305053711, 28.016441345214844, 111.2666244506836, 90.37477111816406, 19.853240966796875, 129.71629333496094, 10.92572021484375, 127.34679412841797, 33.33442687988281, 54.502166748046875, 120.62133026123047, 56.27819061279297, 23.79718780517578, 58.67323303222656, 98.85479736328125, 51.62480163574219, 32.42085266113281, -1.4479751586914062, 37.99981689453125, 81.86296081542969, 129.90707397460938, 54.98405456542969, 111.34085083007812, 86.63644409179688, 88.59282684326172, 86.75633239746094, 101.80067443847656, 23.223243713378906, 158.177001953125, 4.911750793457031, 99.54542541503906, 93.64839172363281, -22.068740844726562, 94.28147888183594, -108.00748443603516, 12.475479125976562, 6.561920166015625, 58.14042663574219, 35.95067596435547, 114.4988784790039, -52.52012634277344, 202.7227783203125, -21.66094207763672, 5.053043365478516, 27.326080322265625, 46.058998107910156, 23.063941955566406, -11.144652366638184, 63.10993957519531, 133.6509552001953, -65.87249755859375, -0.3195381164550781, 130.61512756347656, 130.20272827148438, 103.5403060913086, 52.57152557373047, -0.10666656494140625, 13.815452575683594, 31.852630615234375, 154.47027587890625, 146.82229614257812, 141.54751586914062, 121.11817169189453, 4.519660949707031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000304.npy"}
{"epoch": 0.44640234948604995, "step": 305, "batch_size": 64, "mean": 56.9612922668457, "std": 61.8675537109375, "min": -108.71539306640625, "p10": -18.521598815917965, "median": 59.09696578979492, "p90": 133.25335235595705, "max": 195.5406951904297, "pos_frac": 0.8125, "sample": [101.58514404296875, 121.73753356933594, 13.483795166015625, 63.244476318359375, -54.5880012512207, 67.50372314453125, 100.17190551757812, 48.111297607421875, 62.94212341308594, 154.6511688232422, 100.32872772216797, 7.845493316650391, 16.855205535888672, 101.8267822265625, -20.139083862304688, 28.071456909179688, 60.09300231933594, 195.5406951904297, 128.3166046142578, 110.83780670166016, 178.53677368164062, 65.97234344482422, 70.3253173828125, 81.30113220214844, 37.289058685302734, 9.36335563659668, 40.24725341796875, -8.617279052734375, 99.02342987060547, 42.904144287109375, 24.924285888671875, 100.48602294921875, 17.303939819335938, 17.9891357421875, 146.45553588867188, 11.97427749633789, 146.09310913085938, 37.79655838012695, 16.011070251464844, -10.230728149414062, -20.95049476623535, -14.747467041015625, 99.51978302001953, 108.76005554199219, 94.28978729248047, 133.9248504638672, 67.68386840820312, -1.0819091796875, 97.66285705566406, 152.72279357910156, 131.6865234375, 106.79329681396484, 89.00799560546875, 129.7357635498047, -108.71539306640625, -51.303314208984375, 19.247512817382812, -36.456817626953125, 48.03944396972656, -24.344207763671875, 58.100929260253906, 6.61248779296875, -12.9149169921875, 38.68079376220703], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000305.npy"}
{"epoch": 0.447870778267254, "step": 306, "batch_size": 64, "mean": 69.29483032226562, "std": 52.367340087890625, "min": -45.307586669921875, "p10": 4.5150474548339865, "median": 65.60419464111328, "p90": 140.83999938964845, "max": 168.50152587890625, "pos_frac": 0.90625, "sample": [129.018310546875, 17.302799224853516, 62.85856628417969, 56.03460693359375, -18.428436279296875, 55.5758056640625, 123.92704772949219, 133.7214813232422, 115.53298950195312, 52.05352020263672, 105.32937622070312, 10.566253662109375, -4.651424407958984, 151.45948791503906, 17.30309295654297, 124.2591552734375, 148.29100036621094, 124.80101013183594, 23.714218139648438, 20.590408325195312, 52.372825622558594, 79.12133026123047, 95.9650650024414, 70.10658264160156, 12.684234619140625, 48.21172332763672, -20.726818084716797, 50.16100311279297, 90.83714294433594, 159.41995239257812, 52.56153869628906, -45.307586669921875, 156.69717407226562, 16.63713836669922, 46.763511657714844, 99.54339599609375, 60.71763610839844, 95.16182708740234, 79.26729583740234, 35.56793975830078, 13.664474487304688, 3.697845458984375, 81.43988037109375, 101.10325622558594, -25.204072952270508, 35.416290283203125, 58.379913330078125, 168.50152587890625, 131.81207275390625, 25.5509033203125, 68.34982299804688, 113.86566925048828, 6.421852111816406, 117.69062042236328, 73.51301574707031, 89.7308349609375, 104.60220336914062, 50.51853942871094, 156.6787872314453, 40.543121337890625, 109.98246765136719, 84.15199279785156, -4.4548797607421875, 143.8907928466797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000306.npy"}
{"epoch": 0.44933920704845814, "step": 307, "batch_size": 64, "mean": 49.86820983886719, "std": 66.70695495605469, "min": -95.50299835205078, "p10": -43.751224517822266, "median": 53.712717056274414, "p90": 130.08245391845705, "max": 226.78466796875, "pos_frac": 0.78125, "sample": [144.1136016845703, 4.5931854248046875, 44.723731994628906, 32.49884033203125, 52.93437576293945, 30.343624114990234, -62.900115966796875, -1.5382614135742188, 20.410934448242188, 40.466766357421875, 112.57342529296875, -95.50299835205078, 125.82803344726562, -22.910781860351562, 54.491058349609375, -44.632118225097656, 74.24407958984375, -48.65777587890625, 107.68042755126953, -5.410194396972656, 63.28401184082031, 65.85623931884766, -28.237152099609375, 67.85592651367188, 188.24057006835938, 57.941322326660156, 27.026268005371094, -12.524711608886719, 35.316070556640625, 65.02152252197266, 42.99475860595703, 113.57785034179688, 65.65402221679688, -44.40009307861328, 74.70072937011719, 31.0596923828125, 122.87359619140625, 131.90577697753906, 226.78466796875, 87.83627319335938, 67.3263931274414, 63.340599060058594, -89.59304809570312, -17.695220947265625, 152.01239013671875, 31.773666381835938, 20.973388671875, 119.77955627441406, 35.23882293701172, 11.107261657714844, 57.36620330810547, 69.89765167236328, 96.6292724609375, 67.4244155883789, 58.194679260253906, 175.1636962890625, 90.77430725097656, 31.90066146850586, 178.05494689941406, 90.56692504882812, 36.93309020996094, 3.9252090454101562, -42.23719787597656, -63.40961456298828], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000307.npy"}
{"epoch": 0.45080763582966227, "step": 308, "batch_size": 64, "mean": 49.12928009033203, "std": 68.94951629638672, "min": -84.26394653320312, "p10": -41.82223777770996, "median": 40.69188117980957, "p90": 158.92476348876954, "max": 229.730224609375, "pos_frac": 0.78125, "sample": [94.47360229492188, 86.83973693847656, -72.27974700927734, 19.227832794189453, 66.4645767211914, 160.74990844726562, -84.26394653320312, 63.57559585571289, -10.14263916015625, 28.84303855895996, 49.589141845703125, -58.18704605102539, -77.74543762207031, 20.966278076171875, 42.91712951660156, 100.44119262695312, -39.376224517822266, 109.07518005371094, 95.39468383789062, 32.94242858886719, 0.403594970703125, 229.730224609375, 163.78944396972656, 181.12692260742188, 77.16111755371094, -11.000770568847656, -42.87052917480469, 29.759042739868164, 134.4207305908203, 31.89352798461914, 167.63906860351562, 35.586578369140625, 65.98757934570312, 166.85145568847656, 28.608963012695312, 164.5040283203125, 154.6660919189453, 22.1109619140625, 47.503326416015625, 31.198436737060547, 24.629348754882812, -15.942123413085938, 41.3858642578125, 65.23094177246094, 62.8582763671875, 133.646240234375, -15.238624572753906, 100.3846435546875, 59.456459045410156, 13.248138427734375, 129.60391235351562, 45.574493408203125, -4.3187713623046875, 8.82974624633789, -26.716413497924805, 18.149253845214844, 21.62945556640625, 36.81004333496094, 40.521820068359375, 40.861942291259766, -48.565208435058594, -60.74354553222656, 111.32417297363281, 53.078857421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000308.npy"}
{"epoch": 0.4522760646108664, "step": 309, "batch_size": 64, "mean": 48.37786102294922, "std": 61.822532653808594, "min": -90.69818115234375, "p10": -34.79596557617187, "median": 46.579994201660156, "p90": 135.1778549194336, "max": 185.94375610351562, "pos_frac": 0.828125, "sample": [37.88892364501953, 3.743288040161133, 35.48794174194336, 138.55125427246094, 16.416542053222656, 104.67518615722656, 52.45779037475586, -40.3724479675293, 105.00091552734375, 17.2396240234375, 135.58726501464844, 88.09812927246094, 35.20759582519531, 171.64999389648438, -77.46583557128906, -90.69818115234375, 60.36788558959961, 25.18724822998047, 53.812103271484375, 39.606712341308594, 46.36946105957031, -76.37490844726562, 69.58909606933594, 134.22256469726562, -38.9942626953125, -58.09878158569336, 67.33673095703125, 146.47067260742188, 29.162311553955078, 97.59468078613281, 4.965435028076172, 185.51622009277344, 5.974510192871094, -13.783187866210938, 78.61219024658203, 72.55789184570312, 156.22857666015625, 104.18587493896484, 46.79052734375, 7.23779296875, -55.37908172607422, 120.89035034179688, -9.006584167480469, 185.94375610351562, -24.99993896484375, 66.58753204345703, 68.47425842285156, 31.52886962890625, 82.1185073852539, 17.062881469726562, 57.7513427734375, -8.207988739013672, 55.978973388671875, 4.588188171386719, 65.43907928466797, 28.057945251464844, 96.47444152832031, 63.087493896484375, 45.49153518676758, 33.73172378540039, 23.254806518554688, 53.76607894897461, 86.78946685791016, 28.753982543945312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000309.npy"}
{"epoch": 0.45374449339207046, "step": 310, "batch_size": 64, "mean": 50.79509735107422, "std": 60.667999267578125, "min": -98.21028137207031, "p10": -21.555825042724603, "median": 53.4536247253418, "p90": 127.89046325683594, "max": 190.93687438964844, "pos_frac": 0.765625, "sample": [-9.630834579467773, 15.889541625976562, 190.93687438964844, 65.7087631225586, 9.069564819335938, 165.16473388671875, 104.72616577148438, 67.59336853027344, 26.87408447265625, -15.366134643554688, -45.041587829589844, -24.20854949951172, 14.241653442382812, 76.23844909667969, -9.383258819580078, 26.76622772216797, 12.157474517822266, 24.088539123535156, 93.20782470703125, 56.52558135986328, 109.66552734375, -4.132408142089844, -25.461959838867188, -58.701087951660156, 44.229248046875, 0.9374771118164062, 96.63006591796875, 55.35776138305664, 84.14746856689453, 82.81399536132812, 39.305419921875, 80.94068908691406, 126.47369384765625, -0.42511749267578125, 53.655242919921875, 52.91816711425781, 53.25200653076172, 43.99140930175781, 64.89424133300781, 120.49493408203125, -58.8634033203125, 84.09919738769531, 170.5256805419922, 128.49765014648438, 140.6350555419922, 67.00987243652344, 94.07917785644531, 26.539932250976562, 143.5185546875, 77.89419555664062, -14.37283706665039, -5.320035934448242, 155.6492156982422, 38.82154846191406, -98.21028137207031, -0.9502830505371094, 98.91983032226562, 15.187698364257812, 85.69190216064453, 100.60336303710938, -52.96379470825195, 78.77685546875, 28.38829803466797, 80.18341064453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000310.npy"}
{"epoch": 0.4552129221732746, "step": 311, "batch_size": 64, "mean": 64.79643249511719, "std": 58.922706604003906, "min": -39.648475646972656, "p10": -7.687210845947265, "median": 58.021419525146484, "p90": 147.72927246093755, "max": 220.43922424316406, "pos_frac": 0.859375, "sample": [24.89447784423828, 155.86395263671875, 69.92394256591797, 74.31080627441406, 0.8706960678100586, 204.93431091308594, -18.324111938476562, 98.96365356445312, 94.47624206542969, 180.48947143554688, 89.16922760009766, 20.065261840820312, 97.16480255126953, 152.11752319335938, -39.648475646972656, -9.725830078125, 75.25236511230469, 20.694475173950195, 97.07801818847656, 86.58982849121094, 43.69642639160156, 156.07159423828125, 196.53460693359375, 91.55935668945312, 55.53557586669922, 48.2827262878418, 43.33160400390625, 119.05126190185547, 117.33482360839844, 60.57421112060547, 28.648967742919922, 28.176563262939453, 71.47355651855469, 137.49002075195312, 39.68821716308594, 53.80607604980469, 9.864501953125, 87.42759704589844, -6.8526763916015625, 124.15673828125, 75.55459594726562, -8.044868469238281, 134.64154052734375, 84.90447235107422, 86.11183166503906, 39.83152770996094, -12.49725341796875, 6.389781951904297, -16.843910217285156, 46.234161376953125, -16.413848876953125, 11.683624267578125, 25.463443756103516, 36.17075729370117, 9.125579833984375, 66.64743041992188, 127.75233459472656, 60.50726318359375, 16.480422973632812, -3.0869598388671875, 96.3250732421875, 36.13334274291992, 42.449546813964844, 220.43922424316406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000311.npy"}
{"epoch": 0.4566813509544787, "step": 312, "batch_size": 64, "mean": 55.35394287109375, "std": 63.65188980102539, "min": -108.60513305664062, "p10": -19.900225830078124, "median": 53.13260459899902, "p90": 149.42463684082034, "max": 193.83197021484375, "pos_frac": 0.84375, "sample": [70.3812255859375, 171.72372436523438, 85.9549789428711, 63.31929016113281, 19.60803985595703, -108.60513305664062, 88.42361450195312, 0.705230712890625, 37.51008987426758, 128.76138305664062, -36.54057312011719, 151.513916015625, 144.54965209960938, 103.74578857421875, 132.01841735839844, 34.86286544799805, -39.1115608215332, 110.34146118164062, 59.97645568847656, 160.19773864746094, 91.59907531738281, -55.092567443847656, 73.76431274414062, 35.92670440673828, 27.703994750976562, 7.387310028076172, 116.71397399902344, 52.41436767578125, 175.07968139648438, -18.602706909179688, 45.94384002685547, 80.02981567382812, 4.7871551513671875, 61.620323181152344, 42.814849853515625, 100.54534912109375, 6.179248809814453, 40.89240646362305, -70.77141571044922, 114.94699096679688, 193.83197021484375, 19.330947875976562, -33.166011810302734, 24.561386108398438, 79.9268798828125, 67.62734985351562, -19.221080780029297, 130.99319458007812, 38.873802185058594, 162.66671752929688, 53.8508415222168, -20.191287994384766, 49.98948669433594, 3.7361373901367188, 26.95119857788086, 49.08238983154297, 68.62435150146484, 10.470314025878906, 15.704170227050781, 153.49319458007812, 57.23624801635742, -16.446243286132812, 56.87666320800781, 54.63033676147461], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000312.npy"}
{"epoch": 0.4581497797356828, "step": 313, "batch_size": 64, "mean": 53.44978332519531, "std": 69.3686294555664, "min": -121.03556060791016, "p10": -23.67735748291015, "median": 48.29262924194336, "p90": 144.5484146118164, "max": 214.04405212402344, "pos_frac": 0.78125, "sample": [144.61940002441406, -85.4447021484375, 57.95210266113281, 214.04405212402344, 14.580490112304688, 96.02566528320312, 88.96084594726562, 38.70408630371094, 155.11483764648438, -14.48577880859375, 67.19552612304688, -26.77655029296875, 136.552490234375, 47.27305603027344, 38.98093032836914, 1.2832565307617188, 144.38278198242188, 20.873199462890625, 107.88304901123047, -47.645469665527344, 25.25092887878418, 93.34026336669922, -94.03305053710938, 58.361175537109375, 38.20394515991211, 96.28629302978516, 153.25912475585938, 36.923301696777344, 112.87706756591797, 179.61122131347656, 53.818328857421875, 74.54153442382812, -59.9011116027832, 81.4075927734375, 49.31220245361328, -2.7925872802734375, -2.3205642700195312, -16.445907592773438, 84.4265365600586, 128.64256286621094, 56.31523895263672, -121.03556060791016, 22.655906677246094, 5.372215270996094, 96.70297241210938, 140.87319946289062, 21.6300048828125, -49.272552490234375, 36.88471221923828, 34.94540023803711, 124.38594055175781, 130.59573364257812, 85.93121337890625, 7.992352485656738, -5.997608184814453, 26.912368774414062, -3.603912353515625, 84.5694808959961, 0.7118253707885742, 40.201904296875, -6.207061767578125, 78.77457427978516, 164.97882080078125, 155.62664794921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000313.npy"}
{"epoch": 0.45961820851688695, "step": 314, "batch_size": 64, "mean": 52.88270568847656, "std": 64.00069427490234, "min": -72.76801300048828, "p10": -37.01528244018554, "median": 56.09600067138672, "p90": 132.99373931884767, "max": 233.21435546875, "pos_frac": 0.78125, "sample": [134.16831970214844, -40.372047424316406, -47.88384246826172, -7.948211669921875, -43.35655212402344, 130.2530517578125, 75.64927673339844, -29.182830810546875, 70.84330749511719, -72.76801300048828, 68.59142303466797, 18.861709594726562, 6.802604675292969, 182.12649536132812, 101.01900482177734, 30.70770263671875, 17.985763549804688, 51.920101165771484, 119.17951965332031, 200.71994018554688, 138.77381896972656, 16.87417221069336, 44.47894287109375, 160.60084533691406, -8.731689453125, 34.144134521484375, 10.586708068847656, -7.987092971801758, -53.84565734863281, 16.522926330566406, 73.19237518310547, 94.21723937988281, 56.24793243408203, 91.885009765625, 60.85853958129883, 47.69942855834961, 74.21420288085938, 114.38056945800781, 87.15887451171875, 233.21435546875, 78.0181655883789, 37.99738311767578, 98.99026489257812, 115.85717010498047, -9.772933959960938, 62.41255187988281, 46.77071762084961, 77.7311782836914, -43.74732971191406, 55.944068908691406, -20.787796020507812, 82.63910675048828, -46.92759704589844, 40.63056945800781, 65.0141372680664, 79.39407348632812, 6.2582244873046875, 60.44933319091797, 37.174896240234375, 16.35955810546875, 62.14695739746094, -5.246957778930664, 64.8890380859375, 170.4958953857422], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000314.npy"}
{"epoch": 0.461086637298091, "step": 315, "batch_size": 64, "mean": 54.138145446777344, "std": 74.94766235351562, "min": -140.9664306640625, "p10": -47.95448303222656, "median": 52.663339614868164, "p90": 160.10601959228515, "max": 202.61888122558594, "pos_frac": 0.734375, "sample": [-13.067474365234375, 166.05130004882812, 42.441184997558594, -12.55810546875, -5.303503036499023, 13.521224975585938, -65.51254272460938, -64.94900512695312, -63.871734619140625, -13.17306900024414, 75.23628234863281, 3.4088516235351562, -61.96276092529297, 43.2372932434082, 96.54945373535156, 98.3546142578125, 110.58953094482422, 65.08219909667969, 66.84819030761719, -28.409461975097656, 42.46258544921875, 44.95123291015625, 38.84283447265625, 78.41617584228516, 121.1290283203125, 25.996318817138672, 80.24217224121094, 75.17552185058594, 53.01509094238281, 63.073699951171875, 100.57978820800781, -43.498626708984375, 154.73776245117188, -19.981571197509766, -48.4813232421875, 178.21986389160156, 94.252197265625, 94.30551147460938, 158.03704833984375, 2.6601409912109375, 11.339113235473633, 84.50462341308594, 202.61888122558594, 31.60744285583496, 147.56040954589844, 40.50996398925781, -46.725189208984375, -50.44718933105469, 29.83243179321289, 161.77603149414062, -20.805492401123047, 52.311588287353516, 168.44192504882812, 143.67108154296875, 160.9927215576172, -5.674781799316406, 118.34306335449219, 44.185707092285156, 170.1700897216797, 132.24795532226562, -140.9664306640625, 127.9749984741211, 71.69302368164062, 83.03121185302734], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000315.npy"}
{"epoch": 0.46255506607929514, "step": 316, "batch_size": 64, "mean": 56.54811096191406, "std": 67.0830078125, "min": -114.99534606933594, "p10": -8.540445709228507, "median": 47.893310546875, "p90": 135.86234283447266, "max": 245.34559631347656, "pos_frac": 0.859375, "sample": [36.28663635253906, 9.724042892456055, 18.09691619873047, 63.109893798828125, 70.38997650146484, 99.510009765625, 25.204452514648438, 65.2730712890625, 136.07879638671875, 245.34559631347656, 55.937774658203125, -42.9425048828125, -16.650360107421875, 9.119430541992188, -21.89090347290039, 0.589569091796875, 4.392391204833984, -1.2266921997070312, 1.2496986389160156, 131.62205505371094, 29.98052215576172, 48.83576965332031, 38.991092681884766, 32.83677673339844, 89.77037048339844, 15.935089111328125, 63.96138000488281, 186.140625, 60.21221923828125, 119.38014221191406, 18.35908317565918, -0.148651123046875, 68.03140258789062, 59.50782775878906, 135.35728454589844, 43.46510314941406, 41.92701721191406, -114.99534606933594, 46.95085144042969, 68.4747314453125, 131.57479858398438, 73.82695007324219, 41.01255798339844, 19.522483825683594, 119.55894470214844, -66.41995239257812, 68.20883178710938, 16.36914825439453, 200.81472778320312, 160.24343872070312, 208.72463989257812, 7.607025146484375, -58.734649658203125, 112.15179443359375, 82.1044921875, 6.123676300048828, 63.63108825683594, 95.34049987792969, 1.2309989929199219, 124.91044616699219, 94.30288696289062, 30.50351333618164, -11.674911499023438, 155.95249938964844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000316.npy"}
{"epoch": 0.46402349486049926, "step": 317, "batch_size": 64, "mean": 71.48945617675781, "std": 78.20726776123047, "min": -113.06840515136719, "p10": -22.545283508300777, "median": 58.138248443603516, "p90": 184.29886169433595, "max": 228.2415771484375, "pos_frac": 0.78125, "sample": [73.08721923828125, -3.9018630981445312, -66.31156921386719, -5.947441101074219, 138.29556274414062, 47.20635986328125, 5.4130401611328125, 56.5439453125, 104.74507141113281, 51.36022186279297, 171.8931427001953, 10.392135620117188, 37.69391632080078, -35.157493591308594, 113.76338958740234, 111.98086547851562, -16.9696044921875, -1.1097564697265625, 179.41969299316406, 66.76666259765625, 41.96882629394531, 59.571861267089844, 49.11628723144531, 101.21023559570312, -113.06840515136719, 56.70463562011719, -55.81689453125, 145.916259765625, 218.65707397460938, 96.79251098632812, 60.70680236816406, -0.5177764892578125, -48.48439025878906, 180.86256408691406, 126.98672485351562, 16.310348510742188, 213.24493408203125, 39.00572204589844, 129.99317932128906, 106.8046875, 185.7715606689453, -5.146759033203125, -6.806602478027344, 50.41128158569336, 228.2415771484375, 5.710380554199219, 211.9532470703125, 69.80428314208984, 196.98916625976562, -33.255149841308594, 49.68819046020508, 77.31356811523438, 67.66424560546875, 87.80149841308594, 55.93101501464844, 34.672183990478516, 55.068145751953125, 157.13546752929688, 191.4815673828125, 143.51089477539062, 32.56878662109375, -24.934860229492188, 126.56098175048828, 152.06182861328125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000317.npy"}
{"epoch": 0.4654919236417034, "step": 318, "batch_size": 64, "mean": 64.34667205810547, "std": 66.28287506103516, "min": -91.10248565673828, "p10": -11.806457519531246, "median": 58.24302101135254, "p90": 153.48099975585941, "max": 224.208984375, "pos_frac": 0.828125, "sample": [18.78628921508789, 77.60687255859375, 78.18533325195312, 29.02459716796875, 4.642063140869141, 122.3048095703125, 103.87555694580078, 117.29358673095703, 29.45940399169922, 178.3900146484375, -15.091014862060547, -4.0227203369140625, 80.96659088134766, 103.326416015625, 210.74591064453125, 89.00732421875, -8.695064544677734, 140.79489135742188, 103.40695190429688, 48.85758972167969, 103.92853546142578, 40.84519958496094, 15.907958984375, 104.08937072753906, 158.5794677734375, 66.58255004882812, -6.3223371505737305, -46.300506591796875, 90.53347778320312, 14.97998046875, 112.5345687866211, 167.20468139648438, 145.36456298828125, 1.19091796875, 48.903892517089844, 101.26360321044922, 224.208984375, -3.046865463256836, 6.698944091796875, 156.95947265625, 128.96865844726562, 12.499252319335938, 23.174789428710938, 96.64466857910156, 120.05970001220703, 37.70361328125, -22.65654754638672, 34.30828857421875, -91.10248565673828, -17.272733688354492, -13.139911651611328, 90.29329681396484, 121.28134155273438, 46.44490051269531, 162.18939208984375, 49.90349197387695, 11.715682983398438, 43.648136138916016, 103.57777404785156, 97.16946411132812, -74.93657684326172, 38.13111114501953, 14.675125122070312, 91.93460083007812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000318.npy"}
{"epoch": 0.4669603524229075, "step": 319, "batch_size": 64, "mean": 68.42571258544922, "std": 70.331787109375, "min": -126.7218017578125, "p10": -11.878402709960934, "median": 58.0834903717041, "p90": 153.86070098876954, "max": 224.47047424316406, "pos_frac": 0.828125, "sample": [76.75392150878906, 119.559814453125, 21.88805389404297, 44.9499397277832, 187.29592895507812, 17.01068115234375, 224.47047424316406, 185.34957885742188, 139.91714477539062, 39.164756774902344, 4.838569641113281, -20.284801483154297, 94.97914123535156, 29.237220764160156, 133.91358947753906, 18.572265625, 7.220684051513672, 131.1649169921875, 57.575897216796875, 18.896469116210938, 111.5234375, -1.7299842834472656, 113.0936279296875, -1.7512245178222656, 50.272857666015625, 4.077474594116211, 90.94053649902344, 153.46136474609375, 37.31639862060547, 155.00527954101562, 85.85174560546875, 85.77710723876953, 42.27055358886719, 149.5735321044922, 40.595130920410156, -8.775367736816406, 107.31958770751953, 35.2325439453125, 18.753585815429688, 132.33631896972656, 139.16249084472656, 203.72769165039062, 63.994842529296875, -0.5557746887207031, 131.60350036621094, 41.900718688964844, 83.7971420288086, 75.68399047851562, 132.83441162109375, 123.563720703125, 85.87869262695312, 58.59108352661133, 34.53852844238281, 145.4432373046875, -126.7218017578125, 52.334991455078125, -19.92963409423828, -70.24566650390625, -19.97747039794922, 10.125846862792969, 185.63192749023438, -13.208274841308594, 154.03184509277344, -26.579177856445312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000319.npy"}
{"epoch": 0.4684287812041116, "step": 320, "batch_size": 64, "mean": 57.651084899902344, "std": 64.5251693725586, "min": -123.57609558105469, "p10": -12.969928932189939, "median": 47.984764099121094, "p90": 140.45413970947266, "max": 269.14398193359375, "pos_frac": 0.859375, "sample": [-27.377086639404297, 89.30107879638672, 141.1775665283203, 18.13701629638672, 9.877357482910156, 117.59231567382812, 152.45785522460938, 69.34049224853516, 269.14398193359375, 73.09451293945312, 21.18341064453125, -19.5206298828125, -10.197845458984375, 39.84370422363281, 124.60574340820312, 170.17086791992188, 138.76614379882812, -44.74414825439453, -15.89719009399414, -4.41705322265625, 21.87769317626953, 151.48651123046875, -14.157964706420898, 48.118804931640625, 3.4261856079101562, 81.57691955566406, 87.81558227539062, 47.85072326660156, 42.128196716308594, 62.89951705932617, 0.8462142944335938, 14.070320129394531, 75.87283325195312, 49.180076599121094, 91.88875579833984, 29.355022430419922, 83.4869384765625, 83.64437866210938, 70.36685180664062, 37.6895751953125, 46.347015380859375, -123.57609558105469, 18.10320281982422, 15.505508422851562, 68.8094482421875, 36.13761901855469, 87.71517944335938, 21.023208618164062, 5.630655288696289, 33.94190979003906, 37.342063903808594, 70.45065307617188, 101.84087371826172, 95.57898712158203, 71.5186538696289, 201.8109588623047, 171.4664306640625, 0.702667236328125, 34.531036376953125, 24.22662353515625, 132.8721160888672, 79.99867248535156, 116.54613494873047, -40.81523132324219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000320.npy"}
{"epoch": 0.4698972099853157, "step": 321, "batch_size": 64, "mean": 64.97313690185547, "std": 66.81000518798828, "min": -133.68914794921875, "p10": -12.242491912841786, "median": 59.670684814453125, "p90": 154.01051177978516, "max": 190.131103515625, "pos_frac": 0.84375, "sample": [161.94207763671875, 82.42549133300781, 56.522064208984375, 86.90184783935547, 9.127124786376953, 63.737003326416016, 113.91557312011719, 10.471038818359375, 21.97406005859375, 47.29457092285156, 173.7553253173828, 43.704505920410156, 5.0159759521484375, -2.0881500244140625, -133.68914794921875, 23.848953247070312, 94.1456069946289, 171.85499572753906, 172.678955078125, -33.24095153808594, 1.01434326171875, 16.39293670654297, 46.46159362792969, 49.076934814453125, 173.36703491210938, 51.506324768066406, 95.2229995727539, -16.59435272216797, 43.76023864746094, 61.54741668701172, 84.828857421875, 135.78131103515625, -41.649322509765625, 102.06304931640625, 53.88770294189453, 136.50299072265625, -78.77063751220703, -33.21540832519531, 152.53402709960938, 153.9840545654297, 70.45120239257812, 50.881072998046875, 17.295639038085938, 97.30259704589844, 9.961448669433594, 190.131103515625, 65.9603271484375, -1.170257568359375, 154.0218505859375, 109.95166015625, 150.97816467285156, 111.74250793457031, 25.77497100830078, 143.0236358642578, 54.126853942871094, 58.64588165283203, 131.70040893554688, 60.69548797607422, -0.8240013122558594, 40.78862762451172, -17.741065979003906, 77.71687316894531, 118.30435180664062, 80.56253051757812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000321.npy"}
{"epoch": 0.4713656387665198, "step": 322, "batch_size": 64, "mean": 71.80995178222656, "std": 77.02635955810547, "min": -111.97564697265625, "p10": -24.870047760009758, "median": 61.7217903137207, "p90": 170.89899139404298, "max": 207.1318359375, "pos_frac": 0.828125, "sample": [63.92450714111328, 137.3809814453125, 49.646026611328125, 201.98257446289062, 115.49515533447266, -111.97564697265625, -58.3223876953125, 194.68894958496094, 128.99594116210938, 42.95365905761719, -39.528221130371094, 5.3399810791015625, 115.72360229492188, -9.032806396484375, 204.52676391601562, 154.15260314941406, 113.57087707519531, 38.809661865234375, 51.37952423095703, 31.813400268554688, 148.79150390625, 162.90042114257812, -6.9023284912109375, 192.95672607421875, -34.57001495361328, 69.71472930908203, 3.0424957275390625, 74.31185913085938, -28.517227172851562, 59.519073486328125, 74.11212158203125, 33.298789978027344, 172.4749298095703, 71.4238052368164, 123.06114196777344, 52.85346603393555, 36.99690246582031, 50.345855712890625, 13.676292419433594, 96.83383178710938, -30.526214599609375, 184.08883666992188, 98.82955932617188, 18.663089752197266, 127.31001281738281, 33.21977615356445, 150.24185180664062, -95.22032928466797, 11.534835815429688, -13.339996337890625, 154.9522705078125, 144.17654418945312, 160.3680419921875, 144.36241149902344, 167.2218017578125, 69.19216918945312, 44.78888702392578, -16.359962463378906, 38.99293518066406, 132.8571014404297, 36.014862060546875, 14.659751892089844, 207.1318359375, 14.827547073364258], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000322.npy"}
{"epoch": 0.47283406754772395, "step": 323, "batch_size": 64, "mean": 62.875831604003906, "std": 69.35879516601562, "min": -95.57208251953125, "p10": -15.03536319732666, "median": 45.56454086303711, "p90": 165.3602722167969, "max": 235.9740447998047, "pos_frac": 0.875, "sample": [-26.248031616210938, 165.3397216796875, 44.34632873535156, 11.807815551757812, 34.829124450683594, 29.786521911621094, 159.00466918945312, 235.9740447998047, 16.118833541870117, 11.777870178222656, 45.383644104003906, 34.76210021972656, 10.247703552246094, 103.7474365234375, 18.846778869628906, 180.07179260253906, 12.863357543945312, 122.35487365722656, 12.401802062988281, 155.75515747070312, 38.595947265625, 8.611072540283203, 45.97222137451172, 76.46028137207031, -15.278858184814453, 142.724609375, 16.739398956298828, 51.00859832763672, 184.78590393066406, 7.597816467285156, 130.57635498046875, -15.188385009765625, 45.74543762207031, 69.06481170654297, -95.57208251953125, 62.05224609375, -18.747207641601562, 33.01820373535156, 202.5972900390625, 107.15299224853516, -28.25716781616211, 1.80316162109375, 75.27668762207031, 51.729888916015625, 85.7872314453125, 64.88423156738281, 34.97368240356445, 159.60977172851562, 17.902801513671875, 136.82952880859375, 167.6007080078125, 113.61266326904297, -47.232177734375, 165.36907958984375, 13.52862548828125, 105.58956146240234, 59.995967864990234, 187.36257934570312, 97.53230285644531, 15.188507080078125, 16.860729217529297, -14.678312301635742, 15.094247817993164, 70.6007080078125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000323.npy"}
{"epoch": 0.47430249632892807, "step": 324, "batch_size": 64, "mean": 65.99630737304688, "std": 62.04583740234375, "min": -81.17178344726562, "p10": -22.16801071166992, "median": 69.2300033569336, "p90": 136.12091827392578, "max": 211.7442169189453, "pos_frac": 0.8125, "sample": [57.30919647216797, 57.90808868408203, 62.459102630615234, 86.11988830566406, 46.62620544433594, 191.2869873046875, 123.66300964355469, 131.3534393310547, 83.46852111816406, 79.247802734375, 133.3273162841797, -40.74076843261719, 211.7442169189453, 41.68901062011719, 43.917930603027344, 80.33804321289062, -18.19029998779297, 90.83531188964844, 43.011192321777344, 105.84615325927734, 15.612991333007812, 6.896289825439453, -81.17178344726562, 48.14385223388672, 64.01373291015625, 164.44772338867188, 101.965087890625, -12.549209594726562, 107.10663604736328, 115.45198059082031, 170.03756713867188, 100.09678649902344, 81.77245330810547, 121.00520324707031, 98.08714294433594, -39.67413330078125, 131.28372192382812, 155.35757446289062, 38.39563751220703, 61.633941650390625, 134.08290100097656, -23.8109130859375, 107.08056640625, 56.277862548828125, -27.245758056640625, -19.156593322753906, 11.798385620117188, -0.7260360717773438, -23.4586181640625, 152.297607421875, 136.99435424804688, 85.64189910888672, 58.82074737548828, -18.777122497558594, 79.58512878417969, -27.47919464111328, 102.8218994140625, 4.745628356933594, 77.22625732421875, 98.87120056152344, 74.44627380371094, 42.20684814453125, 24.329391479492188, 58.05772018432617], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000324.npy"}
{"epoch": 0.47577092511013214, "step": 325, "batch_size": 64, "mean": 67.98548889160156, "std": 66.05650329589844, "min": -86.7494125366211, "p10": -18.113801765441895, "median": 73.69377136230469, "p90": 154.6055145263672, "max": 205.8532257080078, "pos_frac": 0.828125, "sample": [-17.559133529663086, -72.03994750976562, 84.71806335449219, 13.989646911621094, 157.47373962402344, 64.0491943359375, 69.40152740478516, -86.7494125366211, -36.74360656738281, 106.00494384765625, 100.16993713378906, 82.26251220703125, 76.78518676757812, 89.57597351074219, -0.1947784423828125, 10.20549201965332, 95.45834350585938, 154.99603271484375, -13.311920166015625, 134.81752014160156, 147.5162353515625, 125.94674682617188, 88.8301773071289, 142.33425903320312, 72.562744140625, 30.67165756225586, 169.4088592529297, 95.13755798339844, 74.82479858398438, 18.138580322265625, 205.8532257080078, 81.49244689941406, 153.69430541992188, 4.9356842041015625, 64.5888900756836, 32.104007720947266, 174.30892944335938, 37.651954650878906, -38.31878662109375, 102.955810546875, 41.7412109375, -2.1032447814941406, 121.75473022460938, -58.16619110107422, 119.81239318847656, 26.42431640625, 87.00418090820312, 54.35028076171875, -18.351516723632812, 34.196990966796875, 68.5074234008789, 20.89898681640625, 20.140647888183594, 158.01712036132812, 138.1668243408203, 62.463111877441406, 142.9104766845703, 143.207275390625, 82.66183471679688, 87.4759292602539, 60.29486846923828, -26.484664916992188, 21.07181167602539, 167.12954711914062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000325.npy"}
{"epoch": 0.47723935389133626, "step": 326, "batch_size": 64, "mean": 61.94574737548828, "std": 69.01652526855469, "min": -112.96044158935547, "p10": -23.24824409484863, "median": 59.9204216003418, "p90": 139.40149841308593, "max": 217.9207305908203, "pos_frac": 0.828125, "sample": [27.76123046875, 103.72859191894531, -112.96044158935547, -25.661357879638672, -11.146644592285156, -24.70599365234375, 110.08767700195312, 34.58373260498047, 114.39485168457031, 51.4119987487793, 137.81173706054688, 84.07257843017578, 175.2545928955078, 40.397430419921875, -13.536273956298828, -33.461631774902344, 24.535987854003906, 34.40985107421875, 56.25664138793945, 200.4578857421875, 4.67071533203125, 87.87889862060547, 144.17547607421875, 125.3466796875, 80.88728332519531, 20.94384002685547, 97.60041046142578, -19.132553100585938, 16.45012664794922, 16.194595336914062, 140.08282470703125, 133.89370727539062, 130.5233917236328, 97.21018981933594, 62.61077117919922, 112.14029693603516, 36.216949462890625, 98.80110168457031, -19.84682846069336, 109.909423828125, 11.968276977539062, -75.03397369384766, 99.91758728027344, 101.93890380859375, 137.34202575683594, 46.49553680419922, 125.76261901855469, 57.230072021484375, 78.76824188232422, 45.60062789916992, -84.21358489990234, 81.24862670898438, 71.91506958007812, 10.805831909179688, 180.31961059570312, 217.9207305908203, 31.301925659179688, 159.68751525878906, 2.4339866638183594, -32.04106903076172, 128.32073974609375, 22.080612182617188, 83.7787094116211, 10.729499816894531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000326.npy"}
{"epoch": 0.4787077826725404, "step": 327, "batch_size": 64, "mean": 60.6379508972168, "std": 68.10586547851562, "min": -70.87134552001953, "p10": -19.644680023193356, "median": 54.843292236328125, "p90": 157.12099151611332, "max": 231.9183349609375, "pos_frac": 0.796875, "sample": [54.27824401855469, -9.965251922607422, 141.57998657226562, 117.56497192382812, 1.9449005126953125, 175.1356201171875, 19.67283821105957, 124.71113586425781, 55.50907897949219, 136.81898498535156, 83.01016235351562, 9.1341552734375, 8.326309204101562, 135.17025756835938, 32.87906265258789, -39.79705047607422, 18.910888671875, 86.99720001220703, 93.70196533203125, 94.61863708496094, -70.87134552001953, 63.999176025390625, 187.53268432617188, 66.86160278320312, 7.248348236083984, 44.08772277832031, 140.1894989013672, -53.99443817138672, 49.087684631347656, 31.950973510742188, -24.677780151367188, 111.03640747070312, -2.186737060546875, 50.19657516479492, 80.47543334960938, 160.31072998046875, -10.699901580810547, 57.2230224609375, 8.17535400390625, 68.34317016601562, -25.092529296875, 19.362899780273438, 62.94764709472656, 149.6782684326172, -43.93865966796875, 73.61788177490234, 32.59618377685547, 118.83256530761719, 210.69187927246094, 52.43437194824219, -2.2309951782226562, -21.247940063476562, 180.719482421875, 8.887298583984375, 86.87144470214844, 16.54511833190918, 55.40834045410156, 169.8519287109375, 95.38230895996094, -15.903739929199219, 46.18697738647461, 231.9183349609375, -0.9909133911132812, 73.81036376953125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000327.npy"}
{"epoch": 0.4801762114537445, "step": 328, "batch_size": 64, "mean": 77.84373474121094, "std": 71.35529327392578, "min": -68.25503540039062, "p10": -11.084358787536612, "median": 72.1947135925293, "p90": 170.77041778564455, "max": 260.8289794921875, "pos_frac": 0.875, "sample": [174.5723876953125, 3.308013916015625, 24.939727783203125, 84.23361206054688, 142.9536895751953, 42.167999267578125, 56.33963394165039, 148.6720428466797, 91.28071594238281, 58.73334503173828, 52.88744354248047, 17.407058715820312, 99.03553771972656, 46.13896179199219, 19.158103942871094, 114.59562683105469, -52.97655487060547, -25.9991455078125, 40.01560974121094, 108.30194091796875, 62.61293029785156, 96.48333740234375, 111.50726318359375, 186.908203125, 19.16402816772461, 72.47747802734375, 32.05668640136719, 28.083389282226562, 115.7224349975586, 182.06365966796875, 72.11891174316406, 160.02764892578125, 178.66134643554688, 34.272377014160156, 12.324333190917969, -16.516937255859375, 47.78443908691406, 139.25228881835938, 8.07952880859375, -15.011100769042969, -1.9219608306884766, 203.59515380859375, -68.25503540039062, 150.3138427734375, 38.7783317565918, 260.8289794921875, -67.77239227294922, 70.3861083984375, 129.03919982910156, 54.218448638916016, 215.8625030517578, 158.62234497070312, 129.05581665039062, -34.44410705566406, 43.21584701538086, 151.14950561523438, 137.18882751464844, 107.96730041503906, 161.89915466308594, 78.73849487304688, 86.18943786621094, 111.10578918457031, 20.12923240661621, 72.27051544189453], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000328.npy"}
{"epoch": 0.48164464023494863, "step": 329, "batch_size": 64, "mean": 61.90422058105469, "std": 68.97064971923828, "min": -78.1154556274414, "p10": -26.579567718505853, "median": 51.71280288696289, "p90": 154.59276123046874, "max": 225.18246459960938, "pos_frac": 0.8125, "sample": [180.82354736328125, 10.287078857421875, 225.18246459960938, 99.60786437988281, 19.325592041015625, 25.44562530517578, 54.55506134033203, 13.280929565429688, 163.17684936523438, 154.19610595703125, 112.77001953125, 146.62147521972656, -2.247272491455078, 10.8421630859375, 29.275680541992188, 61.14273452758789, -45.073509216308594, 73.62857055664062, 27.510337829589844, 189.22943115234375, 72.82294464111328, 19.080848693847656, 133.94387817382812, 25.961605072021484, 96.20893859863281, -5.372947692871094, -45.69114303588867, 135.92967224121094, 99.24005889892578, 107.28111267089844, 42.70734405517578, -30.5504150390625, 88.85730743408203, 28.73785400390625, 154.76275634765625, 105.03453063964844, 101.47994995117188, 88.00790405273438, 180.2639617919922, 151.54225158691406, -15.983352661132812, -35.83033752441406, 118.38653564453125, 94.54203796386719, -19.34814453125, 4.431632995605469, 162.51422119140625, -3.21209716796875, 149.2702178955078, 49.333656311035156, 45.90840530395508, -29.678749084472656, -78.1154556274414, 31.284027099609375, 18.337265014648438, 71.68692016601562, 54.091949462890625, 9.6614990234375, 84.79058837890625, 28.643341064453125, 47.04606628417969, 29.199663162231445, 113.6648941040039, -68.58390808105469], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000329.npy"}
{"epoch": 0.4831130690161527, "step": 330, "batch_size": 64, "mean": 65.90046691894531, "std": 58.76213836669922, "min": -79.53707885742188, "p10": -12.63722038269043, "median": 75.62922668457031, "p90": 136.63994903564458, "max": 177.56927490234375, "pos_frac": 0.859375, "sample": [55.8033447265625, 58.089813232421875, -8.858779907226562, -13.904571533203125, 127.66455841064453, 32.45977783203125, 24.172321319580078, 104.97661590576172, 88.25196838378906, 69.74185180664062, 1.0837593078613281, 86.56975555419922, 128.09437561035156, 108.69298553466797, 36.389739990234375, 13.838714599609375, 113.70674896240234, 74.28215026855469, 8.9019775390625, 95.70245361328125, 84.31877899169922, -13.903377532958984, 14.7728271484375, -12.837211608886719, 145.02255249023438, 171.939453125, 8.430721282958984, -71.79878234863281, -36.75328826904297, 126.82698822021484, 140.30233764648438, 49.05620574951172, 70.05965423583984, 93.44120025634766, 96.18437957763672, 102.83277130126953, 149.87603759765625, 142.11712646484375, 94.42776489257812, 107.85608673095703, -12.170574188232422, 105.37552642822266, 26.14034652709961, 112.319091796875, -73.60980987548828, 141.79161071777344, 75.08575439453125, 102.12614440917969, 52.4788818359375, 82.98008728027344, 74.37750244140625, 125.29580688476562, 17.868614196777344, 76.17269897460938, 68.42620086669922, 177.56927490234375, 23.311267852783203, 100.75341796875, -79.53707885742188, 14.412857055664062, 79.69879150390625, 89.12371826171875, 102.9320068359375, 66.875732421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000330.npy"}
{"epoch": 0.4845814977973568, "step": 331, "batch_size": 64, "mean": 73.05988311767578, "std": 64.00318145751953, "min": -50.8157844543457, "p10": -5.118478012084959, "median": 69.45880508422852, "p90": 156.99905700683595, "max": 240.17440795898438, "pos_frac": 0.859375, "sample": [42.67128372192383, 174.49124145507812, 65.83927917480469, 37.79338073730469, 33.4224853515625, -35.51556396484375, 3.708477020263672, 53.01017761230469, 49.133750915527344, 145.9629669189453, 97.1978530883789, -13.528453826904297, 131.82080078125, 24.279884338378906, 143.25558471679688, -1.2778091430664062, 240.17440795898438, 32.14896774291992, 50.93540954589844, 72.812744140625, 82.51026916503906, 77.81019592285156, 193.13296508789062, 12.909961700439453, 50.19013214111328, -44.268333435058594, 76.20407104492188, -50.8157844543457, 189.82406616210938, 136.0416717529297, 135.4967803955078, 70.05135345458984, 157.92926025390625, 9.851348876953125, 26.727882385253906, 6.2569122314453125, 20.3984375, -3.337839126586914, 41.31736373901367, 50.67631149291992, 54.07526397705078, 95.43608856201172, -5.881608963012695, 154.82858276367188, 65.66657257080078, 109.12043762207031, 176.64627075195312, 139.4362030029297, 107.17230224609375, 69.40452575683594, -12.868118286132812, 99.60750579833984, 107.66020202636719, 54.8277587890625, -22.863548278808594, 103.96851348876953, 75.35751342773438, 69.5130844116211, 10.311981201171875, 175.5242919921875, 113.42320251464844, 98.21131134033203, 115.31755065917969, 134.69296264648438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000331.npy"}
{"epoch": 0.48604992657856094, "step": 332, "batch_size": 64, "mean": 53.36603546142578, "std": 68.29267120361328, "min": -119.22016906738281, "p10": -32.64547348022461, "median": 51.425018310546875, "p90": 142.48952026367192, "max": 209.51864624023438, "pos_frac": 0.828125, "sample": [209.51864624023438, 18.898269653320312, 93.61454010009766, 83.94725036621094, 28.67206573486328, -101.44126892089844, 53.41759490966797, 129.72207641601562, -2.302093505859375, -16.40766143798828, 146.21002197265625, 1.6333808898925781, -30.247955322265625, 163.33755493164062, 26.41177749633789, 49.43244171142578, 83.32295989990234, 155.95541381835938, 44.197471618652344, 13.994807243347168, 65.74105834960938, 31.5631103515625, 72.97693634033203, 2.2453842163085938, 177.11416625976562, 110.50949096679688, 68.07122802734375, -119.22016906738281, 58.01121520996094, 133.808349609375, 84.38188171386719, 84.02236938476562, -33.67298126220703, -44.34070587158203, 23.16851043701172, 33.37923049926758, 58.751853942871094, 130.4954833984375, -8.728498458862305, 42.23857116699219, 7.1069488525390625, -49.844825744628906, 89.45538330078125, 68.67604064941406, 121.53756713867188, 68.70816040039062, 28.9635009765625, 204.42904663085938, 87.83137512207031, -51.194190979003906, 66.13473510742188, 29.57330322265625, 104.23274230957031, 54.032073974609375, 188.764892578125, 3.3859920501708984, 21.738983154296875, 2.2578067779541016, 5.330819129943848, 112.34928894042969, 93.93234252929688, 33.77384948730469, 39.60154342651367, -37.75468444824219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000332.npy"}
{"epoch": 0.48751835535976507, "step": 333, "batch_size": 64, "mean": 71.00698852539062, "std": 85.4545669555664, "min": -179.12210083007812, "p10": -21.44694366455078, "median": 63.159183502197266, "p90": 178.3292434692383, "max": 307.41436767578125, "pos_frac": 0.765625, "sample": [28.540847778320312, -30.257644653320312, 170.0589599609375, -19.819488525390625, 123.83246612548828, 183.60800170898438, -93.0572280883789, 59.373374938964844, -14.387214660644531, 0.8514308929443359, 87.20877075195312, -12.747305870056152, 83.89089965820312, 22.258407592773438, 60.713592529296875, 106.75575256347656, 48.481502532958984, 8.667861938476562, 155.2608642578125, -12.926567077636719, -8.052909851074219, 170.26300048828125, 43.42668151855469, 125.05572509765625, 120.3787841796875, 117.43628692626953, 33.20402145385742, 14.01641845703125, 9.6871337890625, 177.19427490234375, 108.89811706542969, 16.885305404663086, 134.3676300048828, 189.02972412109375, 178.81565856933594, -7.6622467041015625, -39.344398498535156, -19.678442001342773, 63.876914978027344, 97.67301940917969, 62.44145202636719, 162.9329071044922, -25.376876831054688, 169.0509490966797, 54.75153350830078, 75.85562133789062, -22.144424438476562, 119.73477172851562, 307.41436767578125, 179.53335571289062, 95.8388442993164, 117.47763061523438, 229.49884033203125, 24.0557861328125, 163.4355926513672, 113.7545166015625, 132.51048278808594, 35.95865249633789, -12.656368255615234, 18.70391082763672, -24.49884033203125, -179.12210083007812, 73.99543762207031, 189.52316284179688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000333.npy"}
{"epoch": 0.4889867841409692, "step": 334, "batch_size": 64, "mean": 64.21814727783203, "std": 80.99542236328125, "min": -201.09893798828125, "p10": -26.477825927734365, "median": 64.91732025146484, "p90": 168.943212890625, "max": 224.59771728515625, "pos_frac": 0.765625, "sample": [113.24018859863281, 39.31414794921875, 0.9660453796386719, 68.88571166992188, 134.9691162109375, -5.97119140625, -11.282821655273438, 127.2651138305664, 51.649200439453125, 62.63557434082031, -2.0898590087890625, -36.84180450439453, 22.3836669921875, 2.15386962890625, 100.09257507324219, -10.504936218261719, 96.65525817871094, 180.30795288085938, -201.09893798828125, 145.86761474609375, 29.657577514648438, -2.3844146728515625, 126.7909164428711, -37.551368713378906, 67.19906616210938, 47.37290954589844, 217.99635314941406, 15.217208862304688, -9.995323181152344, 35.20356750488281, -17.867919921875, -1.8605880737304688, 88.22898864746094, 95.88623046875, 59.91584777832031, 26.635040283203125, 100.27305603027344, 101.75407409667969, 68.12320709228516, 119.5108413696289, 170.3639373779297, -74.16099548339844, 165.62818908691406, -82.21221923828125, 108.44368743896484, 123.03257751464844, 12.649612426757812, 79.5281982421875, 130.15200805664062, 120.82179260253906, 118.04598999023438, 61.54736328125, 170.90676879882812, 109.95830535888672, 59.267120361328125, 224.59771728515625, 59.011505126953125, 135.63058471679688, -30.16778564453125, 183.20018005371094, 5.39910888671875, 188.656982421875, 157.64244079589844, -96.68329620361328], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000334.npy"}
{"epoch": 0.49045521292217326, "step": 335, "batch_size": 64, "mean": 58.17888641357422, "std": 75.73787689208984, "min": -90.5902099609375, "p10": -46.668481445312494, "median": 55.47896385192871, "p90": 151.236491394043, "max": 248.17791748046875, "pos_frac": 0.75, "sample": [-90.5902099609375, 116.66384887695312, 67.68989562988281, 87.21540832519531, 142.35476684570312, 11.79135513305664, 30.571395874023438, 83.71697998046875, 126.62274169921875, -66.15894317626953, -12.258834838867188, 39.85978698730469, 74.23799896240234, -47.862457275390625, 90.64903259277344, 110.273193359375, 151.6466064453125, 140.05186462402344, -12.17141342163086, -9.722633361816406, 68.6030502319336, 51.99406814575195, 69.7889175415039, -34.517662048339844, 61.798248291015625, 28.972152709960938, 154.93936157226562, -88.00202941894531, -88.5898666381836, 81.01936340332031, 89.21273803710938, 26.185104370117188, 68.22622680664062, 23.575843811035156, 183.59588623046875, -1.7074317932128906, 248.17791748046875, 58.96385955810547, 140.21649169921875, -50.97920227050781, 51.42243957519531, 101.19175720214844, 43.78584289550781, 48.800018310546875, 63.00720977783203, -1.9188270568847656, 50.16170883178711, 46.193115234375, -43.882537841796875, 5.04656982421875, 132.99655151367188, -11.618122100830078, 118.63163757324219, -52.93363952636719, -21.681655883789062, 200.96136474609375, 184.53871154785156, 188.25723266601562, 40.14726257324219, 135.37704467773438, 22.942935943603516, 37.11259460449219, 150.27955627441406, 108.57656860351562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000335.npy"}
{"epoch": 0.4919236417033774, "step": 336, "batch_size": 64, "mean": 73.06648254394531, "std": 76.9444808959961, "min": -152.39358520507812, "p10": -20.281711578369137, "median": 76.59041213989258, "p90": 159.59844665527348, "max": 363.52069091796875, "pos_frac": 0.84375, "sample": [105.9822998046875, 45.912757873535156, 77.28369140625, 91.34210205078125, 132.10415649414062, -152.39358520507812, 91.76140594482422, -21.32604217529297, -1.7616424560546875, 170.463623046875, -46.23732376098633, 47.48811340332031, 83.19992065429688, 41.213043212890625, 363.52069091796875, 92.10977935791016, 89.90252685546875, 82.56878662109375, 127.68761444091797, 23.476364135742188, 15.466976165771484, 145.15069580078125, 162.68869018554688, 75.94184112548828, 45.846099853515625, 61.6015625, 88.87313842773438, 152.38787841796875, 16.399642944335938, 36.11457824707031, 37.737552642822266, 132.9679412841797, 65.49853515625, -44.18256378173828, 119.3186264038086, -43.67200469970703, -21.45391845703125, 72.50853729248047, 103.49210357666016, 92.26200866699219, 218.3040771484375, 77.23898315429688, 127.71405792236328, 5.621501922607422, 205.31442260742188, 39.57196807861328, 22.202247619628906, 46.68739318847656, 41.576072692871094, 141.13064575195312, 126.87581634521484, 91.17892456054688, -10.033370971679688, 133.04302978515625, 188.56353759765625, -17.844940185546875, 79.80906677246094, 60.58660888671875, 21.715961456298828, 41.0828857421875, -27.986190795898438, 181.53338623046875, 80.87429809570312, 42.24859619140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000336.npy"}
{"epoch": 0.4933920704845815, "step": 337, "batch_size": 64, "mean": 66.955322265625, "std": 85.68632507324219, "min": -113.44419860839844, "p10": -42.60061721801756, "median": 61.31806945800781, "p90": 186.2792221069336, "max": 261.0313720703125, "pos_frac": 0.78125, "sample": [114.73092651367188, 186.36488342285156, -94.27784729003906, -48.60389709472656, 128.9763946533203, 224.47830200195312, 70.08686828613281, 73.12913513183594, 140.8585205078125, 128.34706115722656, 19.320083618164062, 131.95252990722656, 42.16674041748047, -78.56092834472656, 147.4750213623047, 0.07086181640625, 154.6149139404297, 59.33857727050781, 39.45637512207031, 186.079345703125, 129.27401733398438, 8.341941833496094, 84.43002319335938, 9.311653137207031, 104.35009765625, 50.37933349609375, 192.9883270263672, 148.47323608398438, -9.420013427734375, 21.11223602294922, 46.98899841308594, 42.6402587890625, -111.12432861328125, -85.73489379882812, 113.91249084472656, -28.59296417236328, 69.11243438720703, 93.57746124267578, -1.1104888916015625, 98.89506530761719, 12.607254028320312, 261.0313720703125, -0.27335357666015625, 34.57060241699219, -48.88286590576172, 137.77639770507812, 228.60494995117188, -13.836936950683594, 67.99205017089844, 25.856658935546875, 144.32489013671875, 24.367431640625, 49.33966064453125, 197.97445678710938, -113.44419860839844, 63.125579833984375, 17.430557250976562, 83.27680206298828, 59.51055908203125, 200.42098999023438, 152.9830322265625, -4.43743896484375, -8.251373291015625, 109.26493835449219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000337.npy"}
{"epoch": 0.4948604992657856, "step": 338, "batch_size": 64, "mean": 64.63056182861328, "std": 72.2614517211914, "min": -113.30404663085938, "p10": -24.710961341857903, "median": 62.19378852844238, "p90": 151.3478942871094, "max": 216.6107940673828, "pos_frac": 0.8125, "sample": [-96.21391296386719, 152.93258666992188, -9.851364135742188, -15.774646759033203, 48.03363037109375, 126.99161529541016, 5.680900573730469, 101.42730712890625, 147.06558227539062, 139.9368133544922, 169.28826904296875, 27.652912139892578, 25.852684020996094, 153.59783935546875, -50.966796875, 20.013580322265625, 95.75646209716797, 122.26213073730469, 216.6107940673828, 52.61457061767578, 27.199909210205078, 50.85717010498047, 45.05066680908203, -55.577880859375, -72.8306884765625, 118.32869720458984, 103.37361145019531, 5.278461456298828, 60.753448486328125, -14.238716125488281, 80.62745666503906, 62.48370361328125, 137.3058624267578, -0.378814697265625, 69.7576904296875, 154.51048278808594, -28.176361083984375, 12.873544692993164, 141.29031372070312, 90.7540283203125, 152.75994873046875, -65.89495849609375, 57.10070037841797, -113.30404663085938, 89.14613342285156, 147.37298583984375, 146.220947265625, 22.058761596679688, 61.903873443603516, 69.65184020996094, 92.0821533203125, -16.625028610229492, 148.0531005859375, 101.4041748046875, 130.6418914794922, 161.0740966796875, 138.7896728515625, 25.56702423095703, 41.98204040527344, 137.65187072753906, 71.43295288085938, 43.53664016723633, 21.381359100341797, 50.214134216308594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000338.npy"}
{"epoch": 0.49632892804698975, "step": 339, "batch_size": 64, "mean": 67.80081939697266, "std": 83.4361801147461, "min": -177.447998046875, "p10": -49.75858459472654, "median": 76.10392761230469, "p90": 173.45775604248047, "max": 251.02328491210938, "pos_frac": 0.78125, "sample": [98.69337463378906, 86.49490356445312, 93.78096771240234, 144.49819946289062, -19.63787078857422, 50.269317626953125, 71.34429931640625, -59.24894332885742, 145.28604125976562, -32.88954162597656, 251.02328491210938, 100.60769653320312, 84.74246215820312, -56.98817443847656, 80.86355590820312, 92.05715942382812, -63.001251220703125, -12.824302673339844, -60.53692626953125, 174.69515991210938, 170.5704803466797, 25.845539093017578, -19.012672424316406, 109.11805725097656, 32.38502502441406, 141.625, 94.488525390625, -6.723243713378906, 222.91717529296875, 117.25089263916016, 14.624885559082031, 97.11632537841797, -177.447998046875, 58.288726806640625, 185.45184326171875, 20.027542114257812, 40.09876251220703, -6.922279357910156, 41.67791748046875, 44.33485412597656, 39.0091552734375, 63.22895812988281, 28.82940673828125, 133.61767578125, 157.60894775390625, 213.37060546875, -28.38030242919922, 151.54495239257812, 46.27123260498047, 12.316108703613281, 88.56510925292969, 182.85540771484375, 197.42442321777344, -68.20836639404297, 81.51133728027344, 124.48149108886719, 83.98561096191406, 123.28623962402344, 68.5062255859375, -70.94046020507812, 170.44033813476562, 107.34352111816406, 36.704345703125, 20.935813903808594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000339.npy"}
{"epoch": 0.4977973568281938, "step": 340, "batch_size": 64, "mean": 60.80580520629883, "std": 75.35305786132812, "min": -172.12298583984375, "p10": -24.910929870605464, "median": 59.67461967468262, "p90": 136.40263824462892, "max": 326.4219970703125, "pos_frac": 0.8125, "sample": [121.99424743652344, 88.85425567626953, 41.16603469848633, 34.267921447753906, -118.05990600585938, 136.59933471679688, 122.23841857910156, 123.52021789550781, 46.6884765625, 98.21741485595703, 92.60447692871094, 326.4219970703125, -31.182174682617188, -19.9738712310791, 150.99954223632812, 65.83843231201172, 22.603134155273438, -22.342796325683594, 135.47486877441406, -8.242118835449219, 86.37566375732422, 35.76428985595703, -172.12298583984375, 79.67913818359375, 101.22677612304688, 36.64825439453125, -18.46636199951172, 48.15324401855469, 54.487667083740234, 47.76294708251953, 114.1343994140625, -3.3779449462890625, 98.17131042480469, 83.54154205322266, 26.061309814453125, 11.60623550415039, 128.13189697265625, 20.03972625732422, -27.396236419677734, 152.1859893798828, 12.123519897460938, 79.66201782226562, 65.02850341796875, 20.34618377685547, 7.86700439453125, 129.53843688964844, 0.87042236328125, 64.861572265625, 38.41201400756836, 11.682876586914062, 14.164749145507812, 168.04705810546875, 50.61712646484375, 95.3182373046875, 123.28722381591797, 161.20452880859375, -29.436641693115234, 135.9436798095703, 122.09150695800781, 175.95347595214844, -26.011558532714844, 122.44499206542969, -29.479827880859375, 66.73982238769531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000340.npy"}
{"epoch": 0.49926578560939794, "step": 341, "batch_size": 64, "mean": 57.78798294067383, "std": 82.58270263671875, "min": -129.26934814453125, "p10": -45.87248229980467, "median": 53.235151290893555, "p90": 162.43774719238283, "max": 264.0537414550781, "pos_frac": 0.765625, "sample": [264.0537414550781, 15.635711669921875, -129.26934814453125, 19.706459045410156, 130.48199462890625, 16.080917358398438, -6.748443603515625, 83.45187377929688, 206.02056884765625, 38.87996292114258, 65.26023864746094, 53.875423431396484, 14.59463119506836, -31.56005859375, 14.002437591552734, 10.99399185180664, -17.815567016601562, 175.72325134277344, 34.61458206176758, -52.48133850097656, -10.82215690612793, 142.19515991210938, 136.97457885742188, 24.210731506347656, 83.18476867675781, 153.5481719970703, -5.536933898925781, -70.35182189941406, -52.006378173828125, 52.594879150390625, 43.12156677246094, 150.877197265625, 203.8724365234375, 163.25946044921875, 122.03483581542969, 160.52041625976562, 128.81170654296875, -29.953845977783203, -5.968742370605469, 25.399097442626953, 65.78477478027344, -117.31658935546875, 129.14031982421875, -18.091819763183594, 9.4476318359375, 78.89315795898438, 26.552459716796875, 71.27644348144531, -118.70553588867188, 102.42522430419922, 144.39698791503906, 23.590099334716797, -59.32255554199219, 122.56265258789062, 178.71563720703125, 49.97645568847656, 81.30731964111328, 46.41699981689453, 58.94122314453125, 66.93102264404297, 70.10894775390625, 115.58477783203125, 182.26077270507812, 66.0884780883789], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000341.npy"}
{"epoch": 0.5007342143906021, "step": 342, "batch_size": 64, "mean": 83.44084167480469, "std": 82.19208526611328, "min": -160.08372497558594, "p10": -16.310071563720697, "median": 89.10765075683594, "p90": 178.79520568847659, "max": 232.72137451171875, "pos_frac": 0.875, "sample": [103.7857894897461, 73.85745239257812, 110.26509094238281, 209.549560546875, 16.533681869506836, 147.30653381347656, 91.99081420898438, 98.38372802734375, 64.13807678222656, -29.78369903564453, 106.46666717529297, 32.59001159667969, 166.47735595703125, 183.44998168945312, 169.6652374267578, 32.96165466308594, 146.84561157226562, 180.13250732421875, 164.26539611816406, 0.30902099609375, 86.2244873046875, -18.784378051757812, 113.42819213867188, -23.242843627929688, 27.734851837158203, -50.3951416015625, 69.16912841796875, 112.51464080810547, 156.4545440673828, -160.08372497558594, -10.536689758300781, 175.67483520507812, 164.281982421875, 26.142505645751953, 56.567138671875, 13.305793762207031, 114.54399108886719, 180.24224853515625, 150.53616333007812, 174.78262329101562, 3.765247344970703, 53.580379486083984, 94.1219253540039, 7.4093017578125, 232.72137451171875, 210.0116729736328, 83.98046875, 72.7667236328125, 141.6259765625, 27.088851928710938, 84.76105499267578, 183.17242431640625, 147.7014923095703, 39.203208923339844, 116.67355346679688, 134.49179077148438, 43.814544677734375, 17.760963439941406, -95.07593536376953, -115.45281982421875, 26.361343383789062, 77.2869873046875, 166.50860595703125, 158.1840057373047], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000342.npy"}
{"epoch": 0.5022026431718062, "step": 343, "batch_size": 64, "mean": 69.78305053710938, "std": 78.2961654663086, "min": -80.79017639160156, "p10": -35.659115600585935, "median": 74.70645523071289, "p90": 167.92366027832034, "max": 248.758056640625, "pos_frac": 0.765625, "sample": [-16.782821655273438, -60.52771759033203, -36.611785888671875, -68.31948852539062, 94.77732849121094, 26.167160034179688, 148.40350341796875, 49.54517364501953, 76.77632141113281, 59.001800537109375, 41.66966247558594, 182.36050415039062, 18.342514038085938, 177.1490020751953, 130.26101684570312, -40.134788513183594, -8.59676742553711, 88.16844177246094, 147.76821899414062, 80.51966857910156, 159.33152770996094, 45.832916259765625, -72.48948669433594, 72.63658905029297, 148.32923889160156, 113.25977325439453, 92.73580169677734, 11.499542236328125, 95.3282470703125, 151.17181396484375, 155.28662109375, 37.40107727050781, -38.307586669921875, 71.57730102539062, 156.52584838867188, 101.9691162109375, -31.2799072265625, -28.216907501220703, 37.06671905517578, 25.740982055664062, -33.43621826171875, 35.8458251953125, 102.04075622558594, 87.902587890625, 172.99789428710938, 92.49653625488281, 87.23394775390625, 120.55830383300781, 52.01235580444336, 30.512664794921875, 171.6060028076172, -19.900634765625, 138.64498901367188, 36.20131301879883, 114.05535125732422, 204.66421508789062, 36.606056213378906, 149.7044677734375, 135.4991912841797, -17.969100952148438, -3.7474822998046875, 209.2821044921875, 248.758056640625, -80.79017639160156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000343.npy"}
{"epoch": 0.5036710719530103, "step": 344, "batch_size": 64, "mean": 69.76876068115234, "std": 86.72594451904297, "min": -131.11007690429688, "p10": -27.16326522827147, "median": 59.50992012023926, "p90": 174.10676116943364, "max": 332.1835021972656, "pos_frac": 0.8125, "sample": [94.36713409423828, -6.498622894287109, -49.84010314941406, -15.171882629394531, 66.28665161132812, 2.2984619140625, 150.72093200683594, 33.585174560546875, 46.99745178222656, 114.83706665039062, 39.39323043823242, 71.27152252197266, -117.19635009765625, 122.23482513427734, 95.85052490234375, 163.39173889160156, 195.6788330078125, 97.1643295288086, -9.940109252929688, 72.5972900390625, 52.97604751586914, -33.47772979736328, 10.756768226623535, 21.634971618652344, 37.44053649902344, 332.1835021972656, 89.24465942382812, 132.78860473632812, 25.82147979736328, 66.04379272460938, 39.56352233886719, 120.71401977539062, 6.501441955566406, 37.52339172363281, 178.69891357421875, 41.40555191040039, 158.38165283203125, 10.465309143066406, -7.6209259033203125, -3.119474411010742, 227.55909729003906, 161.25753784179688, -107.80790710449219, 150.02117919921875, -52.6617546081543, 226.32240295410156, 129.03671264648438, 137.3648681640625, 52.90092086791992, 232.66632080078125, 2.6290664672851562, -32.30242919921875, 25.549592971801758, 132.7416229248047, 143.49777221679688, 190.5408477783203, -131.11007690429688, 49.389488220214844, 106.73360443115234, 44.59327697753906, 66.82005310058594, 81.35588073730469, 94.99217224121094, 47.15628433227539], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000344.npy"}
{"epoch": 0.5051395007342144, "step": 345, "batch_size": 64, "mean": 76.61846160888672, "std": 82.6917724609375, "min": -139.74505615234375, "p10": -4.876280593872068, "median": 64.98620986938477, "p90": 172.18805236816408, "max": 296.64324951171875, "pos_frac": 0.828125, "sample": [31.473106384277344, 145.45574951171875, -42.74969482421875, -68.90758514404297, 30.33035659790039, 41.50294494628906, 296.64324951171875, 174.30953979492188, 189.52532958984375, -16.38372802734375, 32.036415100097656, 116.51495361328125, 129.2866973876953, 52.902618408203125, 228.0694122314453, 18.535919189453125, 5.5055694580078125, 130.42868041992188, 157.39576721191406, 122.22314453125, 151.9872589111328, 122.18972778320312, 64.40689086914062, 151.3563995361328, 235.4803466796875, 92.14285278320312, 34.9537353515625, 48.98674011230469, -9.00466537475586, 12.782684326171875, -2.7048797607421875, 149.24732971191406, 124.67926025390625, 16.865787506103516, 126.19610595703125, 117.12380981445312, -0.5436248779296875, 11.011192321777344, 28.6190185546875, 157.78506469726562, -0.11931610107421875, 164.7003936767578, 9.917465209960938, 88.6044692993164, 151.0441131591797, 65.5655288696289, 10.385391235351562, 102.39723205566406, 79.12200927734375, 183.8109588623047, 77.54764556884766, 80.084716796875, 3.290437698364258, 241.7008056640625, 1.0832481384277344, -139.74505615234375, -3.131084442138672, -52.24943542480469, 40.25273895263672, 131.21029663085938, 51.07832717895508, 167.2379150390625, 47.75758361816406, -5.6242218017578125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000345.npy"}
{"epoch": 0.5066079295154186, "step": 346, "batch_size": 64, "mean": 61.423553466796875, "std": 86.19766998291016, "min": -135.47189331054688, "p10": -25.231225967407223, "median": 59.990779876708984, "p90": 158.6428665161133, "max": 302.66912841796875, "pos_frac": 0.765625, "sample": [185.12631225585938, 150.76144409179688, -6.988552093505859, 197.50537109375, 105.23892974853516, 152.9185791015625, 91.29109191894531, 158.71595764160156, 22.594566345214844, 93.6639633178711, 104.24136352539062, 78.7834243774414, 86.51422119140625, 20.411392211914062, 19.16869354248047, 116.4306640625, 67.26277923583984, -87.29570007324219, 39.14685821533203, -8.962926864624023, -2.2365951538085938, -54.961341857910156, -134.1982421875, 158.47232055664062, -104.84310150146484, 108.43397521972656, 58.802268981933594, 7.629020690917969, 146.07562255859375, 68.93653869628906, 79.06776428222656, 66.86161041259766, -135.47189331054688, 2.5829620361328125, 79.22734069824219, 53.171913146972656, 57.03928756713867, 184.57276916503906, 23.962486267089844, 21.960739135742188, 26.65489959716797, -18.136093139648438, 141.5550537109375, 253.7544708251953, -27.23175048828125, 90.0389404296875, 15.442924499511719, -15.713615417480469, 159.6223907470703, 152.7946319580078, 156.98074340820312, -20.563335418701172, 140.63656616210938, -8.018470764160156, 18.60866928100586, 61.179290771484375, 22.238849639892578, 106.06195068359375, 302.66912841796875, -11.381683349609375, 6.4423980712890625, -37.00164031982422, 7.345130920410156, 135.5138397216797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000346.npy"}
{"epoch": 0.5080763582966226, "step": 347, "batch_size": 64, "mean": 58.69518280029297, "std": 82.06404113769531, "min": -160.54031372070312, "p10": -33.05366401672363, "median": 56.01949691772461, "p90": 169.58269958496095, "max": 245.92254638671875, "pos_frac": 0.75, "sample": [-160.54031372070312, -33.68374252319336, 76.20724487304688, 86.40956115722656, 4.576671600341797, -28.63312530517578, 66.37281799316406, 13.553390502929688, -26.4168701171875, 180.59414672851562, 170.2799835205078, 2.9326095581054688, -31.583480834960938, 62.736358642578125, 25.66071319580078, 63.375694274902344, -89.94307708740234, -14.133819580078125, 245.92254638671875, 9.389991760253906, 167.95570373535156, -6.167236328125, 19.376495361328125, 42.416282653808594, 76.75244140625, 84.71024322509766, 220.0489501953125, 131.86480712890625, 63.59737777709961, 204.5931396484375, 44.86627960205078, -44.053741455078125, 124.4886474609375, 101.55689239501953, -16.2756404876709, 121.78106689453125, 189.36358642578125, 42.56705856323242, 24.612686157226562, -8.53680419921875, 88.41751861572266, -47.79375457763672, 140.7967987060547, 64.83843994140625, 158.80050659179688, 102.96265411376953, 65.89956665039062, 92.24221801757812, 113.89845275878906, 17.66978645324707, 46.744140625, 137.85365295410156, 163.06851196289062, 166.5668487548828, -40.49498748779297, 70.49844360351562, -53.61064910888672, -28.138769149780273, 202.67356872558594, 32.24220275878906, 49.302635192871094, -11.84161376953125, 9.114418029785156, 6.185569763183594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000347.npy"}
{"epoch": 0.5095447870778267, "step": 348, "batch_size": 64, "mean": 67.33739471435547, "std": 79.5189208984375, "min": -130.1693115234375, "p10": -16.418212127685546, "median": 67.05355072021484, "p90": 173.9644226074219, "max": 251.291259765625, "pos_frac": 0.84375, "sample": [-14.581230163574219, 32.74723815917969, 153.58470153808594, 6.9702911376953125, 209.70713806152344, 34.9871826171875, 33.04649353027344, 146.5794219970703, 74.8949966430664, 138.12295532226562, 0.2376556396484375, -5.3179779052734375, 60.458648681640625, 83.44461822509766, 13.2266845703125, 47.61640930175781, 1.0395011901855469, 159.22691345214844, 50.892391204833984, 52.733978271484375, 80.85809326171875, 78.98646545410156, 178.74298095703125, 83.89816284179688, 144.50094604492188, 97.89715576171875, 34.308448791503906, 144.69020080566406, 7.681550979614258, 87.6993408203125, 71.50454711914062, 26.283023834228516, -1.41204833984375, 141.2925262451172, 182.4384765625, 83.63931274414062, 9.360282897949219, 35.28254699707031, 137.07557678222656, 78.36406707763672, -130.1693115234375, 40.87699890136719, 62.60255432128906, 182.1178741455078, -50.30027770996094, -59.981536865234375, 135.62600708007812, 12.546104431152344, 47.94377136230469, 180.79193115234375, 162.814453125, 72.26571655273438, 251.291259765625, 76.46253204345703, 150.59280395507812, -17.205490112304688, 10.716129302978516, 106.92237091064453, 14.939590454101562, 143.32742309570312, 179.06912231445312, -105.40818786621094, -119.42611694335938, -21.532182693481445], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000348.npy"}
{"epoch": 0.5110132158590308, "step": 349, "batch_size": 64, "mean": 63.85336685180664, "std": 79.90320587158203, "min": -157.85174560546875, "p10": -30.412162017822265, "median": 51.280677795410156, "p90": 162.17319793701174, "max": 254.35455322265625, "pos_frac": 0.8125, "sample": [26.26275634765625, 19.112777709960938, -80.74270629882812, -1.1105155944824219, 80.61710357666016, 105.24813842773438, 240.12506103515625, 2.63623046875, 87.9771728515625, 112.60746765136719, 34.01602554321289, 103.56485748291016, 71.02444458007812, 79.84098052978516, 46.381591796875, 15.86274528503418, 11.556743621826172, 72.13131713867188, 83.53492736816406, 27.928993225097656, 254.35455322265625, 155.0408172607422, -49.3690185546875, 20.423099517822266, 194.95892333984375, -8.765296936035156, 160.0823516845703, 105.91809844970703, 74.97532653808594, -35.43731689453125, 242.14260864257812, 17.860023498535156, -30.983238220214844, 32.17428207397461, 42.96647644042969, -38.30528259277344, -157.85174560546875, 40.0899658203125, 155.07728576660156, 164.7655792236328, 63.86383056640625, 11.591201782226562, 1.3470993041992188, 29.955032348632812, 141.43792724609375, 113.72002410888672, 87.48774719238281, 145.467041015625, 29.13715362548828, 108.73332214355469, 18.77159881591797, 209.1634063720703, 107.28106689453125, -3.69012451171875, 56.17976379394531, -44.142730712890625, -2.1161766052246094, 163.06927490234375, 129.845703125, 62.618896484375, -29.07965087890625, 33.443931579589844, 26.003143310546875, 147.83322143554688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000349.npy"}
{"epoch": 0.5124816446402349, "step": 350, "batch_size": 64, "mean": 51.16304397583008, "std": 73.50926971435547, "min": -103.13250732421875, "p10": -44.08068542480468, "median": 46.36201095581055, "p90": 159.9108840942383, "max": 203.3105010986328, "pos_frac": 0.75, "sample": [109.07522583007812, -73.66765594482422, -3.0619430541992188, 53.698307037353516, 126.39804077148438, 85.21387481689453, 60.944854736328125, -18.43804931640625, -47.66499328613281, 80.81603240966797, 20.21310806274414, 201.68911743164062, 4.1636505126953125, 74.01980590820312, 63.731964111328125, -35.71730041503906, 41.50892639160156, -53.06040954589844, 72.08822631835938, 153.79666137695312, 128.9843292236328, 79.04130554199219, 51.24736785888672, 46.24761962890625, -16.301605224609375, 174.25921630859375, 132.56472778320312, -83.76666259765625, -60.90135192871094, 49.87559509277344, 46.476402282714844, 185.48670959472656, 34.777984619140625, 102.09001159667969, 18.770904541015625, 169.51205444335938, -75.08011627197266, 203.3105010986328, 64.4751968383789, 51.026275634765625, -27.917709350585938, 34.53648376464844, 134.36361694335938, 77.171630859375, 130.17770385742188, 193.6998748779297, 26.132186889648438, 36.188087463378906, 8.24578857421875, 123.14463806152344, -12.480499267578125, 162.53126525878906, -4.181282043457031, 27.384796142578125, 14.205732345581055, 8.229736328125, -9.497390747070312, -103.13250732421875, 24.480209350585938, -4.033714294433594, 76.08631134033203, 14.583450317382812, 40.90864562988281, 85.763916015625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000350.npy"}
{"epoch": 0.5139500734214391, "step": 351, "batch_size": 64, "mean": 76.08428955078125, "std": 84.95716857910156, "min": -107.52273559570312, "p10": -65.11488800048828, "median": 76.92010498046875, "p90": 162.29100189208984, "max": 262.11328125, "pos_frac": 0.828125, "sample": [75.17122650146484, 46.8087158203125, 41.7369384765625, 241.84262084960938, 214.97006225585938, 23.430065155029297, 65.85919952392578, 54.719818115234375, 159.35499572753906, 191.4171905517578, 129.83853149414062, 62.63836669921875, 59.09529113769531, 36.550140380859375, 162.6143798828125, 68.60002136230469, -79.09355163574219, 122.34748840332031, 110.08609771728516, 122.9202880859375, -81.53765869140625, 227.8092041015625, 104.67019653320312, 117.86259460449219, -77.42928314208984, 110.32872772216797, 95.27642059326172, 153.88783264160156, -68.53492736816406, 61.98121643066406, 40.787200927734375, 153.54547119140625, -84.17562866210938, 90.71083068847656, 26.15106201171875, 142.20217895507812, 31.440872192382812, 161.5364532470703, 24.625518798828125, -12.9046630859375, -0.37355804443359375, 8.803993225097656, 151.73838806152344, 192.36428833007812, -42.999298095703125, 72.33905029296875, 81.10603332519531, -77.41534423828125, 78.66898345947266, -57.134796142578125, 24.18596076965332, 120.0557861328125, -107.52273559570312, 79.40508270263672, 142.34014892578125, 53.12010192871094, 131.53457641601562, 262.11328125, 155.5537567138672, 24.732330322265625, 138.20318603515625, 149.50711059570312, 62.348697662353516, 97.57750701904297], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000351.npy"}
{"epoch": 0.5154185022026432, "step": 352, "batch_size": 64, "mean": 72.4589614868164, "std": 84.09123229980469, "min": -79.85488891601562, "p10": -27.76329650878906, "median": 61.003780364990234, "p90": 200.33150787353517, "max": 251.29928588867188, "pos_frac": 0.765625, "sample": [251.29928588867188, 220.54196166992188, 16.577259063720703, 93.21278381347656, -31.7794189453125, 22.8531494140625, -5.8983917236328125, -49.90325927734375, 174.06085205078125, 183.69375610351562, 45.585968017578125, 29.4029541015625, 71.20220947265625, -27.22425079345703, 71.86599731445312, -46.955726623535156, 28.265331268310547, 250.95758056640625, 42.455528259277344, -53.6026725769043, 210.4549102783203, 198.64398193359375, 32.574371337890625, 27.704795837402344, 166.3153839111328, 48.357269287109375, -9.75551986694336, 15.165298461914062, 123.28274536132812, 90.62516784667969, -15.07073974609375, 153.5086669921875, 107.05817413330078, -79.85488891601562, 164.79701232910156, 55.687713623046875, -52.922149658203125, 80.11531829833984, -4.974967956542969, 84.65127563476562, 13.83665657043457, 94.17796325683594, 118.04447937011719, 66.3198471069336, -19.78595733642578, 87.471923828125, 178.30947875976562, 231.79693603515625, 201.0547332763672, 97.82783508300781, 48.282920837402344, -27.99431610107422, -5.501289367675781, 211.6403350830078, 112.4181900024414, 42.392311096191406, 14.31186294555664, 105.10295104980469, 54.33885192871094, 98.15077209472656, 2.53582763671875, -3.4258956909179688, 76.58592224121094, 156.50611877441406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000352.npy"}
{"epoch": 0.5168869309838473, "step": 353, "batch_size": 64, "mean": 45.66265869140625, "std": 77.93164825439453, "min": -149.90121459960938, "p10": -50.20035591125488, "median": 44.455623626708984, "p90": 134.4276840209961, "max": 210.09085083007812, "pos_frac": 0.734375, "sample": [210.09085083007812, 89.7779541015625, 36.925994873046875, 188.5034942626953, 40.71623229980469, 124.87516784667969, -10.70943832397461, -86.9912109375, 76.8230972290039, 17.841529846191406, 42.023719787597656, -20.230331420898438, 114.695068359375, 59.413291931152344, 81.1799545288086, 186.07989501953125, -105.27021789550781, -35.525360107421875, 58.47590637207031, 118.93869018554688, 104.74844360351562, 123.18213653564453, 165.66368103027344, -35.26247787475586, 25.861190795898438, 59.481536865234375, -73.49012756347656, 46.88752746582031, 28.03656005859375, 65.91063690185547, 40.805580139160156, -46.63425827026367, -82.82537841796875, 73.92578887939453, -10.253253936767578, -142.67691040039062, 187.69154357910156, 130.15606689453125, -51.72868347167969, 18.292503356933594, 100.06169128417969, 117.91410064697266, -37.26420593261719, 30.938339233398438, 136.2583770751953, 84.03373718261719, 81.03714752197266, -149.90121459960938, 35.8699951171875, 94.78799438476562, 41.56370544433594, 107.07821655273438, 141.57205200195312, 27.595619201660156, 11.6217041015625, 86.63941955566406, 48.58875274658203, 85.53582763671875, -1.363311767578125, -12.645233154296875, -21.49466323852539, 26.96900177001953, 66.60807037353516, 4.998748779296875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000353.npy"}
{"epoch": 0.5183553597650514, "step": 354, "batch_size": 64, "mean": 70.47891235351562, "std": 66.22682189941406, "min": -73.00250244140625, "p10": -2.613371849060058, "median": 55.29905700683594, "p90": 169.7406753540039, "max": 232.50262451171875, "pos_frac": 0.875, "sample": [56.64848327636719, 115.10150146484375, 72.6222915649414, 142.90866088867188, 211.85623168945312, 120.07815551757812, 180.14805603027344, -24.912940979003906, 13.255996704101562, 2.7426910400390625, 37.60389709472656, -6.49238395690918, 82.44731903076172, 200.09304809570312, 166.8428497314453, 31.810100555419922, 55.39060974121094, 68.636962890625, 165.90252685546875, 13.6187744140625, 114.39466857910156, 39.785911560058594, 14.72161865234375, 14.811073303222656, 119.41377258300781, 73.73353576660156, 52.89155578613281, 107.436279296875, 71.86985778808594, 60.54624938964844, 61.645721435546875, 91.35453796386719, 177.99163818359375, 45.8776969909668, 26.46363067626953, 74.0693359375, -73.00250244140625, 47.00635528564453, 55.20750427246094, -33.3009033203125, 47.44476318359375, 136.888427734375, 86.9498519897461, -2.7979507446289062, 40.87001037597656, 78.25039672851562, -2.182687759399414, 167.6248779296875, 116.41744995117188, 54.348541259765625, 33.741634368896484, 32.71580123901367, 31.730606079101562, 33.19303894042969, -46.27967834472656, 81.93861389160156, 210.3260498046875, 54.70835876464844, 40.699684143066406, -14.761184692382812, 232.50262451171875, 46.674041748046875, 29.77923583984375, 170.64744567871094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000354.npy"}
{"epoch": 0.5198237885462555, "step": 355, "batch_size": 64, "mean": 67.51188659667969, "std": 78.21083068847656, "min": -128.81158447265625, "p10": -25.10048675537109, "median": 74.58255386352539, "p90": 167.09583282470706, "max": 240.03121948242188, "pos_frac": 0.796875, "sample": [128.9821014404297, 82.41419982910156, 27.293617248535156, 146.61412048339844, -128.81158447265625, 69.85377502441406, -74.84083557128906, 149.4583740234375, -14.074378967285156, 77.80583190917969, 169.51394653320312, 138.018798828125, -27.068344116210938, 44.7093505859375, 11.228260040283203, 161.4535675048828, 180.1768341064453, 207.37939453125, -94.87432861328125, 5.782985687255859, 186.2286376953125, 77.62008666992188, 85.60689544677734, 125.03839111328125, 21.44964599609375, 68.099609375, 93.4208984375, 70.53894805908203, 90.91819763183594, 131.6468505859375, -38.91185760498047, -20.508819580078125, 116.92671203613281, 91.49812316894531, 109.9126205444336, 1.7301025390625, 18.508865356445312, 160.3663330078125, -11.286701202392578, 240.03121948242188, 135.9916534423828, 94.05874633789062, 33.964576721191406, 6.99468994140625, 69.4540786743164, -46.77051544189453, 71.5450210571289, -9.149566650390625, 18.10167694091797, 79.22351837158203, 118.50785827636719, 203.02658081054688, -64.99105834960938, 174.3867645263672, -3.2562255859375, 153.9532928466797, 83.96240997314453, 77.81649780273438, 60.14390563964844, -8.049861907958984, 34.77320861816406, 13.310737609863281, 112.01029968261719, 31.901779174804688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000355.npy"}
{"epoch": 0.5212922173274597, "step": 356, "batch_size": 64, "mean": 49.970237731933594, "std": 82.1421890258789, "min": -162.44210815429688, "p10": -56.09758834838865, "median": 54.4290828704834, "p90": 141.23250122070314, "max": 277.3501892089844, "pos_frac": 0.734375, "sample": [102.4305419921875, 51.34009552001953, 46.576778411865234, 4.05218505859375, -3.3287086486816406, -3.8442039489746094, 108.78716278076172, 75.523193359375, 25.572792053222656, 127.89868927001953, 143.43313598632812, 55.83695983886719, 106.90155029296875, 194.10235595703125, 161.6747589111328, 118.54267883300781, -66.13172912597656, 132.9407501220703, -32.684593200683594, 72.29521179199219, -18.251266479492188, 95.7064208984375, -32.11833190917969, 142.35739135742188, 23.23302459716797, 92.40760803222656, 107.26465606689453, 87.2890625, -91.23413848876953, 31.808059692382812, -24.188339233398438, 277.3501892089844, 184.97955322265625, 36.09620666503906, 64.53717041015625, -162.44210815429688, 2.51251220703125, 48.40306091308594, -134.0220489501953, 68.86572265625, -71.87545013427734, 58.39506530761719, -102.37998962402344, 51.93513870239258, 22.54170036315918, 7.126251220703125, 70.28255462646484, 44.10713195800781, 191.42083740234375, 16.733840942382812, 138.60775756835938, 81.96128845214844, 121.0728759765625, 60.84166717529297, -5.0480499267578125, -19.963623046875, 53.02120590209961, 106.66493225097656, -15.14126205444336, 123.05673217773438, 56.80891418457031, -97.42822265625, -17.331253051757812, 100.21122741699219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000356.npy"}
{"epoch": 0.5227606461086637, "step": 357, "batch_size": 64, "mean": 84.42666625976562, "std": 74.96184539794922, "min": -77.23370361328125, "p10": -12.941542053222655, "median": 76.27262115478516, "p90": 178.8883026123047, "max": 241.969482421875, "pos_frac": 0.859375, "sample": [164.68502807617188, 77.71575927734375, 118.19003295898438, 209.16851806640625, 241.969482421875, 109.66984558105469, 74.82948303222656, 41.82902526855469, 0.43487548828125, 37.78205871582031, 163.21224975585938, 54.45428466796875, -71.61100006103516, 73.61270141601562, 59.399566650390625, 102.97897338867188, 169.76605224609375, 131.7213592529297, 189.56692504882812, -33.25362777709961, 42.691436767578125, -20.667949676513672, 59.64093780517578, 63.564361572265625, -77.23370361328125, -20.170896530151367, 93.60343933105469, 175.49720764160156, 0.2813262939453125, 180.3416290283203, 161.02142333984375, -10.577247619628906, 96.44055938720703, 42.41710662841797, 169.42971801757812, 0.1479034423828125, 127.80908966064453, 183.67184448242188, 34.41796875, 157.09381103515625, -26.89691162109375, 13.771854400634766, 209.507568359375, 157.0020751953125, 57.58634948730469, -13.954811096191406, -1.3590850830078125, 43.86431884765625, 159.9254150390625, 131.77635192871094, 59.2367057800293, 100.77012634277344, 157.52627563476562, 111.65061950683594, 203.52114868164062, 18.36669158935547, 15.718406677246094, 69.76399993896484, 155.36026000976562, 107.27142333984375, 32.45210266113281, 113.39503479003906, 101.44396209716797, 50.0653076171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000357.npy"}
{"epoch": 0.5242290748898678, "step": 358, "batch_size": 64, "mean": 59.17223358154297, "std": 79.52136993408203, "min": -83.32020568847656, "p10": -39.59218215942383, "median": 41.45606231689453, "p90": 181.70835876464847, "max": 265.31365966796875, "pos_frac": 0.78125, "sample": [-37.24219512939453, 125.55982208251953, 192.44256591796875, 211.0334014892578, 69.87648010253906, 129.12625122070312, 34.859092712402344, 105.22329711914062, 19.535091400146484, 35.30465316772461, -7.408916473388672, 150.24073791503906, 117.08958435058594, 43.66871643066406, -46.06110763549805, 221.78627014160156, -40.59931945800781, 82.48519897460938, 39.243408203125, 29.51919174194336, -57.3380012512207, 92.84461975097656, -47.166099548339844, -7.484189987182617, 54.247833251953125, 63.59625244140625, 47.17620849609375, 19.344867706298828, 175.85049438476562, 162.01126098632812, 137.78964233398438, 21.71038055419922, 184.2188720703125, -4.9900970458984375, 206.12957763671875, 26.140365600585938, 14.497932434082031, -83.32020568847656, 70.80303955078125, 28.631591796875, 16.153770446777344, -42.228515625, 73.06608581542969, 23.35840606689453, 43.76737594604492, 1.51226806640625, 242.4533233642578, 107.13079833984375, 4.498668670654297, 26.95871353149414, -45.78131103515625, 66.66490936279297, 57.07826232910156, 27.314884185791016, 103.0596694946289, 265.31365966796875, 11.153045654296875, 48.621376037597656, 54.75774383544922, -14.216690063476562, 153.92547607421875, -30.695465087890625, 26.989471435546875, -14.209579467773438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000358.npy"}
{"epoch": 0.5256975036710719, "step": 359, "batch_size": 64, "mean": 55.20313262939453, "std": 84.27064514160156, "min": -101.85260009765625, "p10": -45.17621002197265, "median": 34.95159149169922, "p90": 164.3185272216797, "max": 288.1208801269531, "pos_frac": 0.734375, "sample": [-4.073944091796875, -2.5490875244140625, 144.09744262695312, 117.044189453125, -34.1962890625, 247.95272827148438, -101.85260009765625, 288.1208801269531, 81.47215270996094, -1.8312644958496094, -46.93916320800781, -38.20989990234375, 160.36575317382812, 145.37779235839844, -66.4040756225586, 198.8929443359375, 193.0225067138672, 52.8419303894043, 167.9496612548828, 43.989410400390625, 21.79454803466797, 165.38699340820312, 107.46273803710938, 62.99785614013672, 30.081058502197266, 23.11920928955078, 131.5880889892578, 3.0883026123046875, -0.94464111328125, 26.917861938476562, 161.825439453125, 17.821250915527344, 168.43125915527344, 31.7445068359375, 65.33316040039062, 158.3377227783203, 26.152877807617188, 148.61227416992188, 18.941932678222656, 65.87265014648438, -69.2109375, 2.6580352783203125, 64.99007415771484, -8.394147872924805, 13.107986450195312, 12.37635612487793, 62.804779052734375, 98.55062866210938, 117.71288299560547, 51.40763854980469, -36.088836669921875, 33.27619934082031, 36.626983642578125, -24.243316650390625, 44.848594665527344, -61.59815979003906, 141.5440673828125, -72.20193481445312, 96.30755615234375, 6.6304931640625, 137.2941131591797, -41.062652587890625, 27.289180755615234, -81.26153564453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000359.npy"}
{"epoch": 0.527165932452276, "step": 360, "batch_size": 64, "mean": 71.65193176269531, "std": 73.5943603515625, "min": -172.17520141601562, "p10": -10.425800704956051, "median": 68.66268539428711, "p90": 167.79107666015625, "max": 229.8826446533203, "pos_frac": 0.84375, "sample": [114.80158996582031, 54.94329833984375, 62.94938659667969, 131.37950134277344, 40.98175811767578, 168.2849578857422, 116.50656127929688, 181.94859313964844, 163.7705535888672, 32.564422607421875, 126.33802795410156, 70.63453674316406, 27.8302001953125, 2.839405059814453, 172.1932373046875, 18.759502410888672, 3.779630661010742, 37.835670471191406, 164.54615783691406, 14.90325927734375, 117.11714172363281, 56.7130012512207, -0.37525177001953125, 166.63868713378906, -27.390464782714844, 40.664337158203125, 179.81292724609375, 69.964599609375, 135.73892211914062, 145.86216735839844, 229.8826446533203, 97.8658447265625, 109.93238067626953, -172.17520141601562, -7.538143157958984, 104.42707061767578, 95.43905639648438, -11.663368225097656, 121.18765258789062, 61.54969787597656, 56.17059326171875, 207.49771118164062, 24.824146270751953, 67.36077117919922, 3.357025146484375, 97.02342224121094, -34.84214401245117, 90.55160522460938, 17.297061920166016, 34.66273498535156, -28.128875732421875, 126.62152862548828, -23.14112091064453, 135.4365234375, 170.8556671142578, 142.6294708251953, 97.26968383789062, 98.67622375488281, 76.89317321777344, -49.663658142089844, 25.94292449951172, 23.509883880615234, -6.324737548828125, 9.7998046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000360.npy"}
{"epoch": 0.5286343612334802, "step": 361, "batch_size": 64, "mean": 62.546043395996094, "std": 84.84530639648438, "min": -127.93488311767578, "p10": -31.750726318359373, "median": 41.05895233154297, "p90": 191.71976165771486, "max": 235.53329467773438, "pos_frac": 0.765625, "sample": [87.5062255859375, -7.110477447509766, 5.718841552734375, 143.28587341308594, -67.17279052734375, 12.20888900756836, 140.49769592285156, 213.85484313964844, 158.65628051757812, 112.9587631225586, 21.098548889160156, -29.0848388671875, -32.89324951171875, 184.17723083496094, 7.543731689453125, -8.27739143371582, 26.179603576660156, 17.027389526367188, 22.787155151367188, 82.21431732177734, 218.09503173828125, 77.45499420166016, -56.70274353027344, 82.37882995605469, -33.16211700439453, 7.387443542480469, 59.58662414550781, 126.98597717285156, 31.030410766601562, 100.79886627197266, 103.85794830322266, 27.632598876953125, 22.84588623046875, 102.67154693603516, 131.38644409179688, 80.41755676269531, -92.80113220214844, 191.88450622558594, 90.84870910644531, 128.93643188476562, 126.10868835449219, 22.716041564941406, 185.1311492919922, 35.42936706542969, -8.013618469238281, 197.15316772460938, 235.53329467773438, 61.03298568725586, -27.955490112304688, -21.37267303466797, 10.236945152282715, 30.99559783935547, 194.72511291503906, 46.68853759765625, -53.36360168457031, 62.666778564453125, 191.33535766601562, 5.668771743774414, 8.986312866210938, 111.5833740234375, 230.36273193359375, -5.874656677246094, -127.93488311767578, -1.6028823852539062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000361.npy"}
{"epoch": 0.5301027900146843, "step": 362, "batch_size": 64, "mean": 66.46771240234375, "std": 76.83387756347656, "min": -155.71484375, "p10": -31.457125091552733, "median": 74.78661727905273, "p90": 157.05742187500002, "max": 298.3056945800781, "pos_frac": 0.84375, "sample": [52.5347900390625, 193.81149291992188, 84.06581115722656, 69.73896026611328, 31.419462203979492, -155.71484375, 298.3056945800781, 146.0201873779297, 65.90259552001953, 169.69651794433594, 125.9251708984375, 9.5311279296875, 46.880401611328125, 75.04918670654297, 16.982994079589844, -11.221939086914062, 33.65895080566406, -132.41275024414062, 159.57945251464844, 93.89900207519531, 82.14736938476562, 5.720977783203125, 11.730949401855469, 87.1941909790039, 134.61032104492188, 5.695308685302734, 77.83538818359375, 83.5777359008789, 2.1903610229492188, 82.72123718261719, 94.30810546875, 117.58460235595703, 120.50032043457031, 24.40149688720703, 192.0827178955078, 48.0606689453125, 150.12246704101562, -36.93577575683594, 137.13180541992188, 86.235107421875, 79.1751708984375, -31.00446319580078, 59.748321533203125, 51.35588836669922, -37.346527099609375, 36.330902099609375, 187.68792724609375, 117.56291961669922, 35.384185791015625, 91.05900573730469, 48.88829040527344, 166.18846130371094, -57.191986083984375, 151.1726837158203, -31.651123046875, 92.61006927490234, 91.28976440429688, 94.04620361328125, 49.2336311340332, 108.90533447265625, 54.493106842041016, -46.22833251953125, -12.867462158203125, 74.5240478515625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000362.npy"}
{"epoch": 0.5315712187958884, "step": 363, "batch_size": 64, "mean": 84.87525939941406, "std": 86.77227020263672, "min": -107.43435668945312, "p10": -17.581804847717283, "median": 77.63148880004883, "p90": 198.23521728515627, "max": 332.3640441894531, "pos_frac": 0.78125, "sample": [-47.44178009033203, -0.5071487426757812, 175.2440185546875, 61.319976806640625, -24.594783782958984, -16.396465301513672, 68.93671417236328, 115.28155517578125, 13.836761474609375, 162.93576049804688, 62.008575439453125, 46.656166076660156, 199.68035888671875, 48.23250961303711, 152.46432495117188, 88.5394287109375, 48.343841552734375, 132.90350341796875, 169.9178009033203, 230.43771362304688, 26.505882263183594, 84.68115234375, 79.58026123046875, 228.51715087890625, 138.3772735595703, 98.86225891113281, 332.3640441894531, 90.38084411621094, -10.958221435546875, 34.125885009765625, 75.6827163696289, 212.0998077392578, -9.537933349609375, -18.089807510375977, 235.91140747070312, 159.6849365234375, 24.35672378540039, -4.145973205566406, 68.93085479736328, 34.17008972167969, 123.33751678466797, 98.94435119628906, -5.730312347412109, 152.49575805664062, -35.06753158569336, 75.05474853515625, 63.05360412597656, -107.43435668945312, 185.33392333984375, 163.60556030273438, 3.8519287109375, -32.62890625, 99.67572021484375, -55.000328063964844, 151.14306640625, 10.939895629882812, 107.93624114990234, 45.970855712890625, 95.90498352050781, -2.6711387634277344, 213.67889404296875, 194.86322021484375, 162.27830505371094, 153.18264770507812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000363.npy"}
{"epoch": 0.5330396475770925, "step": 364, "batch_size": 64, "mean": 68.58975219726562, "std": 69.59967041015625, "min": -61.5716667175293, "p10": -34.2371109008789, "median": 80.11511611938477, "p90": 161.39031677246095, "max": 243.76995849609375, "pos_frac": 0.796875, "sample": [27.819808959960938, 95.86302947998047, -32.6968994140625, 59.521400451660156, 16.836021423339844, 15.999443054199219, -21.215538024902344, 96.1004638671875, -43.95989227294922, 166.69064331054688, 54.352569580078125, 105.66519927978516, 38.76387023925781, 85.11967468261719, 85.49275207519531, 20.812225341796875, 132.59799194335938, 81.91159057617188, -59.83992004394531, -61.5716667175293, -36.49169158935547, -16.4661865234375, 62.444374084472656, 166.48638916015625, 37.542274475097656, 59.16581726074219, 103.06729888916016, 243.76995849609375, 163.1185302734375, 169.09161376953125, -38.552337646484375, 118.05951690673828, 79.8355941772461, 110.81734466552734, 137.74057006835938, 24.423812866210938, 115.50171661376953, 81.61070251464844, -34.89720153808594, 105.43194580078125, -20.84197235107422, 184.81536865234375, 157.35781860351562, 35.923072814941406, 134.49826049804688, 86.4084701538086, 112.24009704589844, 62.569061279296875, 135.16714477539062, -40.08155822753906, 80.39463806152344, 103.88512420654297, 7.260271072387695, -12.257537841796875, 106.26608276367188, 59.104896545410156, 120.91897583007812, 138.40576171875, -22.803531646728516, 193.63955688476562, 73.628173828125, 59.90812683105469, 23.763164520263672, 93.61198425292969], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000364.npy"}
{"epoch": 0.5345080763582967, "step": 365, "batch_size": 64, "mean": 74.93985748291016, "std": 89.81178283691406, "min": -110.55596923828125, "p10": -48.458694458007805, "median": 75.13059997558594, "p90": 182.18331604003907, "max": 382.3134765625, "pos_frac": 0.796875, "sample": [159.93185424804688, -81.82595825195312, 178.36593627929688, -27.750869750976562, 7.914173126220703, 17.375120162963867, 47.92842102050781, 35.56512451171875, 102.31532287597656, -30.968276977539062, 93.84800720214844, 82.20494079589844, -59.4322509765625, 81.59738159179688, 60.96049880981445, -33.716190338134766, 76.28111267089844, 188.88925170898438, 48.00330352783203, 182.95059204101562, 132.14891052246094, 71.65740203857422, -13.687431335449219, 75.5186767578125, 118.92070007324219, -43.995948791503906, 163.96640014648438, 115.7872314453125, 185.0265655517578, -63.84372329711914, -110.55596923828125, 18.605575561523438, 15.646953582763672, 83.22520446777344, -57.198516845703125, 184.54554748535156, 130.14352416992188, 98.21476745605469, 149.2797088623047, -68.24166870117188, 44.5909423828125, 73.49984741210938, 120.9010009765625, -8.939743041992188, 4.951454162597656, 180.39300537109375, 119.78898620605469, 42.21965026855469, 89.87672424316406, 48.63325500488281, 71.0716552734375, 66.58122253417969, -50.371299743652344, 94.60800170898438, 72.76509857177734, 74.74252319335938, 382.3134765625, 219.71031188964844, 15.687141418457031, 158.3445587158203, 127.15184020996094, 260.25262451171875, 144.03903198242188, 127.73827362060547], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000365.npy"}
{"epoch": 0.5359765051395007, "step": 366, "batch_size": 64, "mean": 65.45736694335938, "std": 78.95293426513672, "min": -57.602447509765625, "p10": -6.363979339599609, "median": 47.7699031829834, "p90": 183.92627105712893, "max": 283.8051452636719, "pos_frac": 0.828125, "sample": [14.428054809570312, 2.1325855255126953, 79.77193450927734, 4.409357070922852, 17.739761352539062, 1.2004165649414062, 70.92593383789062, 54.82801055908203, 3.7256851196289062, 169.31680297851562, 37.648834228515625, 19.284461975097656, 56.51306915283203, 283.8051452636719, 72.63920593261719, 34.2265625, 69.35501098632812, 63.3215446472168, -3.6287269592285156, -11.40740966796875, 109.50802612304688, 0.378265380859375, 101.57534790039062, -33.8409309387207, 180.5143585205078, 94.22997283935547, 141.7201385498047, 75.60452270507812, 35.059776306152344, -6.471931457519531, 185.38851928710938, -16.422332763671875, 94.24676513671875, -6.112091064453125, 92.97050476074219, 6.158241271972656, 208.49842834472656, 212.404541015625, 32.9827880859375, 14.686079025268555, 139.29588317871094, -7.117652893066406, 9.149301528930664, 27.464637756347656, 155.24024963378906, 53.35698699951172, -2.234527587890625, -0.061336517333984375, -57.602447509765625, 281.5059814453125, 71.33230590820312, 5.4032135009765625, 257.6379699707031, 68.19331359863281, 239.64637756347656, 56.59242248535156, 42.18281936645508, 56.33552551269531, 19.96255874633789, 21.884490966796875, 77.71559143066406, 123.2083511352539, 12.833065032958984, -25.968612670898438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000366.npy"}
{"epoch": 0.5374449339207048, "step": 367, "batch_size": 64, "mean": 74.63752746582031, "std": 76.5451889038086, "min": -130.30599975585938, "p10": -1.5646633148193323, "median": 65.50302505493164, "p90": 169.58760681152347, "max": 271.57275390625, "pos_frac": 0.890625, "sample": [6.444599151611328, 76.80229949951172, 157.74575805664062, 67.4942626953125, 271.57275390625, 90.66681671142578, 62.820289611816406, 30.214014053344727, 75.99171447753906, 78.86688232421875, 135.69747924804688, 32.5943603515625, -45.939048767089844, 271.2418212890625, 224.85903930664062, 171.7749481201172, 164.4838104248047, 13.456718444824219, 252.00840759277344, 1.9230079650878906, 48.89442825317383, 175.49778747558594, 59.776611328125, 89.89480590820312, 72.88468933105469, 95.82884216308594, 55.94280242919922, 11.070335388183594, 238.86898803710938, 35.34187316894531, 129.8155517578125, 7.015422821044922, 63.848655700683594, 43.56965637207031, 74.2275390625, 88.88691711425781, 55.837432861328125, 55.08442687988281, 62.57591247558594, 92.24492645263672, 102.32014465332031, 161.70443725585938, 95.56068420410156, -32.529441833496094, 60.372039794921875, -130.30599975585938, 92.34193420410156, -6.864166259765625, 130.3534698486328, 19.663475036621094, 25.685020446777344, -38.1270751953125, 67.15739440917969, 13.893543243408203, -3.0593795776367188, 20.909820556640625, 92.11807250976562, 84.70884704589844, -50.0059814453125, 21.418014526367188, 55.37977600097656, 86.94617462158203, 61.27265930175781, 148.06036376953125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000367.npy"}
{"epoch": 0.5389133627019089, "step": 368, "batch_size": 64, "mean": 80.64979553222656, "std": 82.72282409667969, "min": -142.945068359375, "p10": -15.917600631713865, "median": 86.07685852050781, "p90": 181.18506469726563, "max": 216.41928100585938, "pos_frac": 0.828125, "sample": [163.05535888671875, 114.03978729248047, 46.7812614440918, 180.3745880126953, 59.389404296875, -19.11285400390625, -43.48951721191406, -142.945068359375, 106.34630584716797, 59.46698760986328, 21.055877685546875, 29.648513793945312, 51.15376281738281, 144.05775451660156, 79.84822082519531, 204.0330810546875, 166.59689331054688, 158.34521484375, 50.690284729003906, 197.95310974121094, 123.63897705078125, 7.903537750244141, 181.06509399414062, 113.84661865234375, 216.41928100585938, 181.23648071289062, -14.218109130859375, -4.645530700683594, 79.41349029541016, -16.645954132080078, 208.25723266601562, 184.103271484375, 114.54327392578125, 38.186553955078125, 97.87981414794922, 191.83694458007812, -4.243377685546875, 161.07643127441406, 7.6576385498046875, 1.1921844482421875, 76.08448791503906, 177.25677490234375, 14.639297485351562, -6.4370880126953125, 88.82931518554688, 21.892417907714844, 109.95278930664062, 118.4072265625, -59.924827575683594, -31.290145874023438, 86.94927978515625, 85.20443725585938, 29.455490112304688, -127.04354095458984, 163.7476348876953, 31.639217376708984, 58.77342987060547, 139.53231811523438, 156.98162841796875, 171.13372802734375, 95.90189361572266, 171.26795959472656, 2.292797088623047, 90.54783630371094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000368.npy"}
{"epoch": 0.540381791483113, "step": 369, "batch_size": 64, "mean": 76.65316009521484, "std": 70.0377426147461, "min": -58.51560974121094, "p10": -10.504300308227538, "median": 82.00397109985352, "p90": 168.8750213623047, "max": 291.1668701171875, "pos_frac": 0.84375, "sample": [132.44424438476562, 35.699249267578125, 164.0801239013672, 121.0154800415039, -19.324539184570312, 67.67440795898438, -14.940361022949219, 149.5771026611328, -58.51560974121094, 291.1668701171875, 98.36747741699219, 116.46615600585938, 92.74349975585938, 30.381858825683594, 56.606536865234375, 113.5149917602539, 15.449371337890625, 154.33192443847656, -10.818290710449219, 79.92971801757812, 105.23716735839844, 81.35781860351562, 126.21336364746094, -20.85650634765625, 29.914268493652344, 6.123260498046875, 37.549522399902344, 6.4287261962890625, 86.00285339355469, 23.811325073242188, 99.89772033691406, 92.6661376953125, -2.4437255859375, 19.31536865234375, 126.15017700195312, 96.57746887207031, 82.6501235961914, 200.72593688964844, 124.12093353271484, 47.782676696777344, 100.73226928710938, 73.47945404052734, 204.99017333984375, 108.84062957763672, 125.91096496582031, 6.2703857421875, 25.418212890625, 95.19388580322266, -12.223485946655273, 100.03694152832031, 19.683944702148438, -30.62786865234375, 47.215667724609375, 47.42857360839844, 170.9299774169922, 84.23713684082031, -3.0710525512695312, 33.201847076416016, 129.36846923828125, 180.2743682861328, 203.95489501953125, 15.651641845703125, 203.60211181640625, -9.771656036376953], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000369.npy"}
{"epoch": 0.5418502202643172, "step": 370, "batch_size": 64, "mean": 52.930091857910156, "std": 80.91524505615234, "min": -160.73385620117188, "p10": -38.014767456054685, "median": 48.957027435302734, "p90": 154.20910186767577, "max": 202.71986389160156, "pos_frac": 0.734375, "sample": [133.57107543945312, 143.3677520751953, -160.73385620117188, 144.47927856445312, 153.5908660888672, -13.150054931640625, -46.68067932128906, 24.797462463378906, -8.624691009521484, 115.3605728149414, 192.5426483154297, 87.95074462890625, 13.91448974609375, 45.34803771972656, 154.47406005859375, 85.49279022216797, -40.04542541503906, 32.79053497314453, -33.27656555175781, 133.59210205078125, 111.23968505859375, 88.83723449707031, 131.69088745117188, 8.729736328125, 34.003456115722656, 20.41280174255371, 29.55804443359375, -8.265335083007812, 47.57716369628906, 10.714021682739258, 5.037200927734375, 45.72331619262695, 50.336891174316406, 109.27513122558594, 57.529109954833984, 199.77984619140625, 58.37224578857422, 95.0576171875, 68.78201293945312, -21.21523666381836, 168.83596801757812, 51.21229553222656, -78.60706329345703, 4.081600189208984, 134.9532928466797, 55.4873046875, -19.94378662109375, -11.142349243164062, 202.71986389160156, -71.58483123779297, -13.167526245117188, -7.133087158203125, -94.39348602294922, 146.84536743164062, 22.857833862304688, -18.035629272460938, 24.77099609375, 165.0648193359375, -143.96798706054688, 109.39834594726562, 100.298095703125, 82.14573669433594, 163.5000762939453, 111.3929443359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000370.npy"}
{"epoch": 0.5433186490455213, "step": 371, "batch_size": 64, "mean": 57.24983596801758, "std": 78.32584381103516, "min": -103.34672546386719, "p10": -37.164189147949216, "median": 58.49512481689453, "p90": 143.2850082397461, "max": 230.82403564453125, "pos_frac": 0.78125, "sample": [115.24223327636719, 109.2579345703125, 115.89456176757812, -69.03633880615234, -103.34672546386719, 197.0859832763672, 120.97014617919922, 169.65362548828125, 83.70669555664062, 15.770668029785156, 44.95216369628906, -38.04341125488281, 122.30121612548828, 171.08627319335938, 115.31317138671875, 3.042816162109375, 81.46190643310547, 30.583404541015625, 28.673858642578125, 139.6229248046875, 109.96558380126953, 80.91226196289062, 94.63079071044922, 42.8936767578125, 51.683502197265625, 141.77508544921875, 126.61953735351562, 22.943450927734375, 191.36886596679688, 79.93270874023438, 230.82403564453125, -92.65728759765625, -86.34028625488281, -14.349853515625, -72.20329284667969, -26.354496002197266, 95.21554565429688, 65.30674743652344, 51.654232025146484, -78.0367660522461, -13.147584915161133, 3.1397056579589844, 73.86106872558594, 1.7340145111083984, 1.147186279296875, 12.788703918457031, -35.1126708984375, 151.3089599609375, 119.67729187011719, -23.280120849609375, -30.528900146484375, -30.47784423828125, 37.7894401550293, 139.049072265625, 140.98997497558594, 35.63517761230469, 142.7667694091797, 1.3704643249511719, 65.5577392578125, 21.887718200683594, 143.50711059570312, 108.73513793945312, 120.08529663085938, 5.528404235839844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000371.npy"}
{"epoch": 0.5447870778267254, "step": 372, "batch_size": 64, "mean": 87.87632751464844, "std": 85.5865478515625, "min": -102.17057800292969, "p10": -9.897948455810543, "median": 98.9544792175293, "p90": 174.70821380615234, "max": 401.81500244140625, "pos_frac": 0.859375, "sample": [116.06871795654297, -59.92047882080078, 114.48823547363281, 95.02995300292969, 34.717437744140625, 176.46087646484375, 34.633087158203125, 115.48153686523438, -102.17057800292969, 25.642364501953125, 401.81500244140625, 127.13037109375, 1.5279998779296875, 140.10446166992188, 40.01976013183594, 28.972854614257812, 11.718326568603516, -11.916267395019531, 105.02972412109375, -26.73513412475586, 171.9572296142578, 174.10243225097656, 102.01685333251953, 112.08297729492188, 102.73831176757812, 124.53964233398438, 28.371749877929688, 174.96783447265625, 83.68109130859375, 155.1842498779297, 148.2308349609375, 184.59127807617188, 94.45244598388672, 58.685951232910156, 8.787666320800781, 11.88760757446289, 90.27018737792969, 108.3670654296875, 106.2181396484375, 192.08946228027344, 84.5868911743164, 48.968360900878906, 101.21775817871094, 106.15814208984375, 163.90914916992188, 230.94158935546875, -39.782737731933594, 57.69956970214844, -1.5706329345703125, 56.686004638671875, 128.62112426757812, 96.69120025634766, 160.85272216796875, 74.04161071777344, 121.38898468017578, 124.74696350097656, -35.36719512939453, 172.94522094726562, 22.41370391845703, 266.446044921875, -87.1463623046875, 3.85833740234375, 169.64561462402344, -5.18853759765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000372.npy"}
{"epoch": 0.5462555066079295, "step": 373, "batch_size": 64, "mean": 67.62651824951172, "std": 82.68909454345703, "min": -137.78436279296875, "p10": -39.3099739074707, "median": 62.084842681884766, "p90": 184.56933441162113, "max": 234.82305908203125, "pos_frac": 0.8125, "sample": [-5.881572723388672, 27.104164123535156, -67.23946380615234, 159.6569366455078, 110.14402770996094, 170.34889221191406, 102.85843658447266, 143.35595703125, 13.317401885986328, 43.12462615966797, 6.971336364746094, 94.22567749023438, 77.36642456054688, -0.7398910522460938, 82.13824462890625, 46.0172233581543, 7.016876220703125, 89.22032928466797, 89.99372863769531, 5.303642272949219, -44.87501525878906, -63.467315673828125, 188.73568725585938, -16.081787109375, 49.14884567260742, 26.8832950592041, 210.96438598632812, 95.03868865966797, 72.77859497070312, -32.603294372558594, -81.03399658203125, 72.06658935546875, -28.100318908691406, 160.8486328125, 190.65919494628906, 0.12135696411132812, 169.22100830078125, 85.93905639648438, 17.69791030883789, 67.61299133300781, 213.89356994628906, 109.1518783569336, 13.563053131103516, 178.2637481689453, 125.72564697265625, 207.1034393310547, 116.87776184082031, 38.72740173339844, 187.271728515625, 42.5430908203125, 15.682785034179688, 163.68240356445312, 29.07562255859375, 55.2828483581543, 56.55669403076172, 145.36196899414062, 125.00770568847656, 121.85466766357422, 8.187881469726562, -43.039031982421875, 26.610198974609375, 234.82305908203125, -137.78436279296875, -42.18426513671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000373.npy"}
{"epoch": 0.5477239353891337, "step": 374, "batch_size": 64, "mean": 71.54954528808594, "std": 71.75829315185547, "min": -51.35198974609375, "p10": -17.890893554687494, "median": 62.04563522338867, "p90": 166.10322265625, "max": 284.1640625, "pos_frac": 0.8125, "sample": [10.981452941894531, 142.98768615722656, 42.05359649658203, 174.51034545898438, 69.25182342529297, 284.1640625, 43.24396514892578, -51.35198974609375, 72.69341278076172, 88.61299896240234, 6.1561279296875, -26.767803192138672, 72.69143676757812, -27.746112823486328, 124.31814575195312, 89.58238220214844, 135.16981506347656, 143.63397216796875, 129.48451232910156, 16.987098693847656, 60.09684753417969, -19.571197509765625, 166.46725463867188, -3.4390640258789062, -9.564842224121094, 72.129150390625, 20.949800491333008, -43.96935272216797, 22.145645141601562, 108.3018798828125, 181.7850341796875, 140.12017822265625, 179.26783752441406, 124.48072814941406, 0.9792938232421875, 48.03810119628906, -4.930763244628906, 165.25381469726562, -9.671714782714844, 98.21453857421875, 45.18513488769531, 19.08005142211914, 137.94078063964844, 20.777780532836914, 133.28123474121094, 62.68415832519531, 127.02210235595703, 95.16010284423828, 93.21550750732422, 172.43295288085938, 47.32257080078125, 61.40711212158203, 8.44443130493164, 49.307334899902344, 47.123233795166016, 133.9615478515625, -23.032833099365234, -22.95024871826172, 125.05508422851562, 84.00395965576172, 60.13706970214844, -13.970184326171875, 34.856544494628906, 242.98526000976562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000374.npy"}
{"epoch": 0.5491923641703378, "step": 375, "batch_size": 64, "mean": 79.62525939941406, "std": 80.41040802001953, "min": -100.98226165771484, "p10": -9.683627319335937, "median": 66.80281829833984, "p90": 180.3736831665039, "max": 292.4845275878906, "pos_frac": 0.859375, "sample": [180.5114288330078, 67.48658752441406, 52.30809020996094, 52.62757873535156, 160.0700225830078, 181.23216247558594, 132.06402587890625, 10.077835083007812, 99.81407165527344, 66.11904907226562, 40.78995895385742, 54.8770751953125, -24.631454467773438, -67.18063354492188, 20.16393280029297, 152.43014526367188, 210.51051330566406, 101.43663787841797, 103.2025375366211, -21.125930786132812, 37.092193603515625, 93.19117736816406, 113.53115844726562, 178.03607177734375, 190.96144104003906, 167.97213745117188, 106.1467514038086, 51.83018493652344, 112.63653564453125, 78.19541931152344, 176.15390014648438, 12.783817291259766, 34.00746154785156, 62.24269104003906, 90.07425689697266, 9.331985473632812, 195.29852294921875, 166.01527404785156, 62.34382629394531, 24.594451904296875, -9.548126220703125, 22.482423782348633, -1.4495697021484375, -90.39485168457031, 123.96566772460938, 150.70236206054688, 76.34984588623047, 145.1663360595703, 292.4845275878906, -9.74169921875, 158.80555725097656, -67.80435180664062, 65.37059020996094, 78.95997619628906, 208.76165771484375, 180.05227661132812, 58.91680908203125, 22.705551147460938, 1.7001266479492188, 48.73772430419922, 20.99700927734375, 18.100723266601562, 166.45498657226562, -100.98226165771484], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000375.npy"}
{"epoch": 0.5506607929515418, "step": 376, "batch_size": 64, "mean": 87.5845718383789, "std": 86.03553771972656, "min": -105.96633911132812, "p10": -11.103902435302734, "median": 89.66267013549805, "p90": 209.69769134521485, "max": 286.9085693359375, "pos_frac": 0.84375, "sample": [-29.57989501953125, 93.89266967773438, 167.14031982421875, 149.62290954589844, 185.98550415039062, 29.578048706054688, 106.36323547363281, -20.914993286132812, 117.68753051757812, 120.10162353515625, -11.0245361328125, 0.15442276000976562, 29.743316650390625, 1.2294082641601562, 116.30408477783203, 74.97528076171875, 208.9281463623047, -4.76702880859375, 111.2630615234375, 7.401649475097656, 176.18630981445312, 6.604076385498047, 101.19546508789062, 156.56243896484375, 138.53765869140625, 48.97981262207031, 247.00372314453125, 49.09833526611328, 286.9085693359375, 83.98178100585938, 66.62771606445312, -20.878250122070312, 85.43267059326172, 235.37673950195312, 101.12794494628906, 51.56242752075195, 215.8908233642578, 5.7545318603515625, 136.03565979003906, 48.1733283996582, 105.28519439697266, 240.95794677734375, -83.41378784179688, 130.6808624267578, 59.89379119873047, 100.3700942993164, 126.71603393554688, 159.935302734375, 64.78775024414062, -11.137916564941406, 43.92810821533203, -105.96633911132812, 216.53115844726562, 23.512451171875, 138.35983276367188, 172.74398803710938, 110.03236389160156, 210.02749633789062, 171.66241455078125, -87.70957946777344, -10.981040954589844, 74.85205078125, 34.029762268066406, 46.06797790527344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000376.npy"}
{"epoch": 0.5521292217327459, "step": 377, "batch_size": 64, "mean": 91.17427062988281, "std": 86.7525405883789, "min": -89.83721923828125, "p10": 1.3859552383422855, "median": 98.66630172729492, "p90": 194.15279693603517, "max": 286.4534606933594, "pos_frac": 0.90625, "sample": [213.8953857421875, 262.2064208984375, 114.59310913085938, 214.1434326171875, 21.741321563720703, -4.5487213134765625, 139.6615447998047, 105.52618408203125, 180.53921508789062, 19.27695083618164, 136.99937438964844, 268.5567626953125, 117.04191589355469, 53.903656005859375, 13.305715560913086, -39.896331787109375, 141.2561798095703, 5.894920349121094, 149.46783447265625, 40.848873138427734, 189.04066467285156, 286.4534606933594, 96.34625244140625, -82.0413589477539, 143.8963623046875, 15.147979736328125, 190.6529998779297, 151.61785888671875, 60.9622802734375, 26.652862548828125, 165.1765594482422, 69.73561096191406, 110.99835205078125, 55.48030090332031, 4.176324844360352, 211.6041259765625, 9.119873046875, 156.97146606445312, 176.11082458496094, 137.98667907714844, 1.2811565399169922, 11.587409973144531, 162.02578735351562, 88.82595825195312, -80.27998352050781, 153.30372619628906, 75.1171875, 23.152175903320312, 113.19603729248047, 167.22271728515625, 77.38419342041016, 5.325859069824219, 1.6304855346679688, 100.9863510131836, 44.9489631652832, 49.19001007080078, 10.66168212890625, 195.6527099609375, -89.83721923828125, -24.8814754486084, 116.12918090820312, 160.95191955566406, 137.39210510253906, 3.68292236328125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000377.npy"}
{"epoch": 0.55359765051395, "step": 378, "batch_size": 64, "mean": 74.31245422363281, "std": 82.08851623535156, "min": -160.21286010742188, "p10": -6.100399971008297, "median": 80.12213134765625, "p90": 161.4090362548828, "max": 258.1861267089844, "pos_frac": 0.859375, "sample": [16.928390502929688, 44.210960388183594, 40.06144714355469, 97.61177062988281, 79.19058227539062, 72.90923309326172, 24.961219787597656, 42.355552673339844, 200.70382690429688, 137.69171142578125, 60.19521713256836, 118.45584106445312, -107.89961242675781, 155.1975860595703, -106.5245590209961, 12.867462158203125, 63.930049896240234, 158.1469268798828, 25.597309112548828, 138.50552368164062, 112.17658996582031, -7.724525451660156, 88.33568572998047, 128.32310485839844, 39.38855743408203, 63.960968017578125, -62.97531509399414, 161.8618927001953, 100.33740234375, 73.2619400024414, 158.4956512451172, 128.05548095703125, 86.94831085205078, 16.885948181152344, -58.91424560546875, 70.04828643798828, 6.767608642578125, 152.97833251953125, -2.080615997314453, -160.21286010742188, 209.39051818847656, 177.2913360595703, 113.42704010009766, 81.48660278320312, 178.809326171875, -2.3107738494873047, 160.3523712158203, 114.27249908447266, 258.1861267089844, 93.38678741455078, 81.05368041992188, 113.59359741210938, -108.98164367675781, 17.776565551757812, 90.22773742675781, 99.390869140625, 141.31756591796875, 68.74032592773438, 40.239166259765625, 216.0286407470703, 44.15521240234375, 14.718513488769531, 32.75270080566406, 149.67788696289062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000378.npy"}
{"epoch": 0.5550660792951542, "step": 379, "batch_size": 64, "mean": 67.62254333496094, "std": 95.74021911621094, "min": -161.00108337402344, "p10": -55.151103210449214, "median": 74.41893768310547, "p90": 186.05572357177738, "max": 330.3937683105469, "pos_frac": 0.765625, "sample": [237.82400512695312, 27.382484436035156, 200.4760284423828, 154.8450164794922, -59.28873825073242, -161.00108337402344, 71.65130615234375, 109.6409912109375, 8.070785522460938, 2.0150299072265625, 9.616065979003906, 101.69271087646484, 165.2505340576172, 34.49212646484375, 87.69117736816406, -57.12452697753906, 122.692138671875, 236.8035888671875, 59.802642822265625, -14.247688293457031, 200.76145935058594, 26.615745544433594, -36.88446044921875, -11.728639602661133, 30.349578857421875, 8.559913635253906, 118.6539306640625, 40.294429779052734, 141.79537963867188, 9.860122680664062, 259.0729064941406, 153.86767578125, -50.54644775390625, 190.1011505126953, 110.02128601074219, 78.13127136230469, 114.7845458984375, 176.61639404296875, 30.76556396484375, -63.063133239746094, 135.23609924316406, 121.27175903320312, -37.22118377685547, 109.49736022949219, 77.52435302734375, 9.948684692382812, -83.83699798583984, 24.407379150390625, -34.48297119140625, -11.989402770996094, 16.756290435791016, 120.79524230957031, -59.880096435546875, 78.57011413574219, 330.3937683105469, 32.76750183105469, 115.49046325683594, 146.46937561035156, 77.18656921386719, 166.6490478515625, 156.3522491455078, 90.98750305175781, -10.423402786254883, -110.94041442871094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000379.npy"}
{"epoch": 0.5565345080763583, "step": 380, "batch_size": 64, "mean": 79.3418197631836, "std": 95.60442352294922, "min": -88.45195770263672, "p10": -39.16081619262695, "median": 71.79036712646484, "p90": 230.7885925292969, "max": 384.9031677246094, "pos_frac": 0.796875, "sample": [98.68844604492188, 108.53279113769531, -82.20407104492188, 98.73725891113281, 27.45493507385254, 33.034088134765625, 118.33184814453125, 233.2384033203125, 97.05590057373047, 37.90877151489258, 101.6065902709961, 108.8775405883789, -10.515914916992188, 248.6060791015625, 100.54911804199219, 46.768585205078125, 45.1724853515625, 7.294898986816406, 73.15547180175781, 65.66464233398438, 232.10519409179688, -18.461322784423828, 56.740074157714844, 42.262474060058594, 140.3003387451172, 48.542137145996094, 71.664306640625, 41.743690490722656, 195.47421264648438, -38.924468994140625, -50.52729797363281, 249.7974090576172, 99.83920288085938, 132.51065063476562, 384.9031677246094, 209.3943634033203, -39.262107849121094, 107.23695373535156, 178.9170684814453, 110.1190414428711, 227.71652221679688, -2.598907470703125, 82.16024780273438, -72.85026550292969, -81.89871978759766, 75.89118194580078, 19.16259002685547, 33.427215576171875, -23.655548095703125, -81.57809448242188, 133.1591339111328, 52.8051643371582, 115.07660675048828, 100.68783569335938, 43.75776672363281, -88.45195770263672, 249.86419677734375, 42.60076141357422, 71.08384704589844, -7.51336669921875, 85.68820190429688, 71.91642761230469, 258.44183349609375, 60.65081024169922], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000380.npy"}
{"epoch": 0.5580029368575624, "step": 381, "batch_size": 64, "mean": 70.51676940917969, "std": 82.56534576416016, "min": -210.23422241210938, "p10": -10.217363739013672, "median": 53.83183670043945, "p90": 181.79312438964848, "max": 235.88821411132812, "pos_frac": 0.84375, "sample": [22.571693420410156, -5.341583251953125, 128.10348510742188, 75.70820617675781, 156.96817016601562, 133.85894775390625, 148.1960906982422, 112.81455993652344, 211.44842529296875, 115.53781127929688, 160.5610809326172, 125.16334533691406, 35.092262268066406, 25.251243591308594, 235.88821411132812, 39.861663818359375, 214.0728759765625, 0.3710365295410156, 191.93545532226562, 31.13091278076172, 186.87533569335938, 30.67223358154297, 9.584400177001953, -49.265159606933594, -10.560287475585938, 187.85418701171875, 136.1219940185547, 13.81143569946289, -9.894477844238281, 3.966398239135742, 15.406465530395508, 68.20294952392578, 41.602317810058594, 57.763031005859375, 73.93660736083984, 2.5272216796875, 54.39714050292969, 9.175743103027344, 93.75214385986328, 89.94403076171875, 2.5222320556640625, 160.87738037109375, 169.93463134765625, 139.0289306640625, 168.80435180664062, 124.55753326416016, 3.4308624267578125, 85.42684936523438, 167.32659912109375, -23.498428344726562, 49.25961685180664, 218.69650268554688, 1.8333282470703125, 38.90120315551758, 9.87175178527832, -28.377578735351562, -10.355743408203125, 153.2359161376953, 53.26653289794922, 83.74415588378906, -0.0091705322265625, -210.23422241210938, -11.144378662109375, 0.9067535400390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000381.npy"}
{"epoch": 0.5594713656387665, "step": 382, "batch_size": 64, "mean": 78.04950714111328, "std": 83.93001556396484, "min": -127.9257583618164, "p10": -12.75560073852539, "median": 72.34040069580078, "p90": 184.0535079956055, "max": 274.4487609863281, "pos_frac": 0.8125, "sample": [265.7451171875, 161.669921875, 127.22938537597656, -4.0583648681640625, 131.32363891601562, 133.06155395507812, 134.44544982910156, 95.17387390136719, 94.34352111816406, 82.15412139892578, 220.1691436767578, 18.102222442626953, -4.644195556640625, 163.456298828125, 51.87327575683594, 144.70274353027344, 179.48260498046875, -35.69691467285156, 105.4335708618164, 20.080936431884766, 186.01246643066406, -2.029529571533203, 81.36940002441406, 47.610565185546875, 169.44845581054688, 31.94970703125, 176.11355590820312, 82.60270690917969, 48.532447814941406, 91.90582275390625, 29.74024200439453, -12.0333251953125, -55.60369110107422, 124.57103729248047, 28.83061981201172, 108.31222534179688, 18.130996704101562, 195.39718627929688, 7.613136291503906, 274.4487609863281, 10.874557495117188, 121.06304931640625, 35.667572021484375, 35.68425750732422, -51.4757080078125, 107.08196258544922, -3.4155807495117188, -21.081695556640625, 50.085838317871094, -56.2490348815918, 192.78750610351562, 257.3446044921875, 25.139266967773438, 154.65078735351562, 133.47543334960938, 47.28459167480469, 13.509986877441406, -127.9257583618164, 109.92817687988281, 19.112228393554688, 42.9055290222168, -13.065147399902344, 131.50408935546875, 63.3114013671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000382.npy"}
{"epoch": 0.5609397944199707, "step": 383, "batch_size": 64, "mean": 67.5145492553711, "std": 81.33802032470703, "min": -72.00227355957031, "p10": -36.97115058898925, "median": 61.826908111572266, "p90": 178.13177795410158, "max": 227.54489135742188, "pos_frac": 0.71875, "sample": [181.45816040039062, -50.37690734863281, 173.03872680664062, -64.0704574584961, 131.66561889648438, -0.3323516845703125, -10.891212463378906, 227.54489135742188, 70.94503784179688, 15.973709106445312, 152.87094116210938, 136.58749389648438, 5.56292724609375, -56.70293045043945, 104.11155700683594, 5.317726135253906, 209.33224487304688, 125.46614074707031, 23.62798309326172, 125.91001892089844, 140.82510375976562, -38.03567886352539, -17.439014434814453, 138.1605682373047, 189.99038696289062, 23.163421630859375, 113.11735534667969, 108.95376586914062, -4.90875244140625, -51.89059829711914, 163.60523986816406, 120.11038208007812, -41.594818115234375, 180.31451416015625, -6.768177032470703, 6.9942474365234375, 222.14279174804688, 144.7109375, 212.48214721679688, 39.852386474609375, 136.63905334472656, -11.736495971679688, -17.31609344482422, -0.4410820007324219, 131.15133666992188, 111.8424072265625, 6.050384521484375, 76.21275329589844, -34.48725128173828, 40.93425750732422, 133.57350158691406, 38.43828582763672, -72.00227355957031, 80.19615173339844, 102.87139129638672, 41.6191520690918, 129.2039031982422, 47.682403564453125, -14.525871276855469, 32.6063232421875, -24.866439819335938, 106.97114562988281, 76.78001403808594, 52.708778381347656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000383.npy"}
{"epoch": 0.5624082232011748, "step": 384, "batch_size": 64, "mean": 67.14823913574219, "std": 96.54074096679688, "min": -185.22967529296875, "p10": -64.2554847717285, "median": 78.24892807006836, "p90": 196.45720367431647, "max": 292.3008117675781, "pos_frac": 0.796875, "sample": [101.50031280517578, 203.47801208496094, 109.74268341064453, 47.21989059448242, -55.88500213623047, -121.805908203125, -22.683284759521484, 43.361328125, 292.3008117675781, 67.0177993774414, 92.45532989501953, 213.69683837890625, 162.2368927001953, 85.27924346923828, 76.99745178222656, 43.07939910888672, -185.22967529296875, 35.6825065612793, -24.42071533203125, -46.82878112792969, 203.68206787109375, 96.15458679199219, 9.753480911254883, 203.87551879882812, 45.0303840637207, 179.03753662109375, 23.171546936035156, 13.744232177734375, 17.211692810058594, 132.64956665039062, 96.04402160644531, 47.523712158203125, 41.4273681640625, 229.42556762695312, 133.61106872558594, -67.84283447265625, -116.46202850341797, 122.79756927490234, 135.63372802734375, -80.6448974609375, 79.50040435791016, 97.07628631591797, 44.37336730957031, 179.0063934326172, 61.636932373046875, -6.3764801025390625, 212.16514587402344, 89.24262237548828, 114.89852905273438, -135.26141357421875, -1.433868408203125, 123.57650756835938, 115.63343048095703, 180.0753173828125, 29.31098175048828, 4.80950927734375, 157.99942016601562, 16.93035888671875, 50.26595687866211, 124.94868469238281, 93.12745666503906, 112.29656982421875, -121.37553405761719, 92.04143524169922], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000384.npy"}
{"epoch": 0.5638766519823789, "step": 385, "batch_size": 64, "mean": 84.93192291259766, "std": 92.79419708251953, "min": -89.49736022949219, "p10": -26.567011260986327, "median": 77.78234100341797, "p90": 217.15701904296876, "max": 260.00701904296875, "pos_frac": 0.765625, "sample": [236.537353515625, 23.115890502929688, 101.60232543945312, 27.915851593017578, 217.84500122070312, 41.618003845214844, 115.32147979736328, 163.34579467773438, 131.77374267578125, 193.46939086914062, 81.64138793945312, 9.490463256835938, 34.427886962890625, 2.2943267822265625, -50.27439880371094, -5.628028869628906, 222.897705078125, 163.60610961914062, 63.53875732421875, 196.395263671875, 145.36619567871094, -17.747234344482422, 50.720977783203125, 105.88613891601562, -83.84923553466797, 63.04457092285156, 165.5272216796875, 246.61399841308594, -50.46534729003906, 156.3592529296875, -27.7318115234375, -14.03240966796875, 81.18396759033203, 44.51807403564453, 215.55172729492188, 129.963134765625, -31.5343017578125, -23.849143981933594, 258.4004211425781, 178.51153564453125, -18.42144012451172, 38.97370147705078, 48.165771484375, -17.000450134277344, 157.1737518310547, 223.66354370117188, 58.350181579589844, 85.14678955078125, 188.17787170410156, -89.49736022949219, -28.461166381835938, 39.38294982910156, 208.15145874023438, 20.439483642578125, 177.4681396484375, 90.86093139648438, 167.729248046875, 74.3807144165039, 91.87154388427734, 260.00701904296875, -14.954025268554688, 29.348190307617188, -3.3005142211914062, 84.61441040039062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000385.npy"}
{"epoch": 0.5653450807635829, "step": 386, "batch_size": 64, "mean": 81.86546325683594, "std": 86.7436752319336, "min": -164.77554321289062, "p10": -25.18617248535156, "median": 87.43397521972656, "p90": 182.8299057006836, "max": 248.35223388671875, "pos_frac": 0.8125, "sample": [74.41808319091797, 100.35659790039062, -164.77554321289062, -36.63021469116211, 39.002349853515625, 52.588775634765625, -21.536373138427734, 115.80522918701172, 108.0626220703125, 144.44882202148438, 112.8823013305664, 145.2320098876953, 113.89726257324219, -9.693115234375, 201.55917358398438, 101.09881591796875, 179.00155639648438, 82.64004516601562, 86.82551574707031, -26.107330322265625, 185.11807250976562, 178.89288330078125, 55.66974639892578, 78.84346008300781, 209.0361785888672, 148.75765991210938, 43.49961471557617, -5.1696929931640625, 223.78793334960938, 248.35223388671875, -31.556106567382812, 46.582176208496094, 93.7381591796875, 82.92518615722656, 82.50212860107422, 202.69415283203125, 123.0613784790039, -23.03680419921875, 94.98519134521484, 161.29766845703125, 22.836395263671875, 150.09515380859375, -70.82144165039062, 157.29019165039062, 38.86492919921875, -117.62487030029297, 60.32560729980469, 168.55735778808594, 107.5062255859375, 106.64511108398438, 111.95527648925781, 84.9894027709961, 22.126190185546875, 162.72825622558594, -0.7926406860351562, 184.4706268310547, 63.20397186279297, 76.93641662597656, -157.29843139648438, 62.578521728515625, 150.09732055664062, 7.892459869384766, 88.04243469238281, 159.72760009765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000386.npy"}
{"epoch": 0.566813509544787, "step": 387, "batch_size": 64, "mean": 75.06538391113281, "std": 79.60884857177734, "min": -105.16903686523438, "p10": -16.88375473022461, "median": 77.50993347167969, "p90": 181.75091094970708, "max": 276.5548095703125, "pos_frac": 0.84375, "sample": [93.88444519042969, -4.434318542480469, 47.776161193847656, 185.5092010498047, 81.34082794189453, 172.9815673828125, 112.57516479492188, 25.36736297607422, 196.73818969726562, 96.28688049316406, 5.041023254394531, -89.31010437011719, -0.2566261291503906, 83.1474609375, 26.2115478515625, 144.08102416992188, 202.72564697265625, 241.4490509033203, 44.586761474609375, -105.16903686523438, 1.3486709594726562, 129.64309692382812, 97.87895965576172, 38.54071044921875, 97.28099060058594, 59.125282287597656, 87.1236572265625, 22.051658630371094, 64.27580261230469, 79.55154418945312, -15.455497741699219, 60.55616760253906, 190.52783203125, 78.20297241210938, 92.6663818359375, 34.695640563964844, -51.39472961425781, -17.495864868164062, 63.062835693359375, 9.542465209960938, 83.21825408935547, 30.949499130249023, 166.36289978027344, 61.165740966796875, 52.74705505371094, 93.33137512207031, 64.96885681152344, 20.774524688720703, 125.12175750732422, -64.9482421875, 19.91535186767578, 99.544677734375, -17.57635498046875, 167.76890563964844, -67.14305114746094, 146.44601440429688, 10.356765747070312, 276.5548095703125, 159.08631896972656, 76.81689453125, 155.71844482421875, 141.3621826171875, 94.51535034179688, 224.86573791503906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000387.npy"}
{"epoch": 0.5682819383259912, "step": 388, "batch_size": 64, "mean": 82.60919952392578, "std": 85.6233139038086, "min": -95.33950805664062, "p10": -18.921231842041013, "median": 71.16609954833984, "p90": 192.2392578125, "max": 243.7374267578125, "pos_frac": 0.84375, "sample": [30.974334716796875, 164.8294219970703, -15.438545227050781, 70.56217956542969, 183.64056396484375, 243.7374267578125, 104.44245910644531, 169.00350952148438, 174.20877075195312, 39.79248046875, 190.6063232421875, 118.1702880859375, 21.61193084716797, 153.26535034179688, -29.802303314208984, 51.23335647583008, 30.4820556640625, 25.18783187866211, 200.96212768554688, 136.6885528564453, 102.44613647460938, 63.84779357910156, 23.210861206054688, -95.33950805664062, 136.97886657714844, 159.3336639404297, 56.833412170410156, 50.98692321777344, 210.9049072265625, 136.1021728515625, -22.553848266601562, 0.5071029663085938, 108.95188903808594, 48.427490234375, 208.6021270751953, 120.32557678222656, 23.727264404296875, 15.363143920898438, 159.15330505371094, -15.28740119934082, 10.847198486328125, 42.000675201416016, 229.96612548828125, -94.61276245117188, 153.36895751953125, 209.10848999023438, 7.10540771484375, 5.662086486816406, 119.92276000976562, 192.9390869140625, 58.52315139770508, 185.89486694335938, -32.8994140625, 71.77001953125, 8.093997955322266, -17.786087036132812, 5.693920135498047, 109.08599853515625, 146.2388458251953, -19.40772247314453, 170.31304931640625, 151.2761688232422, 109.67256164550781, -92.46878051757812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000388.npy"}
{"epoch": 0.5697503671071953, "step": 389, "batch_size": 64, "mean": 73.11224365234375, "std": 96.43102264404297, "min": -183.23995971679688, "p10": -31.645010948181152, "median": 61.79822540283203, "p90": 203.8391845703125, "max": 295.2359313964844, "pos_frac": 0.75, "sample": [44.467674255371094, 212.39840698242188, 185.8081817626953, -45.785762786865234, -5.972526550292969, -22.255844116210938, 175.97193908691406, 171.84283447265625, 99.73490142822266, -132.38833618164062, 232.52586364746094, -31.301231384277344, 87.54195404052734, -183.23995971679688, 24.617965698242188, 71.54403686523438, -1.3430709838867188, 61.338043212890625, 26.112937927246094, 12.288604736328125, 67.96826171875, 59.36528778076172, 295.2359313964844, -35.67356491088867, 98.3565444946289, 40.58821105957031, -14.656951904296875, 176.70611572265625, -19.188461303710938, 112.23908996582031, 118.155029296875, 112.65890502929688, 38.759578704833984, -20.296951293945312, -41.9758186340332, -0.309173583984375, 38.87980651855469, 50.61982727050781, 219.31692504882812, 64.74954223632812, 273.0857238769531, 30.605684280395508, 69.80782318115234, 93.55561828613281, 58.66338348388672, 162.2669677734375, 62.25840759277344, 33.83977127075195, 204.68084716796875, 113.29605865478516, 43.203033447265625, 236.29598999023438, -23.75701141357422, -102.28036499023438, 201.87530517578125, 135.7023468017578, 128.3966827392578, 149.0318603515625, 186.27310180664062, 4.7999725341796875, 74.39688110351562, -31.79234504699707, 57.60624313354492, 171.96707153320312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000389.npy"}
{"epoch": 0.5712187958883994, "step": 390, "batch_size": 64, "mean": 68.37908172607422, "std": 99.5161361694336, "min": -118.58609008789062, "p10": -48.408363723754874, "median": 36.99355697631836, "p90": 198.0818023681641, "max": 446.30078125, "pos_frac": 0.75, "sample": [-113.7553939819336, 85.44507598876953, 133.65606689453125, 10.266368865966797, -51.884918212890625, 19.607349395751953, 32.71685791015625, 91.75749969482422, 207.7929229736328, 35.04346466064453, -15.356918334960938, 126.35240936279297, 143.63221740722656, 118.74634552001953, 32.68958282470703, -57.670719146728516, 15.515125274658203, 446.30078125, 3.9120712280273438, 205.01980590820312, 42.47096252441406, 159.58322143554688, 96.299072265625, 192.25469970703125, -26.216915130615234, 9.94479751586914, 15.29220199584961, -25.2530517578125, -27.352195739746094, 26.927566528320312, 6.898921966552734, 216.3038330078125, 104.31132507324219, -67.22383880615234, 10.839111328125, 222.57968139648438, 200.57913208007812, 118.17266845703125, -10.690277099609375, 74.5495834350586, 123.84262084960938, 110.36658477783203, 11.778144836425781, 35.833412170410156, 28.309494018554688, -51.03193664550781, -15.632301330566406, 38.15370178222656, 178.87350463867188, 189.96470642089844, 167.08184814453125, 93.63494873046875, -1.71099853515625, 138.06173706054688, -13.764808654785156, -42.28669357299805, 104.2508544921875, -118.58609008789062, -65.67953491210938, 153.5773468017578, 134.24708557128906, 26.5423583984375, 129.3016357421875, 211.07708740234375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000390.npy"}
{"epoch": 0.5726872246696035, "step": 391, "batch_size": 64, "mean": 75.55020141601562, "std": 89.74540710449219, "min": -117.65971374511719, "p10": -30.513186454772946, "median": 58.43355369567871, "p90": 177.43149719238284, "max": 268.5759582519531, "pos_frac": 0.796875, "sample": [-57.966590881347656, 33.589385986328125, -6.411598205566406, 153.84852600097656, 56.69226837158203, 139.89437866210938, 159.0186309814453, 35.365089416503906, 42.80023193359375, 54.380523681640625, 124.20088195800781, -3.1287689208984375, -31.571916580200195, 17.806808471679688, 16.026504516601562, 72.73966217041016, 60.08648681640625, 27.528945922851562, -6.421466827392578, 52.537017822265625, 156.99002075195312, 215.7654266357422, 8.716461181640625, 178.49212646484375, 122.52761840820312, 103.83678436279297, 67.1524887084961, 42.364288330078125, 135.7871551513672, 75.01666259765625, -28.042816162109375, 189.8166046142578, 22.378080368041992, 173.1125946044922, 75.65450286865234, -44.50287628173828, 130.03009033203125, 148.4537353515625, 139.42544555664062, 31.98523712158203, 132.2508544921875, -114.28925323486328, 171.6540985107422, 60.12803268432617, 264.5806884765625, -86.06428527832031, 51.59120178222656, -8.422870635986328, 16.12548828125, 56.78062057495117, -20.32868194580078, 158.28591918945312, 17.249679565429688, 174.95669555664062, 167.25717163085938, 268.5759582519531, 258.239990234375, -48.78660583496094, 54.3057861328125, 3.8145751953125, 105.8916015625, 214.80662536621094, -117.65971374511719, 168.29483032226562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000391.npy"}
{"epoch": 0.5741556534508077, "step": 392, "batch_size": 64, "mean": 88.1395263671875, "std": 98.11956787109375, "min": -169.04925537109375, "p10": -37.44741516113281, "median": 92.71980667114258, "p90": 201.67963409423828, "max": 307.0094299316406, "pos_frac": 0.828125, "sample": [68.09329223632812, -39.369667053222656, -36.008514404296875, 148.8863067626953, 35.583473205566406, 1.9171142578125, 98.45660400390625, -18.045562744140625, 21.708072662353516, 220.4083709716797, 190.8252410888672, -38.0640869140625, 97.59904479980469, 90.39830017089844, -72.09571838378906, 37.804039001464844, 199.4144287109375, 305.8021240234375, 108.55198669433594, 42.80600357055664, 59.731849670410156, 1.8906097412109375, 217.92962646484375, 185.02603149414062, 50.82152557373047, 181.20701599121094, 132.11410522460938, 229.18948364257812, 40.95234298706055, -22.6953125, 127.2798843383789, 307.0094299316406, 33.401893615722656, 135.1134796142578, 197.75439453125, 224.16012573242188, 27.170799255371094, 101.52796173095703, 96.8486328125, 57.777976989746094, 154.7164764404297, 127.93687438964844, 51.1090087890625, 91.23601531982422, 202.6504364013672, 145.42628479003906, 73.4583969116211, 13.635932922363281, -50.74064254760742, -169.04925537109375, 94.20359802246094, 169.48841857910156, 9.44906997680664, 40.26936340332031, -0.8807601928710938, 139.78489685058594, 158.9314727783203, -57.05317687988281, 199.0123291015625, -140.40599060058594, 160.0957489013672, 72.140380859375, 110.2529067993164, 196.37924194335938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000392.npy"}
{"epoch": 0.5756240822320118, "step": 393, "batch_size": 64, "mean": 80.21553039550781, "std": 85.7212905883789, "min": -94.42112731933594, "p10": -32.53678665161132, "median": 79.98226165771484, "p90": 181.43950347900395, "max": 271.70458984375, "pos_frac": 0.765625, "sample": [184.36058044433594, 166.128662109375, 50.25554275512695, -8.752113342285156, -4.9183502197265625, 16.872207641601562, -43.873207092285156, 157.6123809814453, 78.77947235107422, 64.4308853149414, 126.18353271484375, 227.40481567382812, 27.353971481323242, 130.44825744628906, 104.44284057617188, 66.19800567626953, -25.358245849609375, 271.70458984375, -35.822784423828125, 124.65625762939453, 126.7547607421875, 46.31890869140625, 8.646514892578125, 70.17961883544922, 161.85305786132812, 209.55938720703125, -12.48189926147461, 192.63380432128906, 170.62339782714844, 29.35521697998047, 92.06008911132812, 106.53643035888672, 169.01031494140625, 153.8798370361328, -64.63973236083984, 47.1226806640625, 85.13055419921875, 28.465118408203125, 174.6236572265625, 119.24974060058594, -35.613304138183594, 92.7997817993164, 156.26364135742188, -13.379264831542969, 169.81398010253906, 114.92135620117188, 27.549888610839844, -67.8767318725586, 81.18505096435547, 64.83448028564453, 153.3760986328125, 116.86032104492188, 172.39044189453125, -19.238121032714844, 21.042692184448242, 204.38401794433594, 38.46641540527344, 102.93803405761719, -16.921127319335938, -94.42112731933594, -39.717384338378906, 71.90461730957031, 257.24041748046875, -17.99844741821289], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000393.npy"}
{"epoch": 0.5770925110132159, "step": 394, "batch_size": 64, "mean": 86.02757263183594, "std": 78.95582580566406, "min": -86.85041809082031, "p10": -15.716475296020507, "median": 90.66435241699219, "p90": 184.05559234619142, "max": 231.01708984375, "pos_frac": 0.84375, "sample": [159.11624145507812, 149.54580688476562, -18.030288696289062, 67.74185180664062, 175.8214874267578, 108.51400756835938, 124.17988586425781, 13.903697967529297, 91.86711120605469, 150.21295166015625, 183.03897094726562, 47.260353088378906, 65.68943786621094, 211.78765869140625, -32.73094940185547, 60.27191925048828, -86.85041809082031, 31.97954559326172, 24.66046142578125, -82.06149291992188, 28.9638671875, 67.38472747802734, 170.70358276367188, 99.7069091796875, 201.7863006591797, 159.21336364746094, 48.379547119140625, 19.855579376220703, -14.60061264038086, 231.01708984375, 98.44842529296875, 151.91049194335938, 2.928722381591797, -17.044218063354492, 190.25946044921875, 125.67790222167969, 60.77317810058594, 145.61593627929688, 154.5645751953125, 84.57127380371094, -7.4284210205078125, 67.57406616210938, 9.071266174316406, 107.701416015625, -7.138317108154297, -38.6029052734375, 135.96202087402344, 225.62911987304688, 89.46159362792969, 93.53074645996094, 148.2862091064453, 39.343505859375, 225.54666137695312, 157.13168334960938, 148.794921875, 115.01555633544922, -16.1947021484375, 41.781761169433594, 149.40489196777344, 25.36456298828125, 140.676025390625, 7.291654586791992, 184.4912872314453, 7.0356903076171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000394.npy"}
{"epoch": 0.57856093979442, "step": 395, "batch_size": 64, "mean": 67.20747375488281, "std": 118.05342102050781, "min": -175.52732849121094, "p10": -93.58324737548827, "median": 50.07293701171875, "p90": 228.82199249267583, "max": 315.0163879394531, "pos_frac": 0.71875, "sample": [178.6740264892578, -19.66177749633789, -153.71844482421875, -140.21446228027344, 21.174774169921875, 180.03558349609375, -0.05568695068359375, 50.237579345703125, -135.18536376953125, 185.479736328125, 24.469268798828125, 55.93486785888672, 49.908294677734375, -88.51214599609375, 18.804786682128906, 20.744659423828125, 116.29703521728516, 201.5679931640625, 134.06927490234375, -15.414456367492676, 145.5595245361328, 106.99008178710938, 214.20748901367188, 124.16423034667969, 52.01795959472656, 64.1331558227539, 99.06853485107422, 242.2699737548828, -95.75657653808594, -1.6029205322265625, 315.0163879394531, 176.96353149414062, 83.22940826416016, 115.52544403076172, 53.13124465942383, 21.095901489257812, 34.04450988769531, 218.7911834716797, 309.7955627441406, 25.80096435546875, 47.290138244628906, -50.373451232910156, -140.25546264648438, -136.85997009277344, 40.02373504638672, -1.2791900634765625, 47.588592529296875, 266.3286437988281, 68.3721923828125, -12.166900634765625, 11.969985961914062, -175.52732849121094, 46.293373107910156, 263.515625, 233.12091064453125, 168.9735870361328, -72.17047119140625, 18.643890380859375, 107.06060791015625, 250.71401977539062, 198.4955291748047, -4.596546173095703, 155.2329864501953, -18.197349548339844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000395.npy"}
{"epoch": 0.580029368575624, "step": 396, "batch_size": 64, "mean": 57.408912658691406, "std": 87.27578735351562, "min": -137.93487548828125, "p10": -50.484068298339835, "median": 52.501182556152344, "p90": 164.26922607421878, "max": 255.9981689453125, "pos_frac": 0.703125, "sample": [126.51797485351562, 143.93621826171875, -27.588592529296875, 55.673072814941406, 107.07637786865234, 84.84036254882812, -16.312721252441406, 42.09912872314453, -52.49491882324219, 58.86248779296875, 105.80377197265625, -84.67337036132812, 20.090274810791016, 181.05697631835938, -12.272502899169922, 35.637847900390625, -13.470022201538086, -3.5034942626953125, 3.7716445922851562, 84.40255737304688, 52.284820556640625, -4.377960205078125, 168.69332885742188, 165.9656982421875, 192.45281982421875, 36.624420166015625, 157.16429138183594, 103.18939208984375, 135.17481994628906, 255.9981689453125, 18.462326049804688, 7.18280029296875, -137.93487548828125, 75.51254272460938, 19.75830078125, 45.61833953857422, -45.792083740234375, 132.1001739501953, -37.411842346191406, 253.61947631835938, 106.65291595458984, -13.695747375488281, -98.98517608642578, 29.57550811767578, 123.44145965576172, -129.67117309570312, 160.310791015625, -19.007431030273438, 92.52935028076172, 154.54376220703125, 138.70150756835938, 152.75155639648438, -27.20147705078125, -62.12701416015625, 100.03414916992188, 51.39083480834961, -53.82489013671875, -11.38812255859375, 32.641143798828125, 52.71754455566406, 94.31782531738281, 190.09243774414062, 114.26342010498047, 62.369476318359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000396.npy"}
{"epoch": 0.5814977973568282, "step": 397, "batch_size": 64, "mean": 106.80502319335938, "std": 108.22493743896484, "min": -180.4368133544922, "p10": -30.41552963256835, "median": 116.62564086914062, "p90": 232.12435302734377, "max": 329.17803955078125, "pos_frac": 0.78125, "sample": [-18.399002075195312, 249.64646911621094, 11.131004333496094, 256.35931396484375, -76.74373626708984, 164.13778686523438, 6.1038665771484375, 55.3861083984375, -36.927947998046875, 104.8053207397461, 228.59735107421875, 69.55413818359375, 82.69367980957031, 97.92618560791016, 8.715995788574219, -63.77570343017578, 30.589988708496094, 127.94000244140625, 171.73072814941406, 140.15838623046875, -1.3745651245117188, 239.92218017578125, -17.507240295410156, 145.25802612304688, 127.36088562011719, -180.4368133544922, 198.47238159179688, 227.9154052734375, -21.673152923583984, 127.7928695678711, 197.7303924560547, 233.63592529296875, 221.6045379638672, 225.5843505859375, 140.61660766601562, 41.97711944580078, 86.05276489257812, 34.98908233642578, 67.60552978515625, 194.42202758789062, 218.46148681640625, -22.98113250732422, -35.703514099121094, 163.76808166503906, 209.9373016357422, 185.40431213378906, -33.60169982910156, 101.917236328125, -55.96964645385742, 43.257530212402344, 22.76087760925293, 172.7066650390625, 216.0850372314453, 329.17803955078125, 132.2295379638672, 226.55084228515625, 235.4802703857422, -3.0126609802246094, 296.9302673339844, -5.715583801269531, 174.17880249023438, 105.89039611816406, 49.67741394042969, 208.51318359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000397.npy"}
{"epoch": 0.5829662261380323, "step": 398, "batch_size": 64, "mean": 77.572265625, "std": 103.44872283935547, "min": -224.63827514648438, "p10": -36.33485946655273, "median": 77.13647079467773, "p90": 203.49329833984376, "max": 335.0634765625, "pos_frac": 0.796875, "sample": [124.99382781982422, 40.30534362792969, 16.506179809570312, -5.163734436035156, 197.44393920898438, -48.5474967956543, 47.51942825317383, -28.743301391601562, 58.157928466796875, -38.583831787109375, 132.55648803710938, -224.63827514648438, 35.29389953613281, 27.856857299804688, 80.17194366455078, 275.5395202636719, 11.289161682128906, 184.86141967773438, 9.28887939453125, 196.5153045654297, 145.82510375976562, 103.34734344482422, -3.1296768188476562, 18.19538116455078, 335.0634765625, 91.25982666015625, 120.21942138671875, -104.33075714111328, 3.000274658203125, -5.534343719482422, -31.087257385253906, 196.15943908691406, 74.10099792480469, 131.48025512695312, -124.45219421386719, 148.9860382080078, 202.3577423095703, 112.96180725097656, 203.97996520996094, 21.8568115234375, 47.81462478637695, 205.7069091796875, 81.25714111328125, 14.58907699584961, 44.715057373046875, 87.25657653808594, 237.38095092773438, 142.39466857910156, 103.18472290039062, 89.70111083984375, -40.50849914550781, 251.28240966796875, 149.87269592285156, 282.5362548828125, -54.904632568359375, 46.0552978515625, 98.08053588867188, 132.5843963623047, 2.673797607421875, 28.191612243652344, 102.43611145019531, 191.1363525390625, -14.599441528320312, 2.9044342041015625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000398.npy"}
{"epoch": 0.5844346549192364, "step": 399, "batch_size": 64, "mean": 98.94233703613281, "std": 84.27433013916016, "min": -76.75824737548828, "p10": -5.070375061035151, "median": 85.3523178100586, "p90": 210.7562973022461, "max": 295.24359130859375, "pos_frac": 0.890625, "sample": [34.61182403564453, -76.75824737548828, 94.39899444580078, -7.455841064453125, 150.9385986328125, 88.69670104980469, 141.52130126953125, 26.773284912109375, 122.07328796386719, 165.27313232421875, 41.904510498046875, 37.35536193847656, 202.1510009765625, 51.242919921875, 43.11848449707031, 75.51385498046875, 94.25961303710938, -35.679664611816406, 68.921142578125, 40.34214782714844, 61.42109680175781, 52.4921989440918, 219.17794799804688, 138.86386108398438, 242.34371948242188, 235.24911499023438, 198.3341064453125, 222.2501983642578, -58.03092956542969, 202.76266479492188, 178.25181579589844, 265.5008544921875, 17.689884185791016, 209.61981201171875, 128.8457794189453, -31.896329879760742, 103.12872314453125, 11.54425048828125, 195.375, 180.54736328125, 46.45897674560547, 101.8851318359375, 0.4957122802734375, 34.79578399658203, -33.83003234863281, 82.0079345703125, 44.525184631347656, 137.36325073242188, 144.7275390625, 55.77034378051758, 94.97093200683594, 295.24359130859375, -17.548248291015625, 168.82891845703125, 79.58719635009766, 79.01342010498047, 75.80621337890625, 47.51308059692383, 31.816024780273438, 140.08554077148438, 159.09796142578125, 169.15231323242188, 211.2433624267578, 50.6256103515625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000399.npy"}
{"epoch": 0.5859030837004405, "step": 400, "batch_size": 64, "mean": 100.96365356445312, "std": 102.71650695800781, "min": -129.349609375, "p10": -32.848321914672844, "median": 112.19070434570312, "p90": 213.37630462646484, "max": 354.460205078125, "pos_frac": 0.8125, "sample": [54.644554138183594, 66.0052490234375, 286.7317199707031, 92.83724975585938, 85.41453552246094, -114.0286865234375, -107.11197662353516, 147.84707641601562, 30.625259399414062, 131.82205200195312, 143.20321655273438, 135.7018280029297, -11.491195678710938, 34.10444641113281, -26.469738006591797, -45.42681884765625, 267.41802978515625, 116.67933654785156, 202.4759979248047, 107.49375915527344, 354.460205078125, -129.349609375, 62.55316162109375, 195.3372802734375, 137.20550537109375, 48.444183349609375, 123.1934814453125, 178.70530700683594, 107.70207214355469, 186.74264526367188, 30.23624038696289, 170.68707275390625, -56.96660614013672, 14.614410400390625, 220.68356323242188, 150.98175048828125, 59.66938781738281, 58.09991455078125, 45.460845947265625, 34.77082824707031, -40.903472900390625, -15.460685729980469, 207.31483459472656, 187.1303253173828, 35.55345153808594, 222.3235626220703, 38.16932678222656, 202.76763916015625, 0.620849609375, 213.31739807128906, 148.62503051757812, -35.582000732421875, 69.97232055664062, 197.06747436523438, 167.23159790039062, 269.68157958984375, -7.6365966796875, 213.40155029296875, 160.30270385742188, 204.305908203125, 160.28225708007812, -1.475555419921875, 135.93768310546875, 137.01918029785156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000400.npy"}
{"epoch": 0.5873715124816447, "step": 401, "batch_size": 64, "mean": 63.91277313232422, "std": 107.91503143310547, "min": -159.51954650878906, "p10": -37.805242919921874, "median": 53.0113639831543, "p90": 200.56589660644534, "max": 427.0906677246094, "pos_frac": 0.71875, "sample": [4.452568054199219, -21.38678741455078, 28.3734130859375, 237.99803161621094, 155.78897094726562, 101.25630187988281, -159.51954650878906, -14.697837829589844, -62.736297607421875, -11.661941528320312, -6.000892639160156, 10.272369384765625, 44.84637451171875, -19.568897247314453, 39.12823486328125, 36.46106719970703, 58.76429748535156, 74.92251586914062, -36.90885925292969, 178.914306640625, -18.36944580078125, 56.94008255004883, 52.9991455078125, 237.2706298828125, -35.94245147705078, 74.39682006835938, 235.73104858398438, 92.10545349121094, 427.0906677246094, 15.911920547485352, 58.859580993652344, 21.157737731933594, -30.904415130615234, 195.41439819335938, -38.18940734863281, 61.35016632080078, 276.18487548828125, -97.9896011352539, 71.26104736328125, -119.0921630859375, 51.399658203125, 122.78109741210938, 53.023582458496094, 7.085639953613281, 202.773681640625, 5.5991363525390625, -75.30195617675781, 89.33314514160156, 311.2063903808594, 134.38829040527344, 194.29409790039062, -2.9446563720703125, 111.50894165039062, 114.42869567871094, 166.6212158203125, 95.116455078125, 63.27208709716797, 164.66603088378906, 85.8946533203125, -8.087800025939941, 2.407257080078125, 142.16392517089844, 16.752052307128906, -132.84765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000401.npy"}
{"epoch": 0.5888399412628488, "step": 402, "batch_size": 64, "mean": 116.8514404296875, "std": 89.03114318847656, "min": -95.70598602294922, "p10": -3.453578186035151, "median": 134.1815948486328, "p90": 207.00254516601564, "max": 311.9487609863281, "pos_frac": 0.890625, "sample": [40.574798583984375, 50.373046875, 22.273090362548828, 188.23272705078125, 16.526321411132812, 186.0375213623047, -42.372344970703125, 110.2489013671875, 53.36786651611328, 120.8487548828125, 114.70195770263672, 206.72308349609375, 251.81454467773438, 173.36788940429688, 113.37911987304688, 143.98098754882812, -95.70598602294922, 162.72158813476562, 84.33545684814453, 181.05111694335938, 182.00401306152344, 43.585845947265625, 177.60861206054688, -16.427677154541016, 89.46165466308594, 143.2645263671875, 180.87709045410156, 228.9148406982422, 38.608665466308594, 270.9326171875, 145.6155242919922, 193.4384002685547, 160.43682861328125, 114.26326751708984, -42.08843994140625, 185.07801818847656, 259.0157165527344, 163.39891052246094, 1.6146392822265625, 207.122314453125, 131.89193725585938, 8.903495788574219, 188.55593872070312, 284.809814453125, 190.772705078125, 72.96250915527344, 152.98370361328125, 103.44454193115234, 162.52334594726562, 311.9487609863281, 138.70956420898438, 60.65296173095703, 44.20745849609375, 125.05442810058594, 136.47125244140625, 179.74102783203125, 140.0574951171875, 27.36309051513672, -23.14704132080078, -44.48606491088867, 191.49948120117188, 13.246742248535156, -5.62567138671875, 76.74493408203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000402.npy"}
{"epoch": 0.5903083700440529, "step": 403, "batch_size": 64, "mean": 87.03971099853516, "std": 95.93168640136719, "min": -118.27676391601562, "p10": -32.1500820159912, "median": 82.24420166015625, "p90": 207.70717773437502, "max": 305.4715270996094, "pos_frac": 0.828125, "sample": [41.513282775878906, 86.62987518310547, 188.1175079345703, 53.6949462890625, 46.83270263671875, 74.76966857910156, 253.57228088378906, 163.22933959960938, -113.85431671142578, 14.885477066040039, 44.11695098876953, 152.193115234375, -64.08384704589844, 184.73013305664062, 26.789167404174805, 305.4715270996094, 60.00010299682617, -82.99958801269531, 74.34513092041016, 113.22958374023438, 146.6414031982422, 12.222675323486328, 115.82733917236328, -118.27676391601562, 28.585006713867188, 236.0482177734375, 149.97332763671875, 33.16941833496094, 202.81619262695312, 255.0657958984375, 12.205554962158203, -43.73548889160156, 209.80331420898438, 30.41869354248047, 122.66510009765625, -21.644012451171875, -20.362197875976562, 190.52316284179688, 100.76384735107422, 124.23771667480469, -2.4232406616210938, -36.65268325805664, 168.86727905273438, -3.550381660461426, 190.704345703125, -78.00155639648438, 157.03274536132812, 14.452880859375, 94.3218765258789, 242.59423828125, 74.6400146484375, 185.60279846191406, 221.91217041015625, 102.45249938964844, 163.02963256835938, 8.423873901367188, 18.21350860595703, 101.70735931396484, 138.552978515625, 92.68921661376953, 42.21175003051758, 35.11249542236328, 77.85852813720703, 170.65771484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000403.npy"}
{"epoch": 0.591776798825257, "step": 404, "batch_size": 64, "mean": 74.28379821777344, "std": 107.4809341430664, "min": -160.10980224609375, "p10": -51.15095252990721, "median": 71.24667358398438, "p90": 192.15471191406255, "max": 376.04595947265625, "pos_frac": 0.84375, "sample": [177.09506225585938, 16.230331420898438, 17.39295196533203, -59.199249267578125, 103.3878173828125, 29.575990676879883, 119.99541473388672, 275.8203430175781, 161.656494140625, 15.29730224609375, 291.02978515625, 180.7383575439453, 10.375808715820312, 276.1959533691406, 106.05024719238281, 135.67822265625, 376.04595947265625, 105.18647766113281, -32.3715934753418, 43.059200286865234, 13.771602630615234, 145.32627868652344, 0.0865325927734375, 13.668930053710938, 153.22181701660156, 200.23680114746094, -3.7628211975097656, 108.32456970214844, 0.370941162109375, 54.50575256347656, 45.65796661376953, 36.02464294433594, -135.85409545898438, 69.31765747070312, 128.6556396484375, 127.1542739868164, -15.450492858886719, 113.10543823242188, 133.84161376953125, 96.50932312011719, -106.7623062133789, 26.540815353393555, 182.82861328125, 122.48881530761719, 14.61678695678711, 73.17568969726562, -122.10134887695312, 112.65636444091797, 159.8712615966797, -160.10980224609375, 63.14021682739258, 181.44444274902344, 16.367700576782227, 79.26058959960938, 196.151611328125, 232.4848175048828, 118.20231628417969, -155.02792358398438, 7.154666900634766, -127.1455078125, 109.68437957763672, 24.394241333007812, 45.84870529174805, 25.044898986816406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000404.npy"}
{"epoch": 0.593245227606461, "step": 405, "batch_size": 64, "mean": 76.58912658691406, "std": 87.28007507324219, "min": -87.43376159667969, "p10": -21.168779373168938, "median": 65.19706726074219, "p90": 212.2813461303711, "max": 316.95819091796875, "pos_frac": 0.828125, "sample": [74.41403198242188, 65.36325073242188, -33.35197448730469, 41.41754150390625, -87.43376159667969, 65.0308837890625, 98.95557403564453, 23.2274169921875, 18.926469802856445, 82.96780395507812, 112.55233001708984, 233.4293670654297, 287.30780029296875, 8.488578796386719, 108.24496459960938, 244.44021606445312, 21.561447143554688, 9.473564147949219, 154.67242431640625, 6.442863464355469, 107.0760498046875, 79.24266815185547, -77.11865234375, 245.61956787109375, -11.378711700439453, 90.48431396484375, 63.71687316894531, 213.61279296875, 132.5419921875, 17.530357360839844, -23.815494537353516, 3.467862129211426, 209.1746368408203, 151.99388122558594, 40.59394073486328, -74.53724670410156, 22.885482788085938, 46.308746337890625, 63.615455627441406, -14.993110656738281, 79.05789947509766, 7.385955810546875, 152.43270874023438, 63.080867767333984, -39.94432830810547, 159.6228485107422, 76.89015197753906, 95.58363342285156, 56.14990234375, 215.9474639892578, 124.31293487548828, -4.0540924072265625, 36.68626403808594, 131.085205078125, -10.904060363769531, 107.9786376953125, 127.60525512695312, 39.165794372558594, 109.63471984863281, -41.94976806640625, 316.95819091796875, 46.66996765136719, 144.2148895263672, 85.94075012207031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000405.npy"}
{"epoch": 0.5947136563876652, "step": 406, "batch_size": 64, "mean": 69.48136138916016, "std": 104.68057250976562, "min": -163.5167236328125, "p10": -58.82841644287108, "median": 60.24088668823242, "p90": 212.1115386962891, "max": 258.9331970214844, "pos_frac": 0.765625, "sample": [195.5563201904297, 82.01895904541016, 59.87915802001953, 134.47994995117188, -6.195838928222656, 107.46398162841797, 8.50347900390625, 157.78018188476562, 246.743408203125, -117.43423461914062, 97.19429016113281, -10.429702758789062, 185.87405395507812, 99.13431549072266, 83.58100891113281, 53.98719787597656, 33.686248779296875, 18.250572204589844, -49.20525360107422, 19.829906463623047, 255.4304962158203, 215.61102294921875, 60.60261535644531, 59.42765808105469, 185.173095703125, 24.116458892822266, 36.052886962890625, 121.14926147460938, 115.52033996582031, -163.5167236328125, -117.66094970703125, -159.27789306640625, -4.519401550292969, -0.9486198425292969, 41.15306854248047, -62.95262908935547, 233.50778198242188, -89.24411010742188, 88.6680908203125, 1.0385913848876953, 154.62632751464844, 147.57200622558594, 239.77859497070312, -19.695758819580078, 203.94607543945312, 25.615394592285156, -7.93255615234375, 163.06068420410156, 129.89004516601562, 7.9718170166015625, 255.43960571289062, 137.75921630859375, 185.80758666992188, 10.5189208984375, -119.32245635986328, 1.9987106323242188, -7.860572814941406, 8.141288757324219, 130.65313720703125, 77.82952880859375, 258.9331970214844, 2.36798095703125, 143.32810974121094, 76.35115051269531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000406.npy"}
{"epoch": 0.5961820851688693, "step": 407, "batch_size": 64, "mean": 60.86812973022461, "std": 93.29521179199219, "min": -232.772216796875, "p10": -23.828425598144527, "median": 54.64246368408203, "p90": 177.2475570678711, "max": 335.8199462890625, "pos_frac": 0.734375, "sample": [5.341939926147461, 221.63629150390625, 63.30724334716797, -138.36404418945312, -232.772216796875, 129.9053955078125, 173.56248474121094, -25.067733764648438, 22.544593811035156, -18.207603454589844, 24.8902587890625, -30.658096313476562, 90.05445098876953, 38.453712463378906, 229.2125244140625, 14.483917236328125, 141.18756103515625, 138.6383056640625, 61.93836975097656, 155.0292205810547, 6.943389892578125, 94.61538696289062, 196.13059997558594, 70.54777526855469, -15.517921447753906, 42.949737548828125, 88.65558624267578, 163.53628540039062, -20.93670654296875, 48.73432922363281, 2.1176071166992188, 234.675537109375, 138.39515686035156, -17.139541625976562, 31.71660614013672, 0.19062042236328125, 121.35299682617188, 50.51899719238281, 172.56460571289062, -76.10005187988281, -12.156265258789062, 84.90814971923828, -25.704208374023438, 85.27336120605469, 27.425636291503906, 146.63018798828125, 58.76593017578125, 335.8199462890625, 96.65242767333984, 83.73835754394531, 178.82687377929688, -6.7342071533203125, -17.39122772216797, 60.91822814941406, 84.42195892333984, -5.215845108032227, 25.05051040649414, 6.83795166015625, 68.65217590332031, 117.73965454101562, 179.05548095703125, -14.146675109863281, -55.58616638183594, -7.289344787597656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000407.npy"}
{"epoch": 0.5976505139500734, "step": 408, "batch_size": 64, "mean": 63.99237823486328, "std": 100.1039810180664, "min": -150.2559051513672, "p10": -56.66110534667968, "median": 57.446821212768555, "p90": 179.08155517578132, "max": 360.8289794921875, "pos_frac": 0.703125, "sample": [114.20198059082031, 360.8289794921875, 216.82421875, 135.57542419433594, 133.9484100341797, 107.63102722167969, 58.44005584716797, 68.30378723144531, 11.497161865234375, 95.71959686279297, 28.21414566040039, -11.736377716064453, 165.1730499267578, 99.83511352539062, -35.78699493408203, -150.2559051513672, -4.796836853027344, 187.58856201171875, 209.3217010498047, 154.66908264160156, 56.45358657836914, 6.10211181640625, -59.038848876953125, 129.8131561279297, -122.9942626953125, 77.77967071533203, -83.41307830810547, -7.130279541015625, -23.445907592773438, 115.12187957763672, 76.79341125488281, 155.40147399902344, 120.24383544921875, -69.46620178222656, -81.76150512695312, -43.78582763671875, 104.87397766113281, 43.51487731933594, 7.932609558105469, 261.42193603515625, -5.5109710693359375, 36.15252685546875, 0.7498855590820312, 143.395263671875, 159.75762939453125, -28.560787200927734, 143.61378479003906, 185.04234313964844, 24.16455841064453, 9.686820983886719, 134.1276397705078, -51.113037109375, -41.63377380371094, -78.14796447753906, -13.555313110351562, 30.86053466796875, 36.919090270996094, -8.05810546875, 108.87226867675781, 162.29637145996094, 282.20330810546875, 129.76809692382812, 41.807159423828125, 83.06209564208984], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000408.npy"}
{"epoch": 0.5991189427312775, "step": 409, "batch_size": 64, "mean": 64.50284576416016, "std": 96.92913818359375, "min": -212.16567993164062, "p10": -50.53872108459472, "median": 67.18456268310547, "p90": 182.3838562011719, "max": 251.17771911621094, "pos_frac": 0.78125, "sample": [-3.8955841064453125, -135.05471801757812, 134.07354736328125, 64.58132934570312, 162.34071350097656, -77.97673034667969, 164.673828125, 63.335235595703125, 103.72383117675781, -212.16567993164062, 194.3221435546875, 97.61810302734375, -53.62659454345703, 72.01876831054688, 36.44903564453125, 121.20758056640625, 174.17974853515625, -20.311172485351562, 169.34524536132812, 147.83261108398438, 43.37428283691406, -210.19407653808594, 153.44638061523438, 251.17771911621094, 84.13619995117188, -3.3383827209472656, 115.76655578613281, 10.980594635009766, 77.31939697265625, 123.3656005859375, -13.85302734375, 168.6166534423828, 198.86898803710938, -130.9503173828125, 200.7130126953125, 151.6309814453125, -6.004707336425781, 39.15431213378906, -91.40115356445312, 92.67568969726562, 23.324676513671875, 81.62735748291016, 42.72430419921875, 69.78779602050781, 84.69068145751953, 185.89990234375, 12.50738525390625, 84.89369201660156, 125.607666015625, 150.35614013671875, 29.010164260864258, 62.83698272705078, -43.333683013916016, 31.968570709228516, 40.097625732421875, 225.64810180664062, 61.831085205078125, 7.51806640625, 73.49041748046875, 28.531394958496094, 190.379150390625, 56.772491455078125, -4.933464050292969, 48.789825439453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000409.npy"}
{"epoch": 0.6005873715124816, "step": 410, "batch_size": 64, "mean": 74.11209106445312, "std": 91.33050537109375, "min": -259.67724609375, "p10": -28.3103515625, "median": 71.03424072265625, "p90": 189.12040405273444, "max": 260.1321716308594, "pos_frac": 0.8125, "sample": [141.92181396484375, 65.63523864746094, -17.536216735839844, 27.938148498535156, 19.34058380126953, 45.55101013183594, 112.92263793945312, 244.84600830078125, 235.82571411132812, 134.2179718017578, 149.6986083984375, 27.60840606689453, 49.550025939941406, 71.54024505615234, 4.348545074462891, 44.16813659667969, 154.86085510253906, 115.93429565429688, 5.0608062744140625, 197.31036376953125, 59.285526275634766, 20.898727416992188, 136.999755859375, 81.33126068115234, 70.52823638916016, 131.589599609375, 39.42095947265625, 83.39049530029297, -14.577140808105469, 141.97100830078125, 123.92855834960938, -3.2369956970214844, 116.07958984375, 170.010498046875, 5.6098480224609375, -28.753494262695312, 22.85582733154297, -27.276351928710938, -76.10317993164062, -259.67724609375, -31.92303466796875, 50.519012451171875, 12.502700805664062, 66.14959716796875, -34.26254653930664, -83.47853088378906, -34.31861114501953, 76.43447875976562, 149.9397430419922, 97.20903015136719, 4.256988525390625, 153.73500061035156, 237.88047790527344, 207.36097717285156, 105.87409973144531, 57.78253173828125, -6.4109344482421875, 146.97451782226562, 100.09368896484375, 231.49484252929688, 139.9709930419922, 85.57289123535156, 260.1321716308594, 124.66476440429688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000410.npy"}
{"epoch": 0.6020558002936858, "step": 411, "batch_size": 64, "mean": 72.70220184326172, "std": 88.44660186767578, "min": -87.25977325439453, "p10": -37.65277671813964, "median": 67.8639907836914, "p90": 174.41933898925785, "max": 354.4496765136719, "pos_frac": 0.78125, "sample": [-21.21837615966797, -82.80123901367188, -13.520217895507812, -57.27557373046875, 58.03804016113281, -41.950714111328125, -27.624256134033203, 64.45674133300781, 146.21160888671875, 148.68182373046875, 215.05496215820312, 22.074485778808594, 146.37811279296875, -65.39661407470703, 105.95034790039062, -5.199462890625, 28.128524780273438, 141.07479858398438, 166.62130737304688, 69.74789428710938, 162.85797119140625, 99.66952514648438, 91.05378723144531, -60.50232696533203, 117.78018188476562, 22.501075744628906, 65.98008728027344, 126.17963409423828, 38.661712646484375, 61.196441650390625, 80.84502410888672, 94.89888763427734, 177.7613525390625, 178.29771423339844, 1.52801513671875, 38.902278900146484, 110.26801300048828, 288.65899658203125, 155.8696746826172, 70.0688705444336, 32.65831756591797, 46.668060302734375, 153.03546142578125, 70.61495971679688, 49.51406478881836, 106.48783874511719, 79.05331420898438, 20.0986328125, 354.4496765136719, 88.94929504394531, 145.31793212890625, 18.619579315185547, 114.31488037109375, 248.11082458496094, 71.61817932128906, -10.7586669921875, 17.137252807617188, -49.30241394042969, 27.240432739257812, -5.7247772216796875, 211.67034912109375, 35.621620178222656, -5.1032867431640625, -87.25977325439453], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000411.npy"}
{"epoch": 0.6035242290748899, "step": 412, "batch_size": 64, "mean": 71.35935974121094, "std": 108.1202392578125, "min": -143.98773193359375, "p10": -66.62952270507812, "median": 67.94658279418945, "p90": 212.96194152832032, "max": 370.04473876953125, "pos_frac": 0.71875, "sample": [-24.016193389892578, 182.9552459716797, -140.09059143066406, 127.7154312133789, 149.23634338378906, 72.73637390136719, 251.69679260253906, -44.35451889038086, 3.721527099609375, 106.6243896484375, 91.5408706665039, 185.7072296142578, 9.524261474609375, 242.20770263671875, 18.163169860839844, 106.03146362304688, 179.80628967285156, 26.735050201416016, 63.35014343261719, 114.09813690185547, -3.608642578125, -72.15455627441406, 138.89768981933594, 91.85128784179688, -38.390018463134766, 38.837623596191406, 134.4403839111328, 39.03587341308594, -29.58502197265625, -47.54835510253906, -75.04035186767578, 52.26565933227539, -128.78807067871094, 129.6388397216797, 138.77838134765625, 51.928565979003906, 4.705890655517578, 44.57477569580078, 72.54302215576172, 213.07571411132812, -11.130126953125, -33.52952575683594, 169.7965087890625, -5.5192108154296875, 114.74298858642578, -79.44506072998047, 212.69647216796875, 246.89488220214844, -73.72640991210938, 83.03471374511719, 197.45635986328125, 128.82684326171875, -30.39612579345703, 61.67503356933594, 238.58795166015625, 370.04473876953125, -143.98773193359375, 159.07044982910156, 9.826332092285156, -53.73777770996094, 121.0899429321289, 21.901710510253906, 166.2934112548828, 217.68528747558594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000412.npy"}
{"epoch": 0.604992657856094, "step": 413, "batch_size": 64, "mean": 79.40829467773438, "std": 102.65451049804688, "min": -210.36981201171875, "p10": -12.040586853027342, "median": 77.22020721435547, "p90": 197.7488540649414, "max": 342.8265380859375, "pos_frac": 0.84375, "sample": [14.722198486328125, 15.628799438476562, 18.90664291381836, 8.775096893310547, 96.51730346679688, 7.822364807128906, 137.3585968017578, 40.35359191894531, -12.633514404296875, -141.85028076171875, 266.8995361328125, 225.3795166015625, -19.045394897460938, 59.27684783935547, -9.82562255859375, 12.620828628540039, 65.84992980957031, 39.63642120361328, 163.71841430664062, 125.8350830078125, -32.50885009765625, 142.6881866455078, 220.62286376953125, -210.36981201171875, -1.12701416015625, 32.51028060913086, 77.43649291992188, 171.06483459472656, 15.640739440917969, 79.41960144042969, -10.657089233398438, 196.48487854003906, 167.1941680908203, 143.02125549316406, 188.37814331054688, 111.59207153320312, 254.33065795898438, 101.6124267578125, 198.29055786132812, 130.1392822265625, 27.089309692382812, 87.78511047363281, 189.54827880859375, 90.95242309570312, 57.9469108581543, 109.77786254882812, 63.593231201171875, -195.2229766845703, -55.15248107910156, 77.00392150878906, 11.516342163085938, 115.2705078125, 119.62896728515625, 318.1373291015625, 12.221799850463867, 108.55271911621094, 24.196731567382812, 342.8265380859375, 122.27517700195312, 17.9110107421875, 35.72936248779297, 105.71070098876953, 134.45321655273438, 68.66893005371094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000413.npy"}
{"epoch": 0.6064610866372981, "step": 414, "batch_size": 64, "mean": 72.52461242675781, "std": 109.24222564697266, "min": -177.70046997070312, "p10": -53.52562561035154, "median": 70.59741973876953, "p90": 216.27642669677738, "max": 348.3481140136719, "pos_frac": 0.78125, "sample": [242.62570190429688, 67.75445556640625, 112.60743713378906, -101.41073608398438, 136.52938842773438, 348.3481140136719, 70.08499145507812, -139.02154541015625, -29.51544189453125, 128.0181121826172, 79.73098754882812, -32.122467041015625, 109.29986572265625, 22.879104614257812, -87.99191284179688, 5.590532302856445, 204.780029296875, 93.28294372558594, -5.920330047607422, -21.306283950805664, -14.873580932617188, 69.11333465576172, 129.72633361816406, -13.231117248535156, -33.39237976074219, 141.4876708984375, -177.70046997070312, 14.179729461669922, 91.3809814453125, 134.52023315429688, 218.36756896972656, 285.3009948730469, 7.704036712646484, 53.10877990722656, 277.7211608886719, 43.039669036865234, 13.735000610351562, 114.33382415771484, -62.15415954589844, 192.37730407714844, 71.10984802246094, 147.6032257080078, 268.40399169921875, 15.402137756347656, 37.677921295166016, 113.54476928710938, 67.95526123046875, 90.21061706542969, 10.085540771484375, -119.97911834716797, 153.45921325683594, 115.24205780029297, 113.22382354736328, 15.835975646972656, 132.16455078125, 34.22486877441406, 221.59722900390625, -163.73382568359375, 173.91065979003906, 123.31781005859375, 2.855499267578125, 7.7873687744140625, 109.29093933105469, 211.3970947265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000414.npy"}
{"epoch": 0.6079295154185022, "step": 415, "batch_size": 64, "mean": 62.45792007446289, "std": 95.67012023925781, "min": -148.02508544921875, "p10": -62.43678588867187, "median": 49.974199295043945, "p90": 195.74780883789063, "max": 293.2283630371094, "pos_frac": 0.78125, "sample": [142.8984375, 38.788604736328125, 134.27664184570312, 199.3094024658203, 21.04046630859375, 83.03667449951172, 293.2283630371094, -60.69580078125, 73.18156433105469, 152.4085235595703, 33.79643249511719, 18.611167907714844, 3.15081787109375, 214.56138610839844, -53.361541748046875, 31.34195327758789, 26.019424438476562, 71.70455932617188, -78.98356628417969, 18.140880584716797, 53.91337585449219, 111.7806167602539, 70.57266235351562, -63.18292236328125, 46.0350227355957, 95.01371765136719, 194.99200439453125, 42.52809143066406, 182.1534423828125, -39.424560546875, -106.40505981445312, 72.86219787597656, -119.28956604003906, -77.51416015625, 195.28775024414062, -148.02508544921875, -46.52227020263672, 18.703414916992188, 97.16936492919922, 144.880859375, 61.55917739868164, 160.0677032470703, -16.354774475097656, -76.47593688964844, 0.3935737609863281, 79.61141967773438, 36.22239685058594, 36.55314636230469, 25.38573455810547, 179.255126953125, 31.0953369140625, 214.0215301513672, 123.05490112304688, -40.8114013671875, 185.55056762695312, 54.587974548339844, 39.473846435546875, 41.927703857421875, 195.94497680664062, -16.86353302001953, 218.52529907226562, 110.23648834228516, 59.63569641113281, 206.7266082763672], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000415.npy"}
{"epoch": 0.6093979441997063, "step": 416, "batch_size": 64, "mean": 86.70777893066406, "std": 102.51693725585938, "min": -176.07882690429688, "p10": -37.96926727294921, "median": 83.34060287475586, "p90": 223.1109359741211, "max": 329.7127380371094, "pos_frac": 0.796875, "sample": [125.322265625, 85.84183502197266, 140.27706909179688, 42.23713684082031, -49.64944076538086, 227.8983154296875, 110.32583618164062, 77.92645263671875, 119.34730529785156, 142.20083618164062, 230.6620330810547, -176.07882690429688, 18.090389251708984, 128.09263610839844, 69.17204284667969, 136.77420043945312, 200.13160705566406, -6.3125457763671875, 36.864990234375, -19.70378875732422, 162.0714111328125, 193.34176635742188, -75.54583740234375, 48.45899963378906, 219.86483764648438, 224.5021209716797, 181.54946899414062, 329.7127380371094, -30.899871826171875, 78.56399536132812, 170.87611389160156, 229.22616577148438, 195.86495971679688, 80.83937072753906, 31.09195327758789, 21.40438461303711, 90.15116882324219, 55.56049346923828, -117.54670715332031, 123.43590545654297, 115.43697357177734, 205.4425048828125, 31.513748168945312, 149.3834228515625, -0.4358978271484375, 96.86433410644531, 7.050773620605469, 210.42129516601562, 97.52740478515625, 29.401107788085938, -51.40610885620117, -66.99983215332031, 14.371444702148438, 119.80110168457031, 22.471107482910156, -40.99900817871094, 294.65142822265625, -23.210403442382812, -26.673954010009766, 34.27349853515625, 22.247451782226562, 122.75305938720703, 269.3930358886719, 64.0755615234375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000416.npy"}
{"epoch": 0.6108663729809104, "step": 417, "batch_size": 64, "mean": 80.280517578125, "std": 89.8860855102539, "min": -168.5310821533203, "p10": -29.35687408447265, "median": 80.74263763427734, "p90": 208.4878860473633, "max": 260.93408203125, "pos_frac": 0.8125, "sample": [-18.209415435791016, 136.18603515625, -2.8401317596435547, 152.97012329101562, 8.111900329589844, 211.53953552246094, 8.197738647460938, 152.44711303710938, 49.415489196777344, 141.71173095703125, -52.98412322998047, 46.97233581542969, 144.16110229492188, -15.999462127685547, 124.08285522460938, 177.6051483154297, -47.685020446777344, 92.71737670898438, 195.38455200195312, -99.49974822998047, 94.81065368652344, 234.31455993652344, 232.8520965576172, 161.7218017578125, 230.30165100097656, 225.958251953125, 153.60775756835938, 25.48480224609375, 94.97496795654297, 80.245361328125, 34.64385986328125, -31.047042846679688, 81.7861328125, 86.6004409790039, 39.563438415527344, 21.59149932861328, -35.94593811035156, 144.1588134765625, 151.32424926757812, 1.355621337890625, 67.13059997558594, 58.03505325317383, 52.25069046020508, 128.12362670898438, -11.047554016113281, 151.07025146484375, 44.649078369140625, 7.622264862060547, -33.885009765625, 81.63768768310547, 46.04148864746094, -168.5310821533203, 201.36737060546875, 114.00390625, 18.569915771484375, 119.667236328125, 150.324951171875, 81.23991394042969, 260.93408203125, 223.8736572265625, -25.41314697265625, 42.38249206542969, 60.29185485839844, 35.02557373046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000417.npy"}
{"epoch": 0.6123348017621145, "step": 418, "batch_size": 64, "mean": 101.0872802734375, "std": 93.79409790039062, "min": -121.3169937133789, "p10": 5.793310928344728, "median": 82.10781860351562, "p90": 246.7723983764649, "max": 330.57916259765625, "pos_frac": 0.953125, "sample": [184.8577880859375, 38.553741455078125, 58.17958068847656, 15.507291793823242, 183.37603759765625, 39.99504089355469, 9.515823364257812, 3.2865371704101562, 185.2457275390625, 133.9306640625, 44.8221435546875, 9.543106079101562, 192.61964416503906, 125.28411102294922, 256.68463134765625, 3.3260955810546875, 71.83023071289062, 49.89167785644531, 177.42825317382812, 55.43303680419922, -121.3169937133789, 254.76947021484375, 171.51242065429688, 35.43017578125, 150.87054443359375, 60.861534118652344, 7.653511047363281, 270.4473876953125, 147.05410766601562, 165.55044555664062, 265.19342041015625, 154.8406524658203, 28.561203002929688, 252.07827758789062, 98.16461181640625, 45.833614349365234, 4.753684997558594, 77.63026428222656, 92.82650756835938, 102.65986633300781, 330.57916259765625, 86.85964965820312, 234.3920135498047, 83.62258911132812, 188.40805053710938, 21.30193328857422, 27.885528564453125, 122.53785705566406, 31.832504272460938, -93.78939819335938, 110.84468078613281, 4.996082305908203, 21.019760131835938, 160.17816162109375, 17.563133239746094, -9.287628173828125, 43.905364990234375, 314.7222595214844, 49.99420166015625, 161.21604919433594, 125.99456787109375, 197.11517333984375, 80.59304809570312, 52.415557861328125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000418.npy"}
{"epoch": 0.6138032305433186, "step": 419, "batch_size": 64, "mean": 87.35041809082031, "std": 92.49932098388672, "min": -102.26069641113281, "p10": -31.9432731628418, "median": 85.51127624511719, "p90": 211.78133392333984, "max": 294.06292724609375, "pos_frac": 0.84375, "sample": [87.53117370605469, -88.84925842285156, 48.57073974609375, 48.532135009765625, 107.28242492675781, 82.65144348144531, -31.97339630126953, 81.07769012451172, 42.47686767578125, 150.9492645263672, 235.31890869140625, 15.766410827636719, 108.74028015136719, 276.4833984375, 53.99930191040039, 80.78059387207031, -102.26069641113281, 3.3866100311279297, 113.1336898803711, 83.49137878417969, 89.1247329711914, 23.94989013671875, -78.56341552734375, 52.58837890625, 61.87017822265625, -73.98275756835938, 135.8427734375, 104.4085464477539, 181.37425231933594, 55.256134033203125, -66.82705688476562, 23.24123764038086, 146.12057495117188, 212.58505249023438, -31.87298583984375, 0.9427261352539062, 92.03256225585938, 149.5352783203125, 63.12534713745117, -11.097412109375, 136.22608947753906, -23.854751586914062, 294.06292724609375, 106.49977111816406, 183.53506469726562, 4.313873291015625, 46.5186653137207, 24.366439819335938, 219.9026336669922, 178.6378936767578, 99.90650939941406, 34.485107421875, 72.18024444580078, 171.30392456054688, 188.40597534179688, 172.04183959960938, 277.41253662109375, 209.90599060058594, 94.17941284179688, 118.97886657714844, 120.87158203125, -34.58721923828125, 114.24560546875, 254.14480590820312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000419.npy"}
{"epoch": 0.6152716593245228, "step": 420, "batch_size": 64, "mean": 77.66873931884766, "std": 98.55958557128906, "min": -119.37776947021484, "p10": -57.21990013122558, "median": 72.03490829467773, "p90": 197.21005859375, "max": 281.8346862792969, "pos_frac": 0.765625, "sample": [-48.34208679199219, 51.144866943359375, 76.8074722290039, 102.45736694335938, 166.23654174804688, -62.048561096191406, 108.39118957519531, 55.04925537109375, 270.46563720703125, 117.28779602050781, 35.585575103759766, -14.003196716308594, 87.37704467773438, -13.665657043457031, 31.1810302734375, -61.02467727661133, 77.79737091064453, 196.04269409179688, 18.799989700317383, 15.844432830810547, -34.788047790527344, 62.89186096191406, -72.49899291992188, 59.19776916503906, 56.21397399902344, 163.43948364257812, 218.32931518554688, 101.1221923828125, 67.26234436035156, 125.36376953125, 197.71035766601562, -9.689582824707031, 263.8999938964844, -102.81370544433594, 162.1453857421875, 145.82833862304688, 33.017921447753906, 96.22793579101562, 112.70257568359375, 164.56320190429688, -27.765655517578125, -36.195068359375, 129.776123046875, 41.61297607421875, 82.56396484375, 63.29755401611328, 264.2196044921875, -16.1630859375, 4.297496795654297, 98.6170425415039, -119.37776947021484, -108.45938110351562, 137.3474884033203, 102.32325744628906, 34.118743896484375, 259.3007507324219, 62.80360412597656, 46.78302001953125, 167.8428192138672, 190.26451110839844, 281.8346862792969, 191.95213317871094, -70.23406982421875, 168.52853393554688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000420.npy"}
{"epoch": 0.6167400881057269, "step": 421, "batch_size": 64, "mean": 85.74388885498047, "std": 95.61615753173828, "min": -136.31475830078125, "p10": -26.370124053955074, "median": 78.11682891845703, "p90": 210.11953430175782, "max": 256.49615478515625, "pos_frac": 0.765625, "sample": [199.10317993164062, 23.439899444580078, 213.7895050048828, 72.05970764160156, 185.6165771484375, 61.626678466796875, 256.49615478515625, -1.8238525390625, 105.03754425048828, 11.34262466430664, 209.3149871826172, 96.07972717285156, 68.56539154052734, 155.36805725097656, 96.36210632324219, 74.60401916503906, 163.68072509765625, 10.024421691894531, 82.76435089111328, 153.7142791748047, 233.047119140625, 194.88507080078125, 43.34153747558594, 55.805477142333984, 81.629638671875, 70.64302062988281, -4.312309265136719, 164.3278045654297, 29.04888916015625, 220.0118865966797, 204.23153686523438, 224.73423767089844, 210.46434020996094, 165.45657348632812, 9.391292572021484, -32.9088249206543, 221.5072479248047, 139.19259643554688, -20.273284912109375, 151.45272827148438, -72.74510955810547, -6.101707458496094, 100.15913391113281, 40.7025146484375, 164.61932373046875, 92.3109130859375, 197.24282836914062, -28.54833984375, 29.5441837310791, 204.7814178466797, 124.28440856933594, -136.31475830078125, 41.6502799987793, -123.19676208496094, -5.627223968505859, -14.412399291992188, 191.62718200683594, -2.3150787353515625, -49.110198974609375, -21.287620544433594, 24.956377029418945, -50.156307220458984, 151.1522674560547, 35.551048278808594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000421.npy"}
{"epoch": 0.618208516886931, "step": 422, "batch_size": 64, "mean": 81.53353881835938, "std": 92.5301513671875, "min": -132.84361267089844, "p10": -24.415472412109374, "median": 65.71931076049805, "p90": 195.53875732421878, "max": 352.64447021484375, "pos_frac": 0.84375, "sample": [-38.60118103027344, 92.98467254638672, 289.25762939453125, 236.4747314453125, 28.825851440429688, -22.751968383789062, -73.94081115722656, 68.53167724609375, 52.34626388549805, 352.64447021484375, 183.7615509033203, 152.57740783691406, 108.93356323242188, 23.734970092773438, 198.724609375, -25.128402709960938, 28.60116195678711, 44.53081512451172, 138.34228515625, 152.222412109375, 135.19407653808594, 159.0318603515625, 47.449729919433594, 57.296295166015625, 19.0201416015625, 155.172119140625, 121.01253509521484, 205.92694091796875, 80.23967742919922, 104.80056762695312, 250.68606567382812, 27.806549072265625, 94.1873779296875, 33.4144172668457, 26.502094268798828, 186.7474365234375, 112.07552337646484, -86.83529663085938, 123.41615295410156, 7.745582580566406, 18.442333221435547, 200.38555908203125, 66.69941711425781, -28.524246215820312, 33.998600006103516, 181.27261352539062, 172.33998107910156, 62.362213134765625, 64.73920440673828, -12.185693740844727, 188.1051025390625, 46.63236999511719, 143.9510498046875, 2.151397705078125, 2.147796630859375, 162.49205017089844, -7.65985107421875, 46.761199951171875, 76.17726135253906, 81.61713409423828, -132.84361267089844, 22.249347686767578, 19.98339080810547, -46.10942840576172], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000422.npy"}
{"epoch": 0.6196769456681351, "step": 423, "batch_size": 64, "mean": 80.8725814819336, "std": 109.32508850097656, "min": -163.51614379882812, "p10": -41.13293724060058, "median": 73.9288215637207, "p90": 229.0131530761719, "max": 342.1268310546875, "pos_frac": 0.703125, "sample": [33.02649688720703, -34.97953796386719, -50.42235565185547, -2.5242080688476562, 10.186988830566406, -37.65570068359375, 119.47419738769531, -37.853187561035156, 171.8760528564453, 184.95721435546875, 0.6983642578125, -38.60702896118164, 285.7283935546875, 135.37890625, 48.3748664855957, 130.25938415527344, 104.9704818725586, 247.73910522460938, 211.6018524169922, 196.49893188476562, -83.16606140136719, -83.19500732421875, 42.34410095214844, 33.154659271240234, 83.92697143554688, 118.56195831298828, 231.43527221679688, 162.23336791992188, -163.51614379882812, -44.121307373046875, 54.876441955566406, 35.03788375854492, 63.93067169189453, 155.99481201171875, 278.73870849609375, -42.21546936035156, 41.149436950683594, 165.0601806640625, -20.328041076660156, 17.32799530029297, 134.68630981445312, 264.3055114746094, -28.6829833984375, -17.946678161621094, 342.1268310546875, 29.995105743408203, 213.33187866210938, -27.837865829467773, 94.54147338867188, 144.06007385253906, -54.17754364013672, -35.121055603027344, 263.043212890625, 223.36154174804688, 32.46824645996094, 198.70706176757812, -23.301748275756836, 113.35970306396484, -12.719596862792969, 107.39787292480469, 94.0705795288086, 125.73054504394531, 122.30667114257812, 146.18019104003906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000423.npy"}
{"epoch": 0.6211453744493393, "step": 424, "batch_size": 64, "mean": 82.42845916748047, "std": 93.48959350585938, "min": -189.36422729492188, "p10": -23.36412811279296, "median": 78.2830810546875, "p90": 203.2642379760742, "max": 293.8658447265625, "pos_frac": 0.828125, "sample": [-36.20439910888672, 204.85052490234375, 89.36845397949219, 34.863006591796875, 154.37474060058594, 167.87200927734375, 110.8390884399414, 202.3669891357422, 7.176933288574219, 47.82373046875, 189.5009765625, -34.933074951171875, 177.03482055664062, 79.07928466796875, 24.699050903320312, 258.6745300292969, 107.39044189453125, 211.153564453125, 43.69400405883789, 19.578197479248047, 108.40584564208984, -152.9061279296875, 157.26580810546875, 38.004005432128906, 63.560874938964844, 24.74695587158203, 96.98847961425781, 78.82940673828125, 30.265140533447266, -44.604827880859375, 2.854433059692383, 70.77183532714844, 24.9139404296875, 67.39014434814453, 77.73675537109375, -4.189544677734375, 144.1072998046875, -189.36422729492188, 14.530670166015625, 42.863250732421875, 19.32693862915039, -59.08476257324219, -25.750198364257812, 155.72909545898438, 178.0938262939453, 47.56024169921875, 30.843002319335938, -17.796630859375, -3.15924072265625, 293.8658447265625, 173.93563842773438, 172.84707641601562, 123.33409118652344, 185.7049102783203, 68.1923828125, -9.547088623046875, 220.7177734375, 89.97647094726562, 117.94419860839844, 169.108642578125, 203.64877319335938, 207.68167114257812, 90.22137451171875, 130.65472412109375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000424.npy"}
{"epoch": 0.6226138032305433, "step": 425, "batch_size": 64, "mean": 56.19786071777344, "std": 110.69080352783203, "min": -235.59469604492188, "p10": -56.528977966308595, "median": 33.88379669189453, "p90": 215.0384643554688, "max": 338.2310485839844, "pos_frac": 0.640625, "sample": [-2.024775505065918, 28.061283111572266, -52.651695251464844, -99.90748596191406, -56.73960876464844, 193.28314208984375, -22.238269805908203, 161.59063720703125, 61.0953369140625, 140.7874755859375, 143.95114135742188, 28.981277465820312, 40.16584777832031, -73.19266510009766, 40.78715515136719, -84.23719787597656, -16.447494506835938, 38.78631591796875, 281.8096618652344, 117.79487609863281, -56.037506103515625, 5.226169586181641, 56.028282165527344, -81.598388671875, -15.331039428710938, 4.369129180908203, 58.38999938964844, -64.07064056396484, -35.006004333496094, 241.10610961914062, -37.14866638183594, -12.830718994140625, -40.92285919189453, -4.391963958740234, 208.45413208007812, 17.7529296875, 123.799560546875, 12.789016723632812, 2.4947738647460938, 269.736083984375, -31.93430519104004, 108.612060546875, -30.255874633789062, 2.0173568725585938, 263.4185485839844, 247.7455596923828, 89.633544921875, 62.45830535888672, 163.73880004882812, 135.13131713867188, 125.60308074951172, 217.86032104492188, 91.86175537109375, -41.32415008544922, 77.48699951171875, 177.72311401367188, 154.9806365966797, 338.2310485839844, -41.68274688720703, -39.58985137939453, 131.0483856201172, -235.59469604492188, 82.44190979003906, 24.588483810424805], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000425.npy"}
{"epoch": 0.6240822320117474, "step": 426, "batch_size": 64, "mean": 81.36367797851562, "std": 93.22563934326172, "min": -162.9510040283203, "p10": -35.77227935791015, "median": 86.03887176513672, "p90": 193.07353973388672, "max": 311.65484619140625, "pos_frac": 0.78125, "sample": [97.86915588378906, 4.1776123046875, 21.688934326171875, -23.206222534179688, -37.37972640991211, 92.51850128173828, -21.71856689453125, 179.06961059570312, 311.65484619140625, 75.52510833740234, 177.78305053710938, 61.074119567871094, 135.59161376953125, 97.68667602539062, 62.12847900390625, 102.97537231445312, 85.88552856445312, 40.390663146972656, 246.28817749023438, 194.46145629882812, 175.97607421875, 139.02566528320312, 166.28439331054688, 123.12947845458984, -26.688674926757812, 21.674304962158203, 60.04805374145508, -162.9510040283203, 99.9629135131836, 218.77601623535156, 169.37124633789062, 214.660400390625, 56.273681640625, 86.19221496582031, 175.88479614257812, 84.1957015991211, 113.62091064453125, -33.12342834472656, -5.1918487548828125, -112.43186950683594, 34.55094909667969, 189.83506774902344, 144.35861206054688, -28.652442932128906, 239.62551879882812, 8.155654907226562, -73.15647888183594, -39.86985778808594, -36.907501220703125, 145.54981994628906, 64.69847106933594, 106.20409393310547, 25.9139461517334, 71.58751678466797, 160.12710571289062, 20.220775604248047, 95.73455810546875, 214.5423583984375, 78.45843505859375, -14.8770751953125, 159.96957397460938, 116.07079315185547, -46.25398254394531, 102.23588562011719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000426.npy"}
{"epoch": 0.6255506607929515, "step": 427, "batch_size": 64, "mean": 75.87571716308594, "std": 84.15945434570312, "min": -172.47705078125, "p10": -20.675364112854005, "median": 63.20451736450195, "p90": 174.36895599365238, "max": 276.657958984375, "pos_frac": 0.8125, "sample": [117.9273681640625, 20.506820678710938, 14.622329711914062, -21.802215576171875, 151.6584014892578, 36.50825500488281, 106.20437622070312, -172.47705078125, 29.451324462890625, 58.70964813232422, -20.777359008789062, 155.40640258789062, -1.1424980163574219, 74.22679138183594, 161.67764282226562, 38.41053009033203, -3.134552001953125, 141.43260192871094, -45.84248352050781, 40.17027282714844, 165.94903564453125, -55.13960266113281, 60.430206298828125, 66.76712036132812, 157.3792724609375, 41.45172119140625, 94.27566528320312, 211.39097595214844, 37.335784912109375, 112.43482971191406, 142.24940490722656, 276.657958984375, 128.45669555664062, 123.16969299316406, 27.756244659423828, 156.5582275390625, 65.97882843017578, 57.12677001953125, 162.94927978515625, 163.2364959716797, 184.26132202148438, 25.760482788085938, 7.728172302246094, -8.749588012695312, 1.2728271484375, 162.21661376953125, 13.849403381347656, 53.379722595214844, 177.9774932861328, -20.437376022338867, 24.227203369140625, 78.07001495361328, 224.41677856445312, 71.811279296875, 241.86183166503906, -20.17620849609375, -25.22168731689453, 107.38524627685547, 10.085933685302734, 97.1687240600586, 198.1313934326172, 163.90679931640625, 43.968658447265625, -35.00053405761719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000427.npy"}
{"epoch": 0.6270190895741556, "step": 428, "batch_size": 64, "mean": 64.08061981201172, "std": 101.18181610107422, "min": -224.9757537841797, "p10": -61.44301147460937, "median": 57.30559539794922, "p90": 182.37676239013672, "max": 323.3939514160156, "pos_frac": 0.765625, "sample": [87.82716369628906, -62.88810729980469, -20.84954071044922, -119.77039337158203, 182.68792724609375, 45.57373046875, 170.65914916992188, 323.3939514160156, 72.550537109375, 219.5267333984375, 181.6507110595703, -3.091400146484375, 84.29548645019531, 43.8602294921875, 44.869476318359375, 1.9343719482421875, -57.44140625, 129.8404541015625, 40.151527404785156, 73.95233154296875, 15.6474609375, 15.084869384765625, 117.89805603027344, 28.57082748413086, 147.6348114013672, 121.47071075439453, -3.6764678955078125, 36.54957580566406, 92.4905014038086, -8.897628784179688, 20.055377960205078, 79.34002685546875, 184.63990783691406, 72.88299560546875, 168.6308135986328, 35.946800231933594, 79.82405853271484, 112.10263061523438, 10.065986633300781, -17.25444793701172, -12.526603698730469, 69.03746032714844, 100.01011657714844, -81.74250793457031, 12.280845642089844, 79.97337341308594, -58.07112121582031, -77.85244750976562, 154.24368286132812, 228.01214599609375, 180.68325805664062, 99.95479583740234, 3.7498626708984375, 29.89282989501953, 140.60826110839844, 145.40753173828125, 255.87191772460938, 283.3531494140625, -120.3555908203125, 25.70932388305664, 160.0772247314453, -69.99712371826172, 30.075103759765625, -224.9757537841797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000428.npy"}
{"epoch": 0.6284875183553598, "step": 429, "batch_size": 64, "mean": 83.04490661621094, "std": 105.63555908203125, "min": -130.4217529296875, "p10": -44.10405197143554, "median": 81.73729705810547, "p90": 226.29466400146487, "max": 308.6131591796875, "pos_frac": 0.75, "sample": [144.32688903808594, -21.543441772460938, -17.758380889892578, 230.25857543945312, 108.84532165527344, 122.03924560546875, -97.34725952148438, -49.563323974609375, 107.21160888671875, -15.482986450195312, 34.63202667236328, 18.635848999023438, 35.529624938964844, 102.35951232910156, -58.1263427734375, 190.32640075683594, 51.447113037109375, -4.681468963623047, 267.62396240234375, 147.57907104492188, 79.99095153808594, 179.60809326171875, 36.295982360839844, -6.937835693359375, -18.198760986328125, 21.297622680664062, 90.387451171875, 3.807628631591797, 252.99249267578125, 294.25823974609375, 4.7556304931640625, 19.41107177734375, 144.9615020751953, 40.133575439453125, -124.48838806152344, -33.673912048339844, -130.4217529296875, 102.51121520996094, 209.77420043945312, 2.1897125244140625, 228.00506591796875, 187.0767059326172, 94.91857147216797, 156.13665771484375, 186.94813537597656, 56.96501159667969, 303.52838134765625, 72.6361083984375, 38.83763885498047, -25.46625518798828, 83.483642578125, 171.99942016601562, 174.7542724609375, 89.14730834960938, -8.852252960205078, -58.73945617675781, -48.57411193847656, 96.71011352539062, 222.30372619628906, 72.52493286132812, 128.2265625, 308.6131591796875, 108.32366943359375, 210.40060424804688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000429.npy"}
{"epoch": 0.6299559471365639, "step": 430, "batch_size": 64, "mean": 61.773258209228516, "std": 96.86109924316406, "min": -121.77450561523438, "p10": -70.82544174194335, "median": 63.48238563537598, "p90": 203.9126541137696, "max": 268.294921875, "pos_frac": 0.703125, "sample": [-6.0519256591796875, -108.65870666503906, -38.14176940917969, -119.92057800292969, 234.17593383789062, 66.85780334472656, 81.95169067382812, 141.15884399414062, 147.49661254882812, 223.79046630859375, 54.404884338378906, 41.44401550292969, -15.070236206054688, -103.38990783691406, 88.5761947631836, -28.80264663696289, -85.6822509765625, 253.48284912109375, 136.62974548339844, 44.67631912231445, -121.77450561523438, 91.98785400390625, -14.3831787109375, 153.0656280517578, 9.94833755493164, 127.09830474853516, -95.3880615234375, 233.2050323486328, 145.18972778320312, 73.35655212402344, 58.5318603515625, -0.16072463989257812, 113.29519653320312, 108.52975463867188, 164.35946655273438, 65.36553955078125, -3.944488525390625, -69.00740814208984, 8.645103454589844, 143.19625854492188, 45.31867980957031, 69.39452362060547, 111.76453399658203, -71.60459899902344, 52.05622100830078, 216.52459716796875, 3.07928466796875, 129.08755493164062, 124.76338195800781, 139.329345703125, 100.39117431640625, -20.167388916015625, 66.920166015625, 68.3650131225586, -0.18903732299804688, -19.220245361328125, 61.5992317199707, -45.73041534423828, 188.89505004882812, 210.34877014160156, 268.294921875, 17.23627471923828, 31.771743774414062, 5.216058731079102], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000430.npy"}
{"epoch": 0.631424375917768, "step": 431, "batch_size": 64, "mean": 75.17669677734375, "std": 96.78953552246094, "min": -110.9739990234375, "p10": -58.57698097229003, "median": 92.3264389038086, "p90": 186.6828582763672, "max": 319.83184814453125, "pos_frac": 0.765625, "sample": [-101.47347259521484, 17.26751708984375, -17.814613342285156, 125.25804901123047, 188.60763549804688, 124.15316772460938, 163.44375610351562, -61.0301628112793, 139.7879638671875, 117.36784362792969, 165.44837951660156, -81.64598083496094, 12.181163787841797, -87.79438781738281, 135.11334228515625, 57.981201171875, 145.73641967773438, 117.7232437133789, 232.84188842773438, 35.52125549316406, 48.77632141113281, 140.8905792236328, 98.87553405761719, 150.808349609375, -18.57857322692871, -37.164703369140625, 151.99191284179688, 107.19601440429688, 4.580169677734375, 54.231964111328125, 134.00314331054688, 52.36405563354492, 263.1022033691406, -46.390663146972656, 216.88967895507812, -52.85289001464844, 127.40841674804688, -88.01177978515625, 166.39556884765625, -40.618072509765625, 93.72463989257812, 116.55165100097656, 319.83184814453125, 16.869129180908203, -89.9076919555664, -2.2887420654296875, 71.59983825683594, 141.4983367919922, 37.0511360168457, 106.99705505371094, -42.93345642089844, 70.55357360839844, 16.674030303955078, 207.66427612304688, 60.70668411254883, 126.55162048339844, 11.332332611083984, 61.15940475463867, -110.9739990234375, 107.50639343261719, 182.19171142578125, 218.19117736816406, 137.2577667236328, 90.92823791503906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000431.npy"}
{"epoch": 0.6328928046989721, "step": 432, "batch_size": 64, "mean": 92.16278076171875, "std": 91.88410949707031, "min": -122.33905029296875, "p10": -23.174798583984366, "median": 87.48616790771484, "p90": 213.00751037597658, "max": 315.3275451660156, "pos_frac": 0.828125, "sample": [64.20066833496094, -11.59649658203125, 147.12635803222656, 201.746826171875, 48.15886688232422, 13.37741470336914, 58.71110534667969, -26.671417236328125, 225.62551879882812, 215.65505981445312, 83.79932403564453, -33.30908203125, 158.23126220703125, 97.69245147705078, 0.6761627197265625, 315.3275451660156, 105.9578628540039, 206.82989501953125, 50.23907470703125, 28.574066162109375, 26.587860107421875, 180.81161499023438, 137.13706970214844, 10.567863464355469, 60.31987762451172, 218.59097290039062, 118.80210876464844, -98.70933532714844, 57.158416748046875, 92.37425994873047, -7.4161376953125, -122.33905029296875, -58.81153106689453, 187.2461395263672, -15.016021728515625, 135.6572265625, 111.8768310546875, 28.265182495117188, 85.55767822265625, 112.37867736816406, 152.2044219970703, -27.037307739257812, 142.17559814453125, 275.8116149902344, -14.483062744140625, 114.34854125976562, 126.27908325195312, 60.40991973876953, 161.82008361816406, 86.22944641113281, 122.6973876953125, 176.8008270263672, 54.02256774902344, 60.097259521484375, 40.10581970214844, 54.508785247802734, 230.66285705566406, 159.80572509765625, 265.09014892578125, 88.74288940429688, 82.25984191894531, -61.97962951660156, 148.9604949951172, 187.49229431152344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000432.npy"}
{"epoch": 0.6343612334801763, "step": 433, "batch_size": 64, "mean": 72.43510437011719, "std": 98.66781616210938, "min": -205.9973907470703, "p10": -34.486029052734374, "median": 58.2529411315918, "p90": 222.10536041259766, "max": 253.93780517578125, "pos_frac": 0.734375, "sample": [113.01249694824219, 189.9580535888672, -43.75788879394531, 14.757904052734375, 223.8383026123047, 145.31504821777344, -18.048635482788086, -26.149093627929688, 253.93780517578125, 225.31906127929688, 88.24519348144531, 31.08221435546875, -32.82273864746094, 33.283905029296875, 149.92213439941406, 4.8254241943359375, 22.647048950195312, 171.60076904296875, 98.14350128173828, -205.9973907470703, -73.77178955078125, 218.06182861328125, 233.33474731445312, -57.13261413574219, 229.78744506835938, 8.744186401367188, 235.58868408203125, 181.51162719726562, 85.56627655029297, 128.1112518310547, 15.874908447265625, 126.97685241699219, -15.841567993164062, 32.232330322265625, 12.22247314453125, 77.0686264038086, 48.70909881591797, -42.05668640136719, 142.301025390625, 9.777641296386719, 252.81155395507812, 200.9485321044922, -31.03615951538086, -80.54658508300781, -35.19886779785156, 168.36831665039062, 110.75581359863281, -15.171539306640625, -26.939868927001953, 116.50836181640625, 89.7769775390625, 31.049301147460938, 140.177978515625, -10.82813549041748, 163.7119598388672, -7.387184143066406, 59.00294494628906, 18.42096710205078, -12.78607177734375, 160.39483642578125, 90.26113891601562, 119.93181610107422, 57.50293731689453, 39.938568115234375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000433.npy"}
{"epoch": 0.6358296622613803, "step": 434, "batch_size": 64, "mean": 79.50171661376953, "std": 108.36265563964844, "min": -107.68133544921875, "p10": -50.42629776000975, "median": 64.02056884765625, "p90": 216.8072967529297, "max": 461.67034912109375, "pos_frac": 0.765625, "sample": [221.74526977539062, 100.05184936523438, 461.67034912109375, 4.603057861328125, -34.819419860839844, -98.65481567382812, 54.901519775390625, 153.9242706298828, -20.777786254882812, -57.114959716796875, 125.6356430053711, -17.431365966796875, 55.79909133911133, 87.82676696777344, 89.1072769165039, -83.68948364257812, 61.22028350830078, -10.368270874023438, 116.85769653320312, 84.93536376953125, 200.88790893554688, 10.382610321044922, 33.692047119140625, 16.112564086914062, 179.29525756835938, -16.58730697631836, 82.69490814208984, 63.26570129394531, 112.19393920898438, 239.2423858642578, -107.68133544921875, 235.58139038085938, 160.7855987548828, -87.38158416748047, 141.29684448242188, 280.0069885253906, 29.162372589111328, 25.03347396850586, -30.56317138671875, 171.91006469726562, 15.472885131835938, 24.49224090576172, 36.0159912109375, -86.38521575927734, 168.2178955078125, 181.6986541748047, 216.92022705078125, 167.23251342773438, 16.318893432617188, 76.37452697753906, 14.877525329589844, -24.463764190673828, 216.54379272460938, 31.044498443603516, -0.4137115478515625, 27.412948608398438, 213.01516723632812, 84.31108856201172, 91.26869201660156, 191.18673706054688, 248.46742248535156, 144.42648315429688, 64.77543640136719, -65.45379638671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000434.npy"}
{"epoch": 0.6372980910425844, "step": 435, "batch_size": 64, "mean": 83.42731475830078, "std": 96.42015838623047, "min": -151.20364379882812, "p10": -24.395229339599595, "median": 76.98149490356445, "p90": 218.62139892578128, "max": 326.5035400390625, "pos_frac": 0.8125, "sample": [326.5035400390625, 4.356285095214844, -58.54818344116211, 9.585289001464844, 224.693359375, 180.39242553710938, 152.9019317626953, 10.616851806640625, -2.4667205810546875, 13.795623779296875, 189.09197998046875, -10.217308044433594, 25.718034744262695, 163.11758422851562, 208.6148681640625, 256.9886169433594, 105.1651840209961, 121.7860107421875, 12.969409942626953, -39.985328674316406, 15.641586303710938, -6.2293701171875, 48.37164306640625, 73.74193572998047, 28.721954345703125, 38.62089157104492, 139.78651428222656, 139.30404663085938, -151.20364379882812, 73.395751953125, 51.826202392578125, 11.826702117919922, 148.1662139892578, -7.311065673828125, 174.9422149658203, -2.7818603515625, 84.64067077636719, -71.53563690185547, 0.7926788330078125, -36.380279541015625, 198.24044799804688, 110.28838348388672, 103.11520385742188, 19.66067123413086, 135.2575225830078, 165.49583435058594, -61.4268798828125, 104.61276245117188, 85.44108581542969, 60.49440002441406, 314.3415832519531, 99.99456787109375, 128.86187744140625, 25.90885353088379, 114.49420166015625, 230.86656188964844, 243.2227783203125, 45.9244384765625, 106.79505920410156, 222.909912109375, 133.52964782714844, 52.15303039550781, 80.22105407714844, -30.471481323242188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000435.npy"}
{"epoch": 0.6387665198237885, "step": 436, "batch_size": 64, "mean": 89.17771911621094, "std": 81.05382537841797, "min": -91.99382019042969, "p10": -12.479046249389649, "median": 80.76507949829102, "p90": 206.19804687500002, "max": 229.66036987304688, "pos_frac": 0.828125, "sample": [-16.785356521606445, -71.12713623046875, 99.87983703613281, 209.59390258789062, 208.10401916503906, 102.56747436523438, 38.64781188964844, 39.753028869628906, 188.68055725097656, 76.7967529296875, 56.1677360534668, 100.68590545654297, 82.94432830810547, -91.99382019042969, 171.09881591796875, 203.37689208984375, 10.931625366210938, 43.82098388671875, 180.58811950683594, 68.510009765625, 77.54300689697266, 121.76072692871094, 58.89698791503906, 93.0706787109375, 161.02325439453125, 8.352005004882812, 123.20062255859375, 229.66036987304688, 84.08746337890625, 64.00205993652344, 221.42343139648438, 214.35760498046875, 74.71223449707031, 177.0546417236328, 18.404014587402344, 134.72048950195312, 99.32666778564453, -11.007682800292969, 217.05319213867188, 105.48040771484375, 46.421295166015625, 78.58583068847656, 69.2705078125, -12.887027740478516, 163.62747192382812, 61.483917236328125, -5.432701110839844, -23.4393310546875, 154.64122009277344, -44.14488220214844, 205.41238403320312, 184.0332794189453, 157.99856567382812, 26.824119567871094, 84.77540588378906, 25.331039428710938, 187.57614135742188, 30.082054138183594, -12.308380126953125, -2.8003005981445312, -12.552188873291016, 35.21717834472656, 127.75982666015625, 206.53475952148438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000436.npy"}
{"epoch": 0.6402349486049926, "step": 437, "batch_size": 64, "mean": 68.94998168945312, "std": 80.542724609375, "min": -153.01356506347656, "p10": -24.744689750671387, "median": 72.50028610229492, "p90": 159.789453125, "max": 235.1156463623047, "pos_frac": 0.8125, "sample": [148.13375854492188, 17.631088256835938, 12.710723876953125, 118.02623748779297, 77.95628356933594, -122.14774322509766, 141.1414337158203, 35.68489074707031, 191.12908935546875, 25.232879638671875, 75.52267456054688, -1.4411697387695312, 55.250267028808594, 99.5665054321289, 15.101844787597656, 210.10623168945312, 53.37701416015625, -122.72897338867188, 158.7396240234375, 48.31244659423828, 30.62397003173828, 69.47789764404297, 3.1280555725097656, 163.76841735839844, -3.0696563720703125, 106.24972534179688, 103.37711334228516, -40.633766174316406, 111.11866760253906, 3.938800811767578, 110.1989517211914, -1.41656494140625, 173.240478515625, 4.433418273925781, 235.1156463623047, -24.127456665039062, 36.376739501953125, -25.009218215942383, 117.39997863769531, 91.7079849243164, 99.8533706665039, -153.01356506347656, 157.61465454101562, 160.2393798828125, 89.002685546875, 129.86590576171875, 124.4330825805664, 87.6224365234375, 156.9989013671875, 113.52391052246094, -56.127017974853516, 153.23025512695312, 36.34300231933594, 63.860260009765625, 171.27508544921875, 49.91056823730469, 156.53738403320312, -8.041519165039062, 47.70808410644531, 144.64990234375, -33.02272033691406, 19.081809997558594, 133.6207275390625, 64.4278564453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000437.npy"}
{"epoch": 0.6417033773861968, "step": 438, "batch_size": 64, "mean": 71.30006408691406, "std": 87.75740814208984, "min": -105.86056518554688, "p10": -33.77398986816405, "median": 83.23892974853516, "p90": 178.41155700683595, "max": 232.13389587402344, "pos_frac": 0.75, "sample": [174.00289916992188, 202.82359313964844, 186.7196044921875, 119.9391860961914, 134.55946350097656, -4.7248992919921875, 94.05197143554688, -95.10833740234375, -104.96575927734375, 174.7940216064453, 89.46401977539062, 83.31877136230469, -82.85420227050781, 169.77920532226562, 148.77239990234375, 146.11959838867188, 179.96192932128906, 161.6192169189453, 7.550132751464844, -21.499496459960938, -105.86056518554688, 200.98153686523438, 87.74017333984375, 161.13290405273438, 221.36685180664062, 136.97918701171875, 128.6981201171875, 7.01953125, -51.56201171875, -9.041313171386719, -26.063201904296875, 3.8551063537597656, 217.25257873535156, 78.38420867919922, 113.337646484375, 37.88725280761719, 147.6746826171875, -10.249313354492188, 87.07914733886719, -19.370956420898438, 117.42669677734375, 37.213157653808594, -3.546661376953125, 78.48823547363281, -15.10833740234375, 99.49612426757812, 30.627105712890625, 83.15908813476562, 32.26045227050781, 169.845458984375, 19.764663696289062, 25.556480407714844, 232.13389587402344, 83.7545166015625, 19.507591247558594, 12.034637451171875, 38.005149841308594, -75.06686401367188, 114.08865356445312, 141.54629516601562, 52.18280029296875, 142.50082397460938, -37.07861328125, -7.1517486572265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000438.npy"}
{"epoch": 0.6431718061674009, "step": 439, "batch_size": 64, "mean": 72.81299591064453, "std": 91.86677551269531, "min": -143.93817138671875, "p10": -26.857094955444335, "median": 59.91751670837402, "p90": 188.45082244873046, "max": 302.558349609375, "pos_frac": 0.796875, "sample": [76.87994384765625, 82.18890380859375, -25.185016632080078, 175.63526916503906, 21.20079803466797, -7.404529571533203, 54.68357849121094, 128.61293029785156, 42.857818603515625, -71.97310638427734, 10.230842590332031, 255.45895385742188, 2.4887237548828125, 187.49258422851562, 48.25669860839844, 193.84640502929688, 138.164306640625, 9.512657165527344, 101.92383575439453, 73.37808227539062, 6.694429397583008, 189.7967529296875, 153.08865356445312, 53.692108154296875, 81.66313934326172, 156.05007934570312, 9.347465515136719, -40.28788757324219, -32.662757873535156, 41.19590759277344, 175.3282928466797, -9.982978820800781, 83.19563293457031, 34.245521545410156, 295.77911376953125, 85.76005554199219, 115.72383880615234, 176.9833984375, 47.90043258666992, 137.78038024902344, 5.051242828369141, -11.370010375976562, -100.55992126464844, 78.8698501586914, 23.750320434570312, 62.71639633178711, 23.024005889892578, 199.40000915527344, 171.53135681152344, -19.814537048339844, 186.80984497070312, 68.5015869140625, 115.59480285644531, 302.558349609375, -18.04108428955078, 31.91738510131836, 57.11863708496094, -83.6579360961914, 52.842308044433594, 115.41819763183594, 121.4801254272461, 188.8614959716797, -143.93817138671875, -27.573699951171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000439.npy"}
{"epoch": 0.644640234948605, "step": 440, "batch_size": 64, "mean": 86.86366271972656, "std": 99.5584716796875, "min": -106.74468994140625, "p10": -36.67819137573241, "median": 80.37286758422852, "p90": 213.8090881347657, "max": 392.51348876953125, "pos_frac": 0.828125, "sample": [197.7904052734375, 139.68299865722656, 193.09832763671875, 64.64303588867188, 114.195556640625, 32.09828186035156, 4.267707824707031, 0.9509201049804688, 63.28767776489258, 75.66252136230469, -11.029876708984375, 42.99810791015625, 152.22177124023438, 139.4573974609375, 392.51348876953125, -106.69532775878906, 135.16213989257812, 131.5069122314453, 146.32376098632812, 31.501724243164062, 236.20022583007812, 220.2983856201172, 54.859840393066406, 183.31564331054688, 108.20597839355469, 147.90948486328125, -28.401329040527344, 220.2920379638672, 52.09736633300781, 4.450069427490234, -40.22541809082031, 250.5113983154297, 162.81881713867188, 97.98963928222656, 178.52207946777344, -23.165931701660156, 267.2376403808594, -63.86457443237305, 4.0213623046875, -1.0858821868896484, 198.6822052001953, 19.840530395507812, 113.66961669921875, 85.08321380615234, 39.10265350341797, 29.150310516357422, -106.74468994140625, 130.09881591796875, -76.71780395507812, 234.46023559570312, 175.53347778320312, 172.1405792236328, 130.93643188476562, 144.93788146972656, 32.0239143371582, 14.392562866210938, 10.907024383544922, -50.20791244506836, 28.95492172241211, 40.10487365722656, 124.51131439208984, 128.07843017578125, -42.50459289550781, 11.216476440429688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000440.npy"}
{"epoch": 0.6461086637298091, "step": 441, "batch_size": 64, "mean": 81.84053039550781, "std": 87.96534729003906, "min": -64.72593688964844, "p10": -10.706586074829099, "median": 62.99317169189453, "p90": 207.58254852294925, "max": 413.0335998535156, "pos_frac": 0.859375, "sample": [150.832275390625, 5.986418724060059, 32.8338623046875, 65.32523345947266, 219.44891357421875, 158.61160278320312, 51.456024169921875, 93.63185119628906, -12.104713439941406, -33.57052230834961, 9.428325653076172, 111.51934814453125, 200.9458465576172, 123.75260925292969, 101.89344024658203, 70.32440185546875, 25.394981384277344, 63.50244140625, 62.48390197753906, 44.16680908203125, -8.360597610473633, 210.42684936523438, 268.88995361328125, 194.79708862304688, 68.45310974121094, -8.572334289550781, 74.52066040039062, 107.38236999511719, 37.27416229248047, 413.0335998535156, 2.2538719177246094, -64.72593688964844, 88.18779754638672, 228.7490692138672, 135.76821899414062, 4.242115020751953, 47.097938537597656, 58.62470245361328, 211.67428588867188, 37.099281311035156, 107.24329376220703, 20.177955627441406, 28.99822998046875, -40.33137512207031, 27.21771240234375, 54.32177734375, 161.60494995117188, 188.3936767578125, 14.43682861328125, 10.163986206054688, -24.928726196289062, -11.621265411376953, 112.63310241699219, 107.47483825683594, 28.166465759277344, 144.667236328125, 56.64630126953125, -28.4586181640625, 54.758384704589844, 85.12821197509766, 123.97976684570312, 6.599517822265625, 100.64425659179688, 257.1982421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000441.npy"}
{"epoch": 0.6475770925110133, "step": 442, "batch_size": 64, "mean": 96.75260925292969, "std": 88.3237075805664, "min": -85.15998077392578, "p10": -11.506838989257812, "median": 94.10894393920898, "p90": 226.4542205810547, "max": 287.76727294921875, "pos_frac": 0.84375, "sample": [93.2314453125, 19.513031005859375, 232.05072021484375, 16.314422607421875, 88.8909912109375, 230.71310424804688, 227.46896362304688, 129.11264038085938, 174.1326446533203, 117.94046020507812, 129.28237915039062, 224.08648681640625, 23.98114776611328, 120.11466217041016, 98.65923309326172, 51.87096405029297, 44.72895812988281, 94.98644256591797, -39.856361389160156, 47.484474182128906, 8.272239685058594, 148.5589141845703, 135.7552490234375, 154.27154541015625, -4.728080749511719, 79.36772918701172, -28.277755737304688, -12.177078247070312, 76.855224609375, 150.40328979492188, 172.66708374023438, -7.145463943481445, 90.00718688964844, -85.15998077392578, 180.52078247070312, 92.56217956542969, 35.57490539550781, 105.169677734375, 137.77743530273438, 243.67996215820312, -41.085693359375, 20.77727508544922, 160.69744873046875, -22.050701141357422, -9.942947387695312, 193.38978576660156, 28.967361450195312, 72.5111083984375, 245.61837768554688, 181.81472778320312, 117.89521789550781, 23.351333618164062, 11.412933349609375, 30.6767578125, 96.0308609008789, -84.80844116210938, 160.36322021484375, 191.61631774902344, 268.33355712890625, 75.42021179199219, 287.76727294921875, 112.16213989257812, 186.09249877929688, 86.49414825439453], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000442.npy"}
{"epoch": 0.6490455212922174, "step": 443, "batch_size": 64, "mean": 63.930564880371094, "std": 85.41207885742188, "min": -144.64077758789062, "p10": -24.132596015930176, "median": 56.412065505981445, "p90": 180.59140777587896, "max": 268.90533447265625, "pos_frac": 0.8125, "sample": [268.90533447265625, 3.838594436645508, 189.99411010742188, 100.70672607421875, 28.577499389648438, 42.541229248046875, 36.74513626098633, -8.120872497558594, 12.950820922851562, 19.90906524658203, -144.64077758789062, -53.42120361328125, -23.46827507019043, -24.41730499267578, 101.70571899414062, -120.85098266601562, 159.1165771484375, -8.767967224121094, 245.32232666015625, 74.55485534667969, 242.7443389892578, 51.95909118652344, 71.49224853515625, 131.31826782226562, 71.61796569824219, 61.665679931640625, -95.52650451660156, 165.22181701660156, 207.2958221435547, -52.865997314453125, 88.59984588623047, 79.23458862304688, 56.80210876464844, 52.39501190185547, 47.27461242675781, 7.313018798828125, 42.459625244140625, 33.554527282714844, 99.12580871582031, -20.572525024414062, 50.062103271484375, 89.13702392578125, -4.5057373046875, 111.39685821533203, 15.733016967773438, 28.347869873046875, 63.7735710144043, 133.00076293945312, 56.02202224731445, 126.97874450683594, 147.127685546875, 25.23953628540039, 46.662322998046875, 118.31719970703125, 50.07289123535156, 135.39300537109375, 78.31169891357422, 190.75917053222656, 161.75128173828125, 187.17837524414062, 81.56124877929688, 8.82965087890625, -119.6896743774414, 67.80572509765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000443.npy"}
{"epoch": 0.6505139500734214, "step": 444, "batch_size": 64, "mean": 68.44133758544922, "std": 97.90482330322266, "min": -162.0147705078125, "p10": -56.2129653930664, "median": 44.49655723571777, "p90": 195.30625915527344, "max": 275.2930603027344, "pos_frac": 0.78125, "sample": [-61.49591827392578, 36.00254821777344, 35.9678955078125, 107.83712768554688, -69.77471160888672, 85.76216125488281, 8.452945709228516, 275.2930603027344, 224.52513122558594, -82.035888671875, -37.98506164550781, 56.22685241699219, 18.959930419921875, 159.69879150390625, 171.1446533203125, 16.014984130859375, 8.988021850585938, 101.53086853027344, 150.22264099121094, -59.96038818359375, 42.806514739990234, -5.4105682373046875, 88.60836791992188, 236.9143524169922, 13.366382598876953, -19.0634765625, 126.52766418457031, 197.57308959960938, 40.68257141113281, 5.143768310546875, 46.18659973144531, 263.22235107421875, 177.40451049804688, 14.54849624633789, 97.55168151855469, 163.13563537597656, 147.30169677734375, -4.969184875488281, 133.4078369140625, 223.32070922851562, 23.145912170410156, 196.6423797607422, 136.49429321289062, 74.41163635253906, 136.2914581298828, 164.53350830078125, 115.9898910522461, -0.23050689697265625, -129.6445770263672, 183.08299255371094, -47.46897888183594, 0.8756217956542969, 4.310630798339844, 33.90947341918945, 117.16452026367188, 16.190677642822266, 3.883220672607422, 143.83668518066406, -162.0147705078125, -40.915802001953125, 192.1886444091797, -65.33306884765625, 2.0206451416015625, 147.24658203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000444.npy"}
{"epoch": 0.6519823788546255, "step": 445, "batch_size": 64, "mean": 80.50860595703125, "std": 86.5233383178711, "min": -149.69000244140625, "p10": -12.582557678222656, "median": 73.14179229736328, "p90": 189.6407241821289, "max": 275.85009765625, "pos_frac": 0.8125, "sample": [80.19869232177734, 4.106884002685547, 188.27871704101562, 275.85009765625, -11.990020751953125, -80.10565948486328, 160.63941955566406, 218.46607971191406, 121.01258850097656, 64.54264068603516, 75.77784729003906, 119.64312744140625, 74.15591430664062, 41.01298904418945, -6.071994781494141, -149.69000244140625, 190.2244415283203, 70.06770324707031, -25.42986297607422, 111.14947509765625, 97.48638153076172, -5.220062255859375, 7.216846466064453, 70.61534118652344, -3.507373809814453, 25.249832153320312, 265.66290283203125, 108.3413314819336, 29.576095581054688, 84.36668395996094, 177.5448760986328, 134.93695068359375, 101.32378387451172, 240.7910614013672, 177.2952117919922, 168.28765869140625, 173.2478485107422, 138.92214965820312, -23.382675170898438, 122.8231201171875, -7.971038818359375, 57.23454284667969, 42.09968566894531, -62.264400482177734, 26.89239501953125, 220.1729736328125, 43.18598937988281, 95.1350326538086, 120.36576843261719, 69.91868591308594, 30.55560302734375, 38.78007507324219, 12.335367202758789, 72.12767028808594, 50.19744873046875, 78.70447540283203, 30.724700927734375, 136.00025939941406, 229.2203369140625, -12.836502075195312, -61.13947296142578, 151.33908081054688, 141.097900390625, 37.256805419921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000445.npy"}
{"epoch": 0.6534508076358296, "step": 446, "batch_size": 64, "mean": 73.82595825195312, "std": 84.2347183227539, "min": -137.9477996826172, "p10": -15.222192764282225, "median": 66.89993286132812, "p90": 188.32073669433595, "max": 262.6224365234375, "pos_frac": 0.8125, "sample": [5.18878173828125, 101.53057861328125, -3.612640380859375, 3.6716766357421875, 103.90145874023438, 92.77191162109375, 186.4685821533203, 167.7933349609375, 171.22772216796875, 119.13265228271484, 134.49163818359375, 3.728729248046875, 4.98944091796875, 86.15798950195312, 19.274761199951172, 7.772270202636719, 262.6224365234375, 106.32304382324219, 117.01024627685547, 147.86709594726562, 42.584259033203125, -8.94677734375, 0.68170166015625, 68.63027954101562, -67.3666763305664, 114.39765930175781, 146.5452880859375, 191.46710205078125, 154.0067138671875, 86.36857604980469, 244.4774627685547, -26.793930053710938, 37.04486083984375, -16.122310638427734, -5.438549041748047, 38.878150939941406, 23.341171264648438, 205.70530700683594, 86.39862060546875, 245.90679931640625, -23.031707763671875, -137.9477996826172, 81.20623779296875, 160.65219116210938, 40.76603698730469, -39.965476989746094, 166.82664489746094, 94.32366943359375, 25.549301147460938, 65.16958618164062, 32.22014617919922, -12.6016845703125, -13.121917724609375, 45.96719741821289, 7.772575378417969, 116.87722778320312, 2.1910400390625, 211.42184448242188, 19.08294677734375, 109.76319122314453, -31.246185302734375, 189.11451721191406, 51.42723846435547, 162.36676025390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000446.npy"}
{"epoch": 0.6549192364170338, "step": 447, "batch_size": 64, "mean": 94.40399169921875, "std": 101.1310806274414, "min": -121.99394226074219, "p10": -23.30977802276611, "median": 108.35867691040039, "p90": 195.45233764648438, "max": 353.4026794433594, "pos_frac": 0.84375, "sample": [225.0389862060547, 171.81756591796875, 50.858123779296875, 108.58354187011719, -5.031867980957031, -48.71160888671875, -7.385009765625, 174.8511505126953, 190.97247314453125, 31.203750610351562, 40.70161437988281, 81.83349609375, 191.458740234375, 49.442081451416016, 140.30938720703125, 29.493385314941406, 227.3435821533203, -24.85149574279785, 353.4026794433594, 285.561279296875, 172.32525634765625, 336.0734558105469, 122.85735321044922, 189.1547393798828, 134.95550537109375, 32.923912048339844, 123.83534240722656, -121.43087005615234, 197.16387939453125, 21.25194549560547, 150.82859802246094, 122.60636901855469, 37.66034698486328, 0.6879119873046875, 86.44338989257812, 42.81666564941406, -95.655029296875, 138.71762084960938, 13.579864501953125, 1.0495986938476562, 163.83741760253906, -25.855777740478516, 190.4186248779297, 0.23924827575683594, 204.38656616210938, 180.97152709960938, 150.45098876953125, -121.99394226074219, -103.1657485961914, 74.07516479492188, 182.6700897216797, 31.614395141601562, 139.5651397705078, -19.71243667602539, 131.7012939453125, 101.20790100097656, 160.39405822753906, 44.90966796875, 130.2310333251953, 27.87201690673828, 137.21408081054688, 153.27874755859375, 108.1338119506836, 24.673614501953125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000447.npy"}
{"epoch": 0.6563876651982379, "step": 448, "batch_size": 64, "mean": 91.07563781738281, "std": 113.63292694091797, "min": -159.54974365234375, "p10": -64.21684494018554, "median": 85.17767333984375, "p90": 224.43750305175783, "max": 312.11614990234375, "pos_frac": 0.796875, "sample": [-108.70108032226562, 42.223670959472656, 29.251937866210938, -30.847946166992188, 252.90953063964844, 71.12254333496094, -40.170623779296875, 13.379776000976562, 13.911788940429688, -85.59835815429688, 220.8941192626953, 126.25114440917969, -54.82318115234375, 41.51906967163086, -58.13067626953125, 231.15423583984375, 75.24346160888672, 96.1806640625, 212.86077880859375, 19.9049072265625, -159.54974365234375, 169.0501708984375, 110.69967651367188, 44.83624267578125, 190.43841552734375, 221.1246795654297, 16.99200439453125, 49.20819091796875, 216.64913940429688, 65.65499877929688, 114.53779602050781, 220.62538146972656, 3.9066505432128906, 159.81381225585938, 312.11614990234375, -15.947444915771484, 181.29086303710938, 23.468017578125, -100.54400634765625, 225.85728454589844, 92.14337158203125, 210.15219116210938, 193.81796264648438, -66.82520294189453, 310.59234619140625, 79.418212890625, 33.48643493652344, 180.52304077148438, 236.0105438232422, 28.177597045898438, -2.056243896484375, 4.440803527832031, 159.02481079101562, -90.44349670410156, 251.15158081054688, 197.56080627441406, -79.04114532470703, 200.73239135742188, 195.9330291748047, 110.60602569580078, 206.78646850585938, 90.9371337890625, 129.59429931640625, 37.353851318359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000448.npy"}
{"epoch": 0.657856093979442, "step": 449, "batch_size": 64, "mean": 94.17698669433594, "std": 101.02496337890625, "min": -164.8413848876953, "p10": -38.82267684936523, "median": 99.99771881103516, "p90": 209.42722930908204, "max": 350.86492919921875, "pos_frac": 0.796875, "sample": [-10.514564514160156, 97.63780212402344, 185.34072875976562, 79.80148315429688, 240.77857971191406, 181.41000366210938, 153.9539794921875, 156.87918090820312, 73.253173828125, 117.8460693359375, 257.7979431152344, -164.8413848876953, 156.71923828125, 168.91099548339844, 8.396347045898438, 137.12046813964844, 150.00814819335938, -44.772178649902344, -9.092315673828125, -57.04572677612305, 134.2019805908203, 59.15688705444336, 161.92816162109375, 172.88137817382812, 195.7764892578125, 207.5204620361328, 63.78907775878906, 16.30280876159668, 73.63804626464844, 221.6796417236328, 180.03317260742188, 3.2537193298339844, 144.1297607421875, 59.11909484863281, 110.14884948730469, 208.08645629882812, -36.758453369140625, -39.70734405517578, -31.208755493164062, 192.31240844726562, 350.86492919921875, 210.00184631347656, -103.74189758300781, 124.08270263671875, 163.44412231445312, 27.790855407714844, 88.8260498046875, 41.12074661254883, -40.87669372558594, 187.6223907470703, 158.62918090820312, 135.56793212890625, 43.77540588378906, -69.86219787597656, 222.16241455078125, 4.939208984375, 70.59963989257812, 243.23440551757812, -6.851707458496094, 62.20372772216797, -16.640674591064453, 11.244544982910156, 102.35763549804688, 40.96073913574219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000449.npy"}
{"epoch": 0.6593245227606461, "step": 450, "batch_size": 64, "mean": 88.93949890136719, "std": 99.66510009765625, "min": -152.18359375, "p10": -54.126967620849605, "median": 92.98387908935547, "p90": 214.4036392211914, "max": 306.2242431640625, "pos_frac": 0.859375, "sample": [95.27760314941406, 306.2242431640625, 248.71937561035156, 126.11675262451172, 41.05036926269531, 231.05491638183594, 184.30685424804688, 59.48484802246094, 62.82440185546875, -124.16751098632812, 52.24168395996094, 238.4910888671875, 134.85888671875, 75.12621307373047, 53.78228759765625, 195.1228790283203, 123.50709533691406, 120.92544555664062, 61.23118591308594, 174.19248962402344, -152.18359375, 23.21197509765625, 149.01980590820312, 90.38577270507812, 215.91305541992188, 173.79620361328125, 46.67289733886719, 181.59231567382812, 87.63558959960938, -77.59393310546875, 105.15534210205078, 234.51199340820312, 210.8816680908203, 118.2104721069336, 30.52979278564453, 7.191093444824219, 39.31427001953125, 129.64224243164062, 190.40879821777344, 15.779146194458008, 254.51246643066406, 103.82936096191406, 21.072586059570312, 142.35609436035156, 161.0874786376953, 35.75843811035156, -76.51959991455078, -32.91850280761719, -111.2511215209961, 145.43731689453125, 142.97610473632812, 13.082511901855469, -73.05833435058594, 44.10896301269531, 172.9764404296875, -53.074302673339844, 173.79171752929688, 136.32009887695312, 4.636985778808594, 90.69015502929688, 122.8548355102539, 31.371932983398438, -54.57810974121094, 16.218069076538086], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000450.npy"}
{"epoch": 0.6607929515418502, "step": 451, "batch_size": 64, "mean": 73.95240020751953, "std": 111.01866912841797, "min": -200.23797607421875, "p10": -48.01998672485352, "median": 52.814762115478516, "p90": 215.18479766845707, "max": 293.8162841796875, "pos_frac": 0.71875, "sample": [39.16032409667969, 122.55680847167969, -24.438385009765625, 17.04113006591797, 138.92710876464844, 30.960433959960938, -78.412109375, 219.1654052734375, 152.89251708984375, 25.293819427490234, 4.259613037109375, 290.6042785644531, 122.74761962890625, 178.63729858398438, 162.84750366210938, -10.925727844238281, 5.074525833129883, 49.16703796386719, -47.847801208496094, -21.3245849609375, 89.37998962402344, -41.32203674316406, 175.6082763671875, 164.3616943359375, 281.8868408203125, -49.29974365234375, 40.448509216308594, 36.997100830078125, 194.3218994140625, -7.6256103515625, 17.210721969604492, 293.8162841796875, 138.2491455078125, 40.16698455810547, 129.3812255859375, 71.92890930175781, 203.08270263671875, -111.14752960205078, 63.574729919433594, -144.15548706054688, -48.093780517578125, 1.1330795288085938, 205.89671325683594, -200.23797607421875, -19.77462387084961, -34.11082077026367, -10.239124298095703, 44.156864166259766, 202.79588317871094, 90.56375885009766, 109.74703979492188, -94.81893920898438, 9.068462371826172, 181.6942138671875, 285.81640625, 131.40542602539062, 189.90621948242188, 56.462486267089844, 162.76123046875, -2.714590072631836, 224.05445861816406, -2.734037399291992, 226.37490844726562, 60.588706970214844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000451.npy"}
{"epoch": 0.6622613803230544, "step": 452, "batch_size": 64, "mean": 80.79637145996094, "std": 82.37899780273438, "min": -90.9100341796875, "p10": -13.863314819335935, "median": 66.8646354675293, "p90": 196.6053909301758, "max": 255.08370971679688, "pos_frac": 0.84375, "sample": [182.30633544921875, 25.608291625976562, 127.94649505615234, 217.3963623046875, 157.8082275390625, 213.48757934570312, 218.1248779296875, 216.7289276123047, 99.16329956054688, 62.164886474609375, 1.147552490234375, 54.227542877197266, 31.8182373046875, 7.610141754150391, -37.09172058105469, 30.061141967773438, 138.96788024902344, 56.090736389160156, 49.55731201171875, -41.733665466308594, 188.04197692871094, 25.762104034423828, -69.9398193359375, 200.7836151123047, -14.877998352050781, 162.78378295898438, 135.1510009765625, -11.495719909667969, 146.3449249267578, -17.87384796142578, -90.9100341796875, 196.72164916992188, 5.375787734985352, 78.581787109375, 100.63296508789062, 85.99029541015625, 75.08493041992188, 255.08370971679688, 161.85162353515625, 50.59991455078125, 73.75830841064453, 39.59577178955078, 41.400146484375, 140.24288940429688, 47.79669189453125, 15.181781768798828, 36.568359375, 24.069992065429688, 90.698486328125, 71.56438446044922, 190.6810760498047, 196.33412170410156, 38.148284912109375, -8.263402938842773, -46.21112060546875, 186.81686401367188, 112.74004364013672, 42.65581512451172, 163.15594482421875, 8.618194580078125, 107.1185302734375, 108.39806365966797, -8.276863098144531, 23.09237289428711], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000452.npy"}
{"epoch": 0.6637298091042585, "step": 453, "batch_size": 64, "mean": 96.43700408935547, "std": 92.72126007080078, "min": -86.16873168945312, "p10": -13.326328277587887, "median": 94.46791458129883, "p90": 223.58416748046875, "max": 403.0130615234375, "pos_frac": 0.859375, "sample": [34.01251220703125, 59.663734436035156, 0.817962646484375, -10.127349853515625, 139.1988983154297, 108.4563980102539, 124.82588958740234, 125.55519104003906, 34.50904083251953, 180.19512939453125, 71.74407196044922, 223.1294708251953, 195.04649353027344, 64.99562072753906, 79.06787109375, 153.42420959472656, 193.29469299316406, 236.27792358398438, 162.68597412109375, -19.134979248046875, 87.842529296875, -27.202659606933594, 49.13926696777344, -22.683502197265625, 170.677734375, 4.329383850097656, 9.601455688476562, 272.3690490722656, -20.740833282470703, 118.33565521240234, 98.13723754882812, 120.87825012207031, 2.732208251953125, 220.42108154296875, 230.32997131347656, 51.99052810668945, 19.765663146972656, 17.742929458618164, 403.0130615234375, 92.00636291503906, 112.38800048828125, 30.40634536743164, 100.7672119140625, 96.9294662475586, 183.089599609375, 101.71981811523438, 84.12210083007812, 100.78682708740234, 212.9132843017578, 223.77903747558594, -34.88690185546875, -0.726104736328125, -86.16873168945312, 225.08938598632812, 141.554931640625, -14.697319030761719, 3.4633407592773438, 18.779041290283203, 234.4745635986328, 137.47238159179688, 63.028587341308594, 138.44039916992188, 5.0010528564453125, 37.91799545288086], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000453.npy"}
{"epoch": 0.6651982378854625, "step": 454, "batch_size": 64, "mean": 78.03350067138672, "std": 116.66636657714844, "min": -168.21853637695312, "p10": -92.94132385253904, "median": 83.77336883544922, "p90": 215.18372497558593, "max": 340.50030517578125, "pos_frac": 0.734375, "sample": [203.57827758789062, 85.70864868164062, -19.881256103515625, 22.235965728759766, 169.89682006835938, -46.563560485839844, 70.6995849609375, 47.40919494628906, 94.90512084960938, 17.878311157226562, -136.80050659179688, 48.02775573730469, 213.5477294921875, 169.24220275878906, -18.981159210205078, 128.51547241210938, 30.482738494873047, 10.066291809082031, 17.180641174316406, -78.25775146484375, 142.61082458496094, 239.35037231445312, 136.90318298339844, -52.4501953125, -21.28730010986328, -1.21575927734375, 214.74411010742188, -128.14089965820312, 218.50990295410156, 147.62022399902344, 92.54823303222656, 129.88174438476562, 118.93450164794922, 177.4019012451172, 188.23048400878906, 56.938350677490234, -12.665657043457031, -56.90480041503906, -168.21853637695312, 119.48403930664062, 278.18707275390625, 264.09710693359375, 148.0561981201172, 78.61651611328125, 148.7884521484375, 171.54080200195312, 272.89056396484375, 21.043601989746094, 209.76499938964844, 43.70611572265625, 129.57955932617188, 340.50030517578125, -100.48837280273438, 149.2025146484375, 30.145736694335938, -149.99862670898438, 215.37213134765625, -128.93603515625, 168.6182861328125, -99.23428344726562, 71.34355926513672, 82.99491882324219, 84.55181884765625, -7.364284515380859], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000454.npy"}
{"epoch": 0.6666666666666666, "step": 455, "batch_size": 64, "mean": 75.66259765625, "std": 101.20983123779297, "min": -147.18252563476562, "p10": -41.427219772338866, "median": 82.7574234008789, "p90": 205.06210174560547, "max": 313.74017333984375, "pos_frac": 0.734375, "sample": [44.01218795776367, 129.47674560546875, 226.5985565185547, 38.090484619140625, -9.529422760009766, 48.40753173828125, 156.1354522705078, -5.361793518066406, 313.74017333984375, 85.61284637451172, 191.8973388671875, 156.05593872070312, -102.72367858886719, -18.41283416748047, 106.92637634277344, -94.29780578613281, 93.78809356689453, -25.109710693359375, 27.187789916992188, -125.9528579711914, 171.75982666015625, 117.41804504394531, 134.6254425048828, 158.6622314453125, 161.9481964111328, 50.33903503417969, 244.97088623046875, -94.452392578125, -36.8765869140625, 82.47390747070312, 206.44252014160156, 119.85929107666016, 84.10868835449219, 18.908706665039062, 6.676662445068359, 228.73196411132812, -27.09508514404297, 15.389358520507812, 46.518592834472656, -34.588409423828125, 36.204673767089844, -2.2444076538085938, 166.56033325195312, 201.84112548828125, -64.93106079101562, -19.180063247680664, 45.83758544921875, 114.684814453125, 246.27084350585938, -147.18252563476562, 83.04093933105469, 18.836448669433594, 123.92887878417969, 92.19506072998047, 42.251373291015625, 49.76567077636719, -13.586902618408203, 219.91387939453125, 167.02114868164062, 159.54397583007812, 172.27932739257812, 149.49050903320312, -43.37749099731445, 150.8798828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000455.npy"}
{"epoch": 0.6681350954478708, "step": 456, "batch_size": 64, "mean": 73.88893127441406, "std": 91.2118148803711, "min": -98.93834686279297, "p10": -43.56278533935546, "median": 76.66906356811523, "p90": 174.7811279296875, "max": 280.60345458984375, "pos_frac": 0.75, "sample": [38.329345703125, 148.2880096435547, 154.55027770996094, 189.74769592285156, 52.37876892089844, 77.33393859863281, -98.93834686279297, 76.00418853759766, -84.12332153320312, 162.79776000976562, 43.26750183105469, 12.794620513916016, 167.7481231689453, 119.69326782226562, 138.96707153320312, 70.51251983642578, 110.82723999023438, -32.31263732910156, 29.05821990966797, 16.69158935546875, 70.60653686523438, -12.9039306640625, 114.43302917480469, -56.5706787109375, 2.645233154296875, 98.10105895996094, 161.2689208984375, -92.99601745605469, 174.78611755371094, 91.6219482421875, 27.884857177734375, 278.0491943359375, -21.12627410888672, 157.91903686523438, -48.38427734375, -11.558076858520508, 24.191558837890625, -17.233776092529297, 280.60345458984375, -94.76466369628906, -9.199569702148438, 212.4501953125, 128.7935791015625, 118.09480285644531, 127.60595703125, 83.52336120605469, -16.468734741210938, -1.6596832275390625, 193.19354248046875, 41.7605094909668, 254.7417755126953, 33.983299255371094, 153.86868286132812, 21.636817932128906, 86.02488708496094, 170.59652709960938, 24.984725952148438, 126.41403198242188, 174.7694854736328, 108.77890014648438, 84.64968872070312, -52.91703796386719, -11.985427856445312, 155.0621337890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000456.npy"}
{"epoch": 0.6696035242290749, "step": 457, "batch_size": 64, "mean": 98.66180419921875, "std": 82.88804626464844, "min": -96.72064208984375, "p10": 6.626455688476563, "median": 102.92301177978516, "p90": 197.5211364746094, "max": 308.47235107421875, "pos_frac": 0.921875, "sample": [182.53671264648438, 68.51118469238281, 183.41781616210938, 193.84814453125, 217.37228393554688, 192.94285583496094, 308.47235107421875, 122.02153015136719, 16.49578094482422, 49.44952392578125, 139.88577270507812, 80.78520965576172, 50.774818420410156, -41.853363037109375, 139.82017517089844, 156.17807006835938, 70.86480712890625, 54.27216339111328, 199.09527587890625, 122.14015197753906, 222.79798889160156, 80.8269271850586, 116.63106536865234, 168.4803009033203, 220.6580352783203, 131.54541015625, 48.21051025390625, 38.00963592529297, 4.948539733886719, -17.086959838867188, 115.51443481445312, -96.72064208984375, 113.4476318359375, 92.39839172363281, 50.68544387817383, 124.47660064697266, 6.690147399902344, 181.25527954101562, 29.997344970703125, 136.39942932128906, 187.27804565429688, 264.9508056640625, 49.611602783203125, 6.599159240722656, 28.99222183227539, 130.93922424316406, 128.1268310546875, 54.40281295776367, 15.015754699707031, 128.154052734375, 46.77349090576172, 184.36376953125, 148.85301208496094, 67.66830444335938, -61.101966857910156, 238.9373016357422, 144.30194091796875, 68.06292724609375, 44.88180923461914, 14.119453430175781, 28.72075653076172, 57.72545623779297, 123.44760131835938, -62.6654052734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000457.npy"}
{"epoch": 0.671071953010279, "step": 458, "batch_size": 64, "mean": 73.92202758789062, "std": 105.43711853027344, "min": -111.26596069335938, "p10": -57.28902893066406, "median": 65.81863021850586, "p90": 198.04122009277344, "max": 378.2799072265625, "pos_frac": 0.78125, "sample": [-58.595550537109375, 6.938907623291016, 91.63683319091797, 160.0731201171875, 46.643836975097656, -67.59984588623047, 378.2799072265625, -99.33905029296875, -111.26596069335938, -11.825790405273438, 65.43851470947266, 53.77812194824219, 156.41925048828125, 14.463203430175781, 66.19874572753906, 8.566841125488281, 3.1660804748535156, 9.531425476074219, -21.724842071533203, 67.58547973632812, 144.51205444335938, -23.362625122070312, 152.36221313476562, 178.8265838623047, -84.39739990234375, 73.69263458251953, 163.32781982421875, -32.3763427734375, 236.7230682373047, 66.50829315185547, 135.0421142578125, 253.69744873046875, 29.580947875976562, 121.51335906982422, -15.62957763671875, -17.64203643798828, 155.94033813476562, 89.77316284179688, 54.83277893066406, 164.80364990234375, 199.7484130859375, 98.46295166015625, 27.896995544433594, 0.006977081298828125, 106.18331146240234, -83.12792205810547, 256.85400390625, 138.5850067138672, 9.374977111816406, 347.7584228515625, 16.57281494140625, 77.4023208618164, 38.032997131347656, 40.94574737548828, -109.22927856445312, 191.26947021484375, 76.58674621582031, 29.646026611328125, 113.33656311035156, 194.05776977539062, 133.14588928222656, 244.5032196044922, -54.240478515625, 31.13935089111328], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000458.npy"}
{"epoch": 0.6725403817914831, "step": 459, "batch_size": 64, "mean": 90.64775085449219, "std": 102.83211517333984, "min": -120.29656982421875, "p10": -32.06328201293945, "median": 76.1848030090332, "p90": 229.63305053710943, "max": 368.0363464355469, "pos_frac": 0.796875, "sample": [33.04444885253906, 74.53001403808594, 5.934379577636719, -49.476722717285156, -30.443565368652344, 215.99505615234375, 88.63538360595703, 79.84805297851562, 149.68011474609375, -70.75634002685547, 17.427658081054688, 43.67625427246094, 110.2109146118164, 121.59403991699219, -10.715744018554688, 77.83959197998047, 117.45622253417969, 36.338279724121094, -120.29656982421875, 35.41831970214844, 20.5006103515625, 181.89828491210938, 235.4779052734375, 79.4032974243164, -71.89037322998047, 10.078893661499023, 56.028568267822266, 48.537269592285156, 196.3922119140625, 176.57470703125, 27.679157257080078, 180.26419067382812, 122.37950134277344, 37.02172088623047, 368.0363464355469, -1.2805976867675781, 268.64215087890625, 215.34571838378906, 8.564708709716797, -2.3491363525390625, 25.435882568359375, -30.197486877441406, 158.27520751953125, 156.67852783203125, -21.12175750732422, 210.1987762451172, -32.91558837890625, 134.78976440429688, 105.28387451171875, 167.98907470703125, 264.2696838378906, 174.7722930908203, 61.83013153076172, 168.68934631347656, 244.44366455078125, 193.99560546875, 50.96156692504883, -49.2521858215332, 249.2711181640625, 204.28274536132812, 248.55970764160156, 47.349151611328125, 17.379430770874023, -32.7574462890625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000459.npy"}
{"epoch": 0.6740088105726872, "step": 460, "batch_size": 64, "mean": 82.70344543457031, "std": 102.8926010131836, "min": -134.32786560058594, "p10": -48.91838798522949, "median": 77.14107894897461, "p90": 210.67594757080082, "max": 355.7694091796875, "pos_frac": 0.8125, "sample": [196.07130432128906, 55.556304931640625, 135.42852783203125, 196.4227294921875, -71.23114013671875, 186.37380981445312, 110.494384765625, 224.17855834960938, -23.6944580078125, 12.339149475097656, 127.90563201904297, 85.97632598876953, -52.1452522277832, 89.594482421875, 1.8738346099853516, 67.31723022460938, 84.44610595703125, 116.5955810546875, -65.92416381835938, 1.1071014404296875, 258.31378173828125, 21.549407958984375, 261.3556823730469, -23.207176208496094, 38.61004638671875, -12.102752685546875, 355.7694091796875, 203.44505310058594, 195.2416534423828, -41.3890380859375, -21.151824951171875, 36.22831726074219, 94.65433502197266, 104.17050170898438, 181.39407348632812, 42.812278747558594, 3.1416263580322266, 73.13118743896484, 80.37442779541016, 213.77490234375, 41.12677001953125, 278.230712890625, 68.8172836303711, 159.30975341796875, 87.00001525878906, -121.56613159179688, 24.27911376953125, -134.32786560058594, 87.89082336425781, 38.90491485595703, 93.84037780761719, -116.53062438964844, 25.955169677734375, 59.66438293457031, 135.045654296875, 222.21368408203125, 29.524856567382812, 64.3890380859375, -66.09152221679688, 73.90773010253906, 155.0404052734375, 184.26084899902344, 170.99781799316406, 186.3353271484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000460.npy"}
{"epoch": 0.6754772393538914, "step": 461, "batch_size": 64, "mean": 65.16386413574219, "std": 92.17274475097656, "min": -147.72341918945312, "p10": -38.27048835754395, "median": 56.114152908325195, "p90": 194.6244140625, "max": 274.29400634765625, "pos_frac": 0.734375, "sample": [5.975189208984375, 45.05479431152344, 4.278606414794922, 112.51187133789062, 169.81582641601562, 106.05863952636719, 20.5045166015625, 193.1339874267578, -50.260833740234375, -69.72602081298828, 57.79959487915039, 88.155029296875, 105.40315246582031, 20.959373474121094, 125.03118896484375, 64.0037841796875, 182.94036865234375, -6.905189514160156, 94.7793197631836, 169.5461883544922, 1.220611572265625, 202.00421142578125, 195.26316833496094, 125.98347473144531, 104.79158782958984, 35.99225616455078, 265.79803466796875, 274.29400634765625, -2.1984634399414062, -17.644805908203125, 5.044891357421875, 27.829910278320312, 133.01791381835938, -19.170875549316406, -26.934967041015625, -38.752349853515625, -25.91637420654297, 47.94641876220703, -29.595046997070312, 107.7541732788086, 233.40911865234375, -2.7633094787597656, 15.02569580078125, -37.14614486694336, -50.987998962402344, 146.79913330078125, -147.72341918945312, 50.086280822753906, 58.82440948486328, 54.4287109375, 230.1220245361328, 37.893157958984375, 154.39781188964844, 7.862701416015625, 65.0870361328125, 70.57418823242188, -109.64726257324219, -45.506961822509766, 207.2701873779297, 133.68368530273438, -11.558525085449219, 172.25650024414062, 73.32620239257812, 58.986976623535156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000461.npy"}
{"epoch": 0.6769456681350955, "step": 462, "batch_size": 64, "mean": 88.07096862792969, "std": 92.23759460449219, "min": -126.32176971435547, "p10": -4.654774665832517, "median": 73.34954452514648, "p90": 233.2002166748047, "max": 263.5611572265625, "pos_frac": 0.875, "sample": [33.85845184326172, 89.35486602783203, -114.9090576171875, 114.1966552734375, 185.44818115234375, 105.03459167480469, 26.388484954833984, -8.30002212524414, 197.35562133789062, 209.0660858154297, 245.08908081054688, 62.6878662109375, 13.131271362304688, -46.358673095703125, 137.3406219482422, 235.88247680664062, 237.93746948242188, -66.52888488769531, 25.786590576171875, 253.97781372070312, 119.45186614990234, 78.53616333007812, 47.77703857421875, 89.15850830078125, 141.26502990722656, 120.44145202636719, 29.842308044433594, 114.63533782958984, 1.7991466522216797, 57.54932403564453, 150.4082489013672, 191.58840942382812, 25.572250366210938, 43.83305358886719, 183.644775390625, 85.15695190429688, 10.45798110961914, -5.778461456298828, 234.08169555664062, 49.632049560546875, 27.406116485595703, 157.31121826171875, 35.66033935546875, 20.179588317871094, 6.5850982666015625, 2.0959548950195312, 55.71522521972656, 31.029891967773438, 112.15787506103516, 157.78610229492188, -126.32176971435547, 197.5372314453125, 263.5611572265625, -8.917289733886719, 68.16292572021484, 84.41143798828125, 29.946273803710938, 242.36001586914062, 45.5416259765625, 231.1434326171875, 194.44281005859375, 93.55142974853516, 11.735557556152344, -2.032838821411133], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000462.npy"}
{"epoch": 0.6784140969162996, "step": 463, "batch_size": 64, "mean": 103.35470581054688, "std": 103.50462341308594, "min": -159.9176025390625, "p10": -28.46577568054198, "median": 112.68990325927734, "p90": 224.59174041748054, "max": 324.8791809082031, "pos_frac": 0.859375, "sample": [34.10186767578125, 71.63180541992188, -127.36870574951172, 132.84506225585938, 3.2104644775390625, 281.3573913574219, 196.4857177734375, 86.87034606933594, 29.855884552001953, 170.05157470703125, 240.7274627685547, 184.42324829101562, 0.13775634765625, 65.13145446777344, 112.7950439453125, 157.0774688720703, 69.662109375, -38.188838958740234, 37.238319396972656, 24.597702026367188, 194.84812927246094, 195.756103515625, -100.99441528320312, -159.9176025390625, 112.58476257324219, -15.055816650390625, 30.242366790771484, 208.8721923828125, 151.5998077392578, 199.0614471435547, 172.9856719970703, 93.66737365722656, 50.68060302734375, 101.97000122070312, 125.02692413330078, -18.687129974365234, 41.64459228515625, 80.52167510986328, 141.21975708007812, 48.53911590576172, 72.98725891113281, 27.87000274658203, 152.62734985351562, -32.65662384033203, 292.23138427734375, 92.60516357421875, 127.3934326171875, 231.3286895751953, 238.31329345703125, 183.82643127441406, -79.38800048828125, 169.34043884277344, 237.8835906982422, 192.06277465820312, 187.92535400390625, -126.67878723144531, 160.39865112304688, 81.61577606201172, 139.18203735351562, 136.2261199951172, 92.53826904296875, 164.65277099609375, 324.8791809082031, 160.3281707763672], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000463.npy"}
{"epoch": 0.6798825256975036, "step": 464, "batch_size": 64, "mean": 83.32122802734375, "std": 101.64006042480469, "min": -182.43533325195312, "p10": -33.95303878784177, "median": 70.95389175415039, "p90": 195.08326416015626, "max": 359.9304504394531, "pos_frac": 0.84375, "sample": [-135.57040405273438, 39.20674133300781, 34.616600036621094, 38.30339050292969, 67.77374267578125, 56.63629150390625, 71.0272216796875, 188.94198608398438, 27.82440185546875, 183.39566040039062, 29.84088897705078, 107.01481628417969, 58.57408142089844, 16.357635498046875, 52.834197998046875, 146.05322265625, 119.90575408935547, 6.646141052246094, -8.414505004882812, 139.44830322265625, 186.11831665039062, -130.21591186523438, -4.829383850097656, 123.80929565429688, 258.7890625, 152.5792236328125, 14.267822265625, 50.25768280029297, -87.4999771118164, -57.59996032714844, 144.5723876953125, 88.72184753417969, 166.7518310546875, 58.5485954284668, 9.075836181640625, 197.71524047851562, -44.89812469482422, 80.84526062011719, 12.452285766601562, 113.63775634765625, -8.315025329589844, 96.76055908203125, 171.09796142578125, -51.01131057739258, 2.3787002563476562, 152.1842803955078, -182.43533325195312, 88.81369018554688, 128.42703247070312, 133.38194274902344, 178.83470153808594, 231.9710235595703, 359.9304504394531, 112.80083465576172, 55.365623474121094, 261.1916198730469, 208.66415405273438, 50.561859130859375, 125.27113342285156, 299.77508544921875, 55.34767150878906, 70.88056182861328, 184.52142333984375, 32.644775390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000464.npy"}
{"epoch": 0.6813509544787077, "step": 465, "batch_size": 64, "mean": 98.20915222167969, "std": 94.7164306640625, "min": -140.72030639648438, "p10": -14.13610610961914, "median": 86.71261596679688, "p90": 227.18054199218753, "max": 296.167724609375, "pos_frac": 0.828125, "sample": [79.81674194335938, 140.82164001464844, 172.71109008789062, 1.5015144348144531, -0.3273487091064453, 25.84394073486328, 221.70057678222656, 78.51673889160156, 129.36541748046875, 194.21514892578125, -23.078887939453125, 126.45062255859375, 0.9030380249023438, 18.779388427734375, 27.297119140625, 296.167724609375, 259.2445983886719, 267.7594299316406, 158.42327880859375, -13.801246643066406, -19.638092041015625, 201.82142639160156, 86.5850830078125, 46.62144470214844, 290.5747985839844, 106.61043548583984, 146.31753540039062, 41.24505615234375, -21.266067504882812, 216.59039306640625, 229.5290985107422, 115.24349975585938, 25.151905059814453, 139.52291870117188, 178.59359741210938, 206.03977966308594, 14.92144775390625, 73.49537658691406, -2.0499649047851562, 101.00664520263672, 79.64330291748047, 25.11331558227539, 72.95137786865234, -8.251598358154297, 127.31155395507812, 133.09703063964844, 41.76495361328125, 83.17375183105469, 160.6240997314453, 283.4519348144531, 78.12003326416016, -140.72030639648438, -14.279617309570312, 119.2087173461914, 180.896240234375, 264.6798095703125, 52.07764434814453, 130.676025390625, 123.65380859375, -35.299949645996094, 86.84014892578125, 107.20724487304688, -38.72023010253906, 32.93968963623047], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000465.npy"}
{"epoch": 0.6828193832599119, "step": 466, "batch_size": 64, "mean": 102.01172637939453, "std": 98.56993865966797, "min": -159.29400634765625, "p10": -13.813828277587886, "median": 87.22047805786133, "p90": 238.06341705322265, "max": 310.5143127441406, "pos_frac": 0.859375, "sample": [238.39622497558594, 80.30722045898438, 64.35687255859375, 26.86886215209961, 87.67610931396484, -21.65484619140625, 216.06484985351562, 12.544036865234375, 191.19680786132812, 33.676849365234375, 185.6986846923828, 275.1335144042969, 129.62240600585938, 19.101852416992188, 138.86676025390625, 152.62088012695312, 166.93089294433594, 187.88829040527344, 96.89401245117188, 223.5130157470703, 28.537315368652344, 41.514732360839844, 84.11872100830078, 188.57015991210938, 246.53955078125, 33.3221435546875, -3.9653854370117188, 252.30923461914062, 67.8970718383789, 194.72891235351562, 116.95547485351562, 205.07398986816406, 266.4804382324219, 237.286865234375, -159.29400634765625, 139.76287841796875, 86.76484680175781, 146.79586791992188, 169.85748291015625, 13.982105255126953, 106.2046127319336, -17.284278869628906, -70.77438354492188, 196.86471557617188, 72.78855895996094, 310.5143127441406, 43.325958251953125, 43.674903869628906, 21.474639892578125, 24.321441650390625, 158.78936767578125, 71.63877868652344, 55.190765380859375, 17.01256561279297, 241.27732849121094, 232.57431030273438, -39.79331970214844, -15.70523452758789, 99.67411804199219, 105.35374450683594, 27.407730102539062, -9.40054702758789, -46.94352722167969, 37.62236022949219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000466.npy"}
{"epoch": 0.684287812041116, "step": 467, "batch_size": 64, "mean": 86.26240539550781, "std": 113.04320526123047, "min": -156.86575317382812, "p10": -56.5336627960205, "median": 92.39651870727539, "p90": 201.23625793457032, "max": 358.61407470703125, "pos_frac": 0.78125, "sample": [55.48546600341797, 200.70046997070312, 201.46588134765625, 226.6990966796875, 11.786529541015625, -133.33143615722656, 229.45022583007812, 36.443206787109375, 135.06753540039062, -5.994377136230469, 153.46951293945312, 140.81637573242188, 325.5880126953125, 26.784427642822266, 12.253669738769531, 187.487060546875, -17.826343536376953, 62.09245300292969, 358.61407470703125, 99.9263916015625, 170.60302734375, 175.7147674560547, 188.17703247070312, 27.80260467529297, 62.65101623535156, 134.2365264892578, -135.41404724121094, -9.0250244140625, 179.2875518798828, 213.3212890625, 132.9751434326172, -48.1348991394043, 142.2775421142578, 71.88949584960938, 130.98812866210938, 96.9964599609375, 179.3857421875, 177.5574188232422, -156.86575317382812, 104.94038391113281, 78.2969970703125, -123.85319519042969, 196.99761962890625, -11.064056396484375, 191.7572021484375, 12.156126022338867, 17.442031860351562, -149.73216247558594, 25.04486083984375, 174.7379150390625, 89.54823303222656, -11.706619262695312, 248.3719940185547, 11.819236755371094, -60.13313293457031, 198.12081909179688, 164.49276733398438, 191.1421661376953, 92.44184112548828, 92.3511962890625, -76.93213653564453, 24.70465087890625, -43.57171630859375, 42.01861572265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000467.npy"}
{"epoch": 0.6857562408223201, "step": 468, "batch_size": 64, "mean": 76.4587631225586, "std": 109.4407958984375, "min": -175.48516845703125, "p10": -32.70538864135742, "median": 58.45243835449219, "p90": 230.14803466796877, "max": 369.5903625488281, "pos_frac": 0.71875, "sample": [-18.279998779296875, 1.2240219116210938, 143.0143585205078, 81.5614242553711, 224.79287719726562, 133.0008087158203, 252.58261108398438, -19.952163696289062, 39.06749725341797, 29.430564880371094, 189.6547393798828, -43.524627685546875, 116.50872802734375, -10.647747039794922, -40.77243423461914, 4.8024444580078125, 60.078125, 47.962608337402344, -10.458328247070312, -29.3104248046875, -8.465476989746094, 13.006608963012695, -73.85165405273438, 50.9744873046875, 0.9564208984375, 226.2659912109375, 174.78953552246094, 158.80072021484375, 108.46407318115234, -78.952880859375, -6.577262878417969, 7.90777587890625, 170.11746215820312, -110.17985534667969, 322.23675537109375, 257.72808837890625, 186.42556762695312, -2.026611328125, 95.29583740234375, 118.32232666015625, 193.54100036621094, 20.89604949951172, 15.8284912109375, 231.811767578125, -7.3832550048828125, 73.64427947998047, -33.179290771484375, 56.826751708984375, 99.36985778808594, 149.4661865234375, -31.59961700439453, 267.2737121582031, 3.0337371826171875, 64.15298461914062, 73.8111343383789, 103.94747161865234, 369.5903625488281, 258.2796936035156, 163.53875732421875, 154.08709716796875, 65.20501708984375, -0.16299057006835938, -175.48516845703125, 14.89398193359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000468.npy"}
{"epoch": 0.6872246696035242, "step": 469, "batch_size": 64, "mean": 94.6535873413086, "std": 105.42642974853516, "min": -193.43734741210938, "p10": -16.723590087890617, "median": 86.79598617553711, "p90": 223.81024169921875, "max": 335.53814697265625, "pos_frac": 0.828125, "sample": [142.071044921875, 235.48065185546875, 44.61035919189453, 69.65878295898438, 232.9893798828125, 89.71620178222656, 319.5328369140625, 5.830802917480469, 9.2908935546875, -9.440048217773438, 149.871337890625, 120.59170532226562, -52.169029235839844, -29.751998901367188, 274.9555358886719, 62.68072509765625, 8.93548583984375, 335.53814697265625, 88.3275146484375, 191.05349731445312, 208.4076690673828, 181.62384033203125, 163.87718200683594, 107.37791442871094, 89.3311767578125, 197.19302368164062, 72.68706512451172, 58.737335205078125, 137.25193786621094, -3.557098388671875, 25.557884216308594, 103.15036010742188, 213.56610107421875, 8.677947998046875, 85.26445770263672, -70.27688598632812, 45.85013198852539, 55.488487243652344, 26.072647094726562, 81.91201782226562, 97.42194366455078, 40.07164001464844, 135.34922790527344, 47.41864013671875, 62.45579528808594, -1.3712387084960938, -193.43734741210938, 220.3944091796875, 158.63636779785156, -9.105579376220703, -19.845108032226562, 4.6376953125, -116.96249389648438, 225.274169921875, 219.60012817382812, 250.0685577392578, -94.5174560546875, 220.22650146484375, 24.58710479736328, 71.833251953125, 132.64271545410156, 169.31387329101562, 194.5567626953125, 140.6129913330078], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000469.npy"}
{"epoch": 0.6886930983847284, "step": 470, "batch_size": 64, "mean": 86.77494812011719, "std": 90.8752670288086, "min": -133.34664916992188, "p10": -5.6798627853393535, "median": 74.60110473632812, "p90": 182.9087875366211, "max": 330.3047790527344, "pos_frac": 0.875, "sample": [157.53717041015625, 59.576515197753906, 174.76351928710938, -63.279884338378906, 160.6127471923828, 2.6485137939453125, 115.92302703857422, 144.3886260986328, 27.599445343017578, 75.9607162475586, 97.27680969238281, 128.6548309326172, 179.58888244628906, 40.80546569824219, 116.56375885009766, -133.34664916992188, -3.9761295318603516, 21.665252685546875, 4.771293640136719, 9.828895568847656, -28.855438232421875, 43.90148162841797, 166.5166473388672, -77.24296569824219, 101.28092956542969, 67.14057159423828, 10.734848022460938, 137.62298583984375, 125.281494140625, 12.296573638916016, 34.63239288330078, 15.942548751831055, 330.3047790527344, 28.658966064453125, -29.115528106689453, 125.69607543945312, 29.251712799072266, 240.10226440429688, 130.3692626953125, 100.17456817626953, 73.24149322509766, 45.292816162109375, 159.04391479492188, 175.58006286621094, 66.9193115234375, 259.1239318847656, 140.89755249023438, 163.746337890625, 43.778968811035156, 267.7245788574219, 65.77383422851562, 0.6424236297607422, 46.166473388671875, 101.6973648071289, 253.18507385253906, 122.38217163085938, 29.860309600830078, 10.8984375, 106.45211791992188, -6.4100341796875, 256.8083190917969, 184.33160400390625, 152.8021240234375, -48.599632263183594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000470.npy"}
{"epoch": 0.6901615271659325, "step": 471, "batch_size": 64, "mean": 84.16635131835938, "std": 89.43388366699219, "min": -131.0243377685547, "p10": -38.317635154724115, "median": 75.13279724121094, "p90": 208.78436431884768, "max": 337.9234924316406, "pos_frac": 0.859375, "sample": [39.21756362915039, 79.8113784790039, 64.09871673583984, 188.94229125976562, 41.99467468261719, 218.7977752685547, 97.61807250976562, 205.08470153808594, 62.312835693359375, 57.24749755859375, 29.050247192382812, 20.67633056640625, 177.12313842773438, -91.08741760253906, 103.29798889160156, 140.77635192871094, 49.06684112548828, -31.07132911682129, 83.45716094970703, 69.93548583984375, 337.9234924316406, 45.6436767578125, 12.446235656738281, 140.37442016601562, 12.36029052734375, -41.427955627441406, -63.12126159667969, 162.1584014892578, 113.07453155517578, 229.49107360839844, 58.52199935913086, 142.08123779296875, 62.5257453918457, 109.0003890991211, 69.63455200195312, 93.50616455078125, 76.02716064453125, -27.766067504882812, 2.8082427978515625, 95.28872680664062, 189.77215576171875, 70.21034240722656, 82.46369934082031, -131.0243377685547, 127.47286987304688, 177.69247436523438, 46.445770263671875, -52.27083206176758, 73.92901611328125, 75.12144470214844, 210.36993408203125, 36.084373474121094, -90.28099060058594, 151.16986083984375, 68.00157165527344, 133.0042724609375, -41.423194885253906, 19.73949432373047, 213.50262451171875, 89.64968872070312, 218.91571044921875, 183.03875732421875, 75.14414978027344, 223.01651000976562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000471.npy"}
{"epoch": 0.6916299559471366, "step": 472, "batch_size": 64, "mean": 102.69634246826172, "std": 92.96110534667969, "min": -72.15528869628906, "p10": -7.802455902099596, "median": 84.80590438842773, "p90": 201.58963012695312, "max": 422.37054443359375, "pos_frac": 0.890625, "sample": [-28.608810424804688, -26.850379943847656, 71.9729232788086, 86.26876068115234, -13.40753173828125, 16.613037109375, 39.6595458984375, 59.1910400390625, 60.37853240966797, 39.971126556396484, 69.13870239257812, 10.358352661132812, 81.5518798828125, 149.08018493652344, 30.2603759765625, 104.16841125488281, 112.49169921875, 135.7924346923828, -72.15528869628906, 10.7899169921875, 317.9989013671875, 202.7664031982422, 148.51104736328125, 82.25772094726562, 5.276054382324219, 43.57415771484375, 150.21185302734375, 52.58960723876953, -21.8555908203125, 221.59625244140625, 26.318603515625, 175.8987579345703, 193.6370086669922, 189.6759490966797, 422.37054443359375, 164.83096313476562, 34.36540603637695, 179.38461303710938, 198.8438262939453, 276.9005126953125, 132.37437438964844, 248.82559204101562, 47.57994079589844, 60.57684326171875, 70.750244140625, 172.9148406982422, 265.35797119140625, 170.67935180664062, 110.71257019042969, 71.69660949707031, 153.3262939453125, 152.46896362304688, -43.04444885253906, 123.8609619140625, 151.29180908203125, 176.59848022460938, 96.76492309570312, 83.34304809570312, 23.667396545410156, 121.22219848632812, 20.115520477294922, 46.8162841796875, -36.45098876953125, 149.29925537109375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000472.npy"}
{"epoch": 0.6930983847283406, "step": 473, "batch_size": 64, "mean": 64.00907897949219, "std": 105.5010757446289, "min": -128.31185913085938, "p10": -68.55699920654297, "median": 51.827144622802734, "p90": 184.89707336425784, "max": 384.5870361328125, "pos_frac": 0.703125, "sample": [-23.735107421875, 19.652122497558594, 224.36932373046875, -83.15961456298828, -69.3955078125, 166.6824951171875, 70.61335754394531, -88.66279602050781, -3.54205322265625, 51.228214263916016, 294.1576232910156, 49.98199462890625, -43.747581481933594, -98.60917663574219, 40.72453308105469, 88.25802612304688, 28.8623046875, -36.196048736572266, 166.6981201171875, 51.23682403564453, -42.48748016357422, 73.42071533203125, 188.44317626953125, 13.181968688964844, 106.49349975585938, 43.507789611816406, 137.44512939453125, -43.793785095214844, 62.831947326660156, -71.3020248413086, -17.43781280517578, -128.31185913085938, -66.60047912597656, 98.60685729980469, 12.594440460205078, -55.650352478027344, 384.5870361328125, 176.62283325195312, 50.94507598876953, 148.40362548828125, 39.737998962402344, 83.82355499267578, 113.72895812988281, 277.4917907714844, 167.44984436035156, 77.85401916503906, 52.41746520996094, 100.4996337890625, -24.60234832763672, 249.11407470703125, 140.8302001953125, 29.501190185546875, -33.4375, -115.30816650390625, 121.23136138916016, 96.61381530761719, 250.2298583984375, 88.03073120117188, 151.09642028808594, 24.645118713378906, -4.856758117675781, 110.5976333618164, 69.45986938476562, 153.51470947265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000473.npy"}
{"epoch": 0.6945668135095447, "step": 474, "batch_size": 64, "mean": 63.23215103149414, "std": 104.81983184814453, "min": -177.21484375, "p10": -70.70196075439453, "median": 75.69263458251953, "p90": 200.05613098144534, "max": 285.64422607421875, "pos_frac": 0.734375, "sample": [23.517539978027344, -10.381027221679688, 168.58056640625, 45.19837188720703, 43.00334167480469, -70.0289306640625, 76.3548583984375, 8.074140548706055, 155.6043701171875, 229.67117309570312, 221.66073608398438, 285.64422607421875, 11.774168014526367, 156.15597534179688, -177.21484375, 80.33338928222656, 5.765972137451172, -0.8246383666992188, -62.4088134765625, 19.264707565307617, 133.79832458496094, 100.7528076171875, 162.4539337158203, 63.11745834350586, 3.858551025390625, 108.32836151123047, 107.62283325195312, 185.879638671875, 169.87884521484375, -135.66419982910156, -73.7907485961914, -115.99458312988281, 132.7604217529297, -35.53224182128906, 23.346927642822266, 6.8083038330078125, 75.03041076660156, 13.251426696777344, -132.69442749023438, -29.482418060302734, 203.78277587890625, 43.983062744140625, 28.464881896972656, 105.25546264648438, -64.93684387207031, -70.99040222167969, 273.9786682128906, 156.11260986328125, -78.17813873291016, -47.71635437011719, -34.643341064453125, 217.18978881835938, 95.48973083496094, 81.76876068115234, 105.78541564941406, 151.2826690673828, 136.93858337402344, 96.17764282226562, 191.36062622070312, -45.84269714355469, 99.59219360351562, 204.31712341308594, 96.49296569824219, 127.71752166748047], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000474.npy"}
{"epoch": 0.6960352422907489, "step": 475, "batch_size": 64, "mean": 96.56515502929688, "std": 101.21781921386719, "min": -74.57955169677734, "p10": -23.509149169921873, "median": 82.42598724365234, "p90": 230.5094100952149, "max": 347.4625244140625, "pos_frac": 0.78125, "sample": [35.69915771484375, -67.13050842285156, 235.32659912109375, 27.362018585205078, -40.90887451171875, 220.15695190429688, 170.1805419921875, -66.11226654052734, 203.12847900390625, 279.87823486328125, 67.35074615478516, -1.2748947143554688, 89.2484130859375, -26.810012817382812, 72.17903137207031, 45.08519744873047, 81.93357849121094, 182.57199096679688, -8.06585693359375, -18.289520263671875, 34.15597152709961, 69.077880859375, 32.09046936035156, 180.49208068847656, -6.069141387939453, 159.48919677734375, 153.25509643554688, -0.9706497192382812, 50.07251739501953, -39.4930419921875, 19.263935089111328, -20.62066650390625, 0.00390625, 284.1118469238281, 74.50505828857422, 45.058998107910156, 82.91839599609375, 141.06069946289062, 155.78668212890625, 265.1413879394531, 143.12464904785156, 96.86182403564453, 221.67405700683594, -74.57955169677734, 90.33711242675781, 101.71232604980469, 27.42922592163086, 134.7807159423828, 189.23004150390625, 210.9033203125, -24.7470703125, 51.99163818359375, 118.06655883789062, 113.50810241699219, 218.6837158203125, 10.872344970703125, 126.71331024169922, 347.4625244140625, 178.45709228515625, 291.87860107421875, 42.47315979003906, 180.381591796875, -12.180754661560059, 234.29598999023438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000475.npy"}
{"epoch": 0.697503671071953, "step": 476, "batch_size": 64, "mean": 84.30451965332031, "std": 103.40252685546875, "min": -110.861328125, "p10": -37.618902587890624, "median": 62.372947692871094, "p90": 208.6791336059571, "max": 354.6683044433594, "pos_frac": 0.75, "sample": [24.8072509765625, -65.67942810058594, 4.349925994873047, -33.327247619628906, 215.10092163085938, 54.416297912597656, 354.6683044433594, 176.7246856689453, 8.112178802490234, -48.19355773925781, 144.4341278076172, 156.12501525878906, 31.725570678710938, 270.9356384277344, 106.17417907714844, 167.99559020996094, 27.874252319335938, 3.7496185302734375, 168.55003356933594, 47.865806579589844, 171.66151428222656, 171.07077026367188, -10.783645629882812, 223.23782348632812, 170.23423767089844, -12.509117126464844, -26.563762664794922, -45.96599578857422, -6.622932434082031, -13.297935485839844, 18.114837646484375, -44.4344596862793, -27.539630889892578, 48.0212287902832, 65.27780151367188, 122.94677734375, -39.599815368652344, -39.45818328857422, 34.239585876464844, 80.95234680175781, 66.46270751953125, 32.045509338378906, 116.27596282958984, -2.4709243774414062, -16.738500595092773, 36.20154571533203, 121.54361724853516, 282.6587829589844, 327.0323791503906, 277.3016052246094, 187.25552368164062, 193.69496154785156, 59.46809387207031, 108.86373901367188, 136.08950805664062, 31.475448608398438, 170.38092041015625, 188.95242309570312, 153.06332397460938, -110.861328125, 88.76315307617188, 176.32130432128906, 106.25971984863281, 10.059127807617188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000476.npy"}
{"epoch": 0.6989720998531571, "step": 477, "batch_size": 64, "mean": 88.41944885253906, "std": 104.98445129394531, "min": -202.75962829589844, "p10": -34.935868453979474, "median": 85.41260528564453, "p90": 224.2177978515625, "max": 295.856689453125, "pos_frac": 0.859375, "sample": [-42.38870620727539, 106.80680084228516, 87.21434020996094, -121.48670959472656, 138.30250549316406, 196.5429229736328, 55.141632080078125, 222.1431884765625, 30.657978057861328, 194.66416931152344, 101.48551940917969, 102.02706909179688, 222.18679809570312, 225.08822631835938, 32.66267395019531, -15.356082916259766, 5.264198303222656, 228.01133728027344, 295.856689453125, 152.416015625, 177.12745666503906, 152.32351684570312, 140.63832092285156, 61.00328826904297, 83.61087036132812, 177.60690307617188, 2.2819175720214844, 146.51754760742188, 115.23016357421875, 9.043022155761719, -202.75962829589844, 233.50430297851562, -83.40314483642578, -153.90713500976562, 274.4285888671875, 120.78440856933594, 74.68679809570312, 125.08368682861328, 79.14720153808594, 40.32032775878906, 181.9643096923828, 5.832252502441406, 40.09867858886719, 109.69164276123047, -54.46067810058594, 241.41929626464844, 49.67424774169922, 174.13877868652344, -90.48570251464844, 63.684268951416016, 57.479034423828125, 17.108516693115234, 6.432044982910156, 214.39218139648438, 48.72276306152344, 30.912948608398438, 185.25653076171875, 19.308120727539062, 44.402740478515625, 157.99267578125, -17.545913696289062, 30.88050079345703, 242.7712860107422, 108.66484832763672], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000477.npy"}
{"epoch": 0.7004405286343612, "step": 478, "batch_size": 64, "mean": 91.06809997558594, "std": 100.94072723388672, "min": -204.26039123535156, "p10": -7.3258239746093725, "median": 86.52927780151367, "p90": 233.79885864257815, "max": 312.108642578125, "pos_frac": 0.84375, "sample": [13.892868041992188, 127.58457946777344, 68.4986801147461, -4.825569152832031, -4.808746337890625, 121.97016906738281, -39.73553466796875, 62.658348083496094, 56.245361328125, 1.6458549499511719, -204.26039123535156, 78.71273803710938, 18.59537124633789, -21.239227294921875, 199.2444305419922, 270.89501953125, 36.245750427246094, 312.108642578125, -136.78274536132812, -3.4201431274414062, 129.82455444335938, 18.87078857421875, 80.70406341552734, 167.25299072265625, 13.240913391113281, 181.63609313964844, 192.88604736328125, 160.39947509765625, 14.729827880859375, 123.8076171875, 157.5426025390625, 236.3016815185547, 127.99037170410156, 74.7303237915039, 41.962547302246094, 86.8773422241211, 206.4287567138672, 156.31103515625, 63.297584533691406, 152.01150512695312, 253.29481506347656, 183.14144897460938, -55.01385498046875, -8.397361755371094, 86.18121337890625, 23.32300567626953, 92.67044067382812, 286.742919921875, 243.35964965820312, 22.088516235351562, 94.8097152709961, 87.19769287109375, 227.9589385986328, 256.2730712890625, -47.5423583984375, 90.64030456542969, 96.64016723632812, 41.34794616699219, 88.56061553955078, 8.456832885742188, 83.06646728515625, 96.99629211425781, 223.61154174804688, 12.91864013671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000478.npy"}
{"epoch": 0.7019089574155654, "step": 479, "batch_size": 64, "mean": 84.7488784790039, "std": 93.44571685791016, "min": -174.64695739746094, "p10": -40.01815567016602, "median": 93.4957046508789, "p90": 198.46016540527347, "max": 264.7056884765625, "pos_frac": 0.796875, "sample": [6.1445770263671875, 118.79501342773438, 229.92184448242188, 119.24258422851562, 188.9478759765625, 142.38636779785156, 39.016357421875, -4.4822235107421875, 176.66612243652344, 35.271484375, 189.82208251953125, 96.60639953613281, 105.1658706665039, 165.40231323242188, 125.54325866699219, -63.94482421875, 84.35934448242188, -40.19425964355469, 167.76071166992188, 42.25396728515625, -39.60724639892578, 167.75784301757812, 56.78050994873047, 50.913055419921875, 131.52442932128906, 208.5101776123047, -41.76422119140625, -19.6488037109375, 36.716339111328125, 105.17678833007812, 216.61444091796875, 121.00691223144531, 27.446731567382812, 157.67178344726562, 28.872817993164062, 181.20199584960938, 111.12442016601562, 11.822128295898438, 10.149429321289062, 138.87107849121094, 166.7197265625, 219.31362915039062, 264.7056884765625, 55.765625, -39.18699645996094, -96.834228515625, 133.23391723632812, -62.01460266113281, 113.77595520019531, 77.73296356201172, 73.04033660888672, 69.80992126464844, -174.64695739746094, -45.1383056640625, -8.765670776367188, 171.96998596191406, 202.16220092773438, 55.510414123535156, 142.52987670898438, 175.29086303710938, 13.641845703125, 254.75469970703125, -15.653114318847656, 90.385009765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000479.npy"}
{"epoch": 0.7033773861967695, "step": 480, "batch_size": 64, "mean": 71.2434310913086, "std": 99.04186248779297, "min": -131.54306030273438, "p10": -58.18346099853515, "median": 68.14989852905273, "p90": 203.63551025390626, "max": 265.93603515625, "pos_frac": 0.734375, "sample": [-14.554969787597656, 190.7247314453125, 175.0648193359375, 25.410160064697266, 84.61897277832031, 162.6241912841797, 194.9815673828125, 224.9625244140625, 28.634376525878906, 80.65355682373047, -131.54306030273438, 144.20834350585938, 39.04187774658203, -18.30432891845703, 30.28870391845703, -15.17108154296875, 78.72193908691406, 77.345703125, 98.03784942626953, 51.93467712402344, 154.67788696289062, 173.63633728027344, -98.40263366699219, 59.615447998046875, 38.99749755859375, 76.6843490600586, 243.8293914794922, 222.54541015625, 81.21726989746094, 10.230422973632812, 206.14663696289062, 241.2548065185547, 265.93603515625, 2.6234359741210938, -96.75663757324219, 167.8285369873047, 9.775691986083984, -100.665283203125, 39.858642578125, 22.30762481689453, 125.2371826171875, -26.015274047851562, -15.017921447753906, 142.62274169921875, -31.990219116210938, -38.45008087158203, 109.18775177001953, -60.1904296875, -78.14552307128906, 153.0498046875, -0.5578460693359375, -18.361522674560547, 55.44176483154297, 197.77621459960938, 49.55016326904297, 14.719709396362305, -65.09950256347656, 85.30326080322266, 222.4591827392578, 104.65888214111328, 169.11322021484375, 104.88790893554688, -53.50053405761719, 183.87921142578125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000480.npy"}
{"epoch": 0.7048458149779736, "step": 481, "batch_size": 64, "mean": 83.78054809570312, "std": 101.26884460449219, "min": -169.2752227783203, "p10": -28.145894622802725, "median": 75.33415603637695, "p90": 193.24683227539063, "max": 361.16455078125, "pos_frac": 0.828125, "sample": [204.27427673339844, -157.60198974609375, 121.56088256835938, -18.70269775390625, 33.33099365234375, 11.827316284179688, 39.042388916015625, 53.068302154541016, 25.796815872192383, 175.75567626953125, -19.318077087402344, 120.97117614746094, 76.31471252441406, 67.10072326660156, 74.35359954833984, -44.88309097290039, 31.891082763671875, 29.153106689453125, 225.36749267578125, 110.23772430419922, 118.42330932617188, 56.553611755371094, 171.72303771972656, 140.65957641601562, 174.8769989013672, 8.459220886230469, 33.63941955566406, 190.3328857421875, 41.37007141113281, 145.97232055664062, -7.105915069580078, 198.99374389648438, 95.57777404785156, 152.47384643554688, 70.35952758789062, 171.76873779296875, 41.223175048828125, 108.16618347167969, 185.57891845703125, 3.8200225830078125, -31.929244995117188, 93.89897155761719, 17.820724487304688, 284.722412109375, -148.67430114746094, -169.2752227783203, 194.49566650390625, 137.73777770996094, 361.16455078125, 46.08935546875, 60.47762680053711, 94.93765258789062, 180.12832641601562, 24.543842315673828, 5.560493469238281, -35.2672119140625, -83.31851196289062, 177.00634765625, 158.9066619873047, 187.7024688720703, 156.072509765625, 207.44691467285156, -1.4974422454833984, 180.79742431640625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000481.npy"}
{"epoch": 0.7063142437591777, "step": 482, "batch_size": 64, "mean": 84.26334381103516, "std": 96.0069351196289, "min": -202.40074157714844, "p10": -15.748939514160154, "median": 90.72955703735352, "p90": 210.11740112304688, "max": 264.82275390625, "pos_frac": 0.828125, "sample": [264.82275390625, 23.164031982421875, 210.6293182373047, -13.352203369140625, 208.9229278564453, 66.24440002441406, 34.55433654785156, 42.920066833496094, 108.65936279296875, -84.24388122558594, 110.6241455078125, 58.95267868041992, -8.311634063720703, 18.920486450195312, 125.99238586425781, 259.89691162109375, 167.8939208984375, 93.21383666992188, 145.21641540527344, 226.7755126953125, 29.70379638671875, 6.58612060546875, 20.48114776611328, 148.38870239257812, 55.37306213378906, 202.2169647216797, 25.455921173095703, 211.7101593017578, 91.52679443359375, 16.337696075439453, 89.93231964111328, 113.60595703125, 251.5222625732422, 176.35379028320312, -16.385894775390625, 18.326961517333984, 70.7198486328125, 35.5418701171875, 100.17506408691406, 132.0689697265625, 106.63217163085938, 85.51591491699219, 7.100282669067383, 34.49842834472656, 144.59503173828125, -73.15646362304688, -115.57933044433594, 143.17593383789062, 170.13980102539062, 180.1642303466797, -202.40074157714844, 173.22341918945312, -30.34527587890625, 148.58274841308594, -48.004302978515625, 105.67350769042969, 111.38336181640625, 243.57333374023438, 12.058517456054688, -14.262710571289062, -11.8592529296875, 205.71542358398438, 98.8900146484375, 76.40252685546875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000482.npy"}
{"epoch": 0.7077826725403817, "step": 483, "batch_size": 64, "mean": 87.9349365234375, "std": 95.08845520019531, "min": -179.26449584960938, "p10": -4.609275245666502, "median": 78.17227935791016, "p90": 213.28081970214845, "max": 357.93756103515625, "pos_frac": 0.859375, "sample": [-0.818359375, 138.96343994140625, 181.18408203125, 221.5652313232422, -134.9112548828125, 137.92666625976562, 157.47434997558594, 17.687591552734375, 35.409156799316406, 5.3330078125, 61.163818359375, 258.17510986328125, 59.93376922607422, 153.93972778320312, 3.4789695739746094, 188.35693359375, 157.84698486328125, 93.20349884033203, 163.3802490234375, 187.76895141601562, -31.082984924316406, -5.517988204956055, -15.591094970703125, 73.47715759277344, 64.37234497070312, -18.85931396484375, 98.50025939941406, 261.3013610839844, 164.65345764160156, 119.327392578125, -2.4889450073242188, 357.93756103515625, 38.77601623535156, 59.91850280761719, 93.50228118896484, 59.699867248535156, 82.86740112304688, 54.830406188964844, 243.16555786132812, 112.78153991699219, 72.13616943359375, 46.2635498046875, 215.98992919921875, 94.6678695678711, 206.95956420898438, 163.2454833984375, 33.89594268798828, 21.13213348388672, 59.7047119140625, 21.143508911132812, 46.92127990722656, 54.07624816894531, -118.0085220336914, 53.05158233642578, -179.26449584960938, 103.87908935546875, 124.4900894165039, 123.65077209472656, 220.12237548828125, 85.42958068847656, 17.570953369140625, 84.78538513183594, 158.18450927734375, 19.175384521484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000483.npy"}
{"epoch": 0.7092511013215859, "step": 484, "batch_size": 64, "mean": 95.28274536132812, "std": 105.42849731445312, "min": -203.8485870361328, "p10": -30.045261383056637, "median": 90.72758483886719, "p90": 224.47521972656253, "max": 310.57159423828125, "pos_frac": 0.828125, "sample": [-16.932754516601562, 189.4701690673828, 36.68794250488281, -25.295166015625, 70.8851318359375, 56.00586700439453, 25.191333770751953, 102.48384094238281, 124.75466918945312, 39.24004364013672, -6.469524383544922, 15.500858306884766, 227.07943725585938, 207.40423583984375, 194.8822021484375, 28.156497955322266, 76.40836334228516, -32.081016540527344, -78.71347045898438, 98.27200317382812, 167.45834350585938, 16.74197769165039, 200.58282470703125, 218.39871215820312, 285.04156494140625, -123.67710876464844, 175.13377380371094, 310.57159423828125, 10.129703521728516, 180.14010620117188, 140.94876098632812, -53.73305892944336, 198.75128173828125, 242.73434448242188, -34.12165832519531, 203.436279296875, 89.22402954101562, 107.630859375, 6.523719787597656, 128.41346740722656, 50.93533706665039, 158.30784606933594, 52.66773986816406, 56.2826042175293, 214.8868865966797, -58.762298583984375, 199.9595489501953, 35.760311126708984, 146.89959716796875, -203.8485870361328, 7.348361968994141, 106.44801330566406, 282.34698486328125, 87.54978942871094, 71.50862121582031, 86.81411743164062, 138.48422241210938, 109.08646392822266, 175.90884399414062, 21.385644912719727, 227.31146240234375, 92.23114013671875, -23.429534912109375, 258.75250244140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000484.npy"}
{"epoch": 0.71071953010279, "step": 485, "batch_size": 64, "mean": 107.2056884765625, "std": 99.01457977294922, "min": -76.98899841308594, "p10": -2.7068771362304593, "median": 100.05662155151367, "p90": 240.55406341552737, "max": 323.4678955078125, "pos_frac": 0.890625, "sample": [204.73831176757812, 101.15904235839844, 98.9542007446289, 61.38507080078125, 243.60580444335938, 192.3920135498047, 166.23716735839844, -63.705902099609375, 200.0184326171875, 114.73670196533203, 29.010520935058594, 251.57516479492188, 25.406951904296875, 102.92583465576172, -49.06697082519531, 213.8817138671875, 124.89804077148438, 8.3468017578125, 181.73788452148438, 123.9876708984375, 286.45477294921875, 294.7523193359375, 6.6475372314453125, 45.01510238647461, 233.43333435058594, 192.65228271484375, 29.09015655517578, 68.08770751953125, 139.38441467285156, 122.73263549804688, 191.59140014648438, 9.859817504882812, 33.219947814941406, 28.618209838867188, -76.98899841308594, 65.38604736328125, 232.60067749023438, 225.70716857910156, -53.86579895019531, 81.41766357421875, 201.03292846679688, 93.41470336914062, 303.58905029296875, 144.67724609375, -6.715911865234375, 33.3173828125, -20.982860565185547, 107.10145568847656, 109.37068176269531, -41.27149963378906, 31.001251220703125, 248.29248046875, 35.357872009277344, 120.82342529296875, 12.06048583984375, 202.88241577148438, 160.98280334472656, 98.68963623046875, 30.06588363647461, 14.921279907226562, 47.990638732910156, 27.19971466064453, 323.4678955078125, 95.87428283691406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000485.npy"}
{"epoch": 0.7121879588839941, "step": 486, "batch_size": 64, "mean": 94.40589904785156, "std": 105.55513763427734, "min": -175.66360473632812, "p10": -29.100224304199212, "median": 97.16824340820312, "p90": 219.7768981933594, "max": 276.6478271484375, "pos_frac": 0.78125, "sample": [275.21966552734375, 232.66812133789062, 54.48974609375, 115.86229705810547, 169.06419372558594, 0.8031768798828125, 191.48928833007812, 27.5711669921875, 73.6136703491211, 177.42965698242188, 203.00811767578125, 33.24372100830078, 171.93443298339844, -3.84539794921875, 91.17945861816406, 219.82168579101562, 150.8039093017578, -18.311279296875, 7.3026580810546875, 96.14109802246094, 162.590087890625, -69.61204528808594, 65.05419158935547, 69.82939147949219, -12.695995330810547, 83.69969940185547, -39.670021057128906, 160.69358825683594, 127.20201110839844, 187.69168090820312, 202.994140625, 224.66873168945312, 43.92848205566406, -32.43003845214844, 183.42388916015625, -63.362144470214844, -21.330657958984375, 118.0811767578125, 253.50823974609375, 216.54971313476562, 61.261871337890625, 173.06021118164062, 101.34716796875, -7.560589790344238, 270.57861328125, 211.8819122314453, 105.31546020507812, 215.61773681640625, -2.343475341796875, 192.4650115966797, 56.55162048339844, 115.79974365234375, 6.648164749145508, 98.19538879394531, 12.067840576171875, 13.157587051391602, 172.95225524902344, -13.72381591796875, -175.66360473632812, 7.487331390380859, 219.67239379882812, -102.50291442871094, -97.23970794677734, 276.6478271484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000486.npy"}
{"epoch": 0.7136563876651982, "step": 487, "batch_size": 64, "mean": 86.7838134765625, "std": 96.79026794433594, "min": -125.95110321044922, "p10": -22.004640960693358, "median": 79.66692733764648, "p90": 222.46466522216804, "max": 307.4327392578125, "pos_frac": 0.84375, "sample": [83.781982421875, 288.7701721191406, 9.504974365234375, 14.632339477539062, 100.46534729003906, 80.76190948486328, 94.56159973144531, 40.98857879638672, 307.4327392578125, -31.669387817382812, 83.24554443359375, 105.69329833984375, 145.41835021972656, -22.698219299316406, 151.40744018554688, 297.76129150390625, 184.95925903320312, 202.03419494628906, 103.00479888916016, 88.41275024414062, 143.4078369140625, 231.2205810546875, -100.83362579345703, 149.35208129882812, 74.49158477783203, 171.7938232421875, 7.005943298339844, 9.692581176757812, 34.05207443237305, 35.24756622314453, 64.32034301757812, -5.237871170043945, 167.833251953125, 95.45127868652344, 37.48570251464844, 64.11967468261719, 169.6224365234375, -125.95110321044922, 258.8555908203125, 43.43019104003906, 29.381885528564453, -22.832061767578125, 38.92162322998047, 15.297317504882812, 42.7109375, 201.0803985595703, 18.416213989257812, -20.38629150390625, 72.75957489013672, 176.75901794433594, -109.64227294921875, 263.49029541015625, 91.18031311035156, 65.58024597167969, -5.042051315307617, -57.39349365234375, 80.8050537109375, 245.07412719726562, 156.63125610351562, 47.16334533691406, 78.57194519042969, 89.15238189697266, 28.364288330078125, 174.29156494140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000487.npy"}
{"epoch": 0.7151248164464024, "step": 488, "batch_size": 64, "mean": 91.3109130859375, "std": 86.50662994384766, "min": -134.05001831054688, "p10": -22.138328361511228, "median": 93.94580841064453, "p90": 190.96070251464843, "max": 328.8262939453125, "pos_frac": 0.84375, "sample": [64.52735900878906, 43.55870056152344, 50.69432830810547, 207.23214721679688, 287.31146240234375, -49.15509796142578, 118.97378540039062, 4.0594329833984375, -27.779495239257812, 125.35269927978516, 124.34255981445312, 7.2801055908203125, 46.486785888671875, 158.41632080078125, -2.2237548828125, 47.700435638427734, 109.21084594726562, -20.0853214263916, -4.2978057861328125, -134.05001831054688, 103.57716369628906, 34.45250701904297, 216.26577758789062, 62.60259246826172, 75.83158874511719, 137.65008544921875, 135.62393188476562, 144.9927520751953, 128.65185546875, 159.74757385253906, 40.62883758544922, 112.54430389404297, 100.25390625, 186.9178466796875, 205.35443115234375, 164.63259887695312, 328.8262939453125, 126.5032958984375, 52.08962631225586, 68.72572326660156, 50.989540100097656, 159.58444213867188, 153.59146118164062, 160.95208740234375, 189.3046112060547, -37.576316833496094, 76.37889862060547, 136.656005859375, -26.5684814453125, -23.0181884765625, 137.579833984375, 192.04904174804688, 42.44309997558594, 176.6597900390625, 87.63771057128906, -63.483428955078125, 19.92074203491211, 191.6704559326172, 24.35291862487793, 30.4156494140625, 78.11050415039062, 13.62139892578125, 144.1845703125, 185.01358032226562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000488.npy"}
{"epoch": 0.7165932452276065, "step": 489, "batch_size": 64, "mean": 85.16073608398438, "std": 98.79745483398438, "min": -110.07060241699219, "p10": -30.921858406066878, "median": 91.8936996459961, "p90": 213.29642028808598, "max": 302.8376159667969, "pos_frac": 0.78125, "sample": [109.10726928710938, 98.23129272460938, 42.72740936279297, -4.0590057373046875, 98.73583221435547, 24.4373779296875, 139.48582458496094, 98.23426055908203, 31.162620544433594, 125.25020599365234, 134.69497680664062, -76.53125, -80.71473693847656, 93.4048080444336, 107.02083587646484, 6.3749847412109375, 221.72409057617188, 193.58958435058594, -110.07060241699219, 218.19259643554688, 66.45716094970703, 11.634668350219727, -1.2862930297851562, 48.898284912109375, 67.95492553710938, 7.017326354980469, 197.10235595703125, 5.217277526855469, 113.24553680419922, -55.77288818359375, 25.685216903686523, 92.32853698730469, -14.399038314819336, 37.62889862060547, 287.20941162109375, 57.10540771484375, -9.122425079345703, 1.7527313232421875, 44.62776184082031, -10.897758483886719, 169.04196166992188, -76.95270538330078, 302.4720458984375, 15.783470153808594, 171.71600341796875, 152.64572143554688, 201.87200927734375, 225.57540893554688, 257.5599365234375, -9.618682861328125, 302.8376159667969, 175.03085327148438, 145.20162963867188, 181.17547607421875, -38.00306701660156, 33.790130615234375, 91.4588623046875, 167.429443359375, 178.85653686523438, 103.25194549560547, -10.225311279296875, 172.35696411132812, 141.41934204101562, -47.77415466308594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000489.npy"}
{"epoch": 0.7180616740088106, "step": 490, "batch_size": 64, "mean": 77.19557189941406, "std": 126.21550750732422, "min": -209.1728973388672, "p10": -80.99037170410155, "median": 66.96334838867188, "p90": 250.14544525146485, "max": 355.31707763671875, "pos_frac": 0.71875, "sample": [172.056884765625, -209.1728973388672, 139.00881958007812, -22.428260803222656, 104.67068481445312, 14.635778427124023, -46.199668884277344, -8.688774108886719, 258.6459045410156, 12.478824615478516, -163.07015991210938, 204.5814208984375, 128.25347900390625, 250.92811584472656, -103.51011657714844, -50.25834655761719, -49.35853576660156, 190.220458984375, -86.3834228515625, -10.639289855957031, -0.6335983276367188, 14.349700927734375, -188.56893920898438, 18.767440795898438, -88.0744400024414, 154.19229125976562, 35.74840545654297, -33.92131805419922, 65.79097747802734, 353.81658935546875, 83.62715148925781, 355.31707763671875, 67.43132019042969, 182.19586181640625, 212.22579956054688, 129.60421752929688, 126.16618347167969, 24.173622131347656, 143.82199096679688, -31.556541442871094, 169.628662109375, 81.89327239990234, 196.766845703125, 234.0294952392578, 66.49537658691406, 258.9737548828125, -59.68025588989258, 157.0863037109375, -68.40658569335938, 125.51361083984375, 104.32365417480469, -127.28733825683594, 272.52325439453125, 123.48019409179688, 59.80078125, 260.8546142578125, 173.03326416015625, 54.101646423339844, 20.70795440673828, 248.3192138671875, 63.986793518066406, 95.90640258789062, 58.57666778564453, 19.64488983154297], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000490.npy"}
{"epoch": 0.7195301027900147, "step": 491, "batch_size": 64, "mean": 74.9074935913086, "std": 99.40265655517578, "min": -205.21263122558594, "p10": -45.94740676879882, "median": 69.92913818359375, "p90": 205.89343566894533, "max": 287.2452392578125, "pos_frac": 0.78125, "sample": [48.762176513671875, -20.21804428100586, 101.59187316894531, 191.6602783203125, 93.85796356201172, 49.89995574951172, 147.01284790039062, 9.03597640991211, 45.04017639160156, 105.94964599609375, 78.36772918701172, 69.22689819335938, 88.36476135253906, -94.22119903564453, 184.746826171875, 210.26673889160156, 98.67576599121094, 201.37911987304688, 88.92115783691406, -39.98136901855469, 32.74657440185547, 41.584312438964844, 251.018798828125, 9.907440185546875, -58.816322326660156, 101.69463348388672, 206.40542602539062, -2.203004837036133, 204.69879150390625, 44.580848693847656, 180.97216796875, 171.16400146484375, -41.228660583496094, 95.45500946044922, -47.9697265625, 236.9404296875, -9.291328430175781, 241.05831909179688, -12.017337799072266, 147.11326599121094, 63.04058837890625, -40.01640319824219, 287.2452392578125, -103.33450317382812, 56.26319885253906, 50.679283142089844, 76.20989990234375, 147.72332763671875, 202.28602600097656, 223.18997192382812, 0.07900619506835938, 60.14234924316406, 22.059005737304688, 11.569969177246094, 92.1476058959961, -92.15232849121094, 126.50220489501953, 109.74417114257812, 62.978363037109375, 36.58168029785156, 151.61126708984375, -68.04193115234375, 70.63137817382812, -205.21263122558594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000491.npy"}
{"epoch": 0.7209985315712188, "step": 492, "batch_size": 64, "mean": 59.10065460205078, "std": 119.21634674072266, "min": -284.29071044921875, "p10": -98.22639541625976, "median": 57.05455780029297, "p90": 216.92287292480472, "max": 326.9375305175781, "pos_frac": 0.703125, "sample": [43.37195587158203, 154.63592529296875, 72.66346740722656, -90.08013153076172, 135.27272033691406, 68.79045104980469, -31.97735595703125, 190.37411499023438, -89.82691955566406, -0.2255706787109375, -126.09086608886719, 257.53704833984375, 38.54270935058594, 177.7337646484375, 64.84439086914062, 208.63833618164062, 10.331153869628906, 202.58551025390625, 108.71661376953125, 227.5330352783203, -101.7176513671875, 97.91715240478516, 23.628402709960938, 93.74697875976562, 164.995361328125, 29.535804748535156, 61.158851623535156, -139.98355102539062, 18.095565795898438, -13.510990142822266, -13.8621826171875, -22.869766235351562, 14.926652908325195, -55.30189514160156, 19.001535415649414, 160.6182861328125, 52.95026397705078, -40.68988800048828, -284.29071044921875, 117.14776611328125, 326.9375305175781, 124.47726440429688, 104.17510986328125, 5.185630798339844, 12.967094421386719, 289.9693908691406, 125.9063720703125, 106.38513946533203, 113.19723510742188, 231.34298706054688, 94.1650390625, -2.5786209106445312, 179.40902709960938, -143.724609375, 98.9913330078125, 220.473388671875, -14.233383178710938, 25.669233322143555, -105.83001708984375, 120.15036010742188, -169.5692901611328, 246.58883666992188, 2.7953262329101562, -15.27484130859375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000492.npy"}
{"epoch": 0.7224669603524229, "step": 493, "batch_size": 64, "mean": 78.82870483398438, "std": 90.69609069824219, "min": -136.32595825195312, "p10": -32.3677978515625, "median": 90.0380630493164, "p90": 190.03042449951172, "max": 270.5400695800781, "pos_frac": 0.8125, "sample": [47.246768951416016, 75.63003540039062, 134.86227416992188, 36.51020812988281, 105.58734130859375, 169.4602508544922, 258.83709716796875, 170.02679443359375, -38.290565490722656, -108.209716796875, 148.4175567626953, 97.13487243652344, 135.8400421142578, 53.29466247558594, 39.524444580078125, 75.03983306884766, 104.32186889648438, 94.96311950683594, -115.6825942993164, 21.09755516052246, 36.313072204589844, 85.11300659179688, 188.4796600341797, -4.675468444824219, 115.16206359863281, 99.99150848388672, 151.50668334960938, -136.32595825195312, 162.16195678710938, -29.437557220458984, 80.16072082519531, -33.62361526489258, 191.47203063964844, 57.052879333496094, 223.16015625, -27.118885040283203, 244.62649536132812, 104.73963928222656, 162.07875061035156, -28.337432861328125, 39.35163879394531, 10.33428955078125, 270.5400695800781, 57.130313873291016, 109.73101806640625, 102.71235656738281, 13.396905899047852, -12.354385375976562, 250.11395263671875, 117.18864440917969, 72.3482894897461, 134.31500244140625, 125.74376678466797, 190.69503784179688, -78.40386199951172, -71.99629211425781, 119.00072479248047, 10.609579086303711, 25.194259643554688, 114.74024963378906, 107.47981262207031, 128.22128295898438, 25.02117919921875, 35.81134033203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000493.npy"}
{"epoch": 0.723935389133627, "step": 494, "batch_size": 64, "mean": 103.59664154052734, "std": 101.81532287597656, "min": -158.24392700195312, "p10": -15.520512771606443, "median": 95.8351936340332, "p90": 236.78390197753913, "max": 377.5943603515625, "pos_frac": 0.875, "sample": [-16.246639251708984, 49.25933074951172, 135.16358947753906, 243.4383544921875, 377.5943603515625, 173.05032348632812, -23.69427490234375, 282.6113586425781, 200.1404266357422, 43.95756912231445, 95.50184631347656, 84.26445007324219, -28.489452362060547, 199.02398681640625, 5.20379638671875, 189.71728515625, 114.61125183105469, -102.10614013671875, 68.24256134033203, 249.6673126220703, 135.2080841064453, 106.85501098632812, 159.2570343017578, 254.9142608642578, 22.687179565429688, 39.1219482421875, 81.82366943359375, 242.51608276367188, 197.94451904296875, 94.11817932128906, -88.73957824707031, 29.694313049316406, 65.8010482788086, 211.8355712890625, 209.270263671875, 86.22425842285156, 184.25338745117188, 14.006248474121094, 93.33026123046875, 139.72286987304688, 96.16854095458984, 13.619670867919922, -158.24392700195312, 17.671310424804688, 182.30288696289062, 252.6903533935547, 140.87411499023438, 16.93169403076172, -83.38722229003906, 182.7783203125, 74.88336944580078, 17.720867156982422, 138.3214111328125, 42.84733581542969, 131.5441131591797, 217.453125, 223.4088134765625, 80.38365173339844, 18.05218505859375, -13.826217651367188, 90.2813720703125, 110.69692993164062, 118.1445541381836, 98.11212158203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000494.npy"}
{"epoch": 0.7254038179148311, "step": 495, "batch_size": 64, "mean": 87.85247802734375, "std": 108.46533966064453, "min": -196.88694763183594, "p10": -49.90173034667968, "median": 84.58023071289062, "p90": 215.90910949707032, "max": 374.676513671875, "pos_frac": 0.8125, "sample": [146.39288330078125, -2.321117401123047, 97.13834381103516, 67.08393859863281, 213.1954345703125, 161.8494873046875, -91.33444213867188, -13.71826171875, 25.706008911132812, 61.23304748535156, 137.21002197265625, 64.35611724853516, 63.33733367919922, -61.28257369995117, 194.05111694335938, 84.51834869384766, 30.248401641845703, 67.25715637207031, 28.688201904296875, 65.10136413574219, 14.405014038085938, -39.322967529296875, 142.19874572753906, -31.349754333496094, 107.28564453125, 60.29681396484375, 224.41592407226562, -9.374343872070312, 29.822113037109375, 45.990478515625, 101.419921875, 152.6826629638672, 163.02490234375, -133.94882202148438, 207.80186462402344, 232.22457885742188, 242.3348846435547, 52.94502258300781, 353.7373352050781, 203.79229736328125, 104.43386840820312, -78.40443420410156, 93.3589859008789, 68.45645141601562, 34.79127502441406, 97.25779724121094, -196.88694763183594, 217.07211303710938, 88.14344787597656, 46.7347412109375, 123.51927185058594, 64.54759216308594, 162.48406982421875, 113.98965454101562, 196.67474365234375, -54.43548583984375, 15.561347961425781, 205.96151733398438, -130.13623046875, 84.6421127319336, 237.4955291748047, 177.3747100830078, 374.676513671875, 116.15290832519531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000495.npy"}
{"epoch": 0.7268722466960352, "step": 496, "batch_size": 64, "mean": 74.6668701171875, "std": 92.95833587646484, "min": -159.03579711914062, "p10": -32.86932678222656, "median": 68.74752044677734, "p90": 188.600927734375, "max": 247.43539428710938, "pos_frac": 0.765625, "sample": [-159.03579711914062, -44.31355285644531, 114.91922760009766, 150.170654296875, -52.24407196044922, 148.42185974121094, -122.21720886230469, 230.17140197753906, 164.6775360107422, -21.173583984375, 47.573036193847656, 247.43539428710938, 1.4386672973632812, 146.92120361328125, 188.66424560546875, 65.3479232788086, 11.503662109375, 146.66708374023438, -21.134605407714844, 57.66692352294922, 70.71047973632812, 60.8001708984375, 164.97189331054688, 189.84303283691406, 242.1753387451172, 193.98760986328125, 66.52638244628906, 149.35052490234375, 93.24555206298828, 98.01101684570312, 15.252716064453125, -35.51007843017578, 27.495635986328125, 175.52476501464844, -26.70757293701172, 123.17652893066406, 7.2632293701171875, 111.66545867919922, -82.12950134277344, 184.39466857910156, 2.3489646911621094, -3.3500900268554688, 106.66506958007812, -3.9759063720703125, -4.812416076660156, 66.78456115722656, 117.17861938476562, 238.075927734375, 76.78568267822266, 59.659698486328125, 54.66254425048828, -112.03994750976562, 188.45318603515625, 162.38442993164062, 139.45652770996094, 23.426891326904297, 163.94821166992188, 95.91641998291016, 34.63301086425781, 112.85415649414062, 126.08966064453125, -10.285049438476562, 33.404701232910156, -21.09288787841797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000496.npy"}
{"epoch": 0.7283406754772394, "step": 497, "batch_size": 64, "mean": 51.54722213745117, "std": 100.340576171875, "min": -174.97434997558594, "p10": -75.87365493774412, "median": 31.494277954101562, "p90": 191.8187957763672, "max": 258.07489013671875, "pos_frac": 0.65625, "sample": [11.598636627197266, 193.9572296142578, 54.09983825683594, 212.33677673339844, -4.539865493774414, -28.652973175048828, 58.69190979003906, 13.9085693359375, 53.716644287109375, -0.444366455078125, 171.74615478515625, 103.7320556640625, -6.29522705078125, 0.08069610595703125, 11.590553283691406, 31.771377563476562, 118.04277801513672, 135.63186645507812, 75.09505462646484, 54.50132751464844, -11.789955139160156, 29.19260025024414, 72.46591186523438, -44.74812316894531, -21.058319091796875, 13.821788787841797, -47.979793548583984, 204.67578125, -10.294586181640625, -108.60400390625, 94.90184020996094, 139.164794921875, 88.21495056152344, 181.76104736328125, -91.52220153808594, 245.6129150390625, -5.190711975097656, 111.56158447265625, 186.82911682128906, 106.28907775878906, -82.12542724609375, 174.3228759765625, 5.878482818603516, 258.07489013671875, -174.97434997558594, 83.23353576660156, 231.17514038085938, 154.48577880859375, 208.11538696289062, 31.217178344726562, -126.2032470703125, -88.15557098388672, 56.453453063964844, 29.330711364746094, 52.57776641845703, 20.93157196044922, -114.60800170898438, -33.89463806152344, -38.4207763671875, -25.90119171142578, 181.85092163085938, -61.28618621826172, 173.60923767089844, -10.538093566894531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000497.npy"}
{"epoch": 0.7298091042584435, "step": 498, "batch_size": 64, "mean": 84.29811096191406, "std": 93.25797271728516, "min": -166.9705810546875, "p10": -12.783516311645503, "median": 71.8470687866211, "p90": 216.53023071289067, "max": 300.7043762207031, "pos_frac": 0.828125, "sample": [-67.46687316894531, 176.0264892578125, 51.39893341064453, 158.60208129882812, 35.35150146484375, 36.695465087890625, 42.92905044555664, 136.21966552734375, 86.6480484008789, 194.28866577148438, 42.263572692871094, 51.29918670654297, 7.882961273193359, 204.63734436035156, -70.85443115234375, 94.945556640625, 179.50904846191406, 153.53073120117188, 103.5794677734375, 242.43218994140625, -6.603647232055664, 80.74983978271484, 54.26988220214844, 122.58922576904297, 134.28335571289062, 226.28872680664062, 64.33389282226562, 10.409477233886719, -8.163375854492188, 192.68832397460938, 57.085205078125, 221.62718200683594, 32.30842590332031, 300.7043762207031, 51.37723159790039, 75.025634765625, 82.5368423461914, 149.35601806640625, 252.30722045898438, 96.56687927246094, 21.344863891601562, 10.385482788085938, 139.42941284179688, 57.80683135986328, 182.30401611328125, 11.529159545898438, -166.9705810546875, -3.626068115234375, 77.85417175292969, 154.48483276367188, 32.01020812988281, -116.18071746826172, 121.72572326660156, -2.2601699829101562, -28.859603881835938, -46.420501708984375, 144.7937469482422, 150.7760772705078, 232.44631958007812, 62.08891296386719, 32.69834899902344, 224.1543426513672, 68.66850280761719, -14.76357650756836], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000498.npy"}
{"epoch": 0.7312775330396476, "step": 499, "batch_size": 64, "mean": 84.56077575683594, "std": 107.1153564453125, "min": -185.8519744873047, "p10": -35.624937438964835, "median": 69.62176895141602, "p90": 213.36366424560546, "max": 350.29583740234375, "pos_frac": 0.796875, "sample": [116.13602447509766, 39.57635498046875, 34.291473388671875, -185.8519744873047, 183.5691680908203, 60.26994323730469, 49.14884948730469, 53.123046875, -145.76956176757812, -62.28509521484375, 69.10271453857422, -1.0180854797363281, 15.022984504699707, 115.50704956054688, 2.01422119140625, 176.581787109375, 88.81832885742188, -29.988418579101562, 350.29583740234375, 66.00459289550781, 121.12205505371094, 210.5546112060547, 51.46855163574219, 254.8250732421875, 177.1793212890625, 52.08827209472656, 208.2762908935547, 147.03143310546875, 23.42371368408203, 255.3241729736328, 183.10391235351562, 25.83014678955078, 88.52120971679688, 61.97126770019531, 9.485511779785156, 70.14082336425781, 104.92149353027344, 56.26539611816406, 164.76083374023438, -112.86506652832031, -56.96721649169922, 228.6670379638672, 213.7377166748047, 214.11856079101562, 193.3920135498047, 84.61830139160156, 89.54277801513672, 183.8392333984375, -3.8639259338378906, -38.04058837890625, 6.0726318359375, 179.76478576660156, 208.69931030273438, 40.747230529785156, 25.830963134765625, 212.49087524414062, 293.45819091796875, 71.25941467285156, -25.15106201171875, -77.19953155517578, -15.94289779663086, 116.4605484008789, -26.926498413085938, 145.30340576171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000499.npy"}
{"epoch": 0.7327459618208517, "step": 500, "batch_size": 64, "mean": 76.994140625, "std": 109.16483306884766, "min": -105.131591796875, "p10": -54.716025543212886, "median": 54.76601600646973, "p90": 221.50882568359378, "max": 339.8111572265625, "pos_frac": 0.703125, "sample": [-3.741344451904297, 44.109928131103516, -51.057159423828125, 339.8111572265625, 105.72592163085938, 204.37213134765625, 70.85245513916016, 33.07829284667969, 18.23568344116211, 215.79342651367188, 155.9837188720703, 198.08941650390625, -10.216896057128906, 77.87062072753906, -27.465940475463867, 185.11065673828125, 4.5002593994140625, 14.188995361328125, 21.060646057128906, 205.17681884765625, 56.44563293457031, -73.1710205078125, 144.82095336914062, 268.78009033203125, 20.846282958984375, 235.5282745361328, -56.28411102294922, 293.7498779296875, 171.8201904296875, -49.3206787109375, 29.4681396484375, 34.619354248046875, 68.70681762695312, 169.91183471679688, -77.03326416015625, 176.59359741210938, -105.131591796875, -67.55435943603516, 86.8607177734375, -38.071441650390625, -83.50511169433594, -5.1161651611328125, 164.5989227294922, 179.40367126464844, -66.91887664794922, -0.5634880065917969, 180.56362915039062, 136.1876220703125, 87.30491638183594, 53.10749816894531, 223.95828247070312, 211.51138305664062, 100.32575225830078, 36.86691665649414, 34.214683532714844, 262.71221923828125, 56.00581359863281, -40.68902587890625, 56.44621276855469, -21.792221069335938, 53.52621841430664, 264.78680419921875, -6.2337646484375, -42.14122772216797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000500.npy"}
{"epoch": 0.7342143906020558, "step": 501, "batch_size": 64, "mean": 80.9957046508789, "std": 120.74029541015625, "min": -205.31871032714844, "p10": -53.663945770263666, "median": 71.25572204589844, "p90": 252.14627075195315, "max": 367.72869873046875, "pos_frac": 0.765625, "sample": [180.47311401367188, -141.21893310546875, 75.24890899658203, -31.05044174194336, 57.84247589111328, 65.11679077148438, -14.745018005371094, 218.7211456298828, 9.637992858886719, -47.80329895019531, 35.366905212402344, 6.373361587524414, 128.78125, 161.91641235351562, 213.14337158203125, 274.11767578125, 136.00485229492188, -105.7448959350586, -176.77157592773438, 14.8143310546875, 139.67103576660156, 12.097667694091797, 168.10406494140625, 174.3990936279297, 197.2920379638672, 167.7117919921875, -57.3746337890625, -56.17565155029297, 254.24122619628906, 163.96888732910156, 10.514572143554688, 17.982955932617188, 70.62620544433594, 26.328346252441406, 128.94483947753906, 275.03948974609375, -42.35697937011719, 58.081756591796875, 71.88523864746094, 204.5838623046875, 266.7889404296875, 72.30166625976562, 82.47627258300781, -43.835235595703125, 270.9664306640625, 87.99022674560547, 5.674736022949219, 170.75343322753906, -9.430171966552734, -110.73518371582031, 247.25804138183594, 24.477394104003906, 34.32154846191406, -14.078010559082031, 133.19064331054688, -205.31871032714844, 92.79646301269531, 265.8533935546875, 219.9043731689453, -35.25825119018555, 367.72869873046875, 51.19005584716797, 132.04641723632812, 30.871898651123047], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000501.npy"}
{"epoch": 0.73568281938326, "step": 502, "batch_size": 64, "mean": 72.90963745117188, "std": 109.39634704589844, "min": -179.04766845703125, "p10": -75.41257019042968, "median": 67.55469512939453, "p90": 202.04957427978516, "max": 249.87332153320312, "pos_frac": 0.765625, "sample": [120.46751403808594, -83.51659393310547, 58.783599853515625, 97.99339294433594, 12.372055053710938, -55.29020690917969, -40.938446044921875, -95.856201171875, 249.87332153320312, 166.83157348632812, 163.88021850585938, 211.2491455078125, 25.275253295898438, 195.8060302734375, 173.63169860839844, 11.54437255859375, -52.60118103027344, 170.92282104492188, 158.61871337890625, 199.03677368164062, 11.108642578125, 39.65146255493164, 32.79762268066406, 53.47343826293945, 56.80255126953125, -56.50318145751953, -127.67440032958984, 76.32579040527344, 107.08942413330078, 194.2335205078125, -52.06208801269531, 249.67945861816406, -179.04766845703125, -13.420257568359375, 49.603515625, 236.2527618408203, 14.7781982421875, 148.49220275878906, -144.3280792236328, 19.59905242919922, 225.87515258789062, 91.38334655761719, -134.44920349121094, -20.94866943359375, 203.3407745361328, 30.019454956054688, 55.533782958984375, -7.104766845703125, 204.56051635742188, 173.09176635742188, 194.5432586669922, 83.42591094970703, 180.68341064453125, 93.51748657226562, 26.13457489013672, 40.73802947998047, 164.11927795410156, -125.61068725585938, 133.01832580566406, 21.60470962524414, 170.89218139648438, 168.60235595703125, 186.84915161132812, 101.46067810058594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000502.npy"}
{"epoch": 0.737151248164464, "step": 503, "batch_size": 64, "mean": 85.12161254882812, "std": 102.55044555664062, "min": -200.0186767578125, "p10": -40.623106384277335, "median": 68.99195861816406, "p90": 209.59937896728516, "max": 298.439208984375, "pos_frac": 0.796875, "sample": [-18.40113067626953, 2.720836639404297, 92.9073486328125, -63.59367370605469, 1.9956130981445312, 16.127653121948242, -64.84144592285156, -5.805507659912109, 43.76474380493164, 200.279052734375, -32.276084899902344, 157.0628662109375, 48.673667907714844, 190.94732666015625, 238.14427185058594, 154.4707489013672, 185.17526245117188, 62.658111572265625, -89.29917907714844, 127.63742065429688, 130.52859497070312, 135.52359008789062, 64.20404052734375, 109.49066925048828, 38.56033706665039, 4.0380859375, -21.89374542236328, 177.20816040039062, 5.808019638061523, 55.41790008544922, 2.2435150146484375, 52.98185348510742, -67.72421264648438, 209.88230895996094, -9.267021179199219, 216.68157958984375, 126.73739624023438, 162.51962280273438, 78.99383544921875, 16.848365783691406, 248.2363739013672, 242.1324005126953, 162.04176330566406, -51.09041213989258, -200.0186767578125, 193.01576232910156, 182.2418670654297, 251.0009765625, 161.12603759765625, 146.10958862304688, -44.200401306152344, 200.37075805664062, 10.582489013671875, 56.271392822265625, -0.1381988525390625, 147.7211456298828, 41.49043273925781, 73.77987670898438, 208.939208984375, 128.14474487304688, 196.6565704345703, 42.9056282043457, 298.439208984375, 14.893936157226562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000503.npy"}
{"epoch": 0.7386196769456681, "step": 504, "batch_size": 64, "mean": 105.27084350585938, "std": 97.36585235595703, "min": -144.31053161621094, "p10": -2.819816207885734, "median": 105.41139602661133, "p90": 236.16423034667972, "max": 316.26873779296875, "pos_frac": 0.890625, "sample": [152.04823303222656, 170.8365478515625, 170.26174926757812, 62.34925842285156, 16.096176147460938, 46.90071487426758, 36.389060974121094, 64.431396484375, 127.94064331054688, 316.26873779296875, 239.05615234375, 170.98939514160156, 242.4061737060547, 18.092235565185547, 39.634498596191406, 106.4842529296875, 194.47206115722656, 176.01853942871094, -144.31053161621094, 163.52182006835938, 219.47763061523438, 71.75273895263672, 107.73638916015625, -116.47171020507812, 15.295818328857422, 145.69790649414062, 53.12815856933594, -81.80722045898438, 58.43975830078125, -6.42608642578125, -55.244041442871094, 19.54718780517578, 186.99423217773438, 255.45361328125, 63.873863220214844, 69.79139709472656, 75.14422607421875, 118.74661254882812, 136.40028381347656, 54.6920166015625, 161.26425170898438, 315.23651123046875, 154.9630126953125, 5.594814300537109, 145.59042358398438, 147.01596069335938, -47.759613037109375, 215.11964416503906, 25.558069229125977, 40.108154296875, -12.939105987548828, 148.75656127929688, 244.35275268554688, 104.33853912353516, 100.88438415527344, 153.75057983398438, 253.17507934570312, 107.48582458496094, 229.41641235351562, 82.42430877685547, 37.77766418457031, 52.89704132080078, 216.97630310058594, 93.23588562011719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000504.npy"}
{"epoch": 0.7400881057268722, "step": 505, "batch_size": 64, "mean": 79.66241455078125, "std": 93.78651428222656, "min": -92.25225830078125, "p10": -52.83763351440428, "median": 69.40940856933594, "p90": 205.0974105834961, "max": 304.86114501953125, "pos_frac": 0.796875, "sample": [-16.33514404296875, 17.86004638671875, 36.8841552734375, 127.78856658935547, 33.4378662109375, 206.15382385253906, 8.470733642578125, 180.79025268554688, 199.58905029296875, 176.62037658691406, -39.124881744384766, 208.5489501953125, 304.86114501953125, 153.03463745117188, 198.0699920654297, 111.35572814941406, 179.4247589111328, 4.276645660400391, 179.5711212158203, 114.6170425415039, 151.82826232910156, 76.97311401367188, 118.38064575195312, 51.89068603515625, -63.504180908203125, 40.388404846191406, 61.42508316040039, 20.473644256591797, 60.4755859375, 213.56704711914062, -92.25225830078125, 214.01559448242188, -10.255229949951172, -32.22080612182617, 202.6324462890625, 129.10113525390625, -20.69244384765625, 129.1280517578125, 6.70574951171875, 180.77987670898438, 56.08893585205078, 67.40118408203125, 227.6922607421875, 40.64701843261719, 84.1011962890625, 73.17803955078125, 71.41763305664062, 62.966373443603516, 94.97247314453125, 201.85450744628906, 9.514358520507812, -34.162025451660156, 8.260763168334961, 103.21658325195312, 137.61444091796875, -58.71452713012695, 62.58338165283203, -74.1552734375, 55.82041931152344, -63.659706115722656, 211.40145874023438, -81.71591186523438, 79.61856079101562, -62.28281784057617], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000505.npy"}
{"epoch": 0.7415565345080763, "step": 506, "batch_size": 64, "mean": 85.08673095703125, "std": 91.68232727050781, "min": -187.28042602539062, "p10": -27.267090988159175, "median": 82.17835998535156, "p90": 198.5901092529297, "max": 238.7699432373047, "pos_frac": 0.84375, "sample": [-50.484153747558594, 79.1348876953125, 24.66531753540039, 108.27497863769531, 85.22183227539062, 43.17803955078125, 45.34929656982422, 169.09976196289062, 54.131805419921875, 48.2881965637207, 88.11076354980469, 50.05616760253906, 200.25889587402344, 68.69367980957031, -50.290077209472656, 224.41384887695312, 187.68801879882812, -28.66000747680664, 33.23011779785156, 206.1769561767578, 170.81060791015625, 192.1458282470703, 171.15977478027344, 186.6046142578125, 222.8091583251953, -47.52778625488281, 11.828865051269531, 94.62440490722656, 238.7699432373047, 58.57036590576172, 116.01820373535156, 69.44795227050781, 178.2455291748047, 36.935638427734375, 79.09111022949219, -187.28042602539062, 105.18781280517578, 119.11717224121094, 176.10816955566406, 164.40142822265625, 193.58950805664062, 62.190914154052734, 159.94618225097656, 14.250606536865234, -24.016952514648438, -9.984100341796875, 45.495704650878906, 108.83309936523438, 56.573822021484375, 219.64096069335938, 61.62457275390625, 37.198768615722656, 51.120849609375, 97.37535858154297, 143.3013916015625, 120.12737274169922, -135.23388671875, 56.799156188964844, 96.04803466796875, 194.69627380371094, 203.24929809570312, 90.26997375488281, -14.407211303710938, -126.74567413330078], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000506.npy"}
{"epoch": 0.7430249632892805, "step": 507, "batch_size": 64, "mean": 89.87872314453125, "std": 112.57156372070312, "min": -192.82577514648438, "p10": -60.2823120117187, "median": 72.67807388305664, "p90": 223.9857788085938, "max": 374.1856994628906, "pos_frac": 0.84375, "sample": [60.316253662109375, 46.849525451660156, 116.75407409667969, 89.111572265625, 374.1856994628906, -80.2119140625, 149.37557983398438, 171.2054443359375, 48.23692321777344, 55.67414855957031, 120.99681091308594, 162.4411163330078, 191.59783935546875, 229.54550170898438, -3.6139678955078125, -97.89425659179688, -13.7799072265625, -83.12445068359375, -5.3867950439453125, 349.4485778808594, 54.94408416748047, 188.94053649902344, 7.160696029663086, 36.60029602050781, 33.77198791503906, 167.6163330078125, 292.9473571777344, 59.75750732421875, 41.78385925292969, 16.420059204101562, 184.39781188964844, 139.249267578125, -192.82577514648438, 20.486486434936523, 195.3101806640625, 211.01309204101562, -117.70498657226562, 203.91004943847656, 187.65008544921875, 41.526615142822266, 95.35845947265625, 136.3358154296875, 145.24969482421875, 76.18462371826172, 196.71902465820312, 103.28666687011719, 132.11337280273438, 233.66505432128906, 107.80516052246094, 256.98236083984375, 27.894073486328125, -96.89435577392578, 15.142057418823242, 48.82756042480469, 83.05609893798828, 272.9535217285156, 69.17152404785156, 34.693992614746094, 58.35601806640625, -138.3512725830078, 8.517578125, 142.41412353515625, 28.832706451416016, 59.24138641357422], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000507.npy"}
{"epoch": 0.7444933920704846, "step": 508, "batch_size": 64, "mean": 73.293212890625, "std": 116.99435424804688, "min": -181.4951171875, "p10": -63.84593963623047, "median": 55.685293197631836, "p90": 240.3589599609375, "max": 296.9206237792969, "pos_frac": 0.75, "sample": [206.83767700195312, 244.91049194335938, -132.22705078125, 225.4672088623047, -7.6207427978515625, -164.5223388671875, -21.418983459472656, 199.0667724609375, 3.7801361083984375, 241.92453002929688, 208.42398071289062, 87.62120056152344, 76.75016021728516, 296.9206237792969, 182.6394500732422, 154.74293518066406, 53.81028366088867, -39.40196228027344, 252.48495483398438, 172.95230102539062, -60.78942108154297, 190.2159423828125, 101.76974487304688, -34.01036071777344, 121.12918090820312, 9.910491943359375, 27.025344848632812, -82.82208251953125, 61.388671875, 33.93678283691406, -6.555656433105469, 253.21495056152344, 167.99517822265625, -12.810375213623047, 268.38946533203125, -65.15587615966797, -107.71635437011719, 15.269184112548828, 10.385505676269531, 206.8656005859375, 74.8419418334961, 28.689346313476562, 32.065460205078125, 73.18461608886719, 146.8951416015625, 85.72763061523438, 44.67571258544922, 80.93858337402344, 121.11274719238281, 236.70596313476562, 113.96743774414062, 7.9713897705078125, -181.4951171875, 292.5080871582031, 213.58456420898438, -30.19446563720703, 57.560302734375, 15.391876220703125, 23.11962127685547, 23.345867156982422, 43.05268859863281, -104.83686065673828, 10.439376831054688, -59.263641357421875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000508.npy"}
{"epoch": 0.7459618208516887, "step": 509, "batch_size": 64, "mean": 71.44049835205078, "std": 102.5967025756836, "min": -197.5279083251953, "p10": -52.88943481445312, "median": 90.44109725952148, "p90": 184.0666412353516, "max": 276.90399169921875, "pos_frac": 0.75, "sample": [12.294811248779297, 91.73905944824219, -185.69668579101562, -3.71905517578125, -13.098602294921875, 150.40576171875, 190.6736297607422, 37.63094711303711, 106.92073059082031, 160.29678344726562, 129.38487243652344, 104.12196350097656, 9.464126586914062, 47.068702697753906, 114.9224853515625, 10.293365478515625, 128.74465942382812, 19.382102966308594, -76.01068115234375, -4.473602294921875, 276.90399169921875, 192.15301513671875, 18.283164978027344, 68.41770935058594, 135.95001220703125, -16.410694122314453, -24.08258819580078, 133.74740600585938, 89.14313507080078, -23.659896850585938, 187.273193359375, -101.29896545410156, 134.22958374023438, -47.77433776855469, 112.44723510742188, 121.98346710205078, 166.26129150390625, 134.84095764160156, 215.02854919433594, -93.53282165527344, 6.303215026855469, -55.08161926269531, 83.46906280517578, 153.39151000976562, 145.10427856445312, -197.5279083251953, 172.77218627929688, 139.58914184570312, -9.039642333984375, 272.39532470703125, -188.71194458007812, 163.55636596679688, 108.2603759765625, -1.5448951721191406, 79.98527526855469, 31.645488739013672, 109.8743667602539, 40.73118591308594, 146.17349243164062, 198.17266845703125, 145.19403076171875, 74.02566528320312, 176.58468627929688, 66.62092590332031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000509.npy"}
{"epoch": 0.7474302496328928, "step": 510, "batch_size": 64, "mean": 83.55233764648438, "std": 100.51374816894531, "min": -145.1163330078125, "p10": -43.67166290283203, "median": 92.96498489379883, "p90": 225.07911071777346, "max": 287.9031982421875, "pos_frac": 0.8125, "sample": [-52.91291809082031, 6.970893859863281, 181.182373046875, 196.8541259765625, -106.51608276367188, 87.6684341430664, 243.15020751953125, 228.91616821289062, 120.87255859375, 43.98551940917969, 10.435527801513672, 102.25059509277344, 2.346424102783203, 232.91412353515625, -15.998344421386719, 148.61395263671875, 193.649169921875, -145.1163330078125, -122.57508850097656, 140.23919677734375, -39.00389099121094, 0.3187274932861328, 66.04283905029297, -81.35687255859375, 94.15312957763672, 173.049560546875, 146.59848022460938, 140.81297302246094, 252.02627563476562, 76.7127685546875, 116.11043548583984, 95.34873962402344, 49.24207305908203, 287.9031982421875, 237.06944274902344, 10.823921203613281, 118.29762268066406, 153.97425842285156, 15.105648040771484, 246.32449340820312, 93.31584167480469, 40.520408630371094, 109.80349731445312, 44.1002197265625, 73.31550598144531, 100.07379150390625, 161.26304626464844, 216.1259765625, -83.14854431152344, 70.09957885742188, 137.456298828125, 21.148334503173828, 22.13751220703125, 96.41915893554688, 61.024932861328125, 208.9601287841797, -33.00395202636719, 54.16254425048828, -14.864017486572266, 186.11300659179688, 120.50676727294922, 92.61412811279297, -43.72038269042969, -43.5579833984375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000510.npy"}
{"epoch": 0.748898678414097, "step": 511, "batch_size": 64, "mean": 91.5009765625, "std": 103.19740295410156, "min": -134.4951629638672, "p10": -23.33693389892578, "median": 92.58449172973633, "p90": 214.85765838623047, "max": 419.33001708984375, "pos_frac": 0.828125, "sample": [73.50977325439453, 265.5164794921875, 13.945411682128906, 190.0023651123047, 126.69638061523438, 22.040298461914062, 117.138427734375, 100.29228210449219, 210.88192749023438, 54.04935836791992, 13.902313232421875, 132.316162109375, 250.5447235107422, 99.62623596191406, -2.339689254760742, 139.18380737304688, -76.76546478271484, 12.228179931640625, 21.07666015625, -52.549583435058594, 240.91171264648438, 206.9559326171875, 19.484054565429688, 161.9549560546875, 214.54539489746094, -96.02913665771484, -134.4951629638672, 140.58609008789062, 85.5427474975586, 209.17361450195312, 138.16404724121094, 101.22879028320312, 74.65208435058594, 46.474609375, 160.7176055908203, 125.13536834716797, 69.29052734375, 247.60450744628906, 55.378013610839844, 153.48622131347656, 140.76516723632812, -3.655487060546875, 49.06308364868164, 2.58966064453125, -51.724853515625, 42.43427276611328, 104.12086486816406, 21.056873321533203, -24.022212982177734, 14.684844970703125, -51.70557403564453, 67.0905532836914, 147.83450317382812, -21.73794937133789, -1.92803955078125, 159.90606689453125, 214.99148559570312, 106.37104797363281, 419.33001708984375, 2.9998931884765625, 118.28277587890625, 132.39791870117188, 24.780826568603516, 310.0788269042969], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000511.npy"}
{"epoch": 0.750367107195301, "step": 512, "batch_size": 64, "mean": 86.1579818725586, "std": 109.71417236328125, "min": -180.8627471923828, "p10": -37.87558898925781, "median": 86.60128402709961, "p90": 217.46746826171875, "max": 319.73309326171875, "pos_frac": 0.796875, "sample": [169.24124145507812, -41.910308837890625, 180.6465606689453, 56.812461853027344, 87.61634063720703, -8.987728118896484, 295.91455078125, -86.04722595214844, -10.30274772644043, -9.632669448852539, 102.06372833251953, 184.14404296875, -28.46124267578125, 259.9295959472656, 49.94709777832031, 169.9296417236328, -125.65824127197266, 130.20755004882812, 8.64141845703125, 14.242168426513672, -153.35198974609375, 223.10800170898438, 4.333179473876953, 28.644607543945312, 144.12332153320312, 319.73309326171875, 8.375244140625, 126.34980773925781, 107.86894989013672, 153.0367431640625, 61.82811737060547, 46.667118072509766, 82.34687805175781, 64.22592163085938, -180.8627471923828, 195.87322998046875, 218.1748046875, 191.41384887695312, 144.99993896484375, 138.19505310058594, -131.77291870117188, 240.14080810546875, 215.8170166015625, 173.87118530273438, 15.624908447265625, 134.15072631835938, 63.969764709472656, 128.18817138671875, -26.19470977783203, -11.789863586425781, 105.49491882324219, 21.34868621826172, 168.82322692871094, 107.63164520263672, 123.19639587402344, 40.394222259521484, 204.56497192382812, 27.862083435058594, 85.58622741699219, 82.48078918457031, -81.616455078125, 309.69049072265625, 115.55830383300781, 77.67091369628906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000512.npy"}
{"epoch": 0.7518355359765051, "step": 513, "batch_size": 64, "mean": 75.15151977539062, "std": 97.85369873046875, "min": -247.32489013671875, "p10": -22.872815322875972, "median": 67.3184814453125, "p90": 177.7541915893555, "max": 283.35540771484375, "pos_frac": 0.828125, "sample": [139.53262329101562, -24.24429702758789, 50.68218231201172, 10.461992263793945, -56.127037048339844, 57.80851745605469, 34.76234817504883, 127.60126495361328, 68.5068359375, -6.0969696044921875, 133.99948120117188, 7.894401550292969, 199.40103149414062, -41.752174377441406, 10.229499816894531, 109.30657958984375, 9.042976379394531, -19.364486694335938, 110.95797729492188, 167.28524780273438, 132.68922424316406, 256.9297180175781, 283.35540771484375, 66.130126953125, 63.559486389160156, 52.931678771972656, -46.56790542602539, 137.70872497558594, 176.33978271484375, -48.54790115356445, 168.63922119140625, 4.861286163330078, 38.16545104980469, 234.29806518554688, 169.21424865722656, 117.12020874023438, 30.53216552734375, 141.89720153808594, 93.7293701171875, 173.9110107421875, 139.91098022460938, 12.185087203979492, 163.6801300048828, -206.76780700683594, 169.16665649414062, 71.2557373046875, 18.032230377197266, 17.621028900146484, 138.40240478515625, 51.40605163574219, 82.37403106689453, -4.814817428588867, 58.5908088684082, 178.36036682128906, 77.27000427246094, 38.37229919433594, 155.26715087890625, 74.76543426513672, -19.672691345214844, 33.294219970703125, -247.32489013671875, 260.68572998046875, 195.11465454101562, 15.737693786621094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000513.npy"}
{"epoch": 0.7533039647577092, "step": 514, "batch_size": 64, "mean": 80.029296875, "std": 100.01789093017578, "min": -84.98429870605469, "p10": -50.44588623046875, "median": 65.44499397277832, "p90": 219.7150619506836, "max": 313.741943359375, "pos_frac": 0.765625, "sample": [39.91625213623047, -84.98429870605469, -50.886932373046875, -65.29329681396484, 24.40283203125, 59.98796463012695, 236.62274169921875, 198.728271484375, 270.450439453125, 242.69369506835938, 28.42473602294922, 158.7798309326172, 113.41729736328125, 13.216690063476562, 192.94204711914062, -40.869537353515625, 208.67327880859375, 42.918487548828125, 99.76130676269531, 99.08551025390625, -32.9480094909668, 41.026947021484375, 225.38485717773438, 44.32233810424805, -56.32257843017578, 70.90202331542969, 184.82913208007812, 14.256057739257812, 4.559150695800781, 17.75920867919922, 118.58792877197266, 112.54647064208984, 52.14533996582031, 109.27176666259766, 19.571163177490234, 150.96383666992188, 313.741943359375, -56.425933837890625, -34.163963317871094, -42.06487274169922, 49.283382415771484, 28.935775756835938, -51.276405334472656, 152.14044189453125, 87.18490600585938, -8.321378707885742, -5.522666931152344, -66.55088806152344, 217.8427734375, 211.56944274902344, 102.43464660644531, 195.15432739257812, 220.51747131347656, -43.417686462402344, 76.50941467285156, 79.26612854003906, -49.416778564453125, 203.4317626953125, 36.587249755859375, 173.42889404296875, 229.0460968017578, 102.40135955810547, 57.41839599609375, 77.29806518554688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000514.npy"}
{"epoch": 0.7547723935389133, "step": 515, "batch_size": 64, "mean": 73.31364440917969, "std": 99.10452270507812, "min": -163.53900146484375, "p10": -59.859915161132804, "median": 74.56514358520508, "p90": 209.06893463134767, "max": 313.0544738769531, "pos_frac": 0.796875, "sample": [23.901981353759766, -64.15791320800781, 127.86679077148438, 65.333984375, -48.03620910644531, -139.39950561523438, 101.66304016113281, 34.60987091064453, -22.22449493408203, -83.07040405273438, 109.12981414794922, 145.91078186035156, 55.09104919433594, 84.86093139648438, 152.1932373046875, -77.43121337890625, 112.28775024414062, 152.65231323242188, 14.397323608398438, -44.26997375488281, 313.0544738769531, -64.2891845703125, 193.31272888183594, 232.29364013671875, 138.221923828125, -111.20075988769531, 53.489097595214844, 177.77667236328125, 135.39540100097656, 110.12516784667969, 211.3950653076172, 34.532386779785156, -2.1200294494628906, 78.68010711669922, 218.35958862304688, 57.45356750488281, 203.64129638671875, 81.2633285522461, 88.45732116699219, 10.768165588378906, 165.48635864257812, 146.66299438476562, 72.21198272705078, 28.078086853027344, 103.33805847167969, 26.192855834960938, 61.99629211425781, 134.4473876953125, 76.91830444335938, 27.716075897216797, -163.53900146484375, 234.0583038330078, 32.526885986328125, -2.085641860961914, 237.4979705810547, 202.11477661132812, 0.60595703125, 21.914518356323242, 28.806846618652344, 84.37020874023438, 30.6761474609375, -49.83125305175781, 110.27479553222656, 219.71575927734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000515.npy"}
{"epoch": 0.7562408223201175, "step": 516, "batch_size": 64, "mean": 75.31637573242188, "std": 121.59198760986328, "min": -213.04566955566406, "p10": -92.0098190307617, "median": 55.811832427978516, "p90": 240.41010437011718, "max": 296.89617919921875, "pos_frac": 0.734375, "sample": [180.11016845703125, 122.56309509277344, 285.3697204589844, -82.80389404296875, 211.0721435546875, 109.31929016113281, 140.70712280273438, 38.14947509765625, 15.428024291992188, 50.78459930419922, 240.66268920898438, 216.43621826171875, 74.39598846435547, 59.315391540527344, -213.04566955566406, 55.47161102294922, 115.42912292480469, -150.21389770507812, 49.04090881347656, 148.93093872070312, -30.654861450195312, 195.02517700195312, -99.61400604248047, -5.561908721923828, 216.28500366210938, -104.31398010253906, -32.681884765625, 18.69036865234375, 296.89617919921875, 25.741661071777344, -42.36155700683594, 87.46224975585938, 272.8668518066406, 185.84011840820312, -95.95521545410156, -108.15451049804688, 105.73165893554688, -14.043781280517578, 18.798492431640625, 23.463577270507812, 136.61331176757812, -26.979347229003906, 135.89877319335938, 56.15205383300781, 160.67193603515625, 239.82073974609375, -39.844207763671875, 195.1465606689453, -3.780424118041992, 190.39352416992188, 18.795875549316406, 44.476173400878906, 49.112457275390625, 39.56682586669922, 284.4456481933594, 22.848129272460938, -178.16714477539062, -7.511810302734375, 79.72982788085938, 295.4029541015625, 259.65484619140625, 141.8248291015625, 144.10276794433594, 1.2914962768554688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000516.npy"}
{"epoch": 0.7577092511013216, "step": 517, "batch_size": 64, "mean": 91.72949981689453, "std": 109.90364074707031, "min": -132.06240844726562, "p10": -63.45096435546875, "median": 80.76418685913086, "p90": 233.81009521484376, "max": 307.7398986816406, "pos_frac": 0.78125, "sample": [115.49629974365234, 88.51535034179688, 212.00450134277344, 199.47079467773438, 133.83432006835938, 183.0879364013672, 144.9620819091797, 45.341270446777344, 171.18002319335938, -118.58766174316406, 22.67790985107422, 240.71751403808594, -77.51422119140625, 107.21795654296875, 234.08737182617188, 73.01302337646484, 46.2462272644043, 31.61346435546875, 46.15360641479492, 220.597412109375, 253.50244140625, 229.60464477539062, 182.7327880859375, 113.90128326416016, -45.07563781738281, -94.25413513183594, 28.01769256591797, 30.655963897705078, -64.80078125, 247.83238220214844, -132.06240844726562, -17.977500915527344, -9.280448913574219, 307.7398986816406, 13.093902587890625, 32.11785888671875, 155.7068634033203, -0.581085205078125, -30.731569290161133, 4.448524475097656, 70.05525970458984, 207.61373901367188, 64.38890075683594, -70.3003921508789, 114.50706481933594, 233.16311645507812, 54.06837463378906, 69.85521697998047, -28.85613250732422, 50.46588134765625, 34.088218688964844, 177.60757446289062, 186.75244140625, 302.00439453125, 32.95220947265625, 209.6685028076172, -60.3013916015625, 175.36627197265625, -70.2938003540039, 191.54257202148438, 147.25314331054688, 234.50894165039062, 90.93362426757812, 128.93824768066406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000517.npy"}
{"epoch": 0.7591776798825257, "step": 518, "batch_size": 64, "mean": 68.14192199707031, "std": 108.17417907714844, "min": -205.31805419921875, "p10": -55.79477081298828, "median": 58.57900047302246, "p90": 217.74607391357424, "max": 312.13299560546875, "pos_frac": 0.765625, "sample": [-129.3525390625, 297.662109375, 130.30970764160156, 27.001094818115234, 38.719322204589844, 157.28855895996094, 62.05724334716797, 119.14335632324219, 18.872085571289062, -20.22132110595703, 91.30591583251953, 215.74185180664062, 5.76751708984375, -54.6065673828125, 60.483219146728516, 79.07913970947266, 218.6050262451172, 56.674781799316406, 16.243209838867188, -1.4975433349609375, 267.12725830078125, 79.8167495727539, 10.693931579589844, 161.96627807617188, 34.0406494140625, 184.0070037841797, 246.10328674316406, 129.4813995361328, 7.052558898925781, 265.2626037597656, 122.53919982910156, 172.13653564453125, 95.35044860839844, 231.46414184570312, 41.668853759765625, 169.161865234375, 32.885982513427734, 44.77130126953125, 312.13299560546875, 92.65260314941406, 87.87650299072266, 9.245468139648438, 103.7532958984375, -23.553817749023438, 66.68716430664062, 132.88348388671875, -205.31805419921875, -34.19615173339844, 22.59076690673828, -2.0681838989257812, -100.455810546875, -62.662845611572266, 34.368751525878906, -56.30400085449219, -41.832393646240234, -72.53350830078125, 188.456787109375, 170.2155303955078, -40.961021423339844, 142.01852416992188, 23.74217987060547, 8.02276611328125, 72.13607788085938, -150.62033081054688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000518.npy"}
{"epoch": 0.7606461086637298, "step": 519, "batch_size": 64, "mean": 75.99348449707031, "std": 86.82377624511719, "min": -94.45310974121094, "p10": -23.716925430297845, "median": 59.08680534362793, "p90": 206.67742309570315, "max": 306.8430480957031, "pos_frac": 0.8125, "sample": [-49.465728759765625, 231.6331329345703, 20.000808715820312, -64.42401123046875, 93.12091064453125, 135.45477294921875, 114.45330810546875, -86.83334350585938, 276.87158203125, 20.301467895507812, -9.281951904296875, 211.80445861816406, 30.068790435791016, 171.01283264160156, 112.04135131835938, 59.459041595458984, 120.01718139648438, 306.8430480957031, 118.98486328125, 171.52249145507812, 74.54603576660156, 253.38177490234375, 4.513666152954102, 73.85987854003906, -8.171783447265625, 100.15286254882812, 75.42501068115234, 132.11016845703125, -94.45310974121094, 52.93540954589844, 58.714569091796875, 156.60501098632812, 32.332183837890625, -3.1547470092773438, 127.38249206542969, -17.3802490234375, 85.51107788085938, -7.096630096435547, 16.448440551757812, 44.82518768310547, 81.7147445678711, 74.70480346679688, 56.02151870727539, 57.187164306640625, -27.115478515625, 176.71697998046875, 44.37005615234375, -29.874950408935547, 200.59548950195312, 48.5426025390625, 73.877685546875, 256.355224609375, 71.43995666503906, 54.88031768798828, 115.31794738769531, 209.28396606445312, 15.949302673339844, 67.41279602050781, 47.0318603515625, 48.78050231933594, -26.43264389038086, 1.9337596893310547, 58.637290954589844, 44.17963409423828], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000519.npy"}
{"epoch": 0.762114537444934, "step": 520, "batch_size": 64, "mean": 88.84642028808594, "std": 89.95305633544922, "min": -158.17578125, "p10": -21.550439453124998, "median": 94.33428573608398, "p90": 199.9091705322266, "max": 336.64990234375, "pos_frac": 0.859375, "sample": [-97.25042724609375, 60.34294128417969, 150.96905517578125, 4.96043586730957, 86.22724151611328, 209.1422119140625, 124.41204071044922, -27.416446685791016, -158.17578125, -20.36004638671875, -22.06060791015625, 145.61512756347656, -26.671478271484375, -32.71977615356445, 188.55984497070312, 98.76695251464844, 94.86664581298828, 336.64990234375, 0.31600189208984375, 21.17145538330078, 242.45413208007812, 187.1259765625, 67.61897277832031, 75.28238677978516, 153.37913513183594, 108.6248779296875, 137.2133026123047, 135.220703125, 4.325874328613281, 165.04275512695312, 144.00518798828125, 46.865413665771484, 205.20965576171875, -15.387771606445312, 202.51715087890625, 155.348388671875, 236.48394775390625, 158.56512451171875, 24.223098754882812, 16.925537109375, 93.80192565917969, 91.16618347167969, 126.42100524902344, 193.82388305664062, 137.3025360107422, 104.4508285522461, 60.40282440185547, 12.753374099731445, 238.98062133789062, 8.892864227294922, 17.051729202270508, -55.67646026611328, 133.1436767578125, 31.840438842773438, 30.637733459472656, 115.57171630859375, 80.98077392578125, 175.30911254882812, 105.89982604980469, 27.66014862060547, 138.6094970703125, 85.21040344238281, 34.7904052734375, 108.75656127929688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000520.npy"}
{"epoch": 0.7635829662261381, "step": 521, "batch_size": 64, "mean": 89.41287994384766, "std": 90.42444610595703, "min": -104.93585205078125, "p10": -29.34508037567138, "median": 78.62734985351562, "p90": 219.32877502441406, "max": 301.4519958496094, "pos_frac": 0.828125, "sample": [56.58296203613281, 170.71786499023438, 218.76055908203125, 52.453025817871094, 30.352828979492188, 77.27951049804688, 10.240959167480469, 132.29605102539062, 54.60475540161133, 109.9288558959961, 15.760936737060547, 94.09101867675781, 44.37451171875, 118.89421081542969, 55.59101104736328, 152.59262084960938, -31.758270263671875, -42.01175308227539, 142.16940307617188, 89.96548461914062, 59.82041931152344, -104.93585205078125, 92.71463012695312, -5.400569915771484, 147.62680053710938, 228.56600952148438, 36.55097579956055, -75.1748275756836, 50.6207160949707, 44.14330291748047, 75.13408660888672, 66.28494262695312, 208.6546630859375, 224.50172424316406, 39.03765869140625, 198.79534912109375, 72.2208251953125, -21.210861206054688, 91.50413513183594, 21.501022338867188, -19.790271759033203, 222.27099609375, 27.419189453125, 139.96627807617188, -37.26699447631836, 161.5536651611328, -23.714303970336914, 205.36868286132812, 163.8878173828125, -48.176475524902344, 11.925201416015625, -50.53667068481445, 90.4664306640625, 60.75321960449219, 118.22787475585938, 229.8260498046875, 79.97518920898438, 219.57229614257812, 93.95831298828125, 301.4519958496094, 166.1592559814453, 142.23951721191406, 206.65455627441406, 256.3908996582031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000521.npy"}
{"epoch": 0.7650513950073421, "step": 522, "batch_size": 64, "mean": 84.41744232177734, "std": 101.6431884765625, "min": -141.72103881835938, "p10": -36.793818664550784, "median": 71.13264465332031, "p90": 225.55035552978518, "max": 282.2213134765625, "pos_frac": 0.734375, "sample": [217.79922485351562, 116.3409194946289, 172.9751739501953, 80.89385986328125, 256.66656494140625, -21.579917907714844, 60.03521728515625, 38.39729309082031, 64.10719299316406, 211.83248901367188, -25.05522918701172, 228.8722686767578, 272.75433349609375, -20.17224884033203, 253.9896240234375, -17.844642639160156, 87.75825500488281, 40.30918884277344, -0.282806396484375, -36.34733581542969, 282.2213134765625, 188.2653350830078, 58.872032165527344, 116.54239654541016, -14.095726013183594, 127.88821411132812, 189.47283935546875, -38.72100067138672, 145.2318878173828, 191.73907470703125, 168.1768798828125, -36.98516845703125, 45.7080078125, 61.68601989746094, 85.98696899414062, 1.704681396484375, 142.03289794921875, -52.81946563720703, 182.38345336914062, -141.72103881835938, -62.79224395751953, 242.90383911132812, -10.238433837890625, 70.07398986816406, 27.289661407470703, 157.20272827148438, 23.461441040039062, 88.79254150390625, -88.5499038696289, 179.13818359375, 118.94976806640625, 72.19129943847656, 178.8216094970703, -0.865325927734375, -51.66145706176758, 79.90565490722656, 14.755603790283203, -15.471908569335938, 57.53675842285156, 44.0254020690918, 275.6784362792969, 4.189580917358398, 144.5086669921875, 167.85165405273438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000522.npy"}
{"epoch": 0.7665198237885462, "step": 523, "batch_size": 64, "mean": 58.72737503051758, "std": 109.45225524902344, "min": -178.4071044921875, "p10": -75.79150924682617, "median": 60.82229995727539, "p90": 196.34056243896487, "max": 362.50836181640625, "pos_frac": 0.734375, "sample": [79.23872375488281, 79.87026977539062, 29.659568786621094, -15.278152465820312, 0.00020599365234375, -61.29144287109375, 224.16567993164062, 79.68771362304688, 54.784820556640625, 130.01779174804688, -94.03336334228516, 162.6875762939453, 4.073675155639648, -17.113494873046875, -115.74596405029297, 6.217533111572266, 113.36166381835938, 127.39736938476562, -67.373779296875, 258.4016418457031, 286.57489013671875, 122.18975830078125, -7.898353576660156, 7.609201431274414, 108.29004669189453, 168.8294677734375, 77.7322769165039, -178.4071044921875, -168.400390625, 49.30305480957031, 52.45045852661133, 31.918439865112305, 39.18280792236328, -89.0789794921875, 94.4306869506836, 98.8962173461914, 34.07255172729492, -50.4013671875, 216.1096954345703, -74.89498138427734, 65.27035522460938, 48.82823181152344, 362.50836181640625, 26.162769317626953, 126.34827423095703, -29.189895629882812, 73.63117980957031, -66.0662841796875, 204.83253479003906, 94.21903991699219, 100.95530700683594, 188.97279357910156, -147.441650390625, 61.379722595214844, 53.86078643798828, 64.25072479248047, 190.6138916015625, 60.26487731933594, 197.24923706054688, 194.22032165527344, 152.31076049804688, 76.52521514892578, -62.215301513671875, -76.17573547363281], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000523.npy"}
{"epoch": 0.7679882525697503, "step": 524, "batch_size": 64, "mean": 81.98780059814453, "std": 100.20703887939453, "min": -76.37611389160156, "p10": -48.03468017578125, "median": 72.14941787719727, "p90": 219.98325805664064, "max": 344.8707580566406, "pos_frac": 0.765625, "sample": [-46.508567810058594, 223.81680297851562, 2.196197509765625, 90.84919738769531, 16.31652069091797, -6.141845703125, 195.5787811279297, 4.223705291748047, 114.02447509765625, 110.45520782470703, 57.57659912109375, 2.53961181640625, 9.431686401367188, 70.8558120727539, 168.897216796875, 182.4486083984375, 128.99368286132812, 344.8707580566406, 73.44302368164062, 260.6763000488281, -35.51976776123047, 142.49928283691406, 83.24781799316406, 126.2159423828125, 60.022369384765625, 243.18467712402344, 216.14173889160156, 208.84213256835938, -7.830238342285156, -52.4716911315918, 39.515132904052734, 115.59259033203125, 82.88743591308594, -48.68872833251953, 117.84752655029297, -76.08905029296875, 37.55549621582031, 81.68031311035156, 214.23593139648438, -1.9844894409179688, 129.58364868164062, 7.8770294189453125, 69.66903686523438, -62.46795654296875, 205.8167724609375, 21.50537109375, 238.690185546875, 147.507080078125, 147.20700073242188, 191.5511474609375, -12.192855834960938, 105.59490966796875, 221.62962341308594, 54.754669189453125, 47.591644287109375, -76.37611389160156, -1.8207855224609375, 75.13278198242188, -37.466888427734375, 272.97442626953125, 38.77460479736328, -66.41806030273438, 45.20697021484375, -68.5328140258789], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000524.npy"}
{"epoch": 0.7694566813509545, "step": 525, "batch_size": 64, "mean": 92.11900329589844, "std": 113.22888946533203, "min": -84.43013763427734, "p10": -44.67179794311522, "median": 73.45776748657227, "p90": 255.53256530761726, "max": 386.5822448730469, "pos_frac": 0.765625, "sample": [122.98371887207031, 157.9453582763672, 48.68302917480469, 69.37759399414062, 17.13648223876953, 236.9312744140625, 386.5822448730469, 47.92680358886719, -50.6727294921875, -84.43013763427734, 46.83135986328125, -3.8072967529296875, 35.90202331542969, -61.885528564453125, 144.31539916992188, -65.19013977050781, 184.36050415039062, 173.7330322265625, 120.65277099609375, 156.32620239257812, 6.2554931640625, 1.9545860290527344, 16.02509307861328, 86.30856323242188, -63.373291015625, 77.5379409790039, 108.44004821777344, 263.5045471191406, 50.39305114746094, 85.35189819335938, 112.42163848876953, -30.66962432861328, 337.43377685546875, -58.519596099853516, 286.2489013671875, -27.291290283203125, 234.6029510498047, 63.51008605957031, 10.876640319824219, 85.1545639038086, 205.0831298828125, -14.05157470703125, 189.2557373046875, -23.495643615722656, -14.040267944335938, 99.07830810546875, -5.78887939453125, 16.662456512451172, 169.0226287841797, 199.5245361328125, 296.3603210449219, 303.2856140136719, 146.51329040527344, 25.17767333984375, 217.18772888183594, -24.80225372314453, 23.100372314453125, 207.81236267089844, -56.11186218261719, 101.81169891357422, 12.275115966796875, 198.24581909179688, 29.939491271972656, 263.70269775390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000525.npy"}
{"epoch": 0.7709251101321586, "step": 526, "batch_size": 64, "mean": 86.28730010986328, "std": 105.68538665771484, "min": -159.88211059570312, "p10": -34.672272109985336, "median": 73.95428466796875, "p90": 224.4536849975586, "max": 300.03094482421875, "pos_frac": 0.78125, "sample": [140.64874267578125, 70.82177734375, 175.1582794189453, 39.09657669067383, 209.84730529785156, -133.55709838867188, -15.39454460144043, 66.86883544921875, 107.20632934570312, -97.16183471679688, 198.28567504882812, 231.15968322753906, 101.10417938232422, 29.420406341552734, 105.8171615600586, 230.6839599609375, 162.01441955566406, 178.68470764160156, 144.36557006835938, -19.909950256347656, 24.91317367553711, -2.2213287353515625, 219.75941467285156, 243.81056213378906, 168.79156494140625, 217.58554077148438, 143.46998596191406, 199.33322143554688, 93.84263610839844, 41.95301055908203, 30.251800537109375, 270.14501953125, 11.963630676269531, 300.03094482421875, -79.12820434570312, -73.29281616210938, 251.26324462890625, 106.00065612792969, 4.5844879150390625, -40.99898147583008, 112.28765869140625, 203.45785522460938, 37.35951232910156, 57.31816101074219, 22.31108856201172, -9.904518127441406, 169.0078125, 173.05776977539062, 16.856292724609375, -42.54853820800781, 36.632118225097656, 197.85418701171875, 124.423095703125, 226.46551513671875, 56.54711151123047, 77.0867919921875, 170.48275756835938, -18.191558837890625, -11.257049560546875, -159.88211059570312, -9.977508544921875, 28.836265563964844, 3.9913177490234375, 2.9555816650390625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000526.npy"}
{"epoch": 0.7723935389133627, "step": 527, "batch_size": 64, "mean": 87.36438751220703, "std": 82.93514251708984, "min": -97.55352020263672, "p10": -12.672674942016588, "median": 68.79230117797852, "p90": 202.28629455566406, "max": 268.77362060546875, "pos_frac": 0.875, "sample": [-39.79308319091797, 50.3297119140625, 8.987274169921875, 201.29318237304688, 102.49798583984375, 13.081924438476562, 154.37213134765625, -39.28223419189453, 66.83305358886719, 168.97064208984375, 173.42205810546875, -97.55352020263672, 240.62185668945312, 10.260814666748047, -25.654747009277344, -17.967262268066406, 202.7119140625, 16.70058822631836, 237.986083984375, 224.21047973632812, 90.91171264648438, 57.83642578125, 19.535369873046875, -0.3186378479003906, 31.381561279296875, 111.41046142578125, 55.21584701538086, 182.8021697998047, 51.49129867553711, 223.94100952148438, 154.6501007080078, 27.039199829101562, 81.99006652832031, 54.54054260253906, 107.33094787597656, 42.987640380859375, 190.15704345703125, 28.475147247314453, 180.82322692871094, -18.982315063476562, 268.77362060546875, 61.55827331542969, 151.0098114013672, 42.54876708984375, 70.75154876708984, 132.6336212158203, 141.92926025390625, 60.070037841796875, 65.0087890625, 98.52235412597656, 219.4320526123047, 95.88721466064453, 22.37542724609375, 192.30015563964844, 117.57232666015625, 8.1434326171875, 61.62110900878906, 90.93143463134766, 168.01251220703125, 89.62700653076172, 1.4613094329833984, -27.725746154785156, 3.6196861267089844, 130.00909423828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000527.npy"}
{"epoch": 0.7738619676945668, "step": 528, "batch_size": 64, "mean": 88.57562255859375, "std": 103.16441345214844, "min": -154.57225036621094, "p10": -43.277733612060544, "median": 78.91569137573242, "p90": 210.81739501953126, "max": 312.5002136230469, "pos_frac": 0.828125, "sample": [25.051837921142578, 173.05828857421875, -51.0386962890625, -45.602516174316406, 74.7667236328125, 95.15350341796875, -154.57225036621094, 262.4894714355469, 233.35423278808594, -10.012271881103516, 73.25263977050781, 8.707244873046875, 156.59085083007812, 41.163509368896484, 142.47891235351562, 195.41329956054688, 143.72161865234375, 54.741241455078125, 139.03756713867188, 51.287261962890625, -96.64326477050781, 51.66538619995117, 133.52923583984375, 189.9132080078125, 1.6056289672851562, 144.51480102539062, -36.349586486816406, 4.474967956542969, 183.0966796875, 199.24072265625, -139.27932739257812, 45.1701774597168, 174.2880859375, 23.16328239440918, 55.156982421875, 46.036415100097656, 205.1669464111328, 83.06465911865234, 212.45835876464844, 19.306922912597656, 93.00359344482422, 223.20361328125, 34.90617752075195, 182.24771118164062, 289.53167724609375, 120.76714324951172, 206.9884796142578, 312.5002136230469, 159.7377166748047, 101.30043029785156, -56.47914123535156, 183.65187072753906, -20.56524658203125, 267.0572204589844, 13.244832992553711, 132.33343505859375, 86.09925842285156, 42.832679748535156, -37.853240966796875, -47.5321044921875, 35.594627380371094, 33.434303283691406, 43.954490661621094, 160.2572021484375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000528.npy"}
{"epoch": 0.775330396475771, "step": 529, "batch_size": 64, "mean": 78.0731201171875, "std": 112.10169982910156, "min": -161.18414306640625, "p10": -42.60760879516601, "median": 63.3641242980957, "p90": 214.16385040283205, "max": 415.1982116699219, "pos_frac": 0.71875, "sample": [-118.58596801757812, 146.23150634765625, 242.27072143554688, 88.59017944335938, 89.60855865478516, 38.68925476074219, 28.416053771972656, 121.06261444091797, 131.5245361328125, 415.1982116699219, 89.17525482177734, 116.79048919677734, 63.06018829345703, 207.004638671875, 177.63424682617188, -20.277862548828125, 17.893346786499023, 35.741905212402344, 176.39019775390625, -24.736045837402344, -0.4288368225097656, -14.2237548828125, 292.1922607421875, 141.54156494140625, 261.5572509765625, -18.642913818359375, 170.95803833007812, -72.477294921875, 51.077232360839844, 12.245162963867188, -6.295623779296875, 91.5107421875, 47.94406509399414, 287.3158874511719, -31.96459197998047, -161.18414306640625, 63.668060302734375, 26.56827163696289, 33.982391357421875, 142.080810546875, -60.164791107177734, 162.51712036132812, 117.73146057128906, -80.85481262207031, 100.65225982666016, -36.89140319824219, 91.57119750976562, 158.2615966796875, 186.67764282226562, 44.967445373535156, 200.04022216796875, 70.69843292236328, -23.557912826538086, -6.221763610839844, 208.01499938964844, 61.47706604003906, -38.890594482421875, 216.799072265625, 182.34161376953125, 30.337345123291016, 48.981475830078125, -155.89065551757812, -44.20061492919922, 223.177001953125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000529.npy"}
{"epoch": 0.7767988252569751, "step": 530, "batch_size": 64, "mean": 79.56475830078125, "std": 86.98889923095703, "min": -75.1220703125, "p10": -16.671837615966794, "median": 63.15639877319336, "p90": 210.1639755249024, "max": 309.43524169921875, "pos_frac": 0.796875, "sample": [3.7159423828125, 91.66314697265625, 186.3623809814453, 128.1311798095703, 34.074440002441406, 49.90589904785156, 240.08181762695312, 83.49862670898438, 102.92922973632812, 22.456581115722656, -1.9915657043457031, 59.256103515625, 95.93439483642578, 54.25054931640625, -0.26800537109375, 133.39508056640625, 71.76516723632812, 99.95846557617188, 136.68548583984375, 168.93045043945312, 68.11490631103516, 219.78057861328125, 27.418624877929688, -12.1148681640625, 17.208282470703125, 45.39909362792969, -5.694740295410156, 32.023155212402344, 54.64515686035156, -10.27960205078125, 5.981142044067383, 141.75677490234375, 145.10931396484375, 14.042789459228516, -24.576026916503906, 41.23475646972656, 45.99757385253906, 128.6234588623047, 110.2989501953125, -36.0146484375, 156.18162536621094, 275.585205078125, -18.62482452392578, 309.43524169921875, 79.26908111572266, 195.12930297851562, 111.56744384765625, -24.619712829589844, 277.3438720703125, 17.44594955444336, 216.60740661621094, 30.50945472717285, 67.05669403076172, -75.1220703125, 218.62545776367188, 176.54689025878906, -61.95063781738281, 132.12124633789062, 144.38980102539062, -28.017120361328125, 26.32593536376953, 21.631942749023438, 80.00482177734375, -4.988800048828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000530.npy"}
{"epoch": 0.7782672540381792, "step": 531, "batch_size": 64, "mean": 98.76272583007812, "std": 94.2693099975586, "min": -191.29579162597656, "p10": -18.65600471496581, "median": 109.21723175048828, "p90": 205.16471557617191, "max": 307.9085388183594, "pos_frac": 0.859375, "sample": [99.66023254394531, -8.309463500976562, 77.50962829589844, 302.09912109375, 158.2042694091797, -99.06307983398438, 115.79703521728516, 191.1180877685547, 307.9085388183594, 192.62286376953125, 53.85072708129883, 227.0833740234375, -23.09023666381836, 174.12493896484375, 94.57128143310547, 48.38214111328125, 234.89263916015625, 167.0506591796875, 25.24402618408203, 165.4611358642578, 179.5653076171875, 66.35204315185547, 166.40399169921875, 35.15087890625, 82.9762954711914, 123.67384338378906, 16.70614242553711, 83.70702362060547, 40.939796447753906, -191.29579162597656, 270.75421142578125, 108.14024353027344, 191.42822265625, 127.40406799316406, -7.0189208984375, 100.55693817138672, 33.36515808105469, 70.25541687011719, 52.92463302612305, 153.54205322265625, 214.27871704101562, 9.52425765991211, 123.89633178710938, 112.47064208984375, 124.3388671875, -29.10354232788086, 210.539794921875, 145.78573608398438, 170.76593017578125, 144.8868865966797, 116.87155151367188, -40.68641662597656, 110.29421997070312, 51.621253967285156, 0.6758308410644531, 14.318279266357422, 170.36685180664062, 60.479698181152344, 149.7659454345703, -49.43853759765625, -60.05158996582031, 169.68505859375, 53.29194641113281, 135.58726501464844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000531.npy"}
{"epoch": 0.7797356828193832, "step": 532, "batch_size": 64, "mean": 107.93487548828125, "std": 100.67464447021484, "min": -84.87408447265625, "p10": -27.70066299438476, "median": 121.65727996826172, "p90": 244.15474395751954, "max": 294.334228515625, "pos_frac": 0.8125, "sample": [131.72201538085938, 247.76492309570312, 222.13226318359375, 55.72469711303711, 13.899871826171875, 143.04931640625, 8.21466064453125, 222.46279907226562, 58.726287841796875, 63.95802688598633, -3.49066162109375, 233.8934326171875, 243.6695098876953, 169.8756561279297, 96.9017333984375, 12.100570678710938, 194.01885986328125, -44.35173034667969, 200.73916625976562, -18.812225341796875, 78.4384765625, 252.8148193359375, 294.334228515625, 185.72451782226562, 142.2936553955078, -29.273834228515625, 132.978759765625, 93.03968811035156, 97.91387939453125, -43.62042236328125, 187.5327606201172, 274.05694580078125, -84.87408447265625, 152.21453857421875, 8.591323852539062, -56.25569152832031, 22.893844604492188, 159.46865844726562, 2.991668701171875, 97.49447631835938, 22.119173049926758, 167.80255126953125, 125.15447998046875, 244.36270141601562, 171.0934295654297, 162.69534301757812, 118.16007995605469, 262.6866149902344, -9.63519287109375, 109.17022705078125, 132.38015747070312, -66.17648315429688, -59.04182434082031, 257.0953369140625, 207.5011444091797, 61.67280578613281, 184.45782470703125, 58.84454345703125, 205.505859375, 146.3397216796875, -24.029930114746094, 145.1163787841797, -19.212127685546875, 82.81175231933594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000532.npy"}
{"epoch": 0.7812041116005873, "step": 533, "batch_size": 64, "mean": 63.86848449707031, "std": 102.80362701416016, "min": -140.36216735839844, "p10": -58.94509506225586, "median": 51.515262603759766, "p90": 205.97181091308596, "max": 380.8032531738281, "pos_frac": 0.765625, "sample": [13.865516662597656, 19.89020538330078, 46.26211929321289, 6.73406982421875, 30.00339126586914, 75.51557922363281, -138.00320434570312, 132.0946044921875, -60.25263977050781, 224.9560089111328, 87.15095520019531, 103.09620666503906, 51.214683532714844, 6.281471252441406, -10.939445495605469, -25.358367919921875, 274.98431396484375, 40.73045349121094, -35.38319396972656, -32.074737548828125, 197.06161499023438, 209.91299438476562, 51.81584167480469, 45.0484619140625, 169.4566650390625, 158.2983856201172, 193.02352905273438, -60.230003356933594, 32.51316833496094, 380.8032531738281, 68.67761993408203, 57.002288818359375, 192.64398193359375, -55.94697570800781, 64.01365661621094, 92.18283081054688, 120.26463317871094, 128.4733123779297, 98.84385681152344, 103.429931640625, 7.222103118896484, 23.376352310180664, 243.02749633789062, 89.46697998046875, 35.23779296875, -96.60333251953125, -20.273155212402344, -77.23771667480469, 134.57875061035156, 109.4378662109375, 71.90394592285156, -140.36216735839844, 129.72727966308594, 34.524810791015625, 16.82714080810547, -66.413330078125, -37.17325973510742, 59.95661926269531, 6.051513671875, 279.5630187988281, 59.632484436035156, -49.88690185546875, 209.79046630859375, 7.150943756103516], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000533.npy"}
{"epoch": 0.7826725403817915, "step": 534, "batch_size": 64, "mean": 91.88386535644531, "std": 85.93589782714844, "min": -86.47085571289062, "p10": -22.36314601898193, "median": 83.81319046020508, "p90": 203.062614440918, "max": 283.869140625, "pos_frac": 0.875, "sample": [70.98410034179688, 225.9925537109375, 138.17271423339844, 242.41287231445312, 19.25157928466797, 89.83617401123047, 75.78677368164062, 50.0101432800293, 8.492141723632812, 196.4342498779297, 5.742221832275391, 196.4927978515625, -31.954078674316406, 188.99868774414062, 83.19600677490234, 14.609710693359375, 216.56610107421875, -70.40867614746094, -24.723556518554688, 92.72760009765625, 118.21978759765625, -83.15786743164062, 125.83903503417969, 47.69252014160156, 205.8782501220703, 158.4573516845703, 61.706329345703125, 9.273101806640625, 9.77279281616211, 133.57212829589844, 100.64164733886719, 154.80081176757812, -24.301164627075195, 59.951499938964844, 84.43037414550781, 30.814193725585938, -86.47085571289062, 57.00361633300781, 185.24928283691406, 208.16357421875, 162.47308349609375, 79.20326232910156, 136.44625854492188, 162.2020721435547, 143.89144897460938, 165.76119995117188, 176.07513427734375, 81.78520965576172, 137.59197998046875, 230.1898956298828, 152.57162475585938, 52.924949645996094, 52.87113952636719, 129.70962524414062, 24.959877014160156, 188.68246459960938, 283.869140625, 24.80440902709961, 39.864784240722656, 22.80059051513672, -17.841102600097656, 14.668869018554688, -32.710205078125, 121.61536407470703], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000534.npy"}
{"epoch": 0.7841409691629956, "step": 535, "batch_size": 64, "mean": 96.07040405273438, "std": 104.23201751708984, "min": -175.169189453125, "p10": -38.23916931152343, "median": 88.477294921875, "p90": 236.00336456298828, "max": 344.4124450683594, "pos_frac": 0.796875, "sample": [2.2509803771972656, 187.9895782470703, 142.71612548828125, 65.59419250488281, 147.86793518066406, 76.92739868164062, 59.32931137084961, 145.2245330810547, 94.317138671875, 38.94593048095703, -14.058349609375, 138.95452880859375, 216.24130249023438, 45.98194122314453, 126.30934143066406, 142.7434844970703, 39.82695007324219, 232.99517822265625, 105.98373413085938, 27.75372314453125, 283.27386474609375, 37.6785888671875, 136.5548858642578, 193.95187377929688, 86.20089721679688, 276.4889831542969, 176.70516967773438, 237.29258728027344, 149.06170654296875, 190.53501892089844, 195.6393585205078, 79.96864318847656, 206.63047790527344, 125.3785629272461, -23.43701934814453, -42.313148498535156, -40.214813232421875, 244.78985595703125, -20.290679931640625, 80.5785903930664, 31.404373168945312, 344.4124450683594, 77.3763427734375, 56.32501220703125, -16.10785675048828, 92.15562438964844, 41.28745651245117, 161.662109375, -46.24359130859375, -92.26384735107422, 85.5763931274414, -33.62933349609375, 108.32122802734375, 32.692996978759766, 90.75369262695312, -47.85906219482422, 282.7207946777344, -175.169189453125, 255.0152130126953, 212.0384979248047, 39.14459991455078, 124.64279174804688, -55.13580322265625, -18.983726501464844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000535.npy"}
{"epoch": 0.7856093979441997, "step": 536, "batch_size": 64, "mean": 92.22964477539062, "std": 97.53118133544922, "min": -185.16917419433594, "p10": -26.21599960327148, "median": 87.73255157470703, "p90": 213.0852005004883, "max": 306.5791320800781, "pos_frac": 0.828125, "sample": [5.982770919799805, 80.09013366699219, 243.26512145996094, 238.13101196289062, 48.165550231933594, 128.97312927246094, 139.23977661132812, -42.63292694091797, -64.92902374267578, 155.5078582763672, 215.76321411132812, 190.81094360351562, 125.56178283691406, 107.46540832519531, 196.77789306640625, 86.29481506347656, 201.7285919189453, 16.537086486816406, 155.24038696289062, 203.78147888183594, 263.98272705078125, 93.6046142578125, 13.212493896484375, 223.60202026367188, -0.4757499694824219, 206.8365020751953, 15.467580795288086, 89.1702880859375, 194.407958984375, -111.37876892089844, 188.41563415527344, 84.65318298339844, 74.14579772949219, 92.41712951660156, -10.732501983642578, 129.89447021484375, 46.73789978027344, 265.27093505859375, 61.665279388427734, -27.16559600830078, 131.6693878173828, -185.16917419433594, 140.0606231689453, 183.9398193359375, 39.90559387207031, -11.210296630859375, 60.49706268310547, 112.4629135131836, 76.04840850830078, -24.000274658203125, 93.02700805664062, 85.20866394042969, 82.7920150756836, 175.58848571777344, -46.53276062011719, 75.6375732421875, 4.732479095458984, 13.929805755615234, -29.15091323852539, 1.144989013671875, 306.5791320800781, 131.95230102539062, 41.85430908203125, 116.2430419921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000536.npy"}
{"epoch": 0.7870778267254038, "step": 537, "batch_size": 64, "mean": 103.43372344970703, "std": 97.99868774414062, "min": -133.90089416503906, "p10": -11.129914093017574, "median": 92.89400100708008, "p90": 226.99296875000002, "max": 305.7860107421875, "pos_frac": 0.859375, "sample": [-133.90089416503906, -18.115737915039062, 6.428348541259766, 59.618431091308594, -82.82192993164062, 58.97423553466797, 36.798641204833984, 299.79168701171875, 85.65621948242188, 230.1522979736328, 38.372161865234375, -4.5316009521484375, 6.577186584472656, 97.23435974121094, 85.93959045410156, 196.80224609375, 104.72236633300781, 3.0674591064453125, 188.46652221679688, -47.62236785888672, 2.9661598205566406, 151.58322143554688, -5.9738922119140625, 184.21279907226562, 83.27900695800781, -34.845829010009766, 129.20443725585938, 95.86063385009766, 191.9289093017578, 193.07752990722656, 305.7860107421875, 175.748291015625, 282.41363525390625, 149.765380859375, 181.05538940429688, 121.22218322753906, 11.323352813720703, 219.62120056152344, -27.52050018310547, 57.43666076660156, 26.233123779296875, 238.93560791015625, 183.4566650390625, 89.9273681640625, 7.152702331542969, 180.65118408203125, 140.88851928710938, 232.51966857910156, -13.339637756347656, 136.79847717285156, 195.7400360107422, 118.57131958007812, 64.61628723144531, 70.83226013183594, 147.12826538085938, 5.559253692626953, 301.536865234375, 73.3089599609375, 196.52532958984375, 51.40653610229492, 168.2131805419922, 76.17869567871094, 61.51708984375, 185.64698791503906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000537.npy"}
{"epoch": 0.788546255506608, "step": 538, "batch_size": 64, "mean": 84.50605773925781, "std": 88.19953155517578, "min": -116.94013977050781, "p10": -17.8431282043457, "median": 83.76691055297852, "p90": 194.19351348876955, "max": 290.39385986328125, "pos_frac": 0.875, "sample": [102.15330505371094, 258.4563903808594, 82.9442367553711, 273.40997314453125, 88.17037963867188, 96.23477172851562, 178.10321044921875, 84.58958435058594, 67.49974822998047, 48.878822326660156, 101.50286865234375, 204.0310516357422, 73.4217529296875, 181.89523315429688, 31.275978088378906, 35.381492614746094, 64.57572937011719, 8.389511108398438, 150.7488555908203, 63.746795654296875, 30.68072509765625, 33.226806640625, 26.311630249023438, 168.09800720214844, 14.640304565429688, 90.41880798339844, 166.67457580566406, 98.5510025024414, 148.60137939453125, -77.89674377441406, 62.470245361328125, 218.54100036621094, 149.92489624023438, -116.94013977050781, 233.7327880859375, -47.19629669189453, 10.979900360107422, 109.97549438476562, 157.64674377441406, -38.62141418457031, 153.142578125, 107.98896789550781, 19.12946128845215, 138.26010131835938, 27.104278564453125, 107.77973937988281, 8.551403045654297, -101.38587951660156, 10.797033309936523, 0.9059906005859375, 195.7664031982422, -18.691055297851562, 190.5234375, 87.015869140625, -40.04200744628906, -15.864631652832031, 16.278114318847656, 70.34672546386719, 290.39385986328125, 75.04743957519531, 21.359176635742188, 147.8858184814453, 175.754150390625, 105.11079406738281], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000538.npy"}
{"epoch": 0.7900146842878121, "step": 539, "batch_size": 64, "mean": 86.07090759277344, "std": 108.04013061523438, "min": -160.7167205810547, "p10": -36.8807632446289, "median": 79.07216262817383, "p90": 215.52876281738287, "max": 328.4352722167969, "pos_frac": 0.796875, "sample": [34.68949890136719, 53.13236999511719, -34.42601013183594, 15.456649780273438, 114.9022445678711, 142.51100158691406, -3.9507408142089844, 79.89093017578125, 78.33753967285156, 144.84632873535156, -52.0950927734375, -2.3207244873046875, 58.60392761230469, 152.00848388671875, 177.0732421875, 112.9053955078125, 89.292236328125, 164.9740753173828, 79.8067855834961, 186.1201171875, 305.57501220703125, -160.7167205810547, 220.54690551757812, 239.8477020263672, 174.71969604492188, -25.125064849853516, 186.88992309570312, 58.82417297363281, 182.65553283691406, 154.57598876953125, 16.457569122314453, 196.85629272460938, 70.31375122070312, 26.587921142578125, 34.28520202636719, 0.601409912109375, 58.15399169921875, 328.4352722167969, 36.40080642700195, 113.69522857666016, -145.15203857421875, 235.28656005859375, -33.344207763671875, 100.0083999633789, 191.29844665527344, 15.48521614074707, 203.81976318359375, -106.01646423339844, -141.5274658203125, 43.66786193847656, 251.32473754882812, 26.173980712890625, 124.5689468383789, 23.33344268798828, 158.50564575195312, -37.93280029296875, 269.2596740722656, 58.046470642089844, 7.4766387939453125, 175.10633850097656, -26.06859588623047, 156.36895751953125, 190.8802947998047, -43.37040710449219], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000539.npy"}
{"epoch": 0.7914831130690162, "step": 540, "batch_size": 64, "mean": 103.08011627197266, "std": 115.2513198852539, "min": -175.52490234375, "p10": -17.291388702392553, "median": 97.45653533935547, "p90": 243.87056732177734, "max": 369.1318359375, "pos_frac": 0.890625, "sample": [138.62564086914062, 23.085235595703125, 32.064117431640625, -122.13059997558594, 198.77249145507812, -128.8220672607422, 200.4493408203125, 28.102081298828125, -28.817195892333984, 19.833091735839844, 12.078744888305664, 241.6832275390625, 24.66351318359375, 216.40963745117188, 344.1282958984375, 150.36318969726562, 80.61980438232422, 206.29315185546875, 192.63153076171875, 101.03628540039062, 171.65597534179688, 107.03021240234375, 185.08314514160156, 147.10562133789062, 89.19071960449219, -44.28858947753906, 173.41806030273438, 335.39190673828125, 70.75065612792969, 100.61509704589844, 20.421875, 185.14151000976562, 195.11911010742188, 107.63117980957031, 58.364776611328125, 244.80799865722656, -79.06336212158203, 33.2703857421875, 287.1025085449219, 24.709556579589844, 259.0821838378906, 357.63214111328125, 100.00466918945312, 13.12738037109375, -62.747276306152344, 98.51608276367188, 205.66647338867188, 21.399505615234375, 186.52978515625, 88.68283081054688, -175.52490234375, 35.4888916015625, 51.75336456298828, 148.06655883789062, 16.289947509765625, 31.388748168945312, 38.76123046875, 9.602161407470703, 369.1318359375, 88.13841247558594, 24.928634643554688, 149.63035583496094, 100.65337371826172, 96.39698791503906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000540.npy"}
{"epoch": 0.7929515418502202, "step": 541, "batch_size": 64, "mean": 67.08287811279297, "std": 94.55475616455078, "min": -181.6704559326172, "p10": -35.03463439941406, "median": 51.75041198730469, "p90": 204.5879791259766, "max": 313.367919921875, "pos_frac": 0.796875, "sample": [-23.6123046875, 21.142532348632812, 112.92526245117188, 25.725631713867188, 65.70807647705078, -16.9459228515625, 114.66567993164062, 119.12362670898438, 119.44546508789062, 109.09234619140625, 12.647857666015625, -28.98003387451172, 14.448074340820312, 172.31100463867188, 114.71701049804688, 68.10443115234375, 157.16395568847656, 214.26556396484375, 128.5771026611328, 67.59637451171875, 313.367919921875, 256.86688232421875, 172.3915557861328, 97.53359985351562, 14.010536193847656, -7.8326873779296875, -122.39852905273438, 32.854000091552734, 2.606372833251953, 98.99893188476562, 25.94232177734375, -69.40277099609375, 76.96525573730469, 208.20428466796875, -181.6704559326172, 11.430866241455078, 21.29083251953125, -3.9167442321777344, 196.14993286132812, 237.23936462402344, 34.71086883544922, 48.19511413574219, 32.11848449707031, 57.62117004394531, 52.679962158203125, 146.02096557617188, -57.582462310791016, 125.78305053710938, -37.62946319580078, -63.28291320800781, 23.371944427490234, 33.927223205566406, 22.623550415039062, 89.17801666259766, 291.6900939941406, 89.54116821289062, -46.27940368652344, 57.756614685058594, -8.411544799804688, 42.29655456542969, 217.037353515625, 50.82086181640625, 133.02468872070312, 9.339012145996094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000541.npy"}
{"epoch": 0.7944199706314243, "step": 542, "batch_size": 64, "mean": 101.42529296875, "std": 100.53813934326172, "min": -134.18411254882812, "p10": -32.95146255493163, "median": 108.50820541381836, "p90": 221.42076110839844, "max": 292.3429260253906, "pos_frac": 0.796875, "sample": [98.7259521484375, 177.19839477539062, 220.29998779296875, -19.891799926757812, -16.860519409179688, 146.5920867919922, -4.94355583190918, 276.12347412109375, 239.93812561035156, 91.81796264648438, 122.789306640625, 117.01302337646484, 203.47024536132812, 112.10678100585938, 214.49716186523438, 235.09873962402344, 107.33222961425781, -19.09271240234375, 186.2843017578125, 42.144927978515625, 54.248626708984375, -23.26860809326172, 51.86421203613281, 104.45160675048828, -134.18411254882812, 33.35084533691406, -76.67973327636719, 137.71994018554688, -66.2362060546875, 193.08921813964844, -55.21015167236328, 141.16836547851562, -85.86613464355469, -85.50361633300781, 109.6841812133789, 75.035888671875, 168.50497436523438, 167.9772491455078, 62.362701416015625, 101.39862060546875, 72.68419647216797, 213.3914337158203, 239.13330078125, -21.076560974121094, 165.49093627929688, 169.9510955810547, 20.144041061401367, 71.0487060546875, 67.32432556152344, 14.990699768066406, 199.8489990234375, 89.36250305175781, 239.63990783691406, 183.63064575195312, 153.6341094970703, 292.3429260253906, 173.9468536376953, -37.10125732421875, 204.9102783203125, 60.52539825439453, 158.11146545410156, 123.61778259277344, 221.90109252929688, 9.213729858398438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000542.npy"}
{"epoch": 0.7958883994126285, "step": 543, "batch_size": 64, "mean": 53.89453887939453, "std": 118.05213165283203, "min": -210.56504821777344, "p10": -90.28334503173826, "median": 37.58575630187988, "p90": 195.25649566650392, "max": 369.297119140625, "pos_frac": 0.65625, "sample": [36.08503723144531, -13.660476684570312, 32.42902374267578, -76.81752014160156, 198.48643493652344, 287.2336730957031, -20.421497344970703, -16.707168579101562, -101.1817855834961, 128.9000244140625, -127.47978973388672, -96.05441284179688, -66.15599822998047, 156.78506469726562, 369.297119140625, 27.971736907958984, 85.83683776855469, 303.7861633300781, -4.262767791748047, 181.603515625, 119.17520904541016, 55.02167510986328, -75.30076599121094, 76.04061889648438, -145.33779907226562, 172.2875518798828, -12.961166381835938, 235.11793518066406, -60.50450897216797, 112.14259338378906, 93.53517150878906, 7.837799072265625, -210.56504821777344, 131.35386657714844, -1.8728179931640625, 0.8259773254394531, 187.719970703125, 162.56483459472656, 246.1742401123047, -58.04168701171875, 84.7978286743164, 26.99847412109375, -182.9938201904297, 42.76770782470703, 58.75511932373047, 35.94169616699219, 211.60986328125, 179.01925659179688, -38.90424728393555, 87.65304565429688, 128.36172485351562, 38.14700698852539, 174.5654296875, -34.078338623046875, 155.73785400390625, 112.60855102539062, 20.05261993408203, -123.80654907226562, 37.024505615234375, -43.206390380859375, 34.93328094482422, 60.65447998046875, -2.1989173889160156, 63.92344665527344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000543.npy"}
{"epoch": 0.7973568281938326, "step": 544, "batch_size": 64, "mean": 65.94219207763672, "std": 94.27622985839844, "min": -177.69412231445312, "p10": -21.33617248535156, "median": 44.11864471435547, "p90": 192.54881896972657, "max": 375.07427978515625, "pos_frac": 0.765625, "sample": [63.29917907714844, 17.00469970703125, -55.63630676269531, 36.948822021484375, 375.07427978515625, -28.570846557617188, 43.24543762207031, 90.43608093261719, 47.47115707397461, -7.167348861694336, 2.414642333984375, 4.466045379638672, 99.55947875976562, 44.991851806640625, -177.69412231445312, 91.87516021728516, 221.19920349121094, 192.7227325439453, 70.88389587402344, 74.00103759765625, 167.29122924804688, -20.10589599609375, -0.9902305603027344, 36.9143180847168, 35.46318817138672, 229.43212890625, 192.1430206298828, 184.9844512939453, 17.73143196105957, 200.55450439453125, 188.56845092773438, 9.041038513183594, 36.15892028808594, 129.4258575439453, 35.300357818603516, -14.9715576171875, 46.27203369140625, 7.615715026855469, -21.863433837890625, -19.284988403320312, 180.689208984375, 52.666343688964844, 77.76705932617188, 39.225433349609375, 70.56675720214844, 21.551666259765625, -17.43548583984375, 59.40968322753906, 88.87052154541016, 12.005462646484375, -5.946418762207031, 93.6130599975586, 121.6775894165039, 273.111328125, 150.0113067626953, -14.316940307617188, -27.074695587158203, 23.142013549804688, 210.33811950683594, -94.14067077636719, 116.71592712402344, 178.3754119873047, -37.186561584472656, 0.45828819274902344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000544.npy"}
{"epoch": 0.7988252569750367, "step": 545, "batch_size": 64, "mean": 81.7893295288086, "std": 111.91211700439453, "min": -165.92892456054688, "p10": -56.51874542236328, "median": 92.04413223266602, "p90": 230.9324142456055, "max": 307.5169372558594, "pos_frac": 0.828125, "sample": [99.36132049560547, -148.8914794921875, -15.54931640625, -165.92892456054688, 103.64944458007812, 156.50323486328125, 48.107810974121094, 9.325712203979492, 101.08828735351562, 74.63255310058594, 118.17706298828125, 236.3988800048828, -51.89680480957031, 0.7767333984375, 141.08499145507812, 150.276123046875, -56.80780029296875, 234.99392700195312, 232.2089385986328, 15.266510009765625, 143.36175537109375, 169.21302795410156, -158.1319580078125, -55.84428405761719, 111.34046173095703, 45.816551208496094, 45.238677978515625, -99.11669921875, 220.3738250732422, 131.88243103027344, 143.8452911376953, 22.820999145507812, 1.5121173858642578, 84.30538940429688, 304.2496643066406, 259.76812744140625, 75.52254486083984, 117.2540283203125, 49.84651184082031, 15.183914184570312, 28.84423065185547, 154.051513671875, 167.7741241455078, 15.769733428955078, 29.512359619140625, 142.38839721679688, 141.6935577392578, 227.953857421875, 131.8649139404297, 19.546512603759766, -1.0146598815917969, 27.576400756835938, 84.72694396972656, 159.61045837402344, 199.09713745117188, 307.5169372558594, 169.46426391601562, 167.1619415283203, 37.75244140625, -157.56304931640625, 101.29460144042969, -131.26856994628906, 45.29766845703125, 254.2458038330078], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000545.npy"}
{"epoch": 0.8002936857562408, "step": 546, "batch_size": 64, "mean": 77.05686950683594, "std": 102.6640853881836, "min": -252.45233154296875, "p10": -37.897041320800774, "median": 74.57695388793945, "p90": 210.7830551147461, "max": 269.61676025390625, "pos_frac": 0.796875, "sample": [-32.297393798828125, 39.65475082397461, -102.26323699951172, 126.91585540771484, 78.2309799194336, 88.82459259033203, 111.27972412109375, 169.09771728515625, 211.42982482910156, 72.00082397460938, -22.374073028564453, 133.4555206298828, 138.2894744873047, -87.45121765136719, 120.91472625732422, 89.50746154785156, 27.99396514892578, 36.83756637573242, 269.61676025390625, 66.08322143554688, 18.754283905029297, 266.4484558105469, -252.45233154296875, 239.37179565429688, 6.749359130859375, 241.78237915039062, 28.889404296875, 182.55307006835938, 225.9235076904297, 124.13307189941406, -47.80047607421875, 51.0675048828125, 19.626930236816406, 235.76931762695312, 103.79407501220703, 72.8427505493164, 150.98501586914062, 145.21157836914062, 142.1321563720703, 154.45233154296875, -157.49258422851562, 70.25767517089844, -15.035552978515625, 0.10772705078125, -70.27001953125, 199.30361938476562, -6.488840103149414, 21.509918212890625, 40.024635314941406, 209.27392578125, 9.394729614257812, -40.29689025878906, 58.1438102722168, -4.31524658203125, 151.31222534179688, 141.99032592773438, 15.0260009765625, 76.3111572265625, -4.795398712158203, 120.84625244140625, 43.33190155029297, 160.95013427734375, 85.64157104492188, 180.92726135253906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000546.npy"}
{"epoch": 0.801762114537445, "step": 547, "batch_size": 64, "mean": 88.98194885253906, "std": 83.37480926513672, "min": -107.75752258300781, "p10": -14.642819404602045, "median": 83.1569595336914, "p90": 180.77251434326172, "max": 294.06939697265625, "pos_frac": 0.828125, "sample": [38.65513610839844, -25.310943603515625, 92.39797973632812, 78.63064575195312, -2.659027099609375, 27.82227325439453, 175.4525909423828, -64.73606872558594, 15.397247314453125, 268.138671875, 6.2462005615234375, 157.88973999023438, 163.9275360107422, 294.06939697265625, -107.75752258300781, 94.94930267333984, 189.23751831054688, 115.89038848876953, 40.051055908203125, 223.50746154785156, 45.69493103027344, 163.47738647460938, -1.4575653076171875, 167.90228271484375, 231.5478515625, 136.16880798339844, 158.85110473632812, 179.56634521484375, 163.81146240234375, 35.83197021484375, 102.3260726928711, -9.124221801757812, -24.312641143798828, 102.86714172363281, 157.02392578125, 138.01583862304688, -74.89636993408203, 181.28944396972656, 80.64381408691406, 147.2760009765625, 64.78421020507812, 108.1065673828125, 234.96658325195312, 158.05319213867188, 32.80719757080078, 119.92710876464844, -3.9452552795410156, 83.97589111328125, 37.688453674316406, 27.98351287841797, 73.46772766113281, 134.8736572265625, 82.33802795410156, 66.92901611328125, -23.118202209472656, 58.40834045410156, 115.16055297851562, 86.52420043945312, 78.04442596435547, 69.299560546875, 159.25131225585938, 37.71331787109375, -17.007932662963867, 44.310081481933594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000547.npy"}
{"epoch": 0.8032305433186491, "step": 548, "batch_size": 64, "mean": 69.57292175292969, "std": 117.11952209472656, "min": -211.33474731445312, "p10": -100.16321716308593, "median": 68.32189559936523, "p90": 193.713037109375, "max": 379.5396728515625, "pos_frac": 0.78125, "sample": [173.01739501953125, 119.63084411621094, 14.547744750976562, 42.65852355957031, 81.33072662353516, 23.048484802246094, 2.9597625732421875, 292.93011474609375, 185.49642944335938, 108.06939697265625, 158.10267639160156, 81.10858917236328, 181.91226196289062, 66.2620849609375, 59.707618713378906, -177.1895294189453, -36.56379699707031, -23.18539810180664, 219.3544921875, 192.56259155273438, 195.6239013671875, 20.093196868896484, 33.84882354736328, 63.28102111816406, 194.20608520507812, -211.33474731445312, -119.88432312011719, 100.39163208007812, 60.021461486816406, -97.28990173339844, 111.63241577148438, 379.5396728515625, 132.87332153320312, 86.95783996582031, 54.13428497314453, -73.8697738647461, 102.35548400878906, 61.496665954589844, 166.71493530273438, 103.44804382324219, 181.0025634765625, -89.32704162597656, 37.434513092041016, 67.1430435180664, 61.222633361816406, -175.6688690185547, 94.62158203125, 130.89462280273438, 38.255645751953125, -101.39463806152344, 112.45561218261719, -103.27276611328125, -42.79191589355469, 244.74893188476562, -106.09458923339844, 54.28537368774414, -60.1077880859375, 186.23040771484375, 69.50074768066406, 173.4322967529297, 7.2569732666015625, 151.5982666015625, 113.30117797851562, 277.9396057128906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000548.npy"}
{"epoch": 0.8046989720998532, "step": 549, "batch_size": 64, "mean": 77.89366912841797, "std": 110.12594604492188, "min": -233.60385131835938, "p10": -78.99336624145506, "median": 73.51017761230469, "p90": 217.10416564941409, "max": 278.021728515625, "pos_frac": 0.8125, "sample": [-8.160194396972656, 213.1844940185547, -16.07727813720703, 30.046913146972656, 169.79136657714844, 202.28839111328125, 115.93640899658203, 194.87025451660156, 135.00160217285156, 237.17152404785156, 85.52786254882812, 39.08024597167969, 109.07450866699219, 139.80841064453125, 109.60990905761719, 172.73818969726562, 1.47808837890625, -233.60385131835938, 19.26055908203125, -89.40777587890625, 73.97541809082031, 176.39901733398438, 166.66098022460938, 35.47247314453125, 105.97639465332031, 65.04486083984375, 175.5170440673828, 20.501758575439453, 213.2508544921875, 86.07400512695312, 84.53459167480469, 0.32855796813964844, 51.63691711425781, -113.53555297851562, 218.75558471679688, -41.758331298828125, 160.59017944335938, 266.15008544921875, 63.551475524902344, 3.27728271484375, 73.04493713378906, 129.33412170410156, 163.20709228515625, 236.8881378173828, 268.3836364746094, 200.66549682617188, -69.72535705566406, 11.884113311767578, -88.21966552734375, 242.41897583007812, 59.164058685302734, -155.9422607421875, 20.41885757446289, 80.14247131347656, 104.12646484375, 69.99282836914062, -45.551116943359375, 12.624570846557617, 15.725616455078125, 278.021728515625, -82.96537017822266, 51.877899169921875, 55.708866119384766, -86.05472564697266], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000549.npy"}
{"epoch": 0.8061674008810573, "step": 550, "batch_size": 64, "mean": 74.38369750976562, "std": 91.2183837890625, "min": -151.4488525390625, "p10": -8.271107673645018, "median": 52.66654968261719, "p90": 211.1928894042969, "max": 267.865966796875, "pos_frac": 0.84375, "sample": [56.09687805175781, 37.29584503173828, 56.512210845947266, 231.37774658203125, 44.109344482421875, -60.68888854980469, 231.94662475585938, 28.85614776611328, 0.7962284088134766, 87.39411926269531, 162.57562255859375, 127.90167236328125, 198.35287475585938, 57.293643951416016, 35.21649169921875, 226.13674926757812, 30.815841674804688, -145.2667236328125, 74.01234436035156, 1.747802734375, -3.122772216796875, 16.285308837890625, 38.198036193847656, 172.98541259765625, 106.63551330566406, 53.09547424316406, 77.68255615234375, 101.77679443359375, 81.1620101928711, -6.772001266479492, 13.6844482421875, -3.5947647094726562, 48.860565185546875, 31.442707061767578, -8.913581848144531, 267.865966796875, -53.02374267578125, 253.4403533935547, 203.64663696289062, 40.024024963378906, 139.865234375, 128.7493438720703, 52.06401443481445, -61.09550476074219, 173.82659912109375, 41.25927734375, 158.14328002929688, 41.77960205078125, 213.89395141601562, 91.57362365722656, 39.85570526123047, 266.4747619628906, -50.17062759399414, -151.4488525390625, 50.21836471557617, 44.34592819213867, 52.23762512207031, 120.87553405761719, 16.9547119140625, 35.9903564453125, 70.90824890136719, 73.13418579101562, 204.89041137695312, 92.38899230957031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000550.npy"}
{"epoch": 0.8076358296622613, "step": 551, "batch_size": 64, "mean": 90.0142593383789, "std": 99.27595520019531, "min": -75.25483703613281, "p10": -14.212026882171628, "median": 63.71476745605469, "p90": 231.86455230712892, "max": 332.17498779296875, "pos_frac": 0.84375, "sample": [9.691167831420898, 88.88530731201172, 29.56975555419922, 63.946258544921875, 25.15496826171875, 116.21502685546875, -71.03262329101562, 159.25457763671875, 171.66798400878906, 76.0928955078125, 27.074756622314453, -1.2414283752441406, 53.9814453125, 78.57946014404297, 30.18726348876953, 88.87049865722656, 52.23362731933594, 63.4832763671875, 117.90701293945312, 327.0942687988281, 204.6254425048828, 27.704879760742188, 305.95452880859375, 91.28823852539062, 23.87061309814453, -16.411422729492188, 292.07373046875, -3.4421005249023438, -11.409520149230957, 40.120574951171875, -70.778564453125, 30.896507263183594, 332.17498779296875, -75.25483703613281, 62.243194580078125, 209.5205841064453, 10.516586303710938, 95.77188110351562, 57.87884521484375, 31.521778106689453, 1.2363739013671875, 39.770660400390625, 111.69193267822266, 24.194808959960938, 101.29985809326172, 230.93594360351562, -22.4832763671875, -38.845794677734375, 141.79872131347656, 67.90577697753906, 175.61167907714844, 120.95199584960938, 261.6639709472656, 62.79182434082031, 232.2625274658203, 124.48399353027344, 40.11534881591797, 169.9671630859375, 228.396484375, 274.5859375, 10.464771270751953, 194.70333862304688, -15.413101196289062, 76.34014129638672], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000551.npy"}
{"epoch": 0.8091042584434655, "step": 552, "batch_size": 64, "mean": 124.37358856201172, "std": 110.261962890625, "min": -193.013916015625, "p10": -20.024948883056634, "median": 125.00624465942383, "p90": 272.9895782470703, "max": 355.7478332519531, "pos_frac": 0.875, "sample": [63.454593658447266, 68.3668441772461, 159.65005493164062, 295.8171081542969, 273.8305358886719, 82.9442367553711, 189.47470092773438, 148.148193359375, 77.23255920410156, -23.300575256347656, 234.3485870361328, 45.89537048339844, -55.71720886230469, 200.81597900390625, 179.23658752441406, 110.41116333007812, 139.54965209960938, 139.704345703125, 355.7478332519531, -58.30183792114258, -57.83380126953125, 181.46563720703125, 238.683837890625, 176.09727478027344, -193.013916015625, 69.04505920410156, 165.34463500976562, 226.2115478515625, 84.22191619873047, -22.512901306152344, 296.2403564453125, -14.2197265625, 153.49124145507812, 118.88046264648438, 260.1081237792969, 178.25686645507812, 193.33302307128906, 319.62103271484375, 273.4551696777344, 219.12353515625, 234.12112426757812, 103.13638305664062, 58.80194091796875, 126.1162109375, 27.661666870117188, 295.9279479980469, 138.856689453125, 190.65545654296875, 271.9031982421875, 118.57492065429688, 48.671417236328125, 0.7547206878662109, 0.2276763916015625, 52.74212646484375, 123.89627838134766, 62.414215087890625, 32.94099426269531, -38.64744567871094, 3.9670162200927734, 23.40869140625, 238.19430541992188, 106.33708190917969, 168.02340698242188, 77.91551208496094], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000552.npy"}
{"epoch": 0.8105726872246696, "step": 553, "batch_size": 64, "mean": 76.58863830566406, "std": 103.08342742919922, "min": -162.02479553222656, "p10": -54.908524703979474, "median": 81.45176696777344, "p90": 202.5831726074219, "max": 275.7593078613281, "pos_frac": 0.78125, "sample": [106.91793823242188, 228.5072021484375, 33.7105712890625, -98.91773223876953, 204.51193237304688, -32.11506271362305, 107.08972930908203, -162.02479553222656, 128.1080780029297, 20.47359848022461, 184.74127197265625, 43.36273956298828, -1.52301025390625, 161.71646118164062, 28.663352966308594, 182.77301025390625, -36.00534439086914, 43.3873291015625, 138.2025604248047, -111.609375, 66.49505615234375, 225.2303924560547, 2.0305404663085938, 34.411251068115234, 11.322090148925781, 110.22091674804688, 274.90887451171875, 198.08273315429688, -63.0098876953125, 61.854610443115234, 91.78428649902344, 55.74048614501953, 162.337158203125, -21.696060180664062, 74.53964233398438, 30.194564819335938, 77.66250610351562, 106.45318603515625, 111.60325622558594, -155.01806640625, 17.274425506591797, 168.43930053710938, 13.171241760253906, 133.25662231445312, 213.51507568359375, 154.16262817382812, -10.991653442382812, -96.3755874633789, 195.4801025390625, 30.982337951660156, 177.14080810546875, -8.404014587402344, 275.7593078613281, 118.61097717285156, 132.558349609375, 205.94400024414062, 85.24102783203125, 156.3275604248047, 46.53926086425781, 86.09268188476562, -5.027584075927734, 197.54507446289062, -139.54078674316406, 128.853759765625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000553.npy"}
{"epoch": 0.8120411160058737, "step": 554, "batch_size": 64, "mean": 83.78956604003906, "std": 124.14484405517578, "min": -193.995361328125, "p10": -73.65220413208007, "median": 89.93935012817383, "p90": 214.3124740600586, "max": 361.4595642089844, "pos_frac": 0.75, "sample": [66.33102416992188, 96.36483764648438, 184.11959838867188, 168.3261260986328, 10.17190170288086, 168.81805419921875, -53.64646911621094, -34.903419494628906, 57.83745574951172, 157.83331298828125, 70.78216552734375, 132.73348999023438, 118.12789154052734, 22.19842529296875, 5.811792373657227, 5.7882537841796875, 236.42752075195312, -125.3229751586914, -74.45624542236328, 107.802001953125, -154.5841827392578, -12.443456649780273, 98.20899963378906, 74.44026184082031, 263.1092224121094, 88.8519287109375, -4.4219818115234375, 58.515403747558594, 78.25531005859375, 38.27172088623047, 197.96371459960938, 205.04974365234375, 210.25067138671875, 142.71702575683594, 211.38894653320312, 187.7991180419922, 190.17578125, 155.20492553710938, 124.46623229980469, -55.393226623535156, -88.99617004394531, 153.09213256835938, 240.9441680908203, -10.44363021850586, 200.36160278320312, 10.767738342285156, 193.43038940429688, -63.32403564453125, 272.7384033203125, -71.77610778808594, -156.8130340576172, 132.39622497558594, -15.455718994140625, -193.995361328125, 187.16738891601562, 91.02677154541016, 26.116439819335938, 59.91175079345703, -179.63723754882812, 185.04664611816406, 361.4595642089844, 340.80224609375, 215.56541442871094, 53.17594909667969], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000554.npy"}
{"epoch": 0.8135095447870778, "step": 555, "batch_size": 64, "mean": 79.01618957519531, "std": 114.86090850830078, "min": -139.28585815429688, "p10": -53.65164337158203, "median": 66.84599304199219, "p90": 227.5524230957032, "max": 334.7373046875, "pos_frac": 0.75, "sample": [197.39959716796875, 10.5277099609375, 174.41725158691406, -50.749847412109375, 170.95654296875, 205.8492889404297, 119.153076171875, -52.003936767578125, -105.98246002197266, 169.79501342773438, 15.86505126953125, 77.50521850585938, 146.5701141357422, 210.29949951171875, 56.57783508300781, -54.35780334472656, 60.02500915527344, -38.224952697753906, 83.53900146484375, 312.080322265625, 56.34434509277344, 242.79629516601562, 19.0096435546875, -124.33309936523438, 196.58074951171875, -139.28585815429688, 79.00374603271484, 26.460670471191406, 240.32498168945312, -43.760948181152344, -31.2584228515625, 234.946533203125, 204.51242065429688, 203.49130249023438, 21.6982421875, 63.12229919433594, 16.730484008789062, -96.77742004394531, -2.9367408752441406, -105.1957778930664, -131.94898986816406, 82.42137145996094, 68.94456481933594, 250.3648223876953, 36.15708923339844, 43.55744171142578, 161.08387756347656, 10.474664688110352, 64.74742126464844, 204.86302185058594, 274.9764404296875, 120.77490234375, 182.58001708984375, -30.21202850341797, 18.151325225830078, 36.2493896484375, 334.7373046875, 75.78080749511719, 118.51351928710938, 118.58139038085938, 91.34428405761719, -6.031036376953125, -38.822418212890625, 199.0318603515625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000555.npy"}
{"epoch": 0.8149779735682819, "step": 556, "batch_size": 64, "mean": 86.51844024658203, "std": 104.53836059570312, "min": -177.4009246826172, "p10": -38.634909439086904, "median": 92.68851089477539, "p90": 225.8837966918946, "max": 394.285888671875, "pos_frac": 0.796875, "sample": [119.14834594726562, 32.631622314453125, 67.9877700805664, -20.472091674804688, 197.52764892578125, 117.70753479003906, 163.67483520507812, 39.73065185546875, -148.69232177734375, 253.51800537109375, -30.51461410522461, 68.08020782470703, 103.76841735839844, 102.12547302246094, 188.42921447753906, 27.01666259765625, 120.01356506347656, 108.89300537109375, 140.3317413330078, 87.74529266357422, -46.17021942138672, 164.64002990722656, -10.4761962890625, 31.15155029296875, -117.42760467529297, 236.65521240234375, -76.44402313232422, 152.83265686035156, 163.87478637695312, -177.4009246826172, 54.962825775146484, -9.780197143554688, 157.044677734375, 150.4916534423828, 66.96287536621094, 27.844348907470703, 234.9378662109375, 105.1318359375, 14.659515380859375, -42.11503601074219, 74.66751098632812, 98.0128173828125, 210.5404815673828, 232.45950317382812, 97.63172912597656, 54.186004638671875, 187.9081573486328, 162.20181274414062, 394.285888671875, 14.230094909667969, 51.550567626953125, 176.38458251953125, 11.04437255859375, 142.36868286132812, 233.0364990234375, -67.31459045410156, 28.296356201171875, 185.3048095703125, -0.01117706298828125, 101.54874420166016, 235.5648193359375, -5.644077301025391, 39.99224853515625, 58.907554626464844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000556.npy"}
{"epoch": 0.8164464023494861, "step": 557, "batch_size": 64, "mean": 97.38102722167969, "std": 111.67884063720703, "min": -137.0384521484375, "p10": -37.40668983459472, "median": 87.51117324829102, "p90": 227.2393249511719, "max": 365.88916015625, "pos_frac": 0.78125, "sample": [-75.10830688476562, 306.0379638671875, 203.19532775878906, 29.6414794921875, 74.26261901855469, 149.84954833984375, 6.002716064453125, -8.787910461425781, 137.53469848632812, 9.32647705078125, 122.63107299804688, 145.1837158203125, 365.88916015625, 64.27276611328125, 50.09410095214844, 218.56350708007812, 49.00787353515625, 78.92276000976562, 41.64557647705078, 176.10877990722656, 55.300201416015625, 193.49826049804688, 198.41561889648438, 138.21656799316406, -51.109344482421875, 179.70535278320312, -65.11492919921875, 136.30101013183594, 2.7162704467773438, 214.22532653808594, 175.298583984375, 33.09574890136719, 271.1769104003906, 51.46648406982422, 230.15904235839844, 37.622989654541016, 258.5581359863281, -30.215049743652344, 108.61532592773438, -36.652523040771484, -66.36784362792969, -73.8747329711914, 58.181312561035156, 96.0995864868164, 7.032398223876953, -12.577430725097656, 205.542236328125, 109.90715026855469, -37.72990417480469, 304.9927062988281, 136.2918701171875, 125.75892639160156, 206.38534545898438, 159.44891357421875, 164.56834411621094, 73.01123046875, -137.0384521484375, 311.4691162109375, -12.5050048828125, 181.51248168945312, -32.660552978515625, -6.148990631103516, 5.106605529785156, 220.42665100097656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000557.npy"}
{"epoch": 0.8179148311306902, "step": 558, "batch_size": 64, "mean": 100.5401840209961, "std": 94.94080352783203, "min": -137.0618896484375, "p10": 5.198601531982423, "median": 100.25115203857422, "p90": 213.5351211547852, "max": 387.4079895019531, "pos_frac": 0.90625, "sample": [124.63442993164062, 122.37191772460938, 174.17410278320312, 232.30245971679688, 130.045166015625, 132.66465759277344, 114.96295166015625, 202.71253967285156, 31.168888092041016, -137.0618896484375, 4.7987060546875, 248.37132263183594, 74.62265014648438, 175.466064453125, 65.63261413574219, -0.2183074951171875, 58.784423828125, 29.59408187866211, 108.46484375, 225.18438720703125, 170.97557067871094, 28.353309631347656, 59.064453125, 54.17516326904297, 109.91656494140625, 80.15750122070312, 266.89129638671875, -3.5391387939453125, 75.62895202636719, -70.60771942138672, 167.68307495117188, 10.730552673339844, 45.362770080566406, 181.57113647460938, 63.99382019042969, 186.12924194335938, 21.151092529296875, 173.3775634765625, -122.2802734375, 152.11692810058594, 8.153610229492188, 52.40874481201172, 166.76913452148438, 332.13751220703125, 14.412132263183594, 58.08229446411133, 6.131690979003906, 387.4079895019531, 96.48597717285156, 37.10240173339844, 41.204620361328125, 162.96719360351562, 117.09524536132812, 134.75469970703125, 47.83721160888672, 108.81729125976562, 55.59032440185547, -10.33034896850586, 218.17337036132812, 104.01632690429688, 179.81622314453125, 133.4808349609375, 36.281028747558594, 176.24850463867188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000558.npy"}
{"epoch": 0.8193832599118943, "step": 559, "batch_size": 64, "mean": 84.61210632324219, "std": 103.68717956542969, "min": -193.85122680664062, "p10": -46.095987701416014, "median": 82.89986038208008, "p90": 210.04104461669925, "max": 293.33404541015625, "pos_frac": 0.8125, "sample": [66.70143127441406, 200.0487518310547, 163.42352294921875, 214.32345581054688, -16.302818298339844, 93.8228759765625, -46.3203125, 34.930999755859375, 164.7025604248047, 170.4738006591797, 223.84088134765625, 156.09622192382812, 27.187698364257812, 241.740478515625, 93.01449584960938, 106.752197265625, 157.65748596191406, 267.03692626953125, 31.56573486328125, -19.456329345703125, 293.33404541015625, 58.12217712402344, -78.77345275878906, -76.9623794555664, 96.30510711669922, 74.38616943359375, -169.06158447265625, -193.85122680664062, 199.72637939453125, 144.4243927001953, 184.3048553466797, 15.653240203857422, 64.12565612792969, 143.0011444091797, 143.35952758789062, 58.453216552734375, 38.59709548950195, -45.57256317138672, 33.62861633300781, 26.967426300048828, 177.53515625, -21.283851623535156, 135.03382873535156, 24.465713500976562, 163.230224609375, 179.8686981201172, -100.27066040039062, 186.72889709472656, 232.48956298828125, 1.4457130432128906, 114.84270477294922, 34.2618408203125, 34.76948547363281, 72.1943588256836, 218.4466094970703, 134.86471557617188, -41.82850646972656, 151.14407348632812, 52.98149871826172, 76.4800033569336, 31.81689453125, -64.46796417236328, 189.69810485839844, 89.31971740722656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000559.npy"}
{"epoch": 0.8208516886930984, "step": 560, "batch_size": 64, "mean": 80.60478210449219, "std": 104.02654266357422, "min": -170.17337036132812, "p10": -41.61791267395018, "median": 73.25232696533203, "p90": 223.1760223388672, "max": 297.15521240234375, "pos_frac": 0.78125, "sample": [69.31446838378906, 12.651737213134766, 64.82843017578125, 225.50537109375, 113.76408386230469, 8.419662475585938, -170.17337036132812, -150.21932983398438, 89.3427734375, 174.9756317138672, 102.38763427734375, 33.046173095703125, 198.6425018310547, -50.602630615234375, 164.00839233398438, -26.24764633178711, 217.74087524414062, 36.745384216308594, 172.4180908203125, 46.659088134765625, 87.18862915039062, -18.872581481933594, 116.77218627929688, 233.20999145507812, 68.63410949707031, 99.70620727539062, -4.095680236816406, 255.73074340820312, 12.317245483398438, -48.205169677734375, 158.59201049804688, -168.45140075683594, 65.55987548828125, 187.73980712890625, 55.71064758300781, 75.18864440917969, 93.43748474121094, 151.79544067382812, 249.0836181640625, 17.948379516601562, 238.01422119140625, 61.523681640625, 135.8790283203125, 3.6391258239746094, 111.2848129272461, 250.88980102539062, 194.3480682373047, 216.83909606933594, 46.82575988769531, 297.15521240234375, -20.096099853515625, -12.42205810546875, 106.46986389160156, 67.53034973144531, 105.46309661865234, 117.2723617553711, -22.134780883789062, 84.36051940917969, 71.31600952148438, 198.12655639648438, -55.136932373046875, -23.878463745117188, 11.708755493164062, -48.469207763671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000560.npy"}
{"epoch": 0.8223201174743024, "step": 561, "batch_size": 64, "mean": 76.30671691894531, "std": 87.3763198852539, "min": -104.05476379394531, "p10": -14.971413421630858, "median": 67.51066207885742, "p90": 193.51998748779297, "max": 300.1499938964844, "pos_frac": 0.84375, "sample": [138.56149291992188, 32.175148010253906, -31.290939331054688, 57.55309295654297, 29.195083618164062, 147.92726135253906, 81.91355895996094, 161.1139678955078, 300.1499938964844, 156.11338806152344, 0.5266056060791016, 32.16949462890625, 237.37875366210938, 93.59136199951172, 192.89431762695312, 97.5642318725586, 104.2428970336914, 19.010574340820312, 85.4145278930664, 44.462890625, 295.6226806640625, 22.639488220214844, 35.93132019042969, 149.35958862304688, 14.016204833984375, -15.051666259765625, 203.71243286132812, 98.45513916015625, 75.58004760742188, 164.93365478515625, 228.19284057617188, 120.20135498046875, 7.9399566650390625, 110.24212646484375, 193.7881317138672, 20.344390869140625, -8.31617546081543, 52.42388916015625, 67.13191986083984, 114.43877410888672, 37.31636428833008, -12.982719421386719, 32.08180236816406, 90.07121276855469, -50.33348083496094, 9.684932708740234, 179.51959228515625, 190.5828857421875, 23.35725212097168, 105.84632873535156, -93.89311218261719, 217.474853515625, 9.497184753417969, -104.05476379394531, 41.793121337890625, 12.21212387084961, 30.665904998779297, 86.67264556884766, -42.7265739440918, -14.784156799316406, -55.69664001464844, 67.889404296875, 69.97116088867188, 121.2108154296875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000561.npy"}
{"epoch": 0.8237885462555066, "step": 562, "batch_size": 64, "mean": 73.01620483398438, "std": 114.5401382446289, "min": -222.30970764160156, "p10": -55.65605583190917, "median": 83.61554336547852, "p90": 209.8756866455079, "max": 442.20550537109375, "pos_frac": 0.703125, "sample": [-71.79739379882812, 191.69476318359375, -23.338726043701172, 35.86980438232422, 123.62519836425781, 71.41980743408203, 239.5408172607422, -34.47184753417969, 176.0657196044922, 80.22398376464844, 50.65986251831055, 231.93649291992188, -5.384011268615723, 11.106788635253906, 266.314453125, -161.98182678222656, 37.26788330078125, 110.75898742675781, 87.3988037109375, 222.73226928710938, 86.28306579589844, 123.16976928710938, 156.63885498046875, -1.3984336853027344, 27.668014526367188, 217.66751098632812, 184.27493286132812, 170.26785278320312, 147.87936401367188, 119.31269836425781, 40.266029357910156, -29.4339599609375, 114.06848907470703, 180.08709716796875, -130.637451171875, 442.20550537109375, 72.41007995605469, 122.77011108398438, -149.62698364257812, 190.150146484375, -7.0367279052734375, 88.84468078613281, 104.67031860351562, 22.50922393798828, -14.544139862060547, 152.1942138671875, 147.92996215820312, 85.30401611328125, 3.4655685424804688, 131.46697998046875, -60.103450775146484, 96.04739379882812, 141.1253662109375, -45.27880096435547, 148.95159912109375, -5.650810241699219, -222.30970764160156, 81.92707061767578, -14.046829223632812, -35.941680908203125, 17.188621520996094, -26.872787475585938, 229.3898162841797, -69.85749816894531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000562.npy"}
{"epoch": 0.8252569750367107, "step": 563, "batch_size": 64, "mean": 65.76155090332031, "std": 96.38642883300781, "min": -178.6107177734375, "p10": -29.44734191894531, "median": 62.99688148498535, "p90": 174.01441040039063, "max": 311.06121826171875, "pos_frac": 0.734375, "sample": [23.37008285522461, -178.6107177734375, 59.06866455078125, 61.51264953613281, 227.64947509765625, 13.382080078125, 253.69815063476562, -31.507965087890625, 193.1739044189453, 129.33963012695312, 142.68276977539062, -6.253229141235352, 19.563522338867188, 74.9473876953125, 113.11808776855469, 61.94302749633789, 69.86607360839844, 131.23060607910156, 131.97706604003906, 156.91539001464844, 166.02658081054688, -20.302927017211914, -93.7982177734375, 108.55592346191406, 110.56307983398438, -17.98568344116211, 65.88113403320312, -38.32377624511719, 246.03436279296875, 78.71321105957031, 86.01998901367188, -15.699230194091797, 18.30188751220703, 174.39971923828125, 143.1553497314453, 148.65357971191406, 26.662948608398438, -114.27008056640625, 173.1153564453125, 18.186172485351562, 88.66681671142578, 36.90057373046875, 271.7373046875, 59.39893341064453, -24.63922119140625, -105.62670135498047, 64.05073547363281, 311.06121826171875, 153.81051635742188, -22.381011962890625, -7.1277008056640625, 51.063941955566406, -3.3555068969726562, 7.613739013671875, 45.324676513671875, -133.5269775390625, 76.54081726074219, -8.442960739135742, -3.6349258422851562, 125.66801452636719, 87.67417907714844, 82.11363983154297, 101.65775299072266, 43.23542785644531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000563.npy"}
{"epoch": 0.8267254038179148, "step": 564, "batch_size": 64, "mean": 72.30021667480469, "std": 84.77122497558594, "min": -143.627685546875, "p10": -31.240916442871093, "median": 67.85370635986328, "p90": 185.91116333007812, "max": 251.01708984375, "pos_frac": 0.765625, "sample": [72.62918090820312, 116.22111511230469, 63.473236083984375, 162.12051391601562, 62.68971252441406, -73.5196533203125, 24.924732208251953, 7.526111602783203, 26.239356994628906, 124.60873413085938, 162.0567169189453, 68.83222961425781, 15.38629150390625, -41.05262756347656, 251.01708984375, -26.703811645507812, -31.606948852539062, 156.73846435546875, -2.7981414794921875, 31.74160385131836, 110.58184051513672, 103.20181274414062, 26.640567779541016, -52.03339385986328, -143.627685546875, -59.477481842041016, 134.903076171875, 87.070556640625, 145.16311645507812, -30.3868408203125, 51.699317932128906, 173.62185668945312, 79.3941650390625, -17.632278442382812, 45.16568374633789, 83.65304565429688, 136.33856201171875, 220.08367919921875, 25.647354125976562, -17.026290893554688, 79.05087280273438, 85.65673828125, 66.87518310546875, 186.8567657470703, -23.3277587890625, 109.80111694335938, 218.4627685546875, 204.65017700195312, 96.92767333984375, 20.93109130859375, -1.913299560546875, 105.24781799316406, 60.459007263183594, -37.27656555175781, 226.9635772705078, 156.60220336914062, 183.7047576904297, 60.17101287841797, 39.24127197265625, -4.194976806640625, 115.53591918945312, 194.53192138671875, 26.43360137939453, 182.3184814453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000564.npy"}
{"epoch": 0.8281938325991189, "step": 565, "batch_size": 64, "mean": 91.62552642822266, "std": 104.08709716796875, "min": -147.4487762451172, "p10": -34.487400817871084, "median": 83.44102478027344, "p90": 236.67377624511718, "max": 260.989501953125, "pos_frac": 0.765625, "sample": [-6.127128601074219, 237.16668701171875, 177.56658935546875, -8.608657836914062, 20.78802490234375, 227.11807250976562, 69.86937713623047, -9.481376647949219, -113.20187377929688, 81.4319076538086, 143.0916748046875, 192.15151977539062, 25.493534088134766, 15.20928955078125, -0.8298530578613281, 3.7200927734375, -7.7913055419921875, 23.996978759765625, 75.59356689453125, 191.7999267578125, 260.41845703125, 132.3053436279297, -27.733505249023438, 232.84878540039062, 10.182723999023438, 5.538543701171875, 183.32342529296875, 61.05762481689453, -85.16126251220703, 189.87188720703125, 246.40753173828125, 170.5330047607422, 85.45014190673828, 58.32062530517578, -147.4487762451172, -48.609039306640625, 137.46498107910156, 154.12725830078125, 135.682373046875, 102.08926391601562, 73.25535583496094, 235.52365112304688, -58.24925231933594, 89.74879455566406, 0.1418914794921875, 241.11248779296875, 117.02977752685547, 252.4044189453125, 37.671478271484375, -43.72406005859375, 178.1240234375, 33.209564208984375, 238.88955688476562, 183.14572143554688, 136.71754455566406, 260.989501953125, 148.29759216308594, -4.501043319702148, -37.381927490234375, 66.7886962890625, 182.065673828125, -3.5997047424316406, 110.11357116699219, 230.63430786132812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000565.npy"}
{"epoch": 0.8296622613803231, "step": 566, "batch_size": 64, "mean": 87.17107391357422, "std": 101.75959777832031, "min": -212.12991333007812, "p10": -9.502973937988278, "median": 81.08803939819336, "p90": 223.0790985107422, "max": 285.6346435546875, "pos_frac": 0.84375, "sample": [23.97852325439453, 162.60704040527344, 163.1265869140625, 243.74261474609375, 80.12411499023438, 74.25442504882812, 37.624755859375, 148.69961547851562, -32.5458869934082, 152.56224060058594, 70.03013610839844, -5.1576080322265625, 15.1654052734375, 98.29475402832031, 62.475807189941406, 36.79502868652344, 126.68338012695312, 126.18315887451172, -1.7988166809082031, -157.52713012695312, 23.983863830566406, 168.9814453125, 216.09326171875, 139.7103271484375, 208.01795959472656, -41.50760269165039, 158.61404418945312, 31.954299926757812, 4.987245559692383, 122.55659484863281, 100.32354736328125, 219.72549438476562, 82.05196380615234, 99.63821411132812, 224.516357421875, 12.48708724975586, -133.00344848632812, 246.1136474609375, 43.513084411621094, -6.57647705078125, 26.022369384765625, 114.64888763427734, 70.08413696289062, 252.73814392089844, 58.186279296875, 285.6346435546875, 177.83534240722656, 4.4239959716796875, -212.12991333007812, 35.8660888671875, -10.757186889648438, 253.34060668945312, 98.82345581054688, 114.04972076416016, 8.84620475769043, 92.8785400390625, 9.278450012207031, 188.388427734375, 187.445068359375, 58.11362075805664, -40.432525634765625, 59.093017578125, 122.46775817871094, 276.60467529296875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000566.npy"}
{"epoch": 0.8311306901615272, "step": 567, "batch_size": 64, "mean": 75.91093444824219, "std": 96.77210235595703, "min": -221.54672241210938, "p10": -47.72888793945311, "median": 78.33365631103516, "p90": 196.5333465576172, "max": 281.3743896484375, "pos_frac": 0.78125, "sample": [-113.01795959472656, 97.3581771850586, 167.22657775878906, 62.89546203613281, 68.41275787353516, 264.0948486328125, 123.37229919433594, 167.30419921875, 101.76913452148438, 63.34629821777344, 113.52398681640625, 37.18635559082031, 137.72341918945312, 89.28953552246094, 192.02951049804688, 110.38323974609375, 198.46356201171875, 170.1191864013672, -5.901252746582031, 166.25112915039062, 77.36322021484375, 220.8779296875, -53.97837829589844, 161.90074157714844, 58.705810546875, 80.03834533691406, 24.691734313964844, 36.59381103515625, 115.60414123535156, 215.18431091308594, 48.36424255371094, 79.30409240722656, 29.542518615722656, -62.34373474121094, 155.20626831054688, -14.233070373535156, 133.06216430664062, 132.1815948486328, 281.3743896484375, -3.3043212890625, 39.03167724609375, -30.0736083984375, -62.46363067626953, -3.649566650390625, 36.30156707763672, 208.59019470214844, 38.072021484375, -221.54672241210938, 237.4721221923828, 46.29472351074219, -132.76254272460938, 161.75682067871094, 136.39060974121094, 62.352752685546875, 16.896163940429688, -33.14674377441406, 62.38788604736328, 89.35415649414062, -2.7684288024902344, 95.9329833984375, 144.42723083496094, 48.3373908996582, -93.08358001708984, 86.22994995117188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000567.npy"}
{"epoch": 0.8325991189427313, "step": 568, "batch_size": 64, "mean": 94.91342163085938, "std": 95.93948364257812, "min": -74.87471771240234, "p10": -15.531136703491203, "median": 85.0646858215332, "p90": 220.77870941162112, "max": 311.65643310546875, "pos_frac": 0.828125, "sample": [24.032806396484375, -7.009246826171875, 139.38739013671875, -8.140689849853516, 60.20686340332031, 129.21575927734375, 50.421180725097656, 204.05712890625, 211.29261779785156, -37.89604187011719, 5.746768951416016, -21.079727172851562, 68.75118255615234, 311.65643310546875, 103.40807342529297, 253.32408142089844, 87.01290130615234, 113.01911163330078, 129.38230895996094, -2.675678253173828, 30.012489318847656, 8.368980407714844, 208.2967529296875, 66.37776184082031, 137.146240234375, 40.696861267089844, 127.72724914550781, 175.6595916748047, 186.02664184570312, 93.80058288574219, 192.24070739746094, 14.32730484008789, 68.26652526855469, 164.16351318359375, 224.2976531982422, 212.56784057617188, 113.67829895019531, 131.22348022460938, 17.970962524414062, 130.62579345703125, 250.17550659179688, -74.87471771240234, 16.60076141357422, 65.74169921875, -68.33729553222656, 15.94573974609375, -18.698471069335938, -28.964080810546875, 0.8346195220947266, 256.177734375, 161.20191955566406, 307.19879150390625, 241.49127197265625, -73.28402709960938, 174.36492919921875, -3.27191162109375, 57.610557556152344, 83.11647033691406, 188.72518920898438, 132.642578125, 153.60162353515625, 45.96955871582031, 3.1565399169921875, 29.745861053466797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000568.npy"}
{"epoch": 0.8340675477239354, "step": 569, "batch_size": 64, "mean": 78.85527801513672, "std": 113.76795959472656, "min": -190.19143676757812, "p10": -96.61330718994138, "median": 86.89745330810547, "p90": 208.34174346923828, "max": 265.53424072265625, "pos_frac": 0.828125, "sample": [-190.19143676757812, 157.1470947265625, 241.6367950439453, 121.95314025878906, 62.6180419921875, -122.97454833984375, 141.12010192871094, 27.54399871826172, 70.90969848632812, 187.7694854736328, 184.43655395507812, 10.832839965820312, 31.057165145874023, 142.90380859375, 262.9551086425781, 161.54110717773438, 60.307044982910156, 73.83084106445312, -37.699607849121094, 117.11404418945312, -181.20787048339844, 137.31655883789062, 162.5265350341797, 8.4134521484375, 18.75267791748047, 208.43125915527344, 21.825210571289062, 43.808990478515625, 6.5299072265625, -108.02261352539062, 85.22944641113281, 113.86660766601562, 262.617431640625, 185.60531616210938, 96.3660888671875, 27.31585693359375, 177.9034881591797, 189.63365173339844, 215.44703674316406, -130.141845703125, 208.13287353515625, 15.031875610351562, -119.12965393066406, 257.13043212890625, 129.68313598632812, -1.665496826171875, 166.14808654785156, 130.5321807861328, -177.35128784179688, 170.34388732910156, -33.46673583984375, 163.73178100585938, 2.816415786743164, 119.17559051513672, 199.293212890625, 30.014663696289062, 134.30784606933594, 20.451068878173828, 88.56546020507812, -69.99159240722656, 75.87828063964844, 3.0821914672851562, 21.460968017578125, 265.53424072265625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000569.npy"}
{"epoch": 0.8355359765051396, "step": 570, "batch_size": 64, "mean": 102.04463958740234, "std": 94.10225677490234, "min": -171.40634155273438, "p10": -23.64313735961914, "median": 120.70232391357422, "p90": 214.29537506103514, "max": 317.36212158203125, "pos_frac": 0.8125, "sample": [149.61679077148438, 175.65719604492188, 101.64319610595703, 317.36212158203125, 103.27393341064453, 134.93753051757812, 229.58636474609375, 36.97218322753906, 166.65411376953125, 154.24610900878906, 149.48875427246094, 204.76739501953125, -28.708282470703125, 133.78753662109375, -171.40634155273438, 206.54290771484375, -10.733352661132812, 71.00534057617188, 230.0001220703125, 95.05339813232422, -1.0220375061035156, -5.64508056640625, 5.536582946777344, 93.21800231933594, 130.25405883789062, 133.72225952148438, 63.34846496582031, 220.39707946777344, 214.54092407226562, -24.078514099121094, -36.80823516845703, 125.97842407226562, 57.12812805175781, 19.112625122070312, 45.4912109375, 250.20230102539062, 168.94607543945312, 260.1434631347656, 117.48179626464844, 208.57144165039062, 213.72242736816406, -20.304611206054688, 21.00574493408203, 84.49064636230469, 152.98733520507812, 142.24114990234375, 127.84487915039062, 204.37152099609375, 161.21905517578125, 158.774658203125, 26.709247589111328, 14.995742797851562, 89.18869018554688, -22.62725830078125, -39.46623229980469, 92.80621337890625, 126.65962219238281, -31.457199096679688, 123.9228515625, -36.016605377197266, 18.685089111328125, 203.56900024414062, 156.68374633789062, 64.58541870117188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000570.npy"}
{"epoch": 0.8370044052863436, "step": 571, "batch_size": 64, "mean": 92.67195129394531, "std": 110.23589324951172, "min": -150.4251708984375, "p10": -68.02068710327147, "median": 98.18954467773438, "p90": 241.96367340087895, "max": 295.32086181640625, "pos_frac": 0.828125, "sample": [81.08827209472656, 175.8773651123047, -150.4251708984375, 46.99488830566406, -95.75262451171875, 286.93011474609375, 36.51691818237305, 199.10565185546875, 9.982208251953125, 273.60784912109375, 122.44132232666016, -98.29216003417969, 71.52569580078125, 43.37836456298828, -73.71248626708984, 182.93673706054688, 246.44686889648438, 198.0678253173828, 100.66456604003906, 295.32086181640625, 268.7452697753906, 183.6666717529297, 139.0423583984375, -54.73982238769531, 5.0312042236328125, 144.1883544921875, 96.9478988647461, 168.44168090820312, 188.29165649414062, 283.8907165527344, 7.2054290771484375, 82.16314697265625, -95.68766021728516, 110.44759368896484, 99.43119049072266, 46.83088684082031, 1.2866439819335938, 150.092041015625, 42.839412689208984, 29.425582885742188, 164.25259399414062, 94.12266540527344, 250.9147186279297, 189.23004150390625, 231.5028839111328, 19.92336654663086, 150.43893432617188, 117.96321105957031, -28.807662963867188, 136.7900848388672, 5.546409606933594, -93.36050415039062, 127.46285247802734, -9.346332550048828, 21.512481689453125, 194.01939392089844, 14.932168960571289, 142.5290069580078, -40.00151824951172, 164.9568634033203, 45.90031814575195, 216.043701171875, -103.58256530761719, 67.81854248046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000571.npy"}
{"epoch": 0.8384728340675477, "step": 572, "batch_size": 64, "mean": 91.42375183105469, "std": 107.14691162109375, "min": -113.8249282836914, "p10": -38.1483501434326, "median": 65.12093353271484, "p90": 234.4591903686524, "max": 422.01824951171875, "pos_frac": 0.8125, "sample": [22.438003540039062, 122.53234100341797, -14.184364318847656, 36.57174301147461, 263.2985534667969, -55.12879943847656, 109.86520385742188, 28.08325958251953, 60.68928909301758, 31.945556640625, 0.19821739196777344, 74.64106750488281, 144.36138916015625, -18.623367309570312, 22.21685791015625, 87.45618438720703, -48.523468017578125, 240.13284301757812, 142.02676391601562, 208.87673950195312, 45.08024597167969, 86.99769592285156, -23.547954559326172, 203.6377716064453, 46.93252944946289, -14.236167907714844, -113.8249282836914, 42.397430419921875, 11.339174270629883, 116.04953002929688, 106.026123046875, 25.904403686523438, 223.2236328125, -16.235015869140625, -88.09744262695312, 422.01824951171875, -44.794395446777344, 115.81416320800781, 206.7256622314453, 107.58675384521484, 185.25119018554688, 189.75802612304688, 1.1467533111572266, 255.48452758789062, -51.12694549560547, 62.88043212890625, 296.0787353515625, 60.118408203125, 52.006744384765625, 54.560203552246094, 67.36143493652344, 149.0068359375, -44.405662536621094, 282.73968505859375, 32.64561080932617, 239.27442932128906, 201.25575256347656, 219.48074340820312, 12.136077880859375, 159.87051391601562, 11.637062072753906, 170.2925262451172, 137.2434844970703, 188.55218505859375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000572.npy"}
{"epoch": 0.8399412628487518, "step": 573, "batch_size": 64, "mean": 86.2085952758789, "std": 104.50213623046875, "min": -215.3858642578125, "p10": -17.292538642883294, "median": 83.42620468139648, "p90": 217.345573425293, "max": 313.62255859375, "pos_frac": 0.828125, "sample": [236.24307250976562, -2.2948741912841797, 66.34760284423828, 8.284439086914062, 108.92845916748047, 118.54830932617188, 77.03697204589844, -54.39844512939453, 190.9488525390625, 191.32223510742188, 253.25698852539062, 201.83016967773438, 69.45187377929688, 313.62255859375, 27.934436798095703, 163.9500274658203, 230.6175537109375, -215.3858642578125, 89.81543731689453, 19.34465789794922, 139.88357543945312, 42.46070098876953, 16.52069091796875, 198.17303466796875, 99.16082763671875, 255.31146240234375, 132.91226196289062, 235.05551147460938, 98.57467651367188, 137.71981811523438, -144.30429077148438, -9.762840270996094, 219.54249572753906, 208.6204071044922, 109.7950668334961, -146.15692138671875, 35.829811096191406, -20.51955223083496, -3.731109619140625, 0.42961883544921875, 137.82183837890625, 180.41477966308594, 212.21942138671875, 3.6840057373046875, 117.73503112792969, -2.371929168701172, 36.51387023925781, -75.26681518554688, 37.735347747802734, -87.85296630859375, 12.343017578125, 48.174285888671875, 143.30690002441406, 43.9749755859375, 64.03021240234375, 143.4578399658203, 53.475982666015625, 97.28388977050781, 146.39425659179688, 164.24807739257812, 60.781951904296875, 76.87712097167969, 28.251068115234375, 173.19851684570312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000573.npy"}
{"epoch": 0.8414096916299559, "step": 574, "batch_size": 64, "mean": 90.5914306640625, "std": 107.8010482788086, "min": -155.57748413085938, "p10": -45.57232894897461, "median": 89.2813949584961, "p90": 220.05887908935551, "max": 305.494384765625, "pos_frac": 0.8125, "sample": [12.127582550048828, 4.1815032958984375, 178.34442138671875, -87.52101135253906, 207.52206420898438, 31.22451400756836, 172.4944610595703, 223.4137420654297, 66.98471069335938, 191.4769287109375, 52.008941650390625, 277.9945983886719, 95.97750091552734, 268.71258544921875, 137.5806884765625, 112.92991638183594, 108.25027465820312, 9.892440795898438, 173.66668701171875, 165.77012634277344, 81.07432556152344, -41.33453369140625, 67.75773620605469, 289.06561279296875, 25.116592407226562, 186.08396911621094, 23.755165100097656, -67.2864990234375, 135.8764190673828, 171.76011657714844, 31.16851806640625, -141.931640625, -7.367706298828125, 145.2926483154297, 35.58502197265625, -155.57748413085938, -3.6968994140625, 183.81072998046875, 96.30496978759766, 89.81950378417969, 88.7432861328125, -32.694061279296875, 210.24864196777344, -80.16165924072266, 191.96389770507812, 144.6258087158203, 49.935447692871094, 48.006080627441406, -47.388526916503906, -117.60102844238281, 119.65570068359375, -0.15486526489257812, 116.28726959228516, 212.23086547851562, 57.539886474609375, 246.73468017578125, 43.22023010253906, 305.494384765625, 14.43157958984375, 119.48252868652344, 183.87045288085938, 271.0853576660156, 69.96692657470703, 34.01972961425781], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000574.npy"}
{"epoch": 0.8428781204111601, "step": 575, "batch_size": 64, "mean": 88.20824432373047, "std": 113.16293334960938, "min": -171.68553161621094, "p10": -64.9169063568115, "median": 81.63299560546875, "p90": 250.38716430664064, "max": 365.05755615234375, "pos_frac": 0.8125, "sample": [13.32598876953125, 151.51792907714844, 107.93452453613281, 252.7295379638672, 79.09751892089844, 52.630401611328125, -102.76021575927734, 68.98983764648438, 118.90292358398438, 159.16957092285156, 50.62736511230469, 72.7565689086914, 173.61727905273438, 166.78369140625, 4.506858825683594, -33.621681213378906, -147.94656372070312, 83.8282241821289, 77.34809875488281, 94.63427734375, 235.08685302734375, -131.68606567382812, 252.58450317382812, 10.83453369140625, 138.3185272216797, 97.69792938232422, -95.109130859375, 38.6345100402832, -17.906272888183594, 213.02464294433594, -24.292194366455078, 128.88058471679688, 170.26846313476562, 140.9066619873047, -38.8860969543457, 95.91136932373047, 49.65324401855469, -11.660301208496094, 68.55635833740234, 268.3397216796875, 71.44214630126953, 37.71974182128906, -171.68553161621094, 83.03506469726562, 245.26004028320312, -76.07296752929688, 259.59051513671875, 154.12579345703125, 111.01597595214844, 139.05599975585938, 45.58238220214844, 203.09930419921875, 80.23092651367188, 124.60101318359375, 365.05755615234375, 27.29456329345703, 266.1951599121094, 59.80140686035156, 294.6327819824219, 29.84740447998047, -118.81725311279297, 101.66138458251953, 211.019775390625, 68.40453338623047], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000575.npy"}
{"epoch": 0.8443465491923642, "step": 576, "batch_size": 64, "mean": 85.11408233642578, "std": 111.13868713378906, "min": -209.86270141601562, "p10": -67.04515151977537, "median": 81.2221908569336, "p90": 224.62046813964844, "max": 294.8448486328125, "pos_frac": 0.765625, "sample": [138.00759887695312, 80.24888610839844, -120.51739501953125, 173.05764770507812, -84.9775390625, 106.01810455322266, 173.44895935058594, 65.46665954589844, 43.50655746459961, 196.33035278320312, 245.40399169921875, 163.5808563232422, -19.77320098876953, 217.05563354492188, 294.8448486328125, 261.3559875488281, 59.8721923828125, 87.83889770507812, 22.795333862304688, -141.43124389648438, -2.1558074951171875, 233.37396240234375, 194.01535034179688, 127.01092529296875, -75.23013305664062, 203.661376953125, 13.905559539794922, 153.75296020507812, -29.44499969482422, 157.76321411132812, 13.679100036621094, 41.31153869628906, 80.0272216796875, 49.8404541015625, 33.292633056640625, 283.2473449707031, 214.3282470703125, 13.035968780517578, -24.18067169189453, 137.46473693847656, -15.264762878417969, 90.43721008300781, -0.9521121978759766, 38.553070068359375, 197.49876403808594, -47.946861267089844, 48.18610382080078, 185.9593963623047, 48.37318420410156, 138.54298400878906, -89.7048568725586, 225.49786376953125, 260.6899719238281, 138.1303253173828, -209.86270141601562, 77.69589233398438, 82.19549560546875, 98.173095703125, 222.57321166992188, -3.105133056640625, 52.83990478515625, 123.25773620605469, -90.14157104492188, 94.84310913085938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000576.npy"}
{"epoch": 0.8458149779735683, "step": 577, "batch_size": 64, "mean": 104.58753204345703, "std": 112.42083740234375, "min": -139.32444763183594, "p10": -55.64106826782226, "median": 121.07131576538086, "p90": 219.72076568603518, "max": 420.23980712890625, "pos_frac": 0.8125, "sample": [-139.32444763183594, 420.23980712890625, 260.97967529296875, 170.42120361328125, 114.67598724365234, 23.59020233154297, 201.57937622070312, 167.8287353515625, -56.73094177246094, 147.74652099609375, 37.16267395019531, 197.1067657470703, 210.00836181640625, 189.6535186767578, -122.88539123535156, 133.69720458984375, 279.6626892089844, 229.10719299316406, 92.88662719726562, 193.59217834472656, 93.68595886230469, 163.60250854492188, -53.09803009033203, -46.911468505859375, 205.14593505859375, 93.9761962890625, 27.454509735107422, 99.9720458984375, 179.58831787109375, 133.55361938476562, 74.18893432617188, 159.79942321777344, 83.7046890258789, 144.38973999023438, 165.47042846679688, -64.966552734375, 220.75267028808594, 109.33416748046875, 137.0322265625, -108.85013580322266, 37.35601043701172, -7.703601837158203, 125.62583923339844, 18.857406616210938, 33.873130798339844, 14.969436645507812, -24.977157592773438, 168.46546936035156, -56.971412658691406, 217.31298828125, 55.58079528808594, 152.18231201171875, 116.51679229736328, 38.83872604370117, 181.13079833984375, 208.5800018310547, 61.38562774658203, -133.00196838378906, -30.264511108398438, 299.41845703125, 166.76107788085938, 90.18522644042969, 152.69839477539062, 237.95899963378906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000577.npy"}
{"epoch": 0.8472834067547724, "step": 578, "batch_size": 64, "mean": 75.72772979736328, "std": 105.50279998779297, "min": -232.65586853027344, "p10": -50.98596115112305, "median": 68.17660903930664, "p90": 197.97362670898437, "max": 299.8248291015625, "pos_frac": 0.78125, "sample": [139.46435546875, 25.56110954284668, 56.8179931640625, 198.83755493164062, 219.22940063476562, 118.2703628540039, 91.14505767822266, -51.10856628417969, 66.9119644165039, 50.84284591674805, 58.30207061767578, 158.43899536132812, 1.44281005859375, 185.68475341796875, 6.4267120361328125, -44.57276916503906, 74.34124755859375, 148.25979614257812, 168.86611938476562, 73.09442138671875, 49.82884216308594, 193.41427612304688, 16.34711456298828, -78.05564880371094, -116.66535949707031, 174.81869506835938, 297.7142333984375, -17.538177490234375, 104.6834716796875, 195.95779418945312, 168.3519287109375, -74.37052917480469, 61.345306396484375, 56.743682861328125, 52.511192321777344, 96.81122589111328, -16.545616149902344, -232.65586853027344, -19.000076293945312, -50.69988250732422, 10.171699523925781, 81.64718627929688, 77.08106994628906, 51.471229553222656, 215.35739135742188, -14.206893920898438, 111.86260986328125, -57.78874969482422, 251.84503173828125, 172.71617126464844, 112.56248474121094, 57.318389892578125, 49.8909912109375, 110.25326538085938, 65.33423614501953, 189.99847412109375, 69.44125366210938, 37.478858947753906, 299.8248291015625, 275.7948913574219, -160.2938232421875, -4.862770080566406, 160.07467651367188, 74.34944152832031], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000578.npy"}
{"epoch": 0.8487518355359766, "step": 579, "batch_size": 64, "mean": 77.81399536132812, "std": 100.71125793457031, "min": -146.01901245117188, "p10": -49.38538818359373, "median": 75.90006256103516, "p90": 208.85307922363285, "max": 353.66168212890625, "pos_frac": 0.78125, "sample": [5.3790740966796875, 61.99977111816406, -77.7957992553711, 228.96719360351562, 135.92654418945312, 141.96498107910156, 73.03623962402344, -58.40034484863281, 85.5064926147461, 164.7932586669922, 25.017486572265625, -0.3436927795410156, 4.0823822021484375, -85.86266326904297, 45.998497009277344, 96.9600601196289, 120.95433807373047, 211.04806518554688, 284.4170837402344, 175.03257751464844, -146.01901245117188, 27.924097061157227, -81.34998321533203, 280.8898620605469, 24.19286346435547, 117.43898010253906, 57.67299270629883, 32.39912414550781, 145.1929473876953, -32.64007568359375, -3.3819427490234375, 32.847442626953125, 78.76388549804688, 95.20948791503906, 353.66168212890625, 201.63406372070312, 2.5235061645507812, 79.22488403320312, 136.26171875, -8.281021118164062, 116.0364990234375, 15.012779235839844, 128.11380004882812, 118.2354736328125, 117.82196044921875, 79.35122680664062, 151.336669921875, 65.82496643066406, -93.27854919433594, -14.348224639892578, 227.23251342773438, 178.2689971923828, -20.808324813842773, 222.2598876953125, 115.02501678466797, 41.8021240234375, 203.7314453125, 13.610280990600586, 11.418594360351562, -4.709991455078125, 16.33340072631836, 196.3719024658203, 119.16847229003906, -56.56195068359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000579.npy"}
{"epoch": 0.8502202643171806, "step": 580, "batch_size": 64, "mean": 92.7848129272461, "std": 109.447265625, "min": -118.80250549316406, "p10": -49.511718368530275, "median": 93.56226348876953, "p90": 238.94789276123055, "max": 348.6512756347656, "pos_frac": 0.78125, "sample": [14.480499267578125, 218.7935791015625, 37.97186279296875, 152.05691528320312, 33.50953674316406, 74.54566955566406, 190.92825317382812, 275.4281005859375, 125.50586700439453, 106.15476989746094, 44.85064697265625, 13.765426635742188, 348.6512756347656, 221.06227111816406, -55.72080993652344, 111.66340637207031, -63.674652099609375, 4.376382827758789, 218.16250610351562, 142.47109985351562, -50.22547149658203, 203.01060485839844, 102.042236328125, -9.137367248535156, 9.749038696289062, 104.24488830566406, 85.08229064941406, 84.34452056884766, 263.1707763671875, 42.34400177001953, 158.085693359375, 168.80645751953125, 57.19532775878906, 20.58917999267578, 263.977294921875, 218.69520568847656, 131.81240844726562, -47.84629440307617, 117.94273376464844, -25.818618774414062, -31.415924072265625, -20.220947265625, -67.61200714111328, 154.33316040039062, 80.0201644897461, 40.05769348144531, -85.15786743164062, -118.80250549316406, 11.19921875, 313.02850341796875, 193.52362060546875, -24.30615997314453, 246.6131591796875, 168.69906616210938, 207.05413818359375, 109.7415771484375, 187.2951202392578, 113.82696533203125, -9.509260177612305, -85.20683288574219, 28.890029907226562, 113.32479858398438, 263.3573913574219, 36.447471618652344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000580.npy"}
{"epoch": 0.8516886930983847, "step": 581, "batch_size": 64, "mean": 82.91061401367188, "std": 116.36285400390625, "min": -162.6001434326172, "p10": -95.9937805175781, "median": 90.22541809082031, "p90": 205.37593688964844, "max": 332.69012451171875, "pos_frac": 0.75, "sample": [157.2772216796875, -143.5519256591797, 91.85271453857422, -129.50967407226562, -15.4156494140625, 39.70759582519531, 173.1873016357422, 27.712692260742188, 153.96487426757812, 70.53722381591797, 200.646240234375, 56.524925231933594, 225.37945556640625, 167.7254180908203, -76.89219665527344, 78.6457748413086, 204.27142333984375, 193.65460205078125, 78.14881896972656, 332.69012451171875, 132.26571655273438, 205.19754028320312, -156.13223266601562, 29.25989532470703, 146.9857177734375, 88.5981216430664, 199.73348999023438, 162.54269409179688, 72.87869262695312, 191.06011962890625, 0.9727363586425781, 216.2873992919922, -3.982097625732422, 205.452392578125, 184.42724609375, 27.337844848632812, 209.39114379882812, 189.63999938964844, 102.22682189941406, 66.79566955566406, 159.7733154296875, 63.126319885253906, -72.07806396484375, 21.982574462890625, 174.08609008789062, -113.74580383300781, 234.4771728515625, -104.17851257324219, 150.19314575195312, -2.918651580810547, 88.1190414428711, -49.89732360839844, 2.0998477935791016, -162.6001434326172, 97.55946350097656, 174.07107543945312, -28.33441162109375, 93.02816772460938, 204.06353759765625, -104.49273681640625, -17.0272216796875, 255.14451599121094, -76.89607238769531, 163.22824096679688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000581.npy"}
{"epoch": 0.8531571218795888, "step": 582, "batch_size": 64, "mean": 77.88203430175781, "std": 109.322021484375, "min": -233.9207305908203, "p10": -44.21529998779297, "median": 60.24127197265625, "p90": 232.18653717041016, "max": 366.1791076660156, "pos_frac": 0.8125, "sample": [27.597427368164062, 126.75891876220703, 188.82138061523438, -23.580230712890625, 196.15066528320312, 95.57984924316406, 50.411476135253906, 86.77899169921875, -78.23933410644531, 137.49717712402344, 133.07992553710938, 116.54278564453125, 65.19570922851562, 255.08877563476562, 72.49462890625, 272.02447509765625, 47.25347137451172, 93.38090515136719, -88.88236999511719, 147.2932891845703, -45.066314697265625, 0.09243011474609375, 31.48931121826172, 31.578289031982422, 66.783203125, 80.05485534667969, 108.6982421875, 130.68276977539062, 366.1791076660156, 297.463134765625, 109.55393981933594, 152.6607666015625, 35.847511291503906, 138.51123046875, 176.2964324951172, -42.22959899902344, 2.0637741088867188, -67.26495361328125, 13.722183227539062, 111.30351257324219, -2.4979705810546875, 1.9638595581054688, 362.9856262207031, 103.26242065429688, 31.685226440429688, 203.07077026367188, 40.65716552734375, 16.639007568359375, -48.57727813720703, 233.89892578125, -0.9193267822265625, 234.81309509277344, 59.78791809082031, -66.05082702636719, -40.6757698059082, -233.9207305908203, 228.1909637451172, 36.37531661987305, 23.971786499023438, 45.065792083740234, 60.69462585449219, 14.17734146118164, 28.822998046875, 31.36145782470703], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000582.npy"}
{"epoch": 0.8546255506607929, "step": 583, "batch_size": 64, "mean": 82.64878845214844, "std": 106.39966583251953, "min": -133.36419677734375, "p10": -37.290280151367185, "median": 69.80270767211914, "p90": 234.33544311523437, "max": 355.4165344238281, "pos_frac": 0.75, "sample": [22.951446533203125, 6.8037567138671875, -73.98189544677734, 16.03753662109375, 182.61672973632812, 30.77947998046875, 63.40461730957031, 101.87504577636719, 355.4165344238281, 64.40575408935547, 171.1787109375, 59.37770080566406, -4.4177703857421875, 100.8028793334961, 111.62088775634766, -24.487442016601562, 177.69906616210938, 99.58271026611328, 100.99083709716797, 178.83909606933594, 287.266357421875, 75.19966125488281, 35.28471374511719, -32.702335357666016, -39.25654220581055, -48.37108612060547, 53.550315856933594, 180.68548583984375, -49.293067932128906, 11.104438781738281, 10.869468688964844, 116.34677124023438, 195.83682250976562, 234.57342529296875, -2.8527297973632812, 166.95046997070312, 243.38926696777344, -6.584037780761719, 192.5496368408203, 18.100624084472656, -12.719329833984375, 93.7183837890625, 63.54944610595703, -30.51482391357422, -130.99154663085938, -3.0575714111328125, 298.2545166015625, 20.006301879882812, 106.325439453125, -51.885459899902344, 304.9756164550781, 157.48292541503906, 13.860755920410156, 80.06480407714844, 248.56149291992188, -133.36419677734375, 61.50072479248047, 233.7801513671875, 86.08775329589844, 140.962158203125, 147.13763427734375, 84.79524230957031, 139.05886840820312, -12.210258483886719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000583.npy"}
{"epoch": 0.856093979441997, "step": 584, "batch_size": 64, "mean": 88.83891296386719, "std": 110.46305084228516, "min": -179.19500732421875, "p10": -49.3972801208496, "median": 93.22380828857422, "p90": 232.40070800781254, "max": 317.0964050292969, "pos_frac": 0.796875, "sample": [-96.76033020019531, 124.11231231689453, 19.47388458251953, 109.44203186035156, 152.9728546142578, -34.110198974609375, 139.18995666503906, 93.84306335449219, 173.340087890625, 123.23760223388672, 12.145843505859375, -179.19500732421875, 44.79144287109375, 10.813385009765625, 41.78015899658203, 279.2841796875, -14.068061828613281, 236.54298400878906, -3.445831298828125, -86.35005187988281, 77.51776885986328, 0.2237701416015625, 83.52545166015625, 79.36465454101562, 69.96163177490234, -16.28961181640625, 189.66598510742188, 175.17617797851562, 59.980224609375, 93.34574890136719, 217.96249389648438, -113.63320922851562, 169.36952209472656, -31.46978759765625, 70.56249237060547, 75.639404296875, 46.97309112548828, 144.01780700683594, -52.73162841796875, -97.76228332519531, 261.3978271484375, 95.25499725341797, -41.61713409423828, 317.0964050292969, 235.73837280273438, 77.09664154052734, 245.01589965820312, 119.74307250976562, -165.4356689453125, 194.74205017089844, 268.2759704589844, 41.593040466308594, 139.08541870117188, 93.10186767578125, 22.156444549560547, 176.654052734375, 160.74319458007812, 192.21913146972656, 224.61282348632812, 114.28274536132812, 215.8966064453125, 157.1254425048828, 147.6473388671875, 4.82373046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000584.npy"}
{"epoch": 0.8575624082232012, "step": 585, "batch_size": 64, "mean": 102.68147277832031, "std": 124.49085998535156, "min": -204.64285278320312, "p10": -57.15964813232421, "median": 87.19836807250977, "p90": 249.99672698974612, "max": 455.6799621582031, "pos_frac": 0.859375, "sample": [61.298377990722656, 51.17582702636719, 52.31287384033203, 170.23916625976562, 18.939674377441406, 455.6799621582031, 231.80950927734375, -37.93438720703125, 213.91282653808594, 23.00759506225586, 211.06814575195312, 165.07818603515625, 302.7735900878906, 134.36160278320312, 138.04824829101562, 132.44642639160156, 220.3204803466797, 241.7483367919922, 288.133056640625, 24.464431762695312, 88.20409393310547, 104.9586181640625, 46.57630920410156, -49.072723388671875, 241.41983032226562, 13.596176147460938, 73.61274719238281, 246.0184783935547, 300.7983703613281, 216.1466827392578, 251.70169067382812, 15.048820495605469, 66.05854797363281, -60.62547302246094, 127.09601593017578, 12.868431091308594, 197.54794311523438, -204.64285278320312, 137.02236938476562, 208.2931671142578, 86.19264221191406, -94.84976959228516, 272.7682800292969, 9.486793518066406, 207.84608459472656, 100.31547546386719, 236.741943359375, -96.7741470336914, 5.897666931152344, 91.1008529663086, 52.25153350830078, 15.005325317382812, -76.18545532226562, -110.14741516113281, 73.82847595214844, 283.5362548828125, 40.99322509765625, 68.51496887207031, 43.41654968261719, 64.80636596679688, 121.99247741699219, 86.07975769042969, -151.83824157714844, 109.12353515625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000585.npy"}
{"epoch": 0.8590308370044053, "step": 586, "batch_size": 64, "mean": 69.21916198730469, "std": 89.8900146484375, "min": -184.26068115234375, "p10": -24.850079345703122, "median": 54.91666793823242, "p90": 209.10624237060551, "max": 272.3601989746094, "pos_frac": 0.796875, "sample": [153.5726318359375, 10.084480285644531, 58.68171691894531, 22.288345336914062, 53.462181091308594, 17.74741554260254, 49.540042877197266, 127.93937683105469, 42.21564865112305, -21.83313751220703, -43.17329406738281, 99.3639144897461, 268.1946716308594, 178.24754333496094, -2.6872329711914062, 41.617759704589844, 52.26570129394531, -72.89027404785156, 165.3553466796875, 60.69905090332031, 30.52069091796875, 5.730415344238281, 51.99544906616211, 54.14385223388672, 272.3601989746094, 15.400222778320312, 171.84085083007812, 81.28828430175781, -62.57109069824219, 10.484466552734375, 55.689483642578125, 77.12071228027344, -6.0151214599609375, -102.04049682617188, 173.63710021972656, 71.88601684570312, 46.167869567871094, 137.18020629882812, 94.22239685058594, 219.69427490234375, 227.73211669921875, -30.823711395263672, 118.94918060302734, 219.7750244140625, -184.26068115234375, -23.786514282226562, 61.54399871826172, 62.51508331298828, 15.966934204101562, 99.25211334228516, -5.360618591308594, 197.13714599609375, -25.305892944335938, 90.66490173339844, 238.35122680664062, 106.36045837402344, 49.625633239746094, 214.23585510253906, -6.547389984130859, 27.579544067382812, 115.58972930908203, 88.41778564453125, 82.7352523803711, 30.251434326171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000586.npy"}
{"epoch": 0.8604992657856094, "step": 587, "batch_size": 64, "mean": 75.24751281738281, "std": 96.64007568359375, "min": -108.26033020019531, "p10": -48.33849029541015, "median": 63.329267501831055, "p90": 194.2467239379883, "max": 341.84716796875, "pos_frac": 0.78125, "sample": [138.41220092773438, 204.90228271484375, 14.656051635742188, -4.523771286010742, 84.12966918945312, 91.32677459716797, -2.3462448120117188, 134.68035888671875, 29.75577163696289, 201.3417510986328, 19.655797958374023, 152.3980712890625, 341.84716796875, 31.746578216552734, 176.9756622314453, 215.32481384277344, -1.0020942687988281, -42.04646301269531, 20.475753784179688, 179.6980438232422, -108.26033020019531, -12.56732177734375, 258.08465576171875, 16.462202072143555, 128.8226776123047, 218.48770141601562, -51.375526428222656, 195.23333740234375, 64.27235412597656, 55.536468505859375, 30.147418975830078, 155.93643188476562, -94.25233459472656, 130.35858154296875, 4.08026123046875, 87.22013092041016, 16.249296188354492, -105.77622985839844, 41.52796173095703, 4.402278900146484, 26.463821411132812, 155.21812438964844, -26.6039981842041, 155.28067016601562, 33.006256103515625, 191.9446258544922, 68.49201202392578, -42.82093811035156, 64.33891296386719, 189.00718688964844, 186.3588409423828, 132.3643798828125, 186.61892700195312, 31.461463928222656, 180.43223571777344, 116.10202026367188, 47.851722717285156, -60.762168884277344, -81.62675476074219, 62.38618087768555, 99.31120300292969, -50.703155517578125, 35.82625198364258, 93.89486694335938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000587.npy"}
{"epoch": 0.8619676945668135, "step": 588, "batch_size": 64, "mean": 70.20915222167969, "std": 112.26473236083984, "min": -180.06243896484375, "p10": -66.1631393432617, "median": 58.51306915283203, "p90": 247.07525177001955, "max": 281.54644775390625, "pos_frac": 0.71875, "sample": [121.24360656738281, -109.69735717773438, -47.79345703125, 61.96367645263672, 198.3424530029297, 32.311981201171875, 249.1101531982422, 89.51565551757812, 281.54644775390625, 256.889404296875, -12.724815368652344, 168.97216796875, 8.114639282226562, 75.09046173095703, -165.6386260986328, 55.52582550048828, 72.69775390625, 104.90475463867188, -10.016159057617188, 23.494117736816406, 113.85565185546875, 98.97041320800781, 67.21533203125, 262.8624267578125, -180.06243896484375, 36.890716552734375, 92.13600158691406, -13.710952758789062, -148.7198028564453, -1.9535980224609375, 53.53578567504883, 207.95614624023438, -71.35777282714844, 249.244873046875, 77.30872344970703, -25.497154235839844, -54.042327880859375, 17.05743408203125, 53.8848991394043, 242.3271484375, 167.01025390625, 192.6840057373047, -76.486328125, 43.685272216796875, 191.25013732910156, 36.10673522949219, 61.50031280517578, 208.57058715820312, 92.05528259277344, 98.36177062988281, 10.795646667480469, 268.93243408203125, 273.837646484375, -17.650375366210938, 19.06938934326172, -6.221427917480469, 47.75190734863281, -5.884395599365234, 8.139619827270508, 154.37496948242188, -80.2371826171875, -32.59124755859375, 131.4310760498047, 175.14547729492188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000588.npy"}
{"epoch": 0.8634361233480177, "step": 589, "batch_size": 64, "mean": 92.01499938964844, "std": 88.9891128540039, "min": -108.17416381835938, "p10": -22.995169830322265, "median": 88.6487808227539, "p90": 204.09500732421876, "max": 305.103271484375, "pos_frac": 0.828125, "sample": [221.62432861328125, 195.0231475830078, 16.8631591796875, 5.1331024169921875, 125.78804016113281, -23.838695526123047, 45.0479736328125, 187.56573486328125, 39.492462158203125, -29.738418579101562, 174.3229217529297, 190.25341796875, 65.0054702758789, 89.61061096191406, 4.7892608642578125, 211.3965301513672, 305.103271484375, 114.64334869384766, -10.6815185546875, 85.6224365234375, 90.4239273071289, 181.49667358398438, -42.27861022949219, 113.38617706298828, 131.3749542236328, 203.01223754882812, 72.48004150390625, 229.48641967773438, 122.90435791015625, 41.76389694213867, 87.68695068359375, 155.9869384765625, 101.53984832763672, 39.41014862060547, 204.62696838378906, 67.40206909179688, 204.55905151367188, -92.01670837402344, 119.22062683105469, 50.67399597167969, 189.70309448242188, 28.99468231201172, -42.63545227050781, 103.81332397460938, 218.6549072265625, 59.84027099609375, 106.37088012695312, -11.123382568359375, 195.4451904296875, 202.8961181640625, 163.94296264648438, -21.02694320678711, 60.87566375732422, 110.61198425292969, 6.330131530761719, -19.70624542236328, 58.720611572265625, 133.49050903320312, 52.288429260253906, 42.77557373046875, 84.45918273925781, -108.17416381835938, -26.021629333496094, 202.26718139648438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000589.npy"}
{"epoch": 0.8649045521292217, "step": 590, "batch_size": 64, "mean": 91.15819549560547, "std": 92.29499816894531, "min": -133.07666015625, "p10": -0.5444152832031213, "median": 90.43221282958984, "p90": 215.20396118164064, "max": 333.659423828125, "pos_frac": 0.890625, "sample": [12.40550422668457, 120.77301788330078, 53.53651428222656, 18.643264770507812, 42.08540344238281, -36.675567626953125, 47.54315185546875, 333.659423828125, 294.0789489746094, 12.645782470703125, 22.119579315185547, 109.66277313232422, 91.4349365234375, 315.34326171875, 226.6630859375, 95.71086120605469, 14.916036605834961, -2.08782958984375, 92.98899841308594, 3.056884765625, 129.16610717773438, 201.35462951660156, 88.32894134521484, 95.94792175292969, 52.406768798828125, -133.07666015625, -38.75078582763672, 94.59840393066406, 78.04891967773438, 33.61963653564453, -58.01139831542969, 95.42678833007812, 68.18991088867188, 240.20614624023438, 40.22519302368164, 147.4698486328125, 37.4600830078125, -68.75614166259766, 97.29743957519531, 9.538055419921875, 136.13369750976562, 96.69349670410156, 68.67131805419922, 179.5361328125, 89.42948913574219, 216.91107177734375, 211.220703125, 97.09317016601562, 8.377052307128906, -17.153831481933594, 15.895790100097656, 158.6885986328125, 36.5186767578125, 108.86505889892578, 97.46934509277344, 146.27134704589844, 64.59790802001953, 209.34214782714844, 24.77642059326172, 195.091796875, 73.63136291503906, 115.69451904296875, 180.97171020507812, 240.20388793945312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000590.npy"}
{"epoch": 0.8663729809104258, "step": 591, "batch_size": 64, "mean": 97.93551635742188, "std": 94.69512176513672, "min": -78.88291931152344, "p10": -12.884383583068844, "median": 96.82966995239258, "p90": 202.867138671875, "max": 380.00262451171875, "pos_frac": 0.828125, "sample": [171.10336303710938, 104.71568298339844, 101.91056060791016, 52.36137390136719, 90.37073516845703, -64.96150970458984, 166.8111114501953, 49.87401580810547, -9.697193145751953, 380.00262451171875, 104.37110900878906, 175.0660400390625, 202.8992919921875, 116.34925842285156, 158.75669860839844, 276.8275146484375, 109.28424835205078, 224.5321044921875, 187.67745971679688, 111.83349609375, 74.62019348144531, 100.7285385131836, 12.656845092773438, -4.624645233154297, 22.166168212890625, 7.054668426513672, 63.82278823852539, 193.58078002929688, 75.19667053222656, 76.26988220214844, -5.172660827636719, 130.6347198486328, 193.2637481689453, 6.668191909790039, 248.5760955810547, 115.88957214355469, 118.69282531738281, 32.531246185302734, 19.284561157226562, 5.484020233154297, -52.28239440917969, -25.86325454711914, 191.96066284179688, 24.30937957763672, -35.475502014160156, 92.93080139160156, 176.52023315429688, -14.250322341918945, 62.295082092285156, 152.61477661132812, 202.7921142578125, 104.60467529296875, 269.8913269042969, 196.65554809570312, 161.6142578125, 1.9159774780273438, 88.78430938720703, -7.8608551025390625, -47.570716857910156, -78.88291931152344, 197.354736328125, 233.76797485351562, 82.47161865234375, 92.16329193115234], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000591.npy"}
{"epoch": 0.8678414096916299, "step": 592, "batch_size": 64, "mean": 76.70272827148438, "std": 108.43307495117188, "min": -167.9114990234375, "p10": -67.85603485107421, "median": 80.24718475341797, "p90": 211.82446746826173, "max": 340.641845703125, "pos_frac": 0.78125, "sample": [211.41795349121094, -79.71697998046875, -0.6053466796875, 40.594154357910156, -68.93170166015625, 25.749122619628906, 191.68701171875, -14.424163818359375, 340.641845703125, 130.5283660888672, 48.461219787597656, 131.70761108398438, -95.68816375732422, 124.0435791015625, -141.50967407226562, 9.3916015625, 32.662933349609375, 55.351776123046875, 83.80032348632812, 196.81239318847656, 56.77890396118164, 95.01162719726562, 84.84025573730469, 225.50442504882812, -49.54082489013672, 61.06610870361328, 146.55783081054688, 145.622802734375, 216.05906677246094, 131.0831756591797, 107.60038757324219, -40.418113708496094, 12.611564636230469, 211.99868774414062, 264.8658447265625, 166.10427856445312, -164.986083984375, 59.08033752441406, 26.248138427734375, 178.4285125732422, 165.29095458984375, 164.04029846191406, 219.57579040527344, 207.64166259765625, 34.65325927734375, 8.964820861816406, 83.91195678710938, 92.00096893310547, 72.0130615234375, 201.5111846923828, -65.34614562988281, -59.97709655761719, 242.2674102783203, 40.53984069824219, -39.05634689331055, 113.15557861328125, -78.9226303100586, 151.922607421875, 137.89878845214844, 32.38378143310547, -167.9114990234375, 20.339019775390625, 76.69404602050781, 98.89280700683594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000592.npy"}
{"epoch": 0.869309838472834, "step": 593, "batch_size": 64, "mean": 65.48255157470703, "std": 104.86064147949219, "min": -134.8588104248047, "p10": -74.88211822509766, "median": 49.87346267700195, "p90": 197.76380767822266, "max": 305.53192138671875, "pos_frac": 0.765625, "sample": [30.03594970703125, -112.8050537109375, -119.87212371826172, 34.00867462158203, 11.725540161132812, 32.9239501953125, 49.521446228027344, -27.839454650878906, 79.2746810913086, 49.910247802734375, 119.11949157714844, 236.9315185546875, 38.4710693359375, 10.829132080078125, -7.439262390136719, 19.38718032836914, 305.53192138671875, 197.25979614257812, 180.57098388671875, 57.965171813964844, 148.71267700195312, 40.50810241699219, 67.72097778320312, 75.38048553466797, 123.14219665527344, 123.71966552734375, 18.881935119628906, 163.6044464111328, -11.257003784179688, 9.7154541015625, -72.228759765625, 197.9798126220703, 94.90409851074219, -27.505531311035156, 35.33014678955078, 49.83667755126953, 80.16415405273438, 286.4215087890625, 38.26225280761719, 36.74732208251953, -131.99581909179688, 60.56105041503906, -67.65020751953125, -22.18962860107422, 188.72116088867188, -134.8588104248047, 7.798744201660156, 165.206298828125, 109.3797607421875, 227.19357299804688, 78.44432067871094, 164.18638610839844, 295.4876708984375, 169.00607299804688, -84.46258544921875, 92.44908142089844, 118.61477661132812, 7.276021957397461, -76.01927185058594, 223.13082885742188, 170.01043701171875, -46.159446716308594, -88.8013916015625, 100.00282287597656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000593.npy"}
{"epoch": 0.8707782672540382, "step": 594, "batch_size": 64, "mean": 98.58993530273438, "std": 90.79591369628906, "min": -75.74180603027344, "p10": -6.208115196228027, "median": 86.36376190185547, "p90": 215.92740020751958, "max": 312.74151611328125, "pos_frac": 0.875, "sample": [180.70736694335938, 185.82589721679688, 26.381935119628906, -6.482538223266602, 20.284347534179688, 57.83330535888672, 271.2596435546875, 117.66831970214844, 123.37934875488281, 87.06820678710938, 42.95096969604492, 64.01200866699219, 179.3533477783203, 116.74826049804688, 24.401092529296875, 184.68460083007812, 249.85888671875, 220.47621154785156, 28.46917724609375, 6.053302764892578, 169.30093383789062, 62.70835876464844, 13.660400390625, 312.74151611328125, 43.44709777832031, 49.88761901855469, -23.029041290283203, 205.31350708007812, 96.19539642333984, 175.48117065429688, 38.42658233642578, 96.95325469970703, -50.713600158691406, 75.12959289550781, 87.4564208984375, 196.38543701171875, 35.39305114746094, 1.6675300598144531, -47.51195526123047, -75.74180603027344, 38.316673278808594, 85.65931701660156, 57.485748291015625, -35.76514434814453, 109.9918212890625, 278.5932312011719, 200.66482543945312, 110.35626220703125, -5.5677947998046875, 167.58880615234375, -32.18148422241211, 82.5775146484375, 134.54965209960938, 146.8148193359375, 120.0586929321289, 6.083099365234375, 187.5403289794922, 129.8914337158203, 284.54949951171875, 38.670936584472656, 243.83050537109375, 158.70111083984375, 73.55264282226562, 83.70808410644531], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000594.npy"}
{"epoch": 0.8722466960352423, "step": 595, "batch_size": 64, "mean": 81.45152282714844, "std": 105.79227447509766, "min": -109.9485092163086, "p10": -43.56398544311523, "median": 80.1365966796875, "p90": 210.2853637695313, "max": 312.0049743652344, "pos_frac": 0.703125, "sample": [124.82246398925781, 236.8992919921875, 186.9485321044922, 75.57487487792969, 49.850433349609375, 303.70574951171875, -7.9323577880859375, 100.47901153564453, -46.12507629394531, 231.8753204345703, 174.7416229248047, 186.03997802734375, 176.93576049804688, 9.088653564453125, 0.9006385803222656, 94.09275817871094, 159.42633056640625, 283.9786682128906, 243.6101837158203, -34.823116302490234, -83.7183837890625, -93.92776489257812, 88.94319152832031, 187.987548828125, 14.544666290283203, 170.58810424804688, 23.10620880126953, 9.048717498779297, -64.00584411621094, 186.05044555664062, 28.29501724243164, 195.94281005859375, -66.21426391601562, -33.67124938964844, 199.346923828125, 102.56278991699219, -35.0533447265625, 36.967987060546875, 145.1036834716797, -39.82263946533203, -21.343299865722656, -24.891494750976562, 84.69831848144531, -109.9485092163086, 119.95049285888672, 129.12176513671875, 121.88736724853516, -11.046859741210938, -45.16741943359375, 124.2108154296875, -10.84698486328125, 69.29916381835938, -3.2476234436035156, -7.94122314453125, -29.17810821533203, 65.31065368652344, 93.8026123046875, 21.6087646484375, 184.82986450195312, 58.93400573730469, 156.3661346435547, 197.34669494628906, 214.9732666015625, 312.0049743652344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000595.npy"}
{"epoch": 0.8737151248164464, "step": 596, "batch_size": 64, "mean": 72.33407592773438, "std": 111.39186096191406, "min": -191.43629455566406, "p10": -70.50464019775389, "median": 65.10459899902344, "p90": 207.08614349365237, "max": 326.7608337402344, "pos_frac": 0.75, "sample": [-125.29421997070312, 61.94895935058594, 194.992431640625, -33.448150634765625, 124.17522430419922, 290.3465576171875, -130.8174285888672, -42.20709228515625, 58.601715087890625, 65.84750366210938, 322.59893798828125, 25.681673049926758, -46.37060546875, 158.59603881835938, 53.831024169921875, 287.6420593261719, 169.9483184814453, -8.14192008972168, 131.1202392578125, -53.83186340332031, 51.494163513183594, 94.89967346191406, 74.30815124511719, 149.36734008789062, 78.62612915039062, 120.68408966064453, -16.496706008911133, 20.821544647216797, 138.25491333007812, -2.5837249755859375, 103.98907470703125, 150.88990783691406, 85.53678894042969, 210.697998046875, 5.514884948730469, 16.23320770263672, 326.7608337402344, 202.68930053710938, 148.22669982910156, -163.47525024414062, -78.474609375, 11.987268447875977, -77.65011596679688, 208.9705047607422, -8.112251281738281, 61.64707946777344, 28.906753540039062, 64.3616943359375, 198.86337280273438, 183.408935546875, 20.28671646118164, 30.93020248413086, -84.66741180419922, 158.53564453125, 148.71617126464844, -191.43629455566406, 94.67135620117188, 45.93059539794922, 67.30322265625, 115.8258056640625, 213.71697998046875, -4.236232757568359, 96.85836029052734, 21.378543853759766], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000596.npy"}
{"epoch": 0.8751835535976505, "step": 597, "batch_size": 64, "mean": 96.26970672607422, "std": 107.44855499267578, "min": -168.3602752685547, "p10": -44.20754623413086, "median": 75.1239128112793, "p90": 243.57102966308594, "max": 318.5484619140625, "pos_frac": 0.84375, "sample": [75.29251098632812, 37.342044830322266, 93.45953369140625, 188.3003387451172, 61.138916015625, -44.84625244140625, 8.363777160644531, 246.5189666748047, 29.339656829833984, 188.25677490234375, 87.66523742675781, 40.28935241699219, -168.3602752685547, 148.24508666992188, 156.68438720703125, 23.700653076171875, 59.8272705078125, 40.354820251464844, -62.42584228515625, 318.5484619140625, -79.600341796875, 89.10272216796875, 139.36993408203125, 266.1412658691406, 288.12835693359375, 58.535301208496094, -27.618072509765625, 9.075920104980469, 63.91600799560547, -78.50062561035156, -50.75627899169922, 102.60945129394531, 241.58273315429688, 189.08773803710938, 81.346435546875, 312.7896728515625, 280.2412414550781, 0.390167236328125, 17.541942596435547, 170.6516876220703, -42.71723175048828, 122.55316925048828, -16.25897216796875, 67.21004486083984, 87.28836059570312, 171.25765991210938, 244.42315673828125, 104.6666259765625, 47.577171325683594, 172.3839874267578, 74.95531463623047, 50.74143600463867, -65.77924346923828, 63.8287353515625, 228.22476196289062, 12.979118347167969, 184.1511993408203, 62.230690002441406, 190.1408233642578, 207.7253875732422, 64.56173706054688, 216.92953491210938, 70.8112564086914, 239.64608764648438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000597.npy"}
{"epoch": 0.8766519823788547, "step": 598, "batch_size": 64, "mean": 79.942138671875, "std": 103.49777221679688, "min": -202.992919921875, "p10": -70.2746368408203, "median": 89.10034942626953, "p90": 207.4648468017579, "max": 258.7374267578125, "pos_frac": 0.734375, "sample": [159.777587890625, 20.114013671875, 108.53648376464844, 258.7374267578125, -66.82090759277344, 89.879150390625, 69.13336181640625, -3.39141845703125, 107.45846557617188, 150.5731201171875, 145.06527709960938, -56.25396728515625, -116.96510314941406, -21.670822143554688, 168.13436889648438, 125.91813659667969, -11.491180419921875, 189.39739990234375, 239.47373962402344, 171.49839782714844, -71.75480651855469, 240.3147430419922, 57.17286682128906, -12.444137573242188, 102.10454559326172, 184.30929565429688, 169.27810668945312, 103.20992279052734, -202.992919921875, -71.91102600097656, 85.42574310302734, 245.5350341796875, 218.8837432861328, 122.49604797363281, 28.003677368164062, 171.4704132080078, 188.34112548828125, 38.89111328125, -10.1298828125, 59.94745635986328, -46.43450927734375, -83.7753677368164, 76.75389862060547, 53.451385498046875, -0.22260665893554688, 150.60958862304688, 173.41763305664062, 35.462989807128906, 142.5606231689453, 115.28614044189453, 215.20803833007812, 73.68824768066406, 250.53793334960938, -78.94123077392578, 71.43415832519531, 33.82556915283203, 88.99128723144531, 98.85836791992188, 144.47726440429688, 78.936767578125, -7.0814666748046875, 89.20941162109375, 187.91278076171875, -121.12467956542969], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000598.npy"}
{"epoch": 0.8781204111600588, "step": 599, "batch_size": 64, "mean": 71.37486267089844, "std": 105.2125015258789, "min": -196.66390991210938, "p10": -55.85428771972656, "median": 75.37090682983398, "p90": 220.4426986694336, "max": 272.59722900390625, "pos_frac": 0.71875, "sample": [163.31289672851562, 92.00811767578125, 158.2442169189453, -21.561691284179688, 241.04013061523438, 179.0794677734375, 236.02536010742188, 4.898033142089844, 6.250553131103516, 30.345947265625, 67.31869506835938, 181.4341583251953, 90.14207458496094, -8.238929748535156, -88.13142395019531, 79.52255249023438, 19.892288208007812, 202.254638671875, 71.2192611694336, 103.05098724365234, 147.63279724121094, 272.59722900390625, 137.52432250976562, 115.00717163085938, 226.144287109375, -21.322933197021484, 136.37713623046875, 185.4122314453125, 30.47896957397461, -196.66390991210938, 116.1668701171875, 49.562652587890625, -107.41053009033203, -57.86262512207031, 239.43508911132812, 223.61431884765625, -117.73237609863281, -16.036705017089844, 95.95018768310547, -41.25639343261719, 167.060791015625, 41.97027587890625, 213.04225158691406, -23.139236450195312, 29.38697052001953, -3.949901580810547, 62.46522521972656, -73.20108795166016, 169.08837890625, 90.69412994384766, 118.77806091308594, 5.961917877197266, -108.2418212890625, -18.426681518554688, 236.92257690429688, 89.85334777832031, 131.3455810546875, 46.53423309326172, -27.705108642578125, 95.86714172363281, -51.16816711425781, -23.144306182861328, 1.5039176940917969, 170.7679443359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000599.npy"}
{"epoch": 0.8795888399412628, "step": 600, "batch_size": 64, "mean": 83.31228637695312, "std": 100.35430145263672, "min": -146.03268432617188, "p10": -27.70220336914062, "median": 62.01620292663574, "p90": 211.19229888916016, "max": 311.3913269042969, "pos_frac": 0.78125, "sample": [149.87307739257812, 124.19023895263672, 97.37903594970703, 0.6698150634765625, 280.70574951171875, 182.98956298828125, 3.5445823669433594, -146.03268432617188, 19.319414138793945, 214.7296142578125, -54.431976318359375, 134.33413696289062, 141.83682250976562, 145.04898071289062, 46.33073043823242, 211.35830688476562, -30.828399658203125, 283.81219482421875, 42.776939392089844, 26.59687042236328, 7.6667327880859375, 99.07242584228516, 23.808902740478516, 35.057395935058594, 191.48806762695312, 158.68309020996094, 60.795894622802734, 52.77198028564453, 225.93496704101562, 200.3346710205078, 55.6282958984375, -2.6209716796875, 210.80494689941406, 105.26669311523438, 200.12828063964844, 194.04139709472656, -111.03303527832031, 22.893768310546875, -10.49179458618164, 311.3913269042969, -18.252365112304688, 108.4674072265625, 167.37890625, 27.192466735839844, 114.44691467285156, 63.23651123046875, 209.21022033691406, 93.2092514038086, -95.52450561523438, 43.768280029296875, -2.7446365356445312, 227.76809692382812, 30.068222045898438, 40.940956115722656, 65.3676986694336, 181.0167236328125, -1.0314292907714844, -20.407745361328125, -48.42415237426758, -3.7150039672851562, 114.25289916992188, 137.28948974609375, -43.56291961669922, 36.2088623046875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000600.npy"}
{"epoch": 0.8810572687224669, "step": 601, "batch_size": 64, "mean": 86.24479675292969, "std": 91.09476470947266, "min": -75.26420593261719, "p10": -31.14575614929199, "median": 79.95648956298828, "p90": 193.0982421875, "max": 384.6534423828125, "pos_frac": 0.796875, "sample": [-2.2381668090820312, 64.38447570800781, 384.6534423828125, 122.5221176147461, 11.19637680053711, 192.09066772460938, 65.57096862792969, 182.07180786132812, 98.2401123046875, 74.62705993652344, -1.2998218536376953, 156.53677368164062, 188.37503051757812, 43.33507537841797, 179.38616943359375, 19.985244750976562, -75.26420593261719, 137.95086669921875, 118.07013702392578, 203.59671020507812, 96.58567810058594, 37.52177429199219, 118.9151611328125, 28.15032958984375, 119.74977111816406, 215.7670440673828, 0.6079139709472656, -12.07413101196289, 160.9159698486328, 1.6954002380371094, 35.11351013183594, 196.98953247070312, -51.31977844238281, 79.84889221191406, 134.56263732910156, -6.196929931640625, -30.603065490722656, 174.0408935546875, 26.02104949951172, 173.8389892578125, -50.10470199584961, 143.30435180664062, -31.378337860107422, -41.44279479980469, -13.560775756835938, -44.140724182128906, 69.131591796875, 163.8369140625, 193.53005981445312, 92.733642578125, 136.22032165527344, 82.55743408203125, 43.799896240234375, 182.33407592773438, -60.48942184448242, 259.0953674316406, 34.950592041015625, 42.80084228515625, 117.08671569824219, 66.27037048339844, 200.1903839111328, 18.707826614379883, 80.0640869140625, 170.247802734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000601.npy"}
{"epoch": 0.882525697503671, "step": 602, "batch_size": 64, "mean": 109.70604705810547, "std": 112.61865997314453, "min": -161.03262329101562, "p10": -28.61603088378906, "median": 94.99261093139648, "p90": 232.19278411865236, "max": 439.08941650390625, "pos_frac": 0.828125, "sample": [81.44479370117188, 170.9055633544922, -22.021926879882812, 214.23602294921875, 56.96727752685547, 120.11886596679688, 215.44708251953125, 58.84611511230469, 20.841644287109375, -96.92108154296875, 39.37397003173828, -106.14990997314453, 143.20132446289062, 42.507598876953125, 210.12966918945312, 142.96771240234375, 79.00604248046875, 223.08197021484375, 228.74620056152344, -25.396774291992188, 142.90927124023438, 124.57183074951172, 26.634063720703125, 37.27383041381836, -34.54943084716797, 63.66375732421875, 292.6852722167969, 167.47230529785156, 103.06373596191406, 57.84965133666992, 180.72683715820312, -94.27099609375, 57.02486801147461, 48.83776092529297, 297.7140808105469, -29.995712280273438, 32.16320037841797, 176.6991424560547, -161.03262329101562, 52.73724365234375, 80.59526062011719, 191.01010131835938, 94.62574005126953, -2.589324951171875, 203.7296600341797, 81.5867691040039, 439.08941650390625, 78.03758239746094, 264.52606201171875, -17.914661407470703, 168.1522674560547, 233.66989135742188, 191.17388916015625, 204.50961303710938, 187.30453491210938, 34.98957061767578, 74.04811096191406, 95.35948181152344, 207.36167907714844, 179.23272705078125, 235.36929321289062, 321.70794677734375, 168.8245391845703, -32.72332763671875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000602.npy"}
{"epoch": 0.8839941262848752, "step": 603, "batch_size": 64, "mean": 93.14605712890625, "std": 104.38349151611328, "min": -188.84109497070312, "p10": -33.73905944824219, "median": 95.63773345947266, "p90": 213.55255432128914, "max": 453.8055419921875, "pos_frac": 0.78125, "sample": [143.57049560546875, 34.809226989746094, -32.938507080078125, 21.31234359741211, 156.6790771484375, 183.53756713867188, 39.483245849609375, 160.88314819335938, 140.31846618652344, -47.84223937988281, 156.23590087890625, -14.528244018554688, 52.22291564941406, 87.58930206298828, 33.581512451171875, 77.65385437011719, 153.18426513671875, 175.60614013671875, 237.8653564453125, 86.58155059814453, 157.03285217285156, 80.55560302734375, 39.29766845703125, 100.29740905761719, 163.5614471435547, -42.227935791015625, 17.002182006835938, 96.68284606933594, -8.483654022216797, -15.659934997558594, 94.2820816040039, 25.37103271484375, 238.651611328125, -188.84109497070312, 156.82818603515625, 141.8985595703125, 53.396217346191406, -19.60501480102539, 99.65038299560547, 187.47604370117188, 246.7344207763672, 112.4228286743164, 90.06663513183594, -63.3179817199707, 146.56057739257812, 96.68441772460938, 194.13629150390625, 158.36683654785156, -21.868362426757812, 4.229862213134766, -10.452083587646484, 221.87380981445312, 257.9374084472656, -36.00370788574219, 70.65770721435547, -82.72660827636719, 453.8055419921875, 128.3128204345703, 119.37442779541016, 125.43997192382812, 182.96751403808594, 282.66259765625, 94.59262084960938, -34.0821533203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000603.npy"}
{"epoch": 0.8854625550660793, "step": 604, "batch_size": 64, "mean": 94.17044067382812, "std": 93.48674011230469, "min": -163.3743133544922, "p10": -15.721903610229488, "median": 103.01513671875, "p90": 208.41534729003908, "max": 261.1096496582031, "pos_frac": 0.828125, "sample": [-158.85794067382812, 156.61610412597656, -70.37994384765625, 3.5045013427734375, 46.5777587890625, 238.23870849609375, 223.8375244140625, 142.19650268554688, 159.12033081054688, 105.54301452636719, -163.3743133544922, 210.65997314453125, -3.9525375366210938, 71.29653930664062, 170.25877380371094, 72.33534240722656, 150.21499633789062, 136.30308532714844, -17.780399322509766, 187.58956909179688, 190.0789337158203, -10.918746948242188, 55.47967529296875, 226.7864990234375, -77.42001342773438, -71.01024627685547, 261.1096496582031, 152.60389709472656, 57.63719940185547, 92.00433349609375, -26.835514068603516, 19.867496490478516, 163.82269287109375, 41.50152587890625, 166.4771270751953, 233.75411987304688, 102.10110473632812, 12.6624755859375, 40.63584899902344, 88.19279479980469, 108.57779693603516, 198.772216796875, 75.60899353027344, -5.061676025390625, 142.51600646972656, 182.9901123046875, 76.8531723022461, 214.4188232421875, 203.17788696289062, 122.29627990722656, 62.098350524902344, 189.45252990722656, 194.39166259765625, 69.6259994506836, 110.95266723632812, 51.936038970947266, 67.154052734375, 103.92916870117188, 63.927734375, 106.75856018066406, 69.3726577758789, -6.384307861328125, 110.17076110839844, 134.89434814453125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000604.npy"}
{"epoch": 0.8869309838472834, "step": 605, "batch_size": 64, "mean": 78.25582122802734, "std": 95.49957275390625, "min": -110.7772216796875, "p10": -43.697027587890624, "median": 73.7483139038086, "p90": 217.70837249755863, "max": 286.5071716308594, "pos_frac": 0.75, "sample": [-28.41181182861328, -7.916938781738281, 191.9884033203125, 126.17980194091797, 27.709728240966797, 177.93194580078125, 74.59840393066406, 104.02013397216797, 126.01605987548828, 54.12919616699219, 220.98764038085938, 156.0087890625, 66.61783599853516, 145.6612548828125, 230.15005493164062, 12.805980682373047, 0.21195602416992188, 156.4024658203125, 225.6747283935547, -71.53416442871094, 232.66830444335938, 109.794189453125, 22.52547836303711, -50.272544860839844, -56.507354736328125, 210.05674743652344, 73.32846069335938, -43.912574768066406, -43.19408416748047, 46.148292541503906, -11.772247314453125, -38.899085998535156, 74.16816711425781, 174.34088134765625, 150.67166137695312, 11.130645751953125, 286.5071716308594, 16.871402740478516, 160.61639404296875, 63.680694580078125, 120.2354507446289, 251.14132690429688, -31.429866790771484, 86.08551788330078, 93.0799560546875, 136.99404907226562, -85.13090515136719, 47.12992858886719, -46.59563064575195, 112.89469909667969, 55.04277801513672, -110.7772216796875, 254.69772338867188, 49.46649932861328, -28.90317153930664, 105.31982421875, 187.86431884765625, 50.429134368896484, 105.0096206665039, 90.55902099609375, 169.0902099609375, 50.50462341308594, -0.7704620361328125, -30.746841430664062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000605.npy"}
{"epoch": 0.8883994126284875, "step": 606, "batch_size": 64, "mean": 82.80071258544922, "std": 100.39974975585938, "min": -200.8153076171875, "p10": -36.76623687744139, "median": 89.34214782714844, "p90": 199.91778564453128, "max": 313.25335693359375, "pos_frac": 0.828125, "sample": [-86.39527130126953, 51.28456115722656, 216.73583984375, -75.95906066894531, 108.71857452392578, -10.169044494628906, 33.277099609375, -22.561981201171875, 313.25335693359375, 181.51199340820312, 158.36798095703125, 266.52130126953125, 282.7286376953125, -61.21263885498047, 0.2480316162109375, -5.7491455078125, 70.57305908203125, 26.68686294555664, 25.334312438964844, 159.12615966796875, 16.537303924560547, -200.8153076171875, 220.1131134033203, 108.79412078857422, 132.99473571777344, 110.17796325683594, 124.68942260742188, 126.08150482177734, 40.11897659301758, 105.14486694335938, 32.05157470703125, 160.70489501953125, -105.80067443847656, 123.04631805419922, -6.410606384277344, 110.710693359375, 55.27873229980469, 97.72357940673828, 49.015262603759766, 150.19015502929688, -173.16258239746094, 150.8548583984375, 79.4857177734375, 169.1593475341797, 215.5765838623047, 94.6027603149414, -42.85377502441406, 194.98971557617188, 202.02981567382812, 45.18669891357422, 180.34811401367188, 41.550270080566406, 181.06053161621094, 86.43731689453125, 52.97636413574219, 52.72125244140625, 92.24697875976562, 35.35840606689453, 19.77783203125, 96.34740447998047, 154.6107177734375, 177.32090759277344, 68.51344299316406, 41.439544677734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000606.npy"}
{"epoch": 0.8898678414096917, "step": 607, "batch_size": 64, "mean": 93.01445007324219, "std": 123.09767150878906, "min": -245.49708557128906, "p10": -45.15908050537109, "median": 105.54446792602539, "p90": 249.93066558837893, "max": 310.468017578125, "pos_frac": 0.765625, "sample": [181.3248748779297, 210.92529296875, 13.403060913085938, -27.00333023071289, 149.04705810546875, -47.6683349609375, 124.81233215332031, 58.44291687011719, 191.233154296875, 270.6820373535156, 169.74139404296875, -16.31875228881836, 179.18121337890625, -16.831710815429688, 24.424013137817383, 310.468017578125, 76.39944458007812, 187.12319946289062, 251.01077270507812, 35.423065185546875, 190.32334899902344, -27.998319625854492, 189.26010131835938, 102.05012512207031, -61.04780197143555, 45.021385192871094, -38.48181915283203, 161.71505737304688, 235.798583984375, 49.10227584838867, 295.596923828125, -35.0117073059082, 113.2092056274414, 68.21990966796875, 165.02505493164062, -18.954971313476562, 269.2357177734375, -39.30415344238281, 273.2532043457031, 23.055328369140625, -168.47117614746094, 146.921875, -125.70523071289062, 211.97193908691406, -138.12887573242188, 9.391977310180664, 50.724761962890625, 109.03881072998047, -245.49708557128906, 192.95504760742188, 211.24655151367188, 150.52699279785156, 162.4239501953125, 50.642147064208984, -106.2651596069336, 12.497238159179688, 169.75314331054688, 280.9720458984375, 247.41041564941406, 25.08868408203125, 68.41158294677734, 54.35688781738281, 151.18145751953125, 145.58946228027344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000607.npy"}
{"epoch": 0.8913362701908958, "step": 608, "batch_size": 64, "mean": 96.16629028320312, "std": 108.52436828613281, "min": -279.7450866699219, "p10": -43.38462753295898, "median": 103.24052429199219, "p90": 210.75003509521486, "max": 338.49078369140625, "pos_frac": 0.84375, "sample": [136.07022094726562, 185.02589416503906, 40.228973388671875, 20.229759216308594, 64.02989196777344, 188.7985076904297, 35.649173736572266, 180.17921447753906, 127.09915924072266, 186.499267578125, 37.10236358642578, 54.88951110839844, 30.153480529785156, 115.0199966430664, -68.03656768798828, 23.958805084228516, 72.01241302490234, 64.00453186035156, 11.388023376464844, 83.62709045410156, 238.58953857421875, 213.2667236328125, 195.55160522460938, 338.49078369140625, -34.89982604980469, 156.00775146484375, -85.2384033203125, 88.16596221923828, 158.5224609375, -46.807281494140625, 197.17893981933594, 64.03158569335938, 194.99436950683594, 132.83030700683594, 228.97528076171875, 238.00613403320312, 177.72914123535156, -138.67050170898438, 155.7518768310547, -76.14583587646484, 119.23405456542969, 43.72875213623047, -20.41827392578125, 20.720901489257812, -44.78411865234375, 143.5189208984375, 17.894474029541016, 121.95175170898438, 100.98233795166016, 105.49871063232422, 290.2870788574219, -279.7450866699219, 78.4546127319336, 197.9278106689453, 171.60635375976562, 204.8777618408203, -40.11914825439453, 138.1177520751953, 223.05911254882812, 46.18414306640625, 191.90652465820312, 71.09088134765625, 68.20794677734375, 200.19882202148438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000608.npy"}
{"epoch": 0.8928046989720999, "step": 609, "batch_size": 64, "mean": 94.12151336669922, "std": 107.86158752441406, "min": -144.78916931152344, "p10": -34.16331977844237, "median": 87.63785552978516, "p90": 207.61233673095705, "max": 459.8443298339844, "pos_frac": 0.84375, "sample": [23.473712921142578, 209.37918090820312, 21.488052368164062, 121.9793701171875, -65.43573760986328, 203.4897003173828, 135.23846435546875, 133.4045867919922, -22.934467315673828, -54.29286193847656, 229.62176513671875, 237.94189453125, -19.31927490234375, 55.59189224243164, 26.116226196289062, 173.440185546875, -11.06561279296875, 96.61797332763672, 72.51933288574219, 20.204254150390625, 114.13151550292969, 109.16946411132812, 203.19744873046875, 200.3382568359375, -71.158203125, 72.21292114257812, 266.32855224609375, -92.2669448852539, -144.78916931152344, 237.95199584960938, 76.03684997558594, 83.48725891113281, 183.66879272460938, 166.1212158203125, 170.78273010253906, 198.84190368652344, 164.96273803710938, 46.470272064208984, 59.467464447021484, 94.86922454833984, 44.46306610107422, 91.7884521484375, 72.2885971069336, 459.8443298339844, 32.87091064453125, 17.422012329101562, 179.27650451660156, 98.51527404785156, 2.5432891845703125, 173.58889770507812, 125.00163269042969, 43.66624450683594, 64.17665100097656, 47.244590759277344, 94.77313232421875, 201.96652221679688, 17.04443359375, 288.5041809082031, 176.9018096923828, 189.600341796875, 7.916816711425781, -143.4886932373047, 49.56085205078125, -38.975685119628906], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000609.npy"}
{"epoch": 0.8942731277533039, "step": 610, "batch_size": 64, "mean": 98.20524597167969, "std": 99.6928939819336, "min": -204.51406860351562, "p10": -11.744427490234372, "median": 96.70458602905273, "p90": 223.4786819458008, "max": 276.4730224609375, "pos_frac": 0.859375, "sample": [222.48931884765625, 38.08502197265625, -12.729690551757812, 175.201171875, 90.64402770996094, 14.908798217773438, 238.13026428222656, 183.83544921875, 174.1464385986328, 97.42129516601562, -132.72622680664062, -9.445480346679688, 170.19309997558594, 63.37348937988281, 216.93795776367188, 179.1920166015625, 162.32704162597656, 58.76073455810547, 56.511043548583984, 111.81301879882812, 58.41102600097656, 214.65487670898438, 8.222232818603516, 210.9628448486328, 47.985626220703125, 47.78069305419922, -6.4266357421875, 98.45787048339844, 137.0343780517578, 247.13787841796875, 37.534027099609375, 5.317985534667969, 105.33441162109375, 118.62631225585938, 37.40418243408203, 260.061279296875, -204.51406860351562, 126.49722290039062, 61.26776123046875, 144.28953552246094, 223.90269470214844, 21.133316040039062, -22.251928329467773, 261.44805908203125, 66.22702026367188, -23.612476348876953, 107.54624938964844, 45.74161911010742, -140.68980407714844, 163.47323608398438, 87.36026000976562, 245.01263427734375, 95.98787689208984, 181.3333740234375, 94.22114562988281, 143.6662139892578, 139.8751220703125, 276.4730224609375, 54.627628326416016, 173.04534912109375, -44.62255859375, 24.925369262695312, 87.75141906738281, 167.4524688720703], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000610.npy"}
{"epoch": 0.895741556534508, "step": 611, "batch_size": 64, "mean": 96.54525756835938, "std": 102.3817138671875, "min": -82.6968765258789, "p10": -10.641013717651365, "median": 71.30572509765625, "p90": 246.62982482910158, "max": 346.87786865234375, "pos_frac": 0.8125, "sample": [11.237213134765625, 249.85479736328125, 106.91771697998047, 118.96649169921875, 207.1702117919922, 204.34347534179688, 29.07468032836914, 69.95684814453125, 132.494873046875, 137.9278564453125, -7.955772399902344, 346.87786865234375, -70.87323760986328, -4.5040435791015625, -47.274993896484375, -8.57552719116211, -2.8355274200439453, -3.9427833557128906, 153.8928985595703, 53.17765808105469, -80.51400756835938, 225.39236450195312, 233.31204223632812, -82.6968765258789, 303.2845764160156, 282.9364013671875, 69.05280303955078, 173.0870819091797, -11.526222229003906, 21.105430603027344, 125.15592956542969, 131.24838256835938, 17.248329162597656, 16.189306259155273, 0.188995361328125, 69.89279174804688, 47.81241989135742, 108.4353256225586, -32.381019592285156, 64.43315124511719, 144.65423583984375, 99.54832458496094, 174.74356079101562, 265.567626953125, 40.610565185546875, 105.57417297363281, 159.79490661621094, 126.59375, 239.10488891601562, 18.854957580566406, 46.63130187988281, 41.74310302734375, 252.69810485839844, 72.65460205078125, 26.93219757080078, 47.507240295410156, 90.93766784667969, 237.22402954101562, 33.349605560302734, 250.53570556640625, 157.69265747070312, 7.866340637207031, 202.16946411132812, -21.680328369140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000611.npy"}
{"epoch": 0.8972099853157122, "step": 612, "batch_size": 64, "mean": 98.59622192382812, "std": 95.27534484863281, "min": -110.63461303710938, "p10": -6.091234016418453, "median": 106.35044860839844, "p90": 203.20480804443363, "max": 359.7887878417969, "pos_frac": 0.875, "sample": [359.7887878417969, 145.5404815673828, 57.553382873535156, 9.572219848632812, 145.463134765625, 206.2830352783203, 141.87075805664062, 169.91119384765625, 15.208175659179688, -2.6372737884521484, 112.86070251464844, 1.078125, -40.967254638671875, 132.2418670654297, 256.22601318359375, 120.9970474243164, 72.69284057617188, 148.04962158203125, 172.57798767089844, 143.76400756835938, -101.84286499023438, 193.6897735595703, 7.667549133300781, 168.17147827148438, 174.34262084960938, 38.7188720703125, 132.85592651367188, 161.08758544921875, 48.690589904785156, 105.97920227050781, 139.3087921142578, 96.7349853515625, 56.821624755859375, 113.07666015625, 139.51535034179688, 47.4217529296875, 219.29788208007812, 68.98046112060547, -7.571502685546875, 14.604804992675781, 75.54631042480469, 31.596332550048828, 54.761817932128906, -10.086578369140625, 196.02227783203125, 20.015605926513672, 164.86378479003906, 143.50022888183594, 355.94183349609375, -45.543190002441406, 39.68529510498047, 11.801570892333984, 83.11331176757812, 4.17181396484375, 106.72169494628906, 133.38536071777344, -63.212257385253906, 61.26878356933594, 225.20361328125, 34.276611328125, 195.25082397460938, 235.3408966064453, 181.5400848388672, -110.63461303710938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000612.npy"}
{"epoch": 0.8986784140969163, "step": 613, "batch_size": 64, "mean": 106.90154266357422, "std": 92.02644348144531, "min": -109.4500503540039, "p10": 10.047036361694339, "median": 101.46824645996094, "p90": 241.820475769043, "max": 328.6595153808594, "pos_frac": 0.921875, "sample": [173.041748046875, 91.98501586914062, 234.68463134765625, 126.52025604248047, 65.45797729492188, 245.5074462890625, 174.4039764404297, 118.77870178222656, 168.3349609375, 83.0262222290039, 44.740814208984375, -109.4500503540039, 284.08203125, 133.203125, 144.2354736328125, 149.0023193359375, 120.11024475097656, 38.91257095336914, 192.484375, 34.480621337890625, 47.488685607910156, 114.35287475585938, 240.5526123046875, 67.15469360351562, 104.75776672363281, 38.115638732910156, 259.4229736328125, 221.77857971191406, 107.19194030761719, 120.32467651367188, 126.29656982421875, 182.25030517578125, 16.37987518310547, 29.646270751953125, 38.18182373046875, 247.30206298828125, 114.65037536621094, 134.5537109375, 328.6595153808594, 90.2501220703125, 23.6546630859375, 47.898094177246094, 46.67619323730469, 8.652107238769531, -17.82855224609375, 231.84408569335938, 47.180999755859375, 242.3638458251953, 9.208789825439453, -68.13308715820312, 292.80401611328125, 26.768184661865234, 55.891082763671875, -15.526802062988281, 95.57637023925781, 98.17872619628906, 120.44223022460938, 44.378074645996094, 133.4275665283203, 216.46067810058594, 22.571365356445312, 39.63624572753906, 12.002944946289062, -15.282752990722656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000613.npy"}
{"epoch": 0.9001468428781204, "step": 614, "batch_size": 64, "mean": 85.74708557128906, "std": 107.0660629272461, "min": -170.7930908203125, "p10": -42.42538414001465, "median": 86.96434783935547, "p90": 212.4240447998047, "max": 325.50408935546875, "pos_frac": 0.75, "sample": [163.82156372070312, 173.74862670898438, -81.4305419921875, 129.81808471679688, 155.25192260742188, 67.02587127685547, 5.276130676269531, -37.781402587890625, 108.49786376953125, -42.92101287841797, 41.9131965637207, 79.89998626708984, 62.9754638671875, -27.907958984375, 228.741455078125, -76.37870788574219, 207.6822509765625, 83.07160949707031, 216.3648223876953, 10.978378295898438, 196.479248046875, 55.926727294921875, 106.77677917480469, 74.55230712890625, 152.3939208984375, 17.66690444946289, 12.054901123046875, 153.93423461914062, 64.43494415283203, -160.2481231689453, -75.6020278930664, 182.69540405273438, 207.46697998046875, 50.97066879272461, -5.712623596191406, -134.67514038085938, 208.6453094482422, -9.415935516357422, 172.24114990234375, 214.0435028076172, 227.23695373535156, -170.7930908203125, 174.31817626953125, -10.737117767333984, 325.50408935546875, 221.20286560058594, 148.92391967773438, 118.46404266357422, 50.94676971435547, -23.025558471679688, 60.15009689331055, 174.14230346679688, 123.90486145019531, 72.95132446289062, 90.85708618164062, 171.27798461914062, 147.91224670410156, -18.90536117553711, 134.2780303955078, -41.268917083740234, 182.6884765625, -24.517486572265625, 219.75559997558594, 179.26918029785156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000614.npy"}
{"epoch": 0.9016152716593245, "step": 615, "batch_size": 64, "mean": 76.4342269897461, "std": 88.4114990234375, "min": -140.109619140625, "p10": -29.030015945434563, "median": 73.49352264404297, "p90": 186.12545013427734, "max": 240.98837280273438, "pos_frac": 0.78125, "sample": [-46.99566650390625, 240.98837280273438, 115.84441375732422, 75.4291000366211, 6.3940534591674805, 26.9161376953125, -7.674232482910156, -2.8223800659179688, 28.38458251953125, 53.90068054199219, 102.38623046875, 120.02582550048828, 170.764892578125, 121.296875, 99.96469116210938, 73.1258544921875, 111.70121002197266, -2.7225265502929688, -4.201267242431641, 10.944831848144531, 200.4612579345703, -140.109619140625, 97.01315307617188, 12.875198364257812, 22.627281188964844, 169.39773559570312, 150.17727661132812, 83.65777587890625, 183.3768310546875, 115.28614807128906, 46.511619567871094, 102.08485412597656, -4.54217529296875, 36.04498291015625, 96.0371322631836, 133.58334350585938, 183.71533203125, 186.9206085205078, -31.502883911132812, 54.61408233642578, -92.92507934570312, 215.85504150390625, 220.14682006835938, 35.46609878540039, 221.809326171875, 73.66523742675781, 102.418212890625, 228.84625244140625, 58.596099853515625, 184.27008056640625, 14.233406066894531, 28.754051208496094, 61.12965393066406, -113.02204132080078, 65.63754272460938, -23.259990692138672, -7.342689514160156, 73.32180786132812, -64.0184326171875, 167.18035888671875, -47.45477294921875, 172.75119018554688, 178.7283172607422, 145.12269592285156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000615.npy"}
{"epoch": 0.9030837004405287, "step": 616, "batch_size": 64, "mean": 101.07377624511719, "std": 107.29011535644531, "min": -174.18942260742188, "p10": -42.216961669921865, "median": 102.57296371459961, "p90": 221.9358642578125, "max": 425.31109619140625, "pos_frac": 0.828125, "sample": [238.2579345703125, 8.935348510742188, 201.78018188476562, 218.66098022460938, 70.09771728515625, 87.21670532226562, -46.517578125, -107.50912475585938, 168.59967041015625, 308.61175537109375, 239.10009765625, 172.47152709960938, 165.9230194091797, -57.737342834472656, 173.92930603027344, 180.8933868408203, 223.33938598632812, 211.47842407226562, 124.25828552246094, -7.322711944580078, 179.30514526367188, 241.19207763671875, 134.73275756835938, 158.1441650390625, 141.4310302734375, -90.37371826171875, 53.35338592529297, 79.06379699707031, 135.043701171875, 53.858436584472656, 425.31109619140625, 134.1230010986328, -174.18942260742188, 5.1049346923828125, -69.21011352539062, -26.084693908691406, 89.00847625732422, 103.08428192138672, 149.64158630371094, 113.8848648071289, 82.36128234863281, 94.67350006103516, -32.18218994140625, 37.01838684082031, -76.34193420410156, 138.2193603515625, 129.13983154296875, 102.0616455078125, 72.63294982910156, 38.35255432128906, 48.00372314453125, 90.19841003417969, 116.1829833984375, 0.5234909057617188, 215.8218994140625, 63.71112823486328, 33.07331848144531, 145.91188049316406, 75.13379669189453, 116.51071166992188, 200.62310791015625, 76.64988708496094, 290.93853759765625, -1.388092041015625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000616.npy"}
{"epoch": 0.9045521292217328, "step": 617, "batch_size": 64, "mean": 79.61019897460938, "std": 99.74547576904297, "min": -214.25997924804688, "p10": -44.27491607666015, "median": 77.53688049316406, "p90": 202.49724884033205, "max": 279.59454345703125, "pos_frac": 0.765625, "sample": [26.28321075439453, 135.3399200439453, 89.8389892578125, 210.18594360351562, -102.66256713867188, 161.1094207763672, 170.76605224609375, 69.0213851928711, 125.14125061035156, 53.184669494628906, 12.545166015625, 148.80184936523438, 167.3356170654297, 103.18395233154297, 144.01657104492188, -8.32452392578125, 19.172574996948242, 171.6160888671875, 81.83921813964844, 279.59454345703125, 56.386634826660156, 144.02488708496094, -214.25997924804688, 147.6380615234375, 43.04603958129883, 164.63409423828125, -11.83298110961914, -22.930465698242188, 13.407829284667969, 40.35882568359375, 41.85158920288086, 266.2542419433594, -47.504974365234375, 122.99427032470703, 261.56884765625, 99.41840362548828, 203.38934326171875, 162.6495361328125, 115.45361328125, 199.07894897460938, -36.73811340332031, -12.306913375854492, 216.6080322265625, 211.13424682617188, 177.351806640625, 66.19329833984375, 73.23454284667969, -63.9072265625, 25.167808532714844, 143.52239990234375, -90.19282531738281, -8.144828796386719, -101.8413314819336, -6.236148834228516, 57.792518615722656, 34.804901123046875, 82.78205871582031, 141.0468292236328, -54.449363708496094, 200.4156951904297, 127.54945373535156, 62.44480895996094, 23.118850708007812, -17.914146423339844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000617.npy"}
{"epoch": 0.9060205580029369, "step": 618, "batch_size": 64, "mean": 86.58537292480469, "std": 105.71994018554688, "min": -221.56101989746094, "p10": -52.43863906860349, "median": 100.63601684570312, "p90": 216.59010009765626, "max": 284.85162353515625, "pos_frac": 0.796875, "sample": [-132.01866149902344, 39.0931282043457, 80.9069595336914, 49.647735595703125, 188.8881378173828, 15.059402465820312, 151.30886840820312, 95.90847778320312, 205.93418884277344, 179.02822875976562, 4.002410888671875, -135.27886962890625, 212.23428344726562, 32.57469177246094, 116.73974609375, 90.99728393554688, -221.56101989746094, 241.31997680664062, 119.12387084960938, 105.36355590820312, -151.91513061523438, 190.30282592773438, 133.74476623535156, 12.716415405273438, -70.3780517578125, 64.69583892822266, 37.01227569580078, -68.90815734863281, 157.90963745117188, 129.9623565673828, 225.7173309326172, 53.82227325439453, 199.4230499267578, 219.38621520996094, 31.42877197265625, 107.90585327148438, -26.874267578125, 69.75898742675781, -12.131397247314453, 220.3971710205078, 125.60954284667969, -63.394798278808594, -13.93475341796875, 169.33718872070312, 157.33807373046875, -13.474834442138672, 145.63449096679688, 133.4477081298828, 110.7884292602539, 170.08399963378906, 218.45687866210938, 65.55453491210938, 284.85162353515625, 129.16799926757812, 238.96194458007812, 75.3660888671875, 60.560760498046875, -23.067031860351562, 159.0878448486328, -6.273895263671875, 43.77799987792969, 68.61833953857422, 142.3600616455078, 199.3566131591797], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000618.npy"}
{"epoch": 0.9074889867841409, "step": 619, "batch_size": 64, "mean": 79.16951751708984, "std": 113.07160186767578, "min": -140.84817504882812, "p10": -60.91792030334472, "median": 66.9642105102539, "p90": 223.83368682861328, "max": 425.7388610839844, "pos_frac": 0.765625, "sample": [-62.657501220703125, 201.5281982421875, 116.96542358398438, 250.09396362304688, 71.62330627441406, -82.65766906738281, 6.991455078125, 2.4146499633789062, 168.75546264648438, 62.30511474609375, 222.6696014404297, 245.91259765625, 0.29848480224609375, 193.77603149414062, 40.247283935546875, 23.425880432128906, 136.91558837890625, 22.187984466552734, 224.33258056640625, 88.31401824951172, -138.08172607421875, 127.82890319824219, 112.49589538574219, 200.40859985351562, -140.84817504882812, -41.832275390625, -6.1461944580078125, 146.10292053222656, 8.792152404785156, -61.2685546875, 10.981826782226562, 203.291259765625, 156.0279998779297, 158.8809814453125, 232.39207458496094, 28.58270263671875, -25.80938720703125, -60.09977340698242, 54.94160461425781, 81.20747375488281, 26.611488342285156, 193.8055419921875, 48.541656494140625, 119.6402587890625, 260.318115234375, 52.289649963378906, -122.33413696289062, 220.48556518554688, 102.34461975097656, 72.23552703857422, -47.143245697021484, -11.677642822265625, 133.63568115234375, 425.7388610839844, 11.205421447753906, -21.65380096435547, 185.8173828125, 14.631057739257812, 233.27613830566406, 163.0097198486328, 19.561630249023438, -62.13700866699219, -7.02168083190918, 74.37739562988281], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000619.npy"}
{"epoch": 0.908957415565345, "step": 620, "batch_size": 64, "mean": 87.47955322265625, "std": 114.23461151123047, "min": -141.42002868652344, "p10": -57.80344505310059, "median": 74.23653793334961, "p90": 230.0701416015625, "max": 267.9263610839844, "pos_frac": 0.78125, "sample": [43.07356262207031, -14.001293182373047, 183.9005126953125, 52.32011413574219, 45.82252883911133, 227.18885803222656, 183.22561645507812, -99.3953857421875, 113.23155212402344, 262.02532958984375, -7.536979675292969, -57.557701110839844, -33.80396270751953, 183.2417755126953, -112.53933715820312, 49.1944580078125, 200.90603637695312, 120.83580017089844, 206.79345703125, 219.60882568359375, 120.17630004882812, 208.23146057128906, -83.3809585571289, 47.30625915527344, -134.215087890625, -36.457244873046875, 68.78507232666016, 143.7742156982422, 188.5135040283203, 54.05549621582031, 31.198013305664062, 257.3355712890625, 209.9798126220703, 267.9263610839844, 9.85601806640625, 32.698036193847656, 219.43194580078125, 109.2855224609375, 252.30667114257812, 231.3049774169922, 18.794437408447266, 131.46438598632812, -124.37582397460938, 14.77587890625, 79.68800354003906, 16.268951416015625, 99.07879638671875, 44.600311279296875, 216.86788940429688, 29.881099700927734, -50.951698303222656, 111.69166564941406, 252.9619140625, 40.73625183105469, 194.9798583984375, 210.28012084960938, 29.734161376953125, 29.16815185546875, 130.26055908203125, -57.90876388549805, -52.79766845703125, 256.33038330078125, -141.42002868652344, 153.93690490722656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000620.npy"}
{"epoch": 0.9104258443465492, "step": 621, "batch_size": 64, "mean": 84.41682434082031, "std": 119.07781982421875, "min": -228.0679931640625, "p10": -48.48730354309082, "median": 82.68600082397461, "p90": 245.86748046875002, "max": 359.2381591796875, "pos_frac": 0.734375, "sample": [57.787498474121094, -26.097721099853516, -228.0679931640625, -17.46411895751953, 206.33663940429688, -71.86825561523438, 165.77597045898438, 51.951507568359375, 51.94221878051758, 42.542213439941406, 164.87794494628906, 72.67013549804688, 46.27918243408203, 117.31019592285156, -25.74761962890625, 86.71302032470703, -21.100177764892578, -0.13447952270507812, -193.36532592773438, -82.24394226074219, 191.37722778320312, 31.793777465820312, -45.43316650390625, 175.559326171875, 261.6976013183594, 281.27020263671875, 209.3131866455078, -14.834014892578125, 117.98814392089844, 123.01113891601562, -107.43628692626953, 246.24282836914062, 112.52175903320312, 170.90142822265625, 285.4159240722656, 43.194705963134766, 50.506202697753906, 127.95933532714844, 84.44541931152344, 24.985031127929688, -48.05479431152344, 88.68636322021484, -37.65040588378906, 78.37901306152344, 55.7664680480957, 104.6390380859375, 133.47872924804688, 96.71348571777344, 28.051620483398438, 232.24356079101562, -48.672664642333984, 45.13709259033203, 106.46884155273438, 297.69317626953125, -93.58379364013672, -24.783889770507812, 217.66798400878906, 248.18527221679688, 196.716796875, 117.0287857055664, 359.2381591796875, 80.92658233642578, 244.99166870117188, 154.8328094482422], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000621.npy"}
{"epoch": 0.9118942731277533, "step": 622, "batch_size": 64, "mean": 89.44147491455078, "std": 95.36830139160156, "min": -111.91183471679688, "p10": -30.968791198730468, "median": 93.48544311523438, "p90": 217.30137023925786, "max": 270.73345947265625, "pos_frac": 0.796875, "sample": [168.96383666992188, 32.84349060058594, -1.9140243530273438, 187.8632049560547, 75.00186920166016, -12.3104248046875, 169.7274627685547, 166.17730712890625, 268.69146728515625, 145.29100036621094, 3.181854248046875, 43.583900451660156, -36.2415657043457, -71.9874496459961, 27.605457305908203, 268.18133544921875, 118.39973449707031, 109.25411987304688, 54.793243408203125, 12.257247924804688, 11.924304962158203, -31.062408447265625, 130.061279296875, 141.181396484375, 174.54701232910156, 98.03446960449219, 155.6299285888672, 38.5823974609375, 233.64306640625, -60.24341583251953, 101.0019760131836, 168.43392944335938, 241.84222412109375, 1.7686882019042969, 93.88188171386719, -69.32174682617188, 134.2714080810547, -31.515975952148438, 205.79501342773438, 222.232666015625, 247.65518188476562, 174.27053833007812, -30.750350952148438, -30.171302795410156, 25.15239715576172, 37.132965087890625, -2.6864013671875, -16.974014282226562, 142.73703002929688, 135.79922485351562, 168.5585174560547, 20.303611755371094, 93.08900451660156, 270.73345947265625, 60.674163818359375, 78.84367370605469, 154.88217163085938, -111.91183471679688, 20.60770034790039, 104.33966827392578, 71.23661804199219, 49.101409912109375, 172.83511352539062, 198.74481201171875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000622.npy"}
{"epoch": 0.9133627019089574, "step": 623, "batch_size": 64, "mean": 63.4769401550293, "std": 115.03789520263672, "min": -199.38890075683594, "p10": -78.0573356628418, "median": 49.667457580566406, "p90": 195.3676940917969, "max": 321.7159423828125, "pos_frac": 0.6875, "sample": [121.78136444091797, 81.64082336425781, -48.29674530029297, 275.1314697265625, 108.42720794677734, 149.68539428710938, 54.796443939208984, 183.45883178710938, 176.05361938476562, -135.6307373046875, 167.0625457763672, 59.81315231323242, -54.75686264038086, 13.245193481445312, 182.19671630859375, 21.197296142578125, 221.67514038085938, 0.4718017578125, -39.730384826660156, -3.2362213134765625, -11.215667724609375, 62.9659309387207, -81.83041381835938, -40.802268981933594, -139.28892517089844, -61.35541534423828, 169.81619262695312, 32.26023483276367, 139.62579345703125, 7.234611511230469, -78.27047729492188, 101.79093933105469, 173.42205810546875, 44.53847122192383, -77.56000518798828, 11.40412712097168, 247.04019165039062, 146.3193359375, 35.398643493652344, 90.38693237304688, 203.30848693847656, -118.44681549072266, 136.24786376953125, 104.12803649902344, -37.53123474121094, 3.2015552520751953, 321.7159423828125, 5.7870941162109375, -8.157316207885742, -199.38890075683594, 197.0924835205078, 191.3431854248047, 186.8770294189453, 110.67501831054688, -101.61799621582031, 312.8599853515625, -12.627830505371094, -45.77178192138672, -1.7148590087890625, 85.4578628540039, 176.98312377929688, 26.616302490234375, 174.85195922851562, 43.768524169921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000623.npy"}
{"epoch": 0.9148311306901615, "step": 624, "batch_size": 64, "mean": 99.29826354980469, "std": 105.5029296875, "min": -130.35731506347656, "p10": -45.26506042480468, "median": 94.74137878417969, "p90": 242.87466888427736, "max": 309.83740234375, "pos_frac": 0.796875, "sample": [261.0780944824219, -1.9402847290039062, 83.85321044921875, 102.48768615722656, -130.35731506347656, 155.7350616455078, 38.88348388671875, 75.07858276367188, 239.22930908203125, 148.63638305664062, 177.71755981445312, -74.07441711425781, 231.8833770751953, 110.82139587402344, 269.3588562011719, -47.90228271484375, 241.6747589111328, -87.67951965332031, 121.39910888671875, 82.13192749023438, 197.92245483398438, 91.64433288574219, 198.8499298095703, 34.53306198120117, -35.902442932128906, -9.282875061035156, 269.42034912109375, 104.95445251464844, -79.07867431640625, 30.608673095703125, 101.94247436523438, 163.3111572265625, 134.25564575195312, 251.54222106933594, -6.768135070800781, 97.83842468261719, 117.14054870605469, 39.624759674072266, 128.8243865966797, 180.05398559570312, -39.111541748046875, -48.79545593261719, 18.521499633789062, 81.77730560302734, 223.25636291503906, 100.25836944580078, 60.032470703125, 234.81185913085938, 243.388916015625, 59.245086669921875, 89.85144805908203, -79.05279541015625, 102.22761535644531, 289.9964599609375, 16.727802276611328, 37.85865783691406, 71.20314025878906, 52.60355758666992, -13.275463104248047, 91.23907470703125, 309.83740234375, 61.973976135253906, 188.92201232910156, 192.14154052734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000624.npy"}
{"epoch": 0.9162995594713657, "step": 625, "batch_size": 64, "mean": 74.53196716308594, "std": 97.28756713867188, "min": -151.80435180664062, "p10": -21.864888763427736, "median": 57.98550796508789, "p90": 200.89158325195314, "max": 288.8698425292969, "pos_frac": 0.765625, "sample": [32.47602844238281, 41.71305847167969, -122.9310073852539, 244.2435302734375, 30.769798278808594, 196.16705322265625, 120.36994934082031, 256.2171630859375, 86.38956451416016, 84.92076110839844, 41.429481506347656, -82.58584594726562, -46.50141525268555, 15.186195373535156, 288.8698425292969, 61.68212890625, 33.30113220214844, -14.982505798339844, 99.13555908203125, 39.919219970703125, 191.7549591064453, -15.156394958496094, 20.06161117553711, 83.53453063964844, -21.912521362304688, 111.14646911621094, 156.62242126464844, -18.04784393310547, 10.0445556640625, 105.51724243164062, 161.14236450195312, 67.94911193847656, 54.28888702392578, 35.81355285644531, 269.79046630859375, 2.476520538330078, -1.7398147583007812, 68.35919189453125, -151.80435180664062, 44.46724319458008, -109.28713989257812, 21.00384521484375, 182.23004150390625, 130.77468872070312, 49.161231994628906, 123.84983825683594, 24.903335571289062, -24.242408752441406, 202.9163818359375, 53.782135009765625, -4.982410430908203, -21.753746032714844, -5.628364562988281, 105.8831558227539, 99.37755584716797, 174.09681701660156, 129.28086853027344, 173.4547882080078, 133.37774658203125, -0.6707992553710938, 241.26210021972656, 148.49185180664062, 280.4893798828125, 82.17706298828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000625.npy"}
{"epoch": 0.9177679882525698, "step": 626, "batch_size": 64, "mean": 72.47120666503906, "std": 112.88433837890625, "min": -156.3497314453125, "p10": -57.47579498291015, "median": 52.099788665771484, "p90": 217.0321746826172, "max": 353.8763427734375, "pos_frac": 0.71875, "sample": [34.161041259765625, -24.185989379882812, 45.295372009277344, 118.23191833496094, -142.22662353515625, 262.3095397949219, 196.78811645507812, 55.75537109375, 1.6339111328125, -118.32112121582031, 78.2606201171875, 100.8416748046875, 166.37039184570312, 134.51800537109375, -4.859130859375, 218.61135864257812, 35.56269836425781, 126.77861022949219, 66.24417114257812, -26.450855255126953, 50.3880615234375, 47.612213134765625, 121.88190460205078, 31.270702362060547, -119.90213012695312, 31.970840454101562, 78.004638671875, -8.206130981445312, 30.054664611816406, 213.347412109375, -58.76323699951172, 53.81151580810547, -150.77444458007812, -54.471763610839844, 129.2906494140625, 164.1456756591797, 21.04461669921875, 124.12667083740234, 73.35557556152344, -10.138641357421875, 67.78800201416016, -88.66558837890625, 170.72720336914062, 208.85986328125, 353.8763427734375, 155.96905517578125, -8.75374984741211, 110.27728271484375, 38.162269592285156, 239.28018188476562, -14.311317443847656, 175.6182861328125, -3.135650634765625, 309.2527160644531, 178.51287841796875, -156.3497314453125, 281.4449462890625, 35.08575439453125, 46.08135986328125, -5.623905181884766, 156.9944610595703, 27.362464904785156, 272.56768798828125, -6.231304168701172], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000626.npy"}
{"epoch": 0.9192364170337739, "step": 627, "batch_size": 64, "mean": 90.24308776855469, "std": 113.56268310546875, "min": -169.1273193359375, "p10": -24.733615493774412, "median": 82.14957809448242, "p90": 237.34086608886724, "max": 383.9525146484375, "pos_frac": 0.796875, "sample": [146.98355102539062, 65.92526245117188, 182.36941528320312, 252.03573608398438, 116.33763122558594, -5.8402862548828125, 66.07154846191406, 129.80535888671875, 188.84793090820312, 24.63641357421875, 43.94923400878906, 5.340545654296875, 3.70074462890625, 14.70370864868164, -0.15378189086914062, 74.16860961914062, -128.3206024169922, 185.568359375, 96.08935546875, 150.71218872070312, -93.3329849243164, 103.19319915771484, 192.4969024658203, 4.113916397094727, 225.37744140625, -22.029556274414062, 112.84896087646484, 139.02418518066406, -14.196781158447266, 201.2647705078125, 108.90235900878906, 44.26980972290039, 112.65897369384766, 138.54367065429688, 31.09807586669922, 39.01042938232422, 176.410400390625, 21.042339324951172, 85.41014099121094, -7.282398223876953, 18.08490562438965, 30.45311164855957, 383.9525146484375, -80.8191146850586, 176.95489501953125, -169.1273193359375, 256.38873291015625, 103.48491668701172, 53.75764465332031, 57.706207275390625, 356.2919921875, 210.292724609375, 253.90927124023438, -105.8936767578125, -25.892498016357422, 90.79449462890625, 172.50381469726562, 20.86913299560547, -3.2940216064453125, 242.46804809570312, 355.45709228515625, -45.589630126953125, 78.8890151977539, 132.16079711914062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000627.npy"}
{"epoch": 0.920704845814978, "step": 628, "batch_size": 64, "mean": 96.21630859375, "std": 99.90585327148438, "min": -105.34245300292969, "p10": -35.63555145263671, "median": 78.5184555053711, "p90": 231.7483978271485, "max": 315.53045654296875, "pos_frac": 0.84375, "sample": [181.16551208496094, -3.3064632415771484, 206.63156127929688, 158.4763946533203, 129.11614990234375, 76.4456787109375, 39.51972579956055, 6.511444091796875, -28.136474609375, 6.581714630126953, 182.08529663085938, 17.356582641601562, -84.7275390625, 266.9892883300781, 69.1058349609375, 288.35040283203125, -38.84944152832031, 167.77011108398438, 315.53045654296875, 36.98719787597656, 47.13836669921875, 43.442657470703125, 189.39820861816406, -69.56317138671875, 67.55439758300781, -17.564346313476562, 70.8946533203125, 218.7868194580078, 134.87347412109375, 111.69849395751953, 42.93443298339844, 211.7232208251953, 289.7003173828125, 237.30335998535156, 192.40460205078125, 85.6155776977539, 122.78691101074219, 23.07537078857422, 133.7962646484375, 80.31025695800781, 17.172809600830078, 49.85577392578125, 57.33451843261719, 76.72665405273438, 102.02737426757812, 129.28330993652344, 151.9500732421875, 149.19308471679688, -47.604576110839844, -41.101959228515625, -105.34245300292969, 117.32896423339844, 260.2977294921875, 260.9191589355469, -81.7418212890625, 49.07667541503906, 169.001708984375, 37.3044548034668, 51.105377197265625, 153.82449340820312, 136.3788299560547, 181.2602081298828, 70.1781997680664, 3.5012893676757812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000628.npy"}
{"epoch": 0.922173274596182, "step": 629, "batch_size": 64, "mean": 86.66081237792969, "std": 101.28416442871094, "min": -150.97349548339844, "p10": -49.854238128662104, "median": 100.88753509521484, "p90": 210.47695159912112, "max": 300.4756164550781, "pos_frac": 0.796875, "sample": [124.51533508300781, 220.68887329101562, 15.616762161254883, -1.4593124389648438, 150.35052490234375, 185.39288330078125, 120.49183654785156, -42.978240966796875, 225.16094970703125, 94.64419555664062, 187.61029052734375, 175.62684631347656, 224.1407470703125, 85.47280883789062, 159.38372802734375, -146.5994873046875, 8.1605224609375, 130.5159454345703, 78.76303100585938, 215.84414672851562, -23.352813720703125, 191.64874267578125, 177.73806762695312, 118.29399108886719, -52.80109405517578, 132.3074493408203, 99.65744018554688, -54.971168518066406, 32.56901550292969, 11.610992431640625, 121.07064056396484, 133.30091857910156, 166.08480834960938, 108.67074584960938, 98.71430206298828, 50.811431884765625, -150.97349548339844, 203.02711486816406, 173.21185302734375, 21.367965698242188, 5.407688140869141, 12.696044921875, 51.342323303222656, -21.678192138671875, 109.06716918945312, 102.11763000488281, 194.47354125976562, -6.401878356933594, 69.81890869140625, 1.8030071258544922, 138.94232177734375, 160.68199157714844, -73.2562255859375, 199.42054748535156, -9.902975082397461, 300.4756164550781, 86.11476135253906, 137.06321716308594, 72.11012268066406, 17.518810272216797, 213.66973876953125, 230.23052978515625, -129.89205932617188, -84.85963439941406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000629.npy"}
{"epoch": 0.9236417033773862, "step": 630, "batch_size": 64, "mean": 59.536293029785156, "std": 99.90815734863281, "min": -157.8565673828125, "p10": -81.32765579223631, "median": 62.13905715942383, "p90": 193.48784484863288, "max": 273.0140686035156, "pos_frac": 0.765625, "sample": [220.2476806640625, -89.77725219726562, -56.41594314575195, 55.70258331298828, 128.8857421875, 108.8714370727539, 102.74420166015625, -52.164764404296875, 113.22146606445312, 127.63655853271484, 21.443359375, 273.0140686035156, 68.28836822509766, 228.913818359375, 118.5756607055664, 42.311676025390625, -43.18423843383789, 19.2747802734375, 104.59724426269531, -46.19001388549805, 64.59024047851562, 100.9053955078125, 4.682220458984375, 123.19891357421875, -85.4850082397461, 169.517822265625, 166.49411010742188, 93.063232421875, 12.115952491760254, 200.38278198242188, -125.55250549316406, -48.95854187011719, 75.97418212890625, 6.8620147705078125, 161.08192443847656, 21.135421752929688, -157.8565673828125, 70.06280517578125, 48.38477325439453, 1.3859405517578125, -131.7449951171875, -71.62716674804688, 32.74939727783203, -1.2387542724609375, 119.8192138671875, -130.60968017578125, 73.4140396118164, 233.0380096435547, -97.8421859741211, 23.189971923828125, 164.7266387939453, 205.97149658203125, 59.68787384033203, 78.77763366699219, 18.069366455078125, -14.947883605957031, 210.5205535888672, 25.840415954589844, 93.04022216796875, 45.40100860595703, 157.77174377441406, 28.501358032226562, 177.399658203125, 162.43336486816406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000630.npy"}
{"epoch": 0.9251101321585903, "step": 631, "batch_size": 64, "mean": 83.4664535522461, "std": 95.56238555908203, "min": -172.1141357421875, "p10": -32.53478851318359, "median": 90.42373275756836, "p90": 201.74221954345705, "max": 296.1488037109375, "pos_frac": 0.765625, "sample": [177.68923950195312, 114.44182586669922, -56.86566162109375, 180.97604370117188, 42.06205749511719, 152.02700805664062, 85.24188232421875, 125.22036743164062, -172.1141357421875, 28.45958709716797, 296.1488037109375, 162.2814178466797, -41.957923889160156, 68.5706787109375, 74.18616485595703, 102.73336791992188, 145.3325653076172, 217.01992797851562, -35.816646575927734, 3.4847679138183594, 99.27204132080078, 41.287174224853516, 4.248374938964844, 111.16160583496094, 196.4375, 125.98966217041016, 47.47377014160156, 27.94296646118164, 229.12576293945312, 112.41502380371094, -8.703468322753906, -57.04127502441406, 257.2305603027344, -3.1903076171875, 66.46728515625, 237.13796997070312, -19.254730224609375, 114.10906982421875, 114.47158813476562, 146.4293670654297, 48.27667999267578, -11.254179000854492, 181.8838653564453, 80.60945129394531, 204.0156707763672, -33.084800720214844, 246.43040466308594, 7.1826934814453125, 164.25018310546875, 190.97769165039062, 126.99163818359375, 34.11453628540039, -10.93704605102539, -1.3449935913085938, 95.60558319091797, -135.3999786376953, 131.89393615722656, 131.8400115966797, 60.940399169921875, -17.806692123413086, 81.801025390625, 142.28009033203125, 141.70693969726562, -31.251426696777344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000631.npy"}
{"epoch": 0.9265785609397944, "step": 632, "batch_size": 64, "mean": 93.11445617675781, "std": 114.906494140625, "min": -219.7700653076172, "p10": -42.15723876953125, "median": 91.29463577270508, "p90": 229.56586456298828, "max": 365.95416259765625, "pos_frac": 0.734375, "sample": [179.54891967773438, -38.95477294921875, 28.38976287841797, 155.1563262939453, 228.9099884033203, 82.89372253417969, 9.494064331054688, 266.32879638671875, 303.7918701171875, 250.89743041992188, 189.93846130371094, 64.83233642578125, 75.2498779296875, 99.99870300292969, -18.931655883789062, -13.94961929321289, 98.83531188964844, 211.44618225097656, -11.385908126831055, 82.25896453857422, 123.7564697265625, 68.77059936523438, 137.2628631591797, 194.7581329345703, -43.52972412109375, 277.18438720703125, 216.82925415039062, 98.08822631835938, 211.15826416015625, -57.59532928466797, -36.67716979980469, -123.73445129394531, 365.95416259765625, 229.84695434570312, -16.193214416503906, 222.68740844726562, 179.5082550048828, 191.54998779296875, 106.56008911132812, -8.261054992675781, 126.0993881225586, -14.140342712402344, 89.03253936767578, 93.55673217773438, 76.45852661132812, 127.88972473144531, 80.04800415039062, 97.75860595703125, 190.73484802246094, 291.20172119140625, 210.2398681640625, -72.01690673828125, -3.570150375366211, -104.49028015136719, 62.25783920288086, 29.74617576599121, 15.696273803710938, -53.817649841308594, -219.7700653076172, 75.754150390625, 98.2958984375, 85.2527847290039, -17.718242645263672, 112.15286254882812], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000632.npy"}
{"epoch": 0.9280469897209985, "step": 633, "batch_size": 64, "mean": 57.35297775268555, "std": 126.69013977050781, "min": -188.1270751953125, "p10": -93.19511260986327, "median": 48.28747749328613, "p90": 210.09298400878907, "max": 487.23028564453125, "pos_frac": 0.625, "sample": [-88.79782104492188, 94.8881607055664, 40.54601287841797, -14.790519714355469, -144.5895538330078, -1.1895523071289062, -7.256599426269531, -72.7462387084961, 487.23028564453125, 233.89027404785156, 125.32608032226562, -105.19558715820312, 243.95193481445312, -6.866767883300781, 114.03192138671875, 50.852752685546875, 205.90463256835938, 181.67349243164062, -0.5059967041015625, 139.68563842773438, -55.189735412597656, 207.49313354492188, 220.22079467773438, -38.42034912109375, 101.04994201660156, 220.14271545410156, -59.3217887878418, 45.72220230102539, -174.44161987304688, 89.93575286865234, -20.468765258789062, -36.86224365234375, 209.69186401367188, 177.33071899414062, -74.26271057128906, -154.31179809570312, -61.625465393066406, -95.07966613769531, -49.079933166503906, 199.5152130126953, 131.33065795898438, 51.571197509765625, 147.5944366455078, 137.49403381347656, 41.421287536621094, 83.71997833251953, -57.095611572265625, 88.62223815917969, 210.264892578125, 14.987411499023438, -188.1270751953125, 150.11561584472656, 4.431081771850586, 235.9620361328125, 81.01395416259766, -163.48426818847656, 40.946372985839844, 63.40179443359375, -1.7949943542480469, 167.95455932617188, 2.86578369140625, 118.70181274414062, 30.077743530273438, 150.53466796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000633.npy"}
{"epoch": 0.9295154185022027, "step": 634, "batch_size": 64, "mean": 73.15084838867188, "std": 90.25689697265625, "min": -131.44952392578125, "p10": -28.06532554626465, "median": 74.17251586914062, "p90": 194.53575744628907, "max": 330.59686279296875, "pos_frac": 0.75, "sample": [-98.60929870605469, -52.95037841796875, 25.195560455322266, 50.1651611328125, -28.331012725830078, 67.5999526977539, 122.33386993408203, 141.92506408691406, 190.3772430419922, 72.35069274902344, 6.375175476074219, 75.99433898925781, 143.83285522460938, 28.201446533203125, 257.27081298828125, 113.84425354003906, 100.42913055419922, 138.05967712402344, 34.32823181152344, -8.17059326171875, 91.68075561523438, -22.274940490722656, 89.13105773925781, -17.390869140625, 15.406661987304688, 121.79368591308594, 164.88658142089844, 126.59388732910156, 119.13592529296875, 68.87035369873047, 330.59686279296875, 20.93687629699707, 1.4972686767578125, -131.44952392578125, 92.07522583007812, 196.31797790527344, 200.26861572265625, -80.9031982421875, 81.93478393554688, -15.014419555664062, -27.445388793945312, 204.77276611328125, 130.09576416015625, 200.4302520751953, 130.61038208007812, 174.16781616210938, 121.80569458007812, -12.028244018554688, 143.73049926757812, 151.9029541015625, -64.01809692382812, 55.834564208984375, -11.675933837890625, 66.53733825683594, -82.13166809082031, 80.12891387939453, -5.012409210205078, 60.37652587890625, -0.5620880126953125, 48.82769775390625, 109.93417358398438, 213.3145294189453, 93.69279479980469, 64.04962158203125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000634.npy"}
{"epoch": 0.9309838472834068, "step": 635, "batch_size": 64, "mean": 56.93890380859375, "std": 106.76277923583984, "min": -219.07907104492188, "p10": -61.734912872314446, "median": 58.43966102600098, "p90": 195.5923263549805, "max": 319.93292236328125, "pos_frac": 0.703125, "sample": [128.95709228515625, -50.32061767578125, 202.9195556640625, -115.85926818847656, 150.5040740966797, 116.4531021118164, -71.61885833740234, 4.130218505859375, 29.52264404296875, 80.44705963134766, 112.97471618652344, 175.62469482421875, 108.11833190917969, 38.147705078125, 74.38729858398438, 50.10872268676758, -8.96807861328125, 160.09286499023438, 39.85350036621094, 76.0811767578125, -35.952880859375, -13.675407409667969, 45.274932861328125, 84.36653137207031, 68.91303253173828, -52.695213317871094, 21.4842529296875, 196.9871826171875, 239.3431396484375, 257.72711181640625, -11.844768524169922, 74.55548095703125, -9.42919921875, 319.93292236328125, 185.23158264160156, 27.564544677734375, 3.707416534423828, 57.43574905395508, 59.443572998046875, 116.85700225830078, 86.67194366455078, 277.94561767578125, 192.33766174316406, 68.39749908447266, 117.42439270019531, -50.967803955078125, -22.021785736083984, 34.910545349121094, -76.27936553955078, -65.60906982421875, 86.31556701660156, -36.37992858886719, -219.07907104492188, 50.394981384277344, 92.86434173583984, 84.03921508789062, 102.907958984375, -140.7238006591797, -21.844886779785156, 277.1031799316406, -167.6477813720703, 15.823333740234375, 64.65652465820312, -43.93238830566406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000635.npy"}
{"epoch": 0.9324522760646109, "step": 636, "batch_size": 64, "mean": 91.07327270507812, "std": 97.72618103027344, "min": -143.26727294921875, "p10": -14.891298675537104, "median": 78.76440048217773, "p90": 232.5443557739258, "max": 308.6863098144531, "pos_frac": 0.8125, "sample": [49.067298889160156, 190.4986114501953, -16.7796630859375, 38.601531982421875, 158.99713134765625, -1.1302032470703125, 239.0389404296875, 5.235525131225586, 18.703651428222656, -23.82530975341797, 54.07347106933594, 73.26798248291016, 32.857696533203125, 195.56593322753906, 199.2230682373047, 224.27537536621094, -10.485115051269531, 308.6863098144531, 92.74626159667969, 21.417434692382812, -100.30087280273438, 228.9808349609375, 65.83943939208984, 31.259057998657227, 42.18523406982422, 45.680877685546875, 162.83534240722656, 234.0715789794922, 90.07626342773438, 270.58349609375, 25.717384338378906, -44.68502426147461, 54.04027557373047, 177.4344024658203, 8.657264709472656, -4.0639801025390625, 174.70510864257812, 99.96207427978516, 94.7341537475586, 112.10858154296875, 116.82855224609375, -0.8491020202636719, 134.2972412109375, 182.64205932617188, 90.18882751464844, 188.74261474609375, -64.43326568603516, 111.58397674560547, 58.334930419921875, -143.26727294921875, 67.31222534179688, -23.962173461914062, 86.09912109375, 178.82373046875, 243.41549682617188, 272.38983154296875, 260.6849060058594, 145.7564239501953, 113.54534912109375, 22.315528869628906, -6.030670166015625, 73.65473175048828, 16.88460922241211, 83.87406921386719], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000636.npy"}
{"epoch": 0.933920704845815, "step": 637, "batch_size": 64, "mean": 96.68272399902344, "std": 102.52902221679688, "min": -149.74862670898438, "p10": -11.620987319946288, "median": 90.14376831054688, "p90": 237.97414703369142, "max": 270.4509582519531, "pos_frac": 0.796875, "sample": [2.54718017578125, 167.828369140625, 192.23313903808594, 208.69998168945312, -43.087242126464844, 260.5476989746094, -108.06919860839844, -149.74862670898438, 142.98251342773438, 218.08267211914062, 55.44981384277344, 6.146383285522461, 17.85601043701172, 84.05378723144531, -24.71701431274414, 270.4509582519531, 169.21038818359375, -109.92450714111328, 90.79513549804688, 224.2428741455078, 30.693771362304688, 63.32563018798828, 62.88860321044922, 202.88168334960938, 59.135032653808594, 163.5238800048828, -5.8959808349609375, 40.46025085449219, -10.883285522460938, 89.49240112304688, 36.86552429199219, 189.6930389404297, 118.80787658691406, 92.59872436523438, 259.893798828125, -1.12896728515625, 22.094573974609375, 45.789146423339844, 116.99047088623047, 33.528236389160156, 218.57748413085938, 232.8809356689453, 126.5289077758789, 191.29742431640625, -3.6143646240234375, 159.7790985107422, 95.41413879394531, -4.114448547363281, 243.0098876953125, 59.61729431152344, 240.15695190429688, -86.91436767578125, 63.767181396484375, 246.315673828125, 115.40364074707031, 59.92326354980469, 84.7923583984375, 268.7027893066406, 146.50933837890625, 184.21405029296875, -5.1888275146484375, 133.43121337890625, 142.8072509765625, -11.937145233154297], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000637.npy"}
{"epoch": 0.9353891336270191, "step": 638, "batch_size": 64, "mean": 97.12511444091797, "std": 85.27412414550781, "min": -72.18917846679688, "p10": -16.271376037597655, "median": 105.91079711914062, "p90": 196.83197326660158, "max": 311.46514892578125, "pos_frac": 0.84375, "sample": [186.7398681640625, -44.41156005859375, -20.744903564453125, 115.73372650146484, 144.603515625, 36.39430236816406, 111.53094482421875, 158.57290649414062, 190.89418029785156, 37.038368225097656, 151.28152465820312, 251.24249267578125, 211.2109375, 303.2279968261719, 9.178085327148438, -10.277873992919922, 6.150033950805664, -13.992637634277344, 53.40719985961914, 96.47792053222656, 140.6918487548828, 83.88870239257812, 191.66233825683594, 73.98014831542969, 127.21288299560547, 240.84690856933594, 66.52838897705078, 114.8056411743164, 311.46514892578125, 181.3167724609375, 199.0475311279297, 112.44412231445312, 70.26492309570312, -17.24797821044922, 108.4984130859375, 127.66740417480469, 45.7049560546875, 111.58692932128906, 30.749954223632812, 13.2916259765625, -32.014801025390625, 202.74159240722656, 111.306884765625, 130.572021484375, -33.71863555908203, 4.788127899169922, 153.33297729492188, 129.68820190429688, -3.339691162109375, 147.05323791503906, 79.5189437866211, 19.57132911682129, 103.32318115234375, 177.4554443359375, 49.672752380371094, 74.48910522460938, 166.55355834960938, 183.00860595703125, 87.72262573242188, 144.17762756347656, -28.11792755126953, -72.18917846679688, 65.13142395019531, 46.61634063720703], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000638.npy"}
{"epoch": 0.9368575624082232, "step": 639, "batch_size": 64, "mean": 50.036888122558594, "std": 110.62532806396484, "min": -253.83279418945312, "p10": -85.49486999511718, "median": 55.624267578125, "p90": 198.49183349609376, "max": 262.9891357421875, "pos_frac": 0.703125, "sample": [103.33956909179688, 56.42176055908203, 109.19923400878906, 198.5567626953125, 63.99577331542969, -6.385581970214844, 34.73626708984375, 203.2996063232422, 102.1534423828125, 69.00167846679688, 47.81858825683594, -26.456344604492188, 64.61544799804688, -142.900634765625, 156.40843200683594, 31.591964721679688, -35.68425750732422, -135.1212158203125, 52.722354888916016, 54.82677459716797, 249.6201171875, -253.83279418945312, 21.708927154541016, 146.00115966796875, 198.34033203125, -151.1445770263672, -80.7042236328125, 159.6131591796875, 57.490631103515625, 105.14482116699219, 262.9891357421875, 247.52108764648438, 214.44935607910156, -44.47163009643555, 86.484619140625, 75.01628112792969, 51.54187774658203, 82.41742706298828, -116.522216796875, -82.13512420654297, 158.77572631835938, 84.68875122070312, 48.803443908691406, -9.65338134765625, 183.8255157470703, -157.09011840820312, 11.980682373046875, 64.77442169189453, 7.2643280029296875, 35.173126220703125, 21.88384437561035, -66.98799133300781, 194.01661682128906, 89.61579895019531, -78.10531616210938, -86.93476104736328, -14.0224609375, 11.2313232421875, -53.462257385253906, 253.32644653320312, 135.39480590820312, 73.10079193115234, 72.84109497070312, -9.747543334960938], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000639.npy"}
{"epoch": 0.9383259911894273, "step": 640, "batch_size": 64, "mean": 87.34074401855469, "std": 98.98982238769531, "min": -183.6455078125, "p10": -42.80857086181639, "median": 84.04708480834961, "p90": 228.75769653320313, "max": 275.529296875, "pos_frac": 0.859375, "sample": [-53.31442642211914, 160.32272338867188, -48.457855224609375, 36.045448303222656, 1.3963069915771484, 40.03767395019531, 73.82756042480469, 146.3905029296875, 172.149658203125, 52.8096923828125, 107.4954833984375, 253.89764404296875, 108.73965454101562, 39.060062408447266, 93.2291488647461, 80.40816497802734, 91.15115356445312, -183.6455078125, 54.64488983154297, 67.8800048828125, -14.698944091796875, 141.8206024169922, 92.65386962890625, 93.32555389404297, 56.37220764160156, 65.94384765625, 144.08399963378906, 40.29167175292969, 238.00852966308594, 42.50163269042969, 208.48434448242188, 243.61764526367188, 55.611785888671875, 30.66189956665039, 268.3387145996094, 3.7580127716064453, 28.99449920654297, 87.68600463867188, 16.342056274414062, -83.2611083984375, 156.2300567626953, 262.22650146484375, 148.27816772460938, 200.05831909179688, 203.9424285888672, 88.38816833496094, 106.71097564697266, 29.12335205078125, -81.34115600585938, 275.529296875, 205.19775390625, 65.26432800292969, -29.626907348632812, 229.228515625, -126.83026123046875, 91.7401351928711, 56.113243103027344, 37.295135498046875, 137.8561248779297, 227.65911865234375, 94.88392639160156, 190.12808227539062, -53.855010986328125, 21.002750396728516], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000640.npy"}
{"epoch": 0.9397944199706314, "step": 641, "batch_size": 64, "mean": 91.79606628417969, "std": 117.91643524169922, "min": -115.38617706298828, "p10": -55.85524063110351, "median": 101.64833068847656, "p90": 223.88315734863284, "max": 539.531494140625, "pos_frac": 0.75, "sample": [-36.844993591308594, 219.05401611328125, -36.07067108154297, 294.65118408203125, -56.086097717285156, 29.953399658203125, 134.18057250976562, 246.5870819091797, 11.88671875, -23.05157470703125, -3.3387184143066406, 58.27564239501953, -66.01873779296875, 1.6041412353515625, 539.531494140625, -9.975364685058594, 167.91693115234375, 2.583160400390625, -12.972488403320312, 225.95278930664062, 61.34965515136719, 50.98130798339844, 135.72674560546875, 111.21148681640625, 104.75067138671875, 72.08549499511719, -68.6427001953125, 109.7829818725586, 215.4010009765625, 197.00973510742188, 120.53895568847656, 180.25389099121094, 98.994873046875, -55.31657409667969, -41.2967529296875, 215.60470581054688, 36.042510986328125, 151.8292236328125, -86.37472534179688, -66.57352447509766, 49.42219924926758, -115.38617706298828, 176.3542022705078, 24.270713806152344, 119.27299499511719, -105.22210693359375, -47.180580139160156, 208.95263671875, 105.43231201171875, 153.58583068847656, 142.5057373046875, 233.75701904296875, 76.04891967773438, 132.08450317382812, 179.78944396972656, 14.353103637695312, 84.22284698486328, 130.3895263671875, 182.06703186035156, 104.30178833007812, 91.37055206298828, 187.0416259765625, 231.89259338378906, 284.4442443847656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000641.npy"}
{"epoch": 0.9412628487518355, "step": 642, "batch_size": 64, "mean": 84.43093872070312, "std": 114.77265167236328, "min": -148.60763549804688, "p10": -68.55233726501464, "median": 74.70548248291016, "p90": 219.2900329589844, "max": 488.50152587890625, "pos_frac": 0.78125, "sample": [141.12841796875, -71.64266204833984, 81.541015625, 62.708763122558594, 223.1866455078125, -124.96826934814453, 74.88728332519531, -21.060195922851562, 71.2110366821289, 40.40259552001953, -14.676651000976562, 93.23660278320312, 146.96633911132812, -79.50244903564453, 212.83949279785156, 80.31954956054688, 164.6754608154297, 179.02659606933594, -135.90933227539062, 139.06105041503906, -61.34157943725586, -8.472900390625, -91.16188049316406, -7.222728729248047, 53.124725341796875, 222.05455017089844, 74.27477264404297, 70.65391540527344, 59.570465087890625, 136.97271728515625, 85.77405548095703, 252.35984802246094, 131.14141845703125, 225.49783325195312, 129.27032470703125, 184.63861083984375, 191.51734924316406, 122.93206787109375, 74.523681640625, 59.425540924072266, 177.935546875, 97.38725280761719, 133.0833282470703, 30.292770385742188, 4.909854888916016, 59.37846374511719, 98.237060546875, 258.0118103027344, 145.38319396972656, 32.89251708984375, 488.50152587890625, 25.735580444335938, 82.06763458251953, -4.8335418701171875, 48.230186462402344, -91.83300018310547, 19.281951904296875, 379.865478515625, 55.94865417480469, -12.558418273925781, 1.716094970703125, 197.56634521484375, -148.60763549804688, 156.023193359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000642.npy"}
{"epoch": 0.9427312775330396, "step": 643, "batch_size": 64, "mean": 81.56901550292969, "std": 101.99443817138672, "min": -153.77349853515625, "p10": -51.17767868041992, "median": 75.52633666992188, "p90": 213.1873519897461, "max": 280.4183654785156, "pos_frac": 0.828125, "sample": [235.6090087890625, 174.83895874023438, 198.58143615722656, 28.438064575195312, 137.51651000976562, 218.04513549804688, 236.95172119140625, 27.527572631835938, 24.547698974609375, 65.97398376464844, -96.89519500732422, -110.47618865966797, 18.382259368896484, 116.06185150146484, -40.73780822753906, 131.73497009277344, 120.51850891113281, 59.791290283203125, 215.7950897216797, 181.9029083251953, 206.62400817871094, 161.07168579101562, 130.2162628173828, 50.16901779174805, -1.676095962524414, 69.10345458984375, 73.84097290039062, 157.97073364257812, 258.63128662109375, 56.15936279296875, -50.199867248535156, 134.1778106689453, -153.77349853515625, 29.72876739501953, 192.8203582763672, 61.47967529296875, 87.97947692871094, 130.8076171875, 94.19120788574219, 143.58334350585938, 200.4599609375, 207.10263061523438, 216.65646362304688, 5.9685211181640625, 117.191162109375, 5.52862548828125, 2.324056625366211, 49.35597229003906, 280.4183654785156, 36.45136260986328, 9.260971069335938, 39.22010803222656, -105.53825378417969, 77.21170043945312, 184.0756378173828, 18.256332397460938, -30.785797119140625, -51.59674072265625, 128.29275512695312, -85.31047058105469, 38.785850524902344, 87.99311828613281, -126.7717514038086, 138.85272216796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000643.npy"}
{"epoch": 0.9441997063142438, "step": 644, "batch_size": 64, "mean": 67.11778259277344, "std": 90.01012420654297, "min": -136.1925048828125, "p10": -56.79591140747068, "median": 63.382041931152344, "p90": 184.89059600830078, "max": 275.74200439453125, "pos_frac": 0.8125, "sample": [252.99835205078125, 26.309024810791016, 60.87139892578125, -115.00518798828125, -136.1925048828125, 223.6717071533203, -64.88727569580078, 68.02429962158203, 35.44658660888672, 63.81538391113281, 93.02078247070312, 107.19319915771484, 22.69731903076172, 184.9262237548828, 108.8636703491211, 128.177001953125, 118.53399658203125, -69.79139709472656, 47.833831787109375, 73.99716186523438, 27.984405517578125, 96.20030212402344, 123.37525939941406, -13.788948059082031, 25.27667236328125, 205.62095642089844, -6.519016265869141, 29.55349349975586, 4.195091247558594, 275.74200439453125, 90.90199279785156, 62.1779670715332, 82.48089599609375, 117.48430633544922, 156.37428283691406, 83.64604187011719, 137.35137939453125, 169.60775756835938, 57.049686431884766, 138.04661560058594, 4.1052398681640625, 43.33644104003906, 214.0629425048828, 19.571086883544922, -81.16732788085938, 191.4769744873047, 0.14521026611328125, -36.731048583984375, 49.073116302490234, 179.99465942382812, 62.948699951171875, 88.48785400390625, 0.7875175476074219, -109.09489440917969, 67.22152709960938, 105.03182220458984, 52.29932403564453, 173.38560485839844, -37.91606140136719, 29.15948486328125, 99.45445251464844, 184.80746459960938, -14.009209632873535, -84.15765380859375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000644.npy"}
{"epoch": 0.9456681350954479, "step": 645, "batch_size": 64, "mean": 45.93043518066406, "std": 107.70072937011719, "min": -161.76763916015625, "p10": -87.31297149658202, "median": 50.66520309448242, "p90": 195.61917724609378, "max": 270.9781188964844, "pos_frac": 0.625, "sample": [-142.9232177734375, 185.7688751220703, -79.28721618652344, -65.21884155273438, -108.55503845214844, -97.46653747558594, 51.49053955078125, 161.65267944335938, 270.9781188964844, 50.32495880126953, 31.916255950927734, -23.001998901367188, 95.390869140625, -10.191661834716797, 161.22097778320312, 94.31768798828125, -84.46476745605469, 71.71067810058594, 44.513885498046875, 124.64440155029297, 141.82496643066406, -88.53363037109375, -44.993629455566406, 10.500732421875, 20.627670288085938, -123.3988265991211, -18.256271362304688, -17.36823272705078, -63.08470916748047, -75.6066665649414, 18.430034637451172, 32.71931076049805, 51.00544738769531, 166.74822998046875, 203.51416015625, -70.578125, 91.73121643066406, 190.3971405029297, -23.90924835205078, -161.76763916015625, 235.02130126953125, 128.2782745361328, -36.249298095703125, -57.23365020751953, 158.8147735595703, 217.43902587890625, 52.0196533203125, 102.48717498779297, 197.85719299316406, 62.062217712402344, -74.16279602050781, 5.554351806640625, 201.21084594726562, -9.120838165283203, 81.365966796875, 221.12216186523438, 128.49880981445312, 93.58302307128906, -148.11001586914062, 80.36967468261719, 79.06455993652344, -15.738592147827148, 173.12506103515625, 89.46653747558594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000645.npy"}
{"epoch": 0.947136563876652, "step": 646, "batch_size": 64, "mean": 87.47425842285156, "std": 89.75017547607422, "min": -115.61432647705078, "p10": -19.865917968749994, "median": 89.22164154052734, "p90": 197.4564239501953, "max": 270.81292724609375, "pos_frac": 0.84375, "sample": [227.82717895507812, 180.83432006835938, 185.0534210205078, 193.62327575683594, 0.20699691772460938, 37.2303466796875, -63.6387939453125, 90.86283874511719, 114.61410522460938, 78.65786743164062, 33.502784729003906, 120.62801361083984, 57.671669006347656, 16.748794555664062, 92.27438354492188, 6.231060028076172, 37.69267654418945, 213.43966674804688, 163.80694580078125, 118.85182189941406, -12.732574462890625, 103.34073638916016, 87.5804443359375, 120.90144348144531, 165.86705017089844, -28.38536834716797, 243.14013671875, 12.121047973632812, 82.26435852050781, 190.16668701171875, -7.3701324462890625, 76.92269897460938, -63.56208801269531, 38.972694396972656, 148.1324462890625, 154.95606994628906, 36.1702880859375, 197.5601806640625, -22.923065185546875, -51.33300018310547, 42.19886016845703, 13.037467956542969, 126.87777709960938, -34.93834686279297, -115.61432647705078, 7.553936004638672, 29.135787963867188, 32.19169235229492, 191.26206970214844, 244.28204345703125, 197.21432495117188, 165.56581115722656, 226.2227783203125, 0.8704833984375, 16.29375457763672, 114.98416137695312, 120.16493225097656, 163.3946075439453, 134.96876525878906, -10.282669067382812, 0.355682373046875, 270.81292724609375, 124.81034851074219, 159.08047485351562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000646.npy"}
{"epoch": 0.9486049926578561, "step": 647, "batch_size": 64, "mean": 75.35665130615234, "std": 113.34573364257812, "min": -164.30682373046875, "p10": -69.56760025024413, "median": 81.37306213378906, "p90": 238.3204315185547, "max": 356.1394348144531, "pos_frac": 0.734375, "sample": [81.69203186035156, 207.0513916015625, 248.8723602294922, 106.66386413574219, 182.67745971679688, 169.45565795898438, 26.87816619873047, -79.76461791992188, 77.86701965332031, 50.36387634277344, 87.52801513671875, 50.666656494140625, -12.299407958984375, 122.01494598388672, 95.42620849609375, 7.156959533691406, 17.98504638671875, 81.05409240722656, 266.50860595703125, -11.798229217529297, 115.043701171875, -45.90912628173828, 175.07276916503906, -44.265586853027344, 90.90575408935547, 238.9483642578125, 31.598678588867188, 356.1394348144531, -101.73213195800781, 268.3041076660156, 163.71124267578125, 84.54899597167969, 145.44821166992188, 102.94477081298828, 104.50231170654297, -80.6585922241211, -51.43487548828125, 151.8258819580078, -51.126953125, -26.47967529296875, 3.2043495178222656, 10.254829406738281, 181.17735290527344, 36.924468994140625, -164.30682373046875, 27.086849212646484, 81.75211334228516, -26.750438690185547, -77.3387680053711, -6.9022216796875, 16.90363121032715, 194.61538696289062, 262.6927490234375, 125.91212463378906, -45.456298828125, 236.85525512695312, -108.90476989746094, 198.4793701171875, 1.9651412963867188, 145.31460571289062, 27.626022338867188, 288.8952941894531, -103.96614837646484, 113.40425109863281], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000647.npy"}
{"epoch": 0.9500734214390602, "step": 648, "batch_size": 64, "mean": 106.015625, "std": 109.22081756591797, "min": -227.50486755371094, "p10": -20.987595748901363, "median": 107.25368881225586, "p90": 239.78390502929688, "max": 427.05902099609375, "pos_frac": 0.84375, "sample": [0.6109409332275391, -0.8374557495117188, 54.828697204589844, 166.44020080566406, 122.1944580078125, 76.50626373291016, 117.09248352050781, 336.67535400390625, 23.600799560546875, 100.78148651123047, 39.73834991455078, 52.260711669921875, 8.051544189453125, 160.6029052734375, 23.1617431640625, 182.75396728515625, 237.21722412109375, 0.63134765625, 152.87045288085938, -46.9273681640625, -16.125377655029297, 60.557159423828125, -23.07140350341797, 78.23954772949219, 26.202880859375, 251.72903442382812, 285.1178894042969, 215.31460571289062, 90.14665222167969, 178.0266571044922, 87.02037048339844, 137.6906280517578, -227.50486755371094, 427.05902099609375, 240.8839111328125, 60.621826171875, 30.62476348876953, 125.8946533203125, 71.85497283935547, -23.4295654296875, -60.95166015625, -25.121856689453125, 257.93084716796875, 141.3931884765625, 58.07731246948242, 164.00747680664062, 201.40499877929688, -11.421630859375, 201.02731323242188, 87.01467895507812, 156.11038208007812, 169.009521484375, 129.51744079589844, 90.29065704345703, 161.93453979492188, 37.27873992919922, 131.8291473388672, 192.7700958251953, 202.78781127929688, 260.8465881347656, 162.76864624023438, 178.75010681152344, -101.08734130859375, 113.72589111328125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000648.npy"}
{"epoch": 0.9515418502202643, "step": 649, "batch_size": 64, "mean": 87.23211669921875, "std": 88.11141204833984, "min": -58.82366943359375, "p10": -24.718231201171875, "median": 82.68622970581055, "p90": 218.32628173828127, "max": 261.2381591796875, "pos_frac": 0.8125, "sample": [131.73565673828125, 147.97152709960938, 138.854248046875, 31.740070343017578, 93.12477111816406, 8.766153335571289, 45.65379333496094, 51.012359619140625, 151.08798217773438, -33.899078369140625, 159.83143615722656, -27.981231689453125, -55.38097381591797, -12.297409057617188, 22.715347290039062, -18.488304138183594, 51.83195495605469, 188.91688537597656, 12.921131134033203, 140.20663452148438, 155.06396484375, 80.43722534179688, -6.794651031494141, 6.592164993286133, 212.95701599121094, 36.44541549682617, 164.0726318359375, 69.56114196777344, -6.993568420410156, 220.6273956298828, -58.82366943359375, -23.376678466796875, 75.70358276367188, 130.84242248535156, 126.56584167480469, 84.93523406982422, 85.26470947265625, 122.00971984863281, 224.9498291015625, 113.02796173095703, 113.85664367675781, 31.747894287109375, 1.3644046783447266, 245.41513061523438, 150.86294555664062, 172.13229370117188, 261.2381591796875, 8.754562377929688, 88.98983764648438, 184.47824096679688, 3.0682811737060547, 162.44000244140625, -38.458831787109375, 225.938720703125, 233.16102600097656, 249.54425048828125, 16.414306640625, -50.495784759521484, 66.5740966796875, 192.1893310546875, 33.77423095703125, 149.81744384765625, -25.293182373046875, 63.95094299316406], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000649.npy"}
{"epoch": 0.9530102790014684, "step": 650, "batch_size": 64, "mean": 83.62142181396484, "std": 110.47347259521484, "min": -267.6444091796875, "p10": -40.8244285583496, "median": 84.79127883911133, "p90": 226.32576141357424, "max": 331.2940673828125, "pos_frac": 0.78125, "sample": [72.49961853027344, 61.765777587890625, 111.2007827758789, 258.2237243652344, 107.71847534179688, 101.56983947753906, 111.83978271484375, -44.037391662597656, 185.28152465820312, 194.01573181152344, 301.54241943359375, -18.401832580566406, 110.1298828125, 82.32717895507812, 182.48341369628906, 260.947021484375, 14.462478637695312, 331.2940673828125, 63.04644775390625, 227.74827575683594, 237.50787353515625, 87.25537872314453, 56.37596893310547, 135.34652709960938, 223.00656127929688, 120.25809478759766, -33.3275146484375, 39.994293212890625, 69.06053161621094, 130.74366760253906, 93.43783569335938, 197.0047607421875, 14.353424072265625, -267.6444091796875, 53.07671356201172, 98.80738830566406, -67.44134521484375, 295.4390869140625, -7.283933639526367, 64.89486694335938, -6.73992919921875, -63.80287170410156, -0.30812644958496094, 70.5120849609375, 146.46774291992188, 18.4283447265625, 161.06787109375, 5.2227630615234375, 49.52928161621094, 100.37191772460938, 94.46040344238281, -23.126670837402344, 96.23918151855469, 51.355037689208984, -72.52423095703125, 119.42259216308594, 221.3157958984375, -116.66650390625, -149.9293212890625, 60.49150085449219, 130.3065185546875, 22.81964874267578, 189.3638153076172, -9.028831481933594], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000650.npy"}
{"epoch": 0.9544787077826725, "step": 651, "batch_size": 64, "mean": 100.80976104736328, "std": 92.63040161132812, "min": -111.6949462890625, "p10": -24.751764297485348, "median": 110.9473648071289, "p90": 211.06309356689457, "max": 295.57818603515625, "pos_frac": 0.84375, "sample": [163.82211303710938, 180.80569458007812, 104.88308715820312, 201.57945251464844, 95.08915710449219, 20.785911560058594, 227.47308349609375, 69.54490661621094, 117.37562561035156, 86.88111877441406, 185.21437072753906, 214.36158752441406, 182.44935607910156, -111.6949462890625, 65.1053466796875, 170.3431396484375, 40.95713806152344, -82.09052276611328, 142.2622833251953, 227.86070251464844, 100.67613983154297, 19.47283172607422, 150.71307373046875, -36.42317199707031, 21.088134765625, 52.022918701171875, -26.28183364868164, -10.87103271484375, 152.06259155273438, 186.76611328125, 189.0721435546875, -64.24513244628906, 295.2666015625, 74.38865661621094, 69.57550048828125, 131.6583251953125, 132.93739318847656, 157.89956665039062, 37.450225830078125, -9.322189331054688, 45.40797424316406, 125.5236587524414, -52.983680725097656, 144.2737274169922, 13.041366577148438, 234.54541015625, 6.560401916503906, 295.57818603515625, -21.181602478027344, 92.291015625, 39.638492584228516, 35.454627990722656, 221.7847442626953, 132.62408447265625, 117.01164245605469, 153.73097229003906, 184.99801635742188, -38.19988250732422, 162.5631103515625, 11.317459106445312, 169.29000854492188, 161.38287353515625, 86.88999938964844, 203.36660766601562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000651.npy"}
{"epoch": 0.9559471365638766, "step": 652, "batch_size": 64, "mean": 86.80288696289062, "std": 82.1637954711914, "min": -78.68855285644531, "p10": -12.107220458984374, "median": 77.20840835571289, "p90": 184.20816802978518, "max": 315.9718322753906, "pos_frac": 0.828125, "sample": [77.24008178710938, 72.24120330810547, 117.3026123046875, 17.802383422851562, -2.7107391357421875, 90.40520477294922, 105.7010269165039, 13.067665100097656, 166.97506713867188, 106.84133911132812, 92.95115661621094, 280.67755126953125, 263.8282470703125, -4.231842041015625, -28.501174926757812, 21.262863159179688, 63.431678771972656, 185.75662231445312, 178.08319091796875, -29.36457633972168, 85.86781311035156, 75.27708435058594, 21.253318786621094, -78.68855285644531, 98.30657958984375, 53.37425231933594, 29.972557067871094, 180.45452880859375, 177.4230194091797, 46.63134765625, 116.99858093261719, 148.98336791992188, 106.72021484375, 199.61880493164062, 180.59510803222656, 139.83950805664062, -12.549530029296875, 12.440826416015625, -6.872661590576172, 74.800537109375, 131.07684326171875, 142.89459228515625, -17.03887939453125, 66.27598571777344, 250.63380432128906, 123.43156433105469, 60.079315185546875, 153.82046508789062, 53.320594787597656, 103.27457427978516, 315.9718322753906, -12.763053894042969, 196.34463500976562, 11.984825134277344, 121.66878509521484, 53.62178039550781, 35.225250244140625, -44.0908203125, 11.386932373046875, 76.30035400390625, 77.1767349243164, 113.53298950195312, 103.12419128417969, -11.075164794921875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000652.npy"}
{"epoch": 0.9574155653450808, "step": 653, "batch_size": 64, "mean": 81.45347595214844, "std": 93.53746032714844, "min": -177.04067993164062, "p10": -43.583228683471674, "median": 97.00203323364258, "p90": 199.85682373046876, "max": 261.06121826171875, "pos_frac": 0.796875, "sample": [110.75874328613281, 121.50343322753906, 57.49325180053711, 130.12571716308594, -12.952079772949219, 75.14810180664062, -44.6417236328125, -86.42230224609375, 37.31197738647461, 261.06121826171875, 99.15205383300781, 104.29663848876953, -27.398056030273438, 138.52914428710938, 194.19651794433594, 206.92056274414062, 172.00576782226562, 69.12596130371094, 203.37921142578125, -177.04067993164062, -29.31886863708496, 191.85934448242188, 135.08277893066406, 68.91141510009766, 147.0022735595703, 97.48875427246094, 31.564529418945312, 28.179588317871094, 88.2948989868164, 107.47650146484375, 183.28787231445312, 96.51531219482422, -94.07671356201172, 55.478187561035156, 157.65235900878906, 202.2826690673828, -41.113407135009766, 83.23548889160156, -51.81664276123047, 204.1626434326172, 153.2430419921875, 109.355224609375, -1.8932113647460938, 32.18531799316406, 220.34555053710938, 138.66250610351562, 18.06414794921875, -6.363456726074219, 153.04969787597656, 30.807260513305664, 95.23832702636719, 15.426780700683594, 133.46958923339844, 225.2381134033203, 157.2987518310547, 67.49689483642578, 121.37679290771484, -137.63064575195312, 137.83489990234375, 28.12923240661621, 139.0712432861328, 71.37211608886719, -100.19070434570312, 116.73277282714844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000653.npy"}
{"epoch": 0.9588839941262849, "step": 654, "batch_size": 64, "mean": 71.71923828125, "std": 117.1621322631836, "min": -190.17242431640625, "p10": -75.49535064697265, "median": 64.9533462524414, "p90": 234.72615814208984, "max": 438.22882080078125, "pos_frac": 0.75, "sample": [97.3310317993164, 89.11433410644531, -70.83634948730469, 57.206504821777344, 49.172576904296875, 34.48011779785156, -147.79437255859375, 74.68235778808594, 2.9683399200439453, 133.14801025390625, 220.88491821289062, 147.7934112548828, 62.296173095703125, 57.47648620605469, 12.048107147216797, 78.58244323730469, 212.26556396484375, 39.2139892578125, 121.06892395019531, 61.70467758178711, 240.75152587890625, 234.45352172851562, -15.732738494873047, -9.113433837890625, 81.3170166015625, 281.0865478515625, -114.04559326171875, 78.44293212890625, 3.5948104858398438, 91.44973754882812, 142.6534881591797, 234.84300231933594, 238.9918670654297, -24.25726318359375, 171.2222442626953, -3.571929931640625, 290.28192138671875, 93.2064208984375, 96.50253295898438, 166.52224731445312, -18.111251831054688, 104.3045883178711, 74.81779479980469, 23.681400299072266, -140.06436157226562, 296.2493591308594, 16.17200469970703, 67.61051940917969, 190.04425048828125, -51.57170486450195, 49.41986083984375, -56.091285705566406, 122.49346923828125, -78.38402557373047, 97.04334259033203, -77.4920654296875, 62.062103271484375, -190.17242431640625, 438.22882080078125, 115.05580139160156, 19.055267333984375, -90.764404296875, -15.839344024658203, 20.877288818359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000654.npy"}
{"epoch": 0.960352422907489, "step": 655, "batch_size": 64, "mean": 86.4774169921875, "std": 104.88618469238281, "min": -203.92161560058594, "p10": -34.819596099853506, "median": 78.4342155456543, "p90": 221.55332794189454, "max": 248.13169860839844, "pos_frac": 0.8125, "sample": [20.481292724609375, 110.362060546875, 86.89207458496094, 56.367919921875, 4.322574615478516, 136.56268310546875, 42.08069610595703, 36.484161376953125, 82.14859771728516, 85.27025604248047, 63.70210266113281, 85.76840209960938, -17.204879760742188, -22.355194091796875, 17.112545013427734, 178.86087036132812, 183.13186645507812, 59.461578369140625, 20.0531005859375, 228.98587036132812, 8.741355895996094, 238.10348510742188, 206.32797241210938, -11.692916870117188, -6.875068664550781, 72.17453002929688, 248.13169860839844, 134.08078002929688, -63.02265930175781, 183.34332275390625, -68.36188507080078, 226.1616973876953, 173.85546875, 25.3662166595459, 184.40847778320312, 150.20167541503906, -203.92161560058594, 49.01249694824219, 222.90597534179688, 222.40480041503906, 18.250247955322266, 204.1819610595703, 218.96995544433594, 219.4508514404297, 237.47511291503906, 74.71983337402344, 63.1636962890625, 18.712947845458984, -58.14445495605469, -65.55438232421875, 22.074310302734375, 102.16348266601562, 219.56655883789062, -198.37684631347656, 154.89486694335938, 111.48187255859375, 168.78298950195312, -26.605880737304688, -38.339759826660156, 198.41555786132812, 191.873291015625, 146.29254150390625, 34.99488830566406, 66.27643585205078], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000655.npy"}
{"epoch": 0.9618208516886931, "step": 656, "batch_size": 64, "mean": 107.01776123046875, "std": 100.34764862060547, "min": -115.01152038574219, "p10": -5.673721313476559, "median": 92.9671630859375, "p90": 242.38019104003908, "max": 377.24658203125, "pos_frac": 0.84375, "sample": [265.6030578613281, 143.1883087158203, -41.93919372558594, 90.3237533569336, 50.249847412109375, 211.00027465820312, 36.87596893310547, 93.76400756835938, 114.1832275390625, 18.934417724609375, 153.9056396484375, 39.128814697265625, 70.49932861328125, 92.17031860351562, 109.55081176757812, 254.64950561523438, 152.4212646484375, 121.94798278808594, 221.17433166503906, 173.7178497314453, 135.00494384765625, 62.29034423828125, 108.98358154296875, 37.111724853515625, 50.20166015625, -1.3618011474609375, 192.46310424804688, 173.93557739257812, 216.48617553710938, 220.50970458984375, 76.91075897216797, 159.29983520507812, 110.47454833984375, -11.086936950683594, 360.38751220703125, 57.76066589355469, 239.12985229492188, 79.33663940429688, 377.24658203125, 31.2833251953125, 244.02603149414062, 30.435752868652344, 224.41195678710938, -1.7898178100585938, 171.82525634765625, -115.01152038574219, 38.95943832397461, 243.773193359375, -41.197322845458984, 28.056907653808594, -2.3524169921875, 129.2271270751953, 105.50892639160156, 28.993270874023438, 274.97064208984375, -25.173736572265625, -7.097137451171875, 28.091276168823242, 32.708824157714844, 47.02362060546875, 51.283599853515625, 104.66183471679688, -11.493019104003906, 221.57662963867188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000656.npy"}
{"epoch": 0.9632892804698973, "step": 657, "batch_size": 64, "mean": 83.40191650390625, "std": 113.68656158447266, "min": -159.02212524414062, "p10": -60.614157867431636, "median": 66.7617073059082, "p90": 233.32647705078128, "max": 361.3684997558594, "pos_frac": 0.765625, "sample": [170.4669189453125, -42.30671310424805, 173.58135986328125, 33.44230651855469, 184.73590087890625, 361.3684997558594, -21.620933532714844, 19.70221710205078, 236.55380249023438, 13.878768920898438, -159.02212524414062, -18.13141632080078, 95.7972640991211, 153.30966186523438, -70.30054473876953, 103.48135375976562, 4.618675231933594, 104.09980773925781, -66.58052062988281, 327.88232421875, 104.44430541992188, 212.77243041992188, 128.21762084960938, 291.77545166015625, -27.679367065429688, 62.69737243652344, 67.01853942871094, 169.3248291015625, -91.14183044433594, 225.79605102539062, 59.337310791015625, 106.43294525146484, 50.20107650756836, -133.326171875, 183.01785278320312, -47.18614959716797, 175.06492614746094, -61.348793029785156, -14.018569946289062, 33.469032287597656, 66.50487518310547, 65.72265625, -12.779500961303711, 18.39374542236328, 118.62763977050781, 145.922119140625, 36.32270812988281, 48.96372604370117, 89.38198852539062, 29.18674087524414, 260.07830810546875, 113.05216979980469, 190.06761169433594, 273.619873046875, -58.90000915527344, 112.3790283203125, 188.13955688476562, 273.10040283203125, 68.6998291015625, -124.60169982910156, 65.07235717773438, 64.92724609375, 49.56599426269531, 156.45013427734375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000657.npy"}
{"epoch": 0.9647577092511013, "step": 658, "batch_size": 64, "mean": 72.8197250366211, "std": 95.60106658935547, "min": -179.49407958984375, "p10": -37.0918056488037, "median": 59.97332572937012, "p90": 205.0615966796875, "max": 335.3172302246094, "pos_frac": 0.84375, "sample": [122.59365844726562, 12.067955017089844, 40.273712158203125, -65.40519714355469, -14.964714050292969, 113.79255676269531, 174.58392333984375, 75.88080596923828, 117.04403686523438, 132.9700927734375, 113.68434143066406, 112.81976318359375, 25.748401641845703, 7.430084228515625, 205.70211791992188, 105.09268951416016, 62.4399528503418, 47.718570709228516, 218.2225799560547, -23.40738296508789, 7.072174072265625, -45.20488357543945, -123.02422332763672, 63.654476165771484, 12.094100952148438, 245.3188018798828, 169.5220947265625, 97.41421508789062, 11.188873291015625, -179.49407958984375, 126.27921295166016, 203.56704711914062, 131.61602783203125, 138.31063842773438, 30.740936279296875, 103.30369567871094, 28.67483901977539, 67.07121276855469, 46.77423858642578, -0.6727008819580078, 228.2917938232422, 180.48699951171875, 16.33203125, 7.585899353027344, 26.35003662109375, 214.8986358642578, -76.30078125, 3.2717742919921875, 232.4899139404297, 177.02947998046875, 38.89350128173828, 165.13916015625, 45.18929672241211, 85.5543441772461, 57.50669860839844, -42.95655822753906, 27.815139770507812, 335.3172302246094, 11.751399993896484, 154.59349060058594, -93.4229965209961, 97.89937591552734, 30.673866271972656, 17.577896118164062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000658.npy"}
{"epoch": 0.9662261380323054, "step": 659, "batch_size": 64, "mean": 92.60415649414062, "std": 125.1673812866211, "min": -181.2998046875, "p10": -81.79119873046875, "median": 103.4063491821289, "p90": 223.10311584472657, "max": 370.5257568359375, "pos_frac": 0.78125, "sample": [241.7263946533203, 102.78739929199219, 64.58464050292969, 212.69012451171875, 113.79075622558594, 71.68102264404297, 296.8600769042969, 112.47555541992188, 66.27500915527344, 139.32513427734375, 366.5122375488281, -3.0992355346679688, 210.84246826171875, -155.51626586914062, -98.1117935180664, 13.602569580078125, 23.704925537109375, 17.738082885742188, 82.540771484375, 62.06427764892578, 63.68926239013672, 54.445037841796875, -181.2998046875, 161.0108184814453, 155.98272705078125, 370.5257568359375, 208.76512145996094, 163.39736938476562, 104.02529907226562, -16.960586547851562, -45.55247497558594, 39.79822540283203, -61.54658508300781, 217.02651977539062, 130.19638061523438, 170.2255096435547, 136.09417724609375, -68.56642150878906, 42.76365661621094, 221.53176879882812, 121.5533218383789, 219.88067626953125, 191.11865234375, -117.479248046875, 266.66363525390625, -83.30392456054688, -100.77204895019531, 127.40945434570312, 218.26809692382812, 153.48390197753906, 71.85028839111328, 22.613460540771484, 185.42532348632812, 209.2960205078125, 223.77655029296875, 31.452735900878906, 135.8719024658203, 24.3380126953125, 263.1124572753906, -75.98526763916016, 74.47144317626953, 178.74307250976562, -144.88722229003906, -78.26150512695312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000659.npy"}
{"epoch": 0.9676945668135095, "step": 660, "batch_size": 64, "mean": 94.63003540039062, "std": 103.12702178955078, "min": -135.59097290039062, "p10": -36.49844741821288, "median": 95.8697395324707, "p90": 220.74256744384766, "max": 344.11871337890625, "pos_frac": 0.828125, "sample": [136.75689697265625, 92.2122802734375, 207.15646362304688, 26.69226837158203, 93.70828247070312, 188.50732421875, -38.141990661621094, 239.0166778564453, 50.76347351074219, 152.79458618164062, -43.374393463134766, 228.69142150878906, 282.59149169921875, 9.165702819824219, 158.75390625, 164.15655517578125, 156.5963897705078, -66.33917999267578, -28.733108520507812, 51.635986328125, 53.36964416503906, 106.9314193725586, 208.43121337890625, 217.41937255859375, 59.24198913574219, 344.11871337890625, -70.41317749023438, 98.03119659423828, 89.83055114746094, 36.36444091796875, 142.55978393554688, 143.9180450439453, 91.677490234375, 338.1407165527344, 112.74287414550781, 194.68435668945312, 130.1705780029297, 49.521148681640625, 47.78753662109375, 98.53433227539062, -32.66351318359375, 111.49029541015625, 118.46552276611328, 117.82354736328125, -24.06351661682129, 157.49630737304688, -7.635997772216797, 222.1667938232422, 155.2346649169922, 137.1341552734375, -115.68142700195312, 174.3653564453125, 1.4818267822265625, 54.818817138671875, 71.2328872680664, -135.59097290039062, 105.43267059326172, 11.87506103515625, 22.641942977905273, 278.7003173828125, 82.65373229980469, -88.93843841552734, 10.957069396972656, 71.25181579589844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000660.npy"}
{"epoch": 0.9691629955947136, "step": 661, "batch_size": 64, "mean": 102.49998474121094, "std": 113.33168029785156, "min": -161.76107788085938, "p10": -36.55772323608398, "median": 82.94700241088867, "p90": 246.45591888427737, "max": 364.5401916503906, "pos_frac": 0.859375, "sample": [28.931018829345703, 44.77227020263672, 136.78773498535156, 27.58475112915039, 219.380859375, -122.33152770996094, 92.810546875, 80.21060943603516, 124.99314880371094, 76.01557922363281, 240.9702606201172, 49.53590393066406, 142.7542724609375, 69.7315673828125, 364.5401916503906, -41.06786346435547, 68.66940307617188, 22.38652801513672, -38.0606689453125, 148.79196166992188, 200.39697265625, 149.26914978027344, 186.72030639648438, 57.41387939453125, 40.27070999145508, 248.80691528320312, 189.25469970703125, 77.89910125732422, 267.8981628417969, 59.64630126953125, -118.25753784179688, 189.86790466308594, 73.71595764160156, 213.768310546875, 12.942607879638672, 8.583332061767578, 69.8227310180664, 30.603759765625, 190.42178344726562, 101.49591064453125, -65.79541015625, 18.3345947265625, -33.05084991455078, 140.69906616210938, 74.04533386230469, -161.76107788085938, 208.19888305664062, 119.47763061523438, 204.46507263183594, 217.7991943359375, 363.1583251953125, 0.097320556640625, 44.90122985839844, -1.9235782623291016, 160.03297424316406, 85.68339538574219, 155.1890869140625, 290.368896484375, -103.40892028808594, 309.657958984375, 277.6693115234375, 109.03844451904297, 60.33320617675781, 98.84123229980469], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000661.npy"}
{"epoch": 0.9706314243759178, "step": 662, "batch_size": 64, "mean": 92.24244689941406, "std": 92.07270050048828, "min": -91.44085693359375, "p10": -21.605965805053703, "median": 76.28347778320312, "p90": 209.18928680419924, "max": 318.123046875, "pos_frac": 0.828125, "sample": [-24.83774185180664, 152.88497924804688, 119.88209533691406, -68.06964874267578, 203.80934143066406, 137.78738403320312, -51.55747985839844, 160.02284240722656, 239.72119140625, 169.1688232421875, 143.77658081054688, 32.25455093383789, 55.87994384765625, 144.67164611816406, 279.10919189453125, 65.3701171875, 47.27988815307617, -29.493999481201172, 269.7740783691406, 26.370635986328125, 318.123046875, 165.42324829101562, 134.40798950195312, 1.4567337036132812, 67.27963256835938, 77.77621459960938, 61.35889434814453, 188.2974090576172, 49.93468475341797, -59.34686279296875, 74.79074096679688, 58.01069641113281, 17.634521484375, 17.39388084411621, 66.8927001953125, 211.36788940429688, 65.1409912109375, 185.17921447753906, 43.68529510498047, 212.5631103515625, 138.00274658203125, 133.51571655273438, 64.14730834960938, 160.18011474609375, 119.46180725097656, 222.18572998046875, -5.762367248535156, 175.2450408935547, -91.44085693359375, 92.80986022949219, -57.420284271240234, 204.1058807373047, 12.881103515625, 180.94955444335938, 21.637420654296875, -4.850990295410156, -7.259674072265625, 155.66555786132812, 20.606765747070312, 28.470870971679688, 133.68630981445312, -14.065155029296875, 96.24755859375, 93.34219360351562], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000662.npy"}
{"epoch": 0.9720998531571219, "step": 663, "batch_size": 64, "mean": 85.96340942382812, "std": 109.23673248291016, "min": -138.70248413085938, "p10": -35.412705993652345, "median": 75.4326400756836, "p90": 232.8723159790039, "max": 256.42095947265625, "pos_frac": 0.734375, "sample": [251.16766357421875, 137.87960815429688, 92.11637878417969, 92.56730651855469, 168.439697265625, 145.10867309570312, 16.483915328979492, -29.685081481933594, -1.229766845703125, 212.466552734375, -8.606441497802734, 72.32151794433594, 211.33544921875, 215.64268493652344, 137.94960021972656, 68.68228912353516, 30.550125122070312, 187.2296142578125, -111.41834259033203, -102.6333236694336, 44.56034851074219, -24.521202087402344, 69.2654037475586, 29.409439086914062, 176.5786590576172, 151.68191528320312, 157.4309539794922, -17.901382446289062, 180.17120361328125, 254.62921142578125, -35.82704162597656, 209.4765625, 217.39373779296875, -129.97689819335938, 143.35009765625, -112.58141326904297, 102.247314453125, 78.54376220703125, 59.08430099487305, 256.42095947265625, 221.35215759277344, -6.9754638671875, 114.98809814453125, -90.69815826416016, -8.681610107421875, 233.70143127441406, 33.43866729736328, 59.7769775390625, 60.31498718261719, 251.5704345703125, 69.48356628417969, 127.8656005859375, 230.93771362304688, 28.63214874267578, 239.91641235351562, -138.70248413085938, -16.360366821289062, 15.463382720947266, 18.109615325927734, 109.11045837402344, -34.4459228515625, 164.71368408203125, -20.455276489257812, 242.798095703125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000663.npy"}
{"epoch": 0.973568281938326, "step": 664, "batch_size": 64, "mean": 78.6165771484375, "std": 93.23896789550781, "min": -150.97222900390625, "p10": -29.02356147766113, "median": 78.71134185791016, "p90": 194.5693374633789, "max": 279.1996154785156, "pos_frac": 0.78125, "sample": [56.59306335449219, -150.97222900390625, 84.4446792602539, 168.666748046875, 241.32550048828125, 42.89093780517578, -12.31427001953125, 114.11177062988281, 99.92798614501953, 128.4202117919922, -22.735626220703125, 115.53239440917969, 91.60899353027344, 53.321353912353516, 172.69961547851562, 206.59872436523438, 107.06858825683594, 42.75780487060547, -14.748222351074219, 114.96340942382812, 51.9512939453125, 118.42874145507812, 15.43731689453125, 125.90727233886719, -30.938152313232422, -58.422515869140625, 234.69549560546875, 17.456932067871094, -55.45174026489258, 70.08277893066406, 216.15643310546875, -18.610885620117188, 193.40057373046875, 37.27985763549805, 72.9780044555664, 131.31410217285156, -19.463001251220703, 21.746414184570312, 136.4716796875, 115.30767059326172, 17.535720825195312, 144.41891479492188, 38.1635627746582, -116.5809326171875, 215.1366424560547, 279.1996154785156, 180.13214111328125, 195.0702362060547, 148.44134521484375, 52.326873779296875, -58.62666320800781, 154.81387329101562, 113.21470642089844, 14.701831817626953, 59.46100616455078, 14.341827392578125, 188.05963134765625, -84.41398620605469, -24.556182861328125, -9.723129272460938, 172.63455200195312, 124.17568969726562, 190.1888427734375, 7.454994201660156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000664.npy"}
{"epoch": 0.9750367107195301, "step": 665, "batch_size": 64, "mean": 85.94856262207031, "std": 92.00703430175781, "min": -206.3621368408203, "p10": 1.889636230468751, "median": 74.18581008911133, "p90": 208.1797821044922, "max": 289.41400146484375, "pos_frac": 0.90625, "sample": [46.94782638549805, 33.471397399902344, 19.64849853515625, 10.95672607421875, 50.728240966796875, 112.28718566894531, 30.955543518066406, 130.462158203125, 175.68020629882812, 40.474517822265625, 108.59944152832031, -19.64403533935547, 98.13249206542969, 126.93679809570312, 103.13375091552734, 2.9936294555664062, 16.852670669555664, 23.847869873046875, 1.4164962768554688, 30.004470825195312, 69.01761627197266, 117.22333526611328, 185.87416076660156, 60.86309814453125, 60.06144714355469, 89.99315643310547, 160.8719024658203, 30.056854248046875, 206.4752197265625, -16.896209716796875, 21.19062042236328, 69.12122344970703, 289.41400146484375, 121.35641479492188, 172.68992614746094, 22.798603057861328, 235.40292358398438, 130.68310546875, -206.3621368408203, 66.21752166748047, 68.72052001953125, 73.27294921875, 266.5035095214844, 103.69831848144531, 75.00660705566406, 217.54246520996094, 14.831783294677734, 93.59376525878906, 228.47276306152344, 167.41342163085938, 93.65955352783203, 33.41069793701172, 78.48526763916016, 73.3650131225586, 197.57862854003906, -113.81788635253906, 206.15335083007812, -11.79730224609375, 73.33611297607422, 165.6902618408203, 79.85931396484375, -144.81097412109375, 221.690673828125, 208.91030883789062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000665.npy"}
{"epoch": 0.9765051395007343, "step": 666, "batch_size": 64, "mean": 84.91444396972656, "std": 109.26222229003906, "min": -162.18817138671875, "p10": -51.90691757202148, "median": 83.43096542358398, "p90": 234.68755798339848, "max": 346.664306640625, "pos_frac": 0.796875, "sample": [260.2383117675781, 148.10784912109375, 82.16136169433594, -58.291282653808594, -41.873390197753906, -19.484424591064453, 119.72669982910156, 84.70056915283203, 65.4830322265625, 346.664306640625, 63.2183837890625, 12.238967895507812, -69.74046325683594, -102.78012084960938, 27.23076629638672, -82.15203857421875, 266.4502258300781, 159.3636932373047, -30.474838256835938, 81.3996810913086, 286.7394104003906, 42.70459747314453, 15.535972595214844, 92.67666625976562, 312.00665283203125, -35.021087646484375, 86.92850494384766, -162.18817138671875, 11.396034240722656, -144.19363403320312, 186.1636505126953, 198.95941162109375, 102.85842895507812, 90.35208129882812, 116.81935119628906, 28.488525390625, 183.8888702392578, 117.1629638671875, -56.207000732421875, 86.67910766601562, 31.515756607055664, 51.776187896728516, 15.54464340209961, 7.2254638671875, -41.783447265625, 191.2298583984375, 4.6537933349609375, 141.63006591796875, 149.71804809570312, 127.15457916259766, 175.98544311523438, 183.45516967773438, 139.158203125, 63.79328155517578, 47.68980407714844, 51.54701232910156, 187.07342529296875, 81.3673095703125, 240.95162963867188, 118.5011978149414, 141.06509399414062, -10.983039855957031, 222.33636474609375, 239.98092651367188], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000666.npy"}
{"epoch": 0.9779735682819384, "step": 667, "batch_size": 64, "mean": 92.57351684570312, "std": 89.40380859375, "min": -75.74256896972656, "p10": -26.023106765747055, "median": 96.35173034667969, "p90": 221.7149398803711, "max": 238.09942626953125, "pos_frac": 0.796875, "sample": [219.65562438964844, 42.48356628417969, 192.98663330078125, -47.92003631591797, 37.244773864746094, 197.9978485107422, 227.34869384765625, 85.69052124023438, 156.21653747558594, 57.192237854003906, 37.413299560546875, 200.9445343017578, 4.618465423583984, 120.95259857177734, 150.57493591308594, 181.87533569335938, 131.4984893798828, -10.50537109375, 181.01486206054688, 47.022891998291016, 100.72615051269531, 28.106624603271484, 238.09942626953125, 113.33830261230469, 116.99429321289062, 14.079925537109375, 114.32876586914062, 106.61015319824219, 223.1381072998047, 91.69403076171875, -8.195137023925781, -61.119388580322266, 96.8610610961914, 21.957252502441406, 95.84239959716797, -7.065673828125, -38.410560607910156, 231.37271118164062, 166.65097045898438, 166.46194458007812, -75.24079895019531, 230.57046508789062, 109.73382568359375, -32.67356491088867, 75.34486389160156, 228.61508178710938, 130.0770721435547, 48.614845275878906, 92.38456726074219, 222.59750366210938, -43.459381103515625, 173.4325714111328, -4.997627258300781, 37.28663635253906, -2.1266708374023438, 216.0886993408203, 109.3994369506836, 15.140911102294922, 51.18534469604492, -5.97222900390625, 106.09417724609375, 90.5257797241211, 202.048583984375, -75.74256896972656], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000667.npy"}
{"epoch": 0.9794419970631424, "step": 668, "batch_size": 64, "mean": 105.17715454101562, "std": 108.89938354492188, "min": -73.02619934082031, "p10": -18.69225997924804, "median": 86.08255004882812, "p90": 268.6204727172852, "max": 353.2162170410156, "pos_frac": 0.8125, "sample": [93.253662109375, 90.9984130859375, 321.4228820800781, 39.262359619140625, -12.292182922363281, 158.72869873046875, 46.46685028076172, 50.02832794189453, -6.556671142578125, 228.68121337890625, 11.776809692382812, -27.126632690429688, 194.85952758789062, -21.435150146484375, 149.5290985107422, 81.16668701171875, 6.102806091308594, 100.49471282958984, 5.339256286621094, -41.73418045043945, 62.05778503417969, 241.33245849609375, 0.9351577758789062, 285.546875, 235.25079345703125, 44.564796447753906, -4.8126220703125, 122.070068359375, 148.5286407470703, 124.77339172363281, 135.41444396972656, -45.733978271484375, 252.6770477294922, 41.7059326171875, 172.79669189453125, -73.02619934082031, 42.58119201660156, 275.453369140625, 53.04893112182617, 13.661014556884766, 115.502197265625, 57.828819274902344, 229.45651245117188, 113.84111022949219, -40.93342590332031, 310.5126647949219, 176.6883544921875, -31.41101837158203, 241.9684600830078, 33.346580505371094, -4.8192901611328125, 65.95893096923828, 106.20120239257812, 113.57958984375, 43.49968719482422, 302.4757385253906, 158.92034912109375, 27.559921264648438, 353.2162170410156, 69.21004486083984, -11.142383575439453, 223.232421875, 159.2490234375, 319.6038818359375], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000668.npy"}
{"epoch": 0.9809104258443465, "step": 669, "batch_size": 64, "mean": 101.7453842163086, "std": 98.9828872680664, "min": -90.28730010986328, "p10": -17.5916633605957, "median": 94.39927673339844, "p90": 220.92444458007813, "max": 313.668701171875, "pos_frac": 0.796875, "sample": [154.66958618164062, -90.28730010986328, -77.75721740722656, 184.1507568359375, -15.779125213623047, 182.5293426513672, 40.24217987060547, 198.6642608642578, 52.58649444580078, -4.489877700805664, 313.668701171875, -31.28650665283203, -2.6050186157226562, 99.2562255859375, 73.90032196044922, -2.4847412109375, 228.34967041015625, 70.16336059570312, -15.437667846679688, 12.35736083984375, 102.01882934570312, -64.02448272705078, 162.5411376953125, 82.83226776123047, 85.06967163085938, 222.82476806640625, 105.75588989257812, 273.5631103515625, 279.6087646484375, -18.368465423583984, 102.416015625, 157.11761474609375, 42.199073791503906, 177.00302124023438, 251.58230590820312, -38.55649948120117, -4.936985015869141, 51.54743957519531, 189.7301025390625, 62.12071990966797, 10.103614807128906, 11.34417724609375, 180.779541015625, 178.07589721679688, -62.24745178222656, 89.40974426269531, 31.90350341796875, 89.54232788085938, 155.46298217773438, 169.7412567138672, 208.84915161132812, 83.85801696777344, 141.12196350097656, 150.42059326171875, 204.98876953125, 199.62420654296875, 3.29093074798584, 216.4903564453125, 176.96188354492188, 184.68551635742188, 5.584678649902344, 60.58903884887695, 185.27584838867188, 243.392578125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000669.npy"}
{"epoch": 0.9823788546255506, "step": 670, "batch_size": 64, "mean": 111.06494140625, "std": 101.80490112304688, "min": -191.2919921875, "p10": -8.384699630737288, "median": 119.6086654663086, "p90": 224.61289062500003, "max": 331.755126953125, "pos_frac": 0.890625, "sample": [192.44552612304688, 199.9963836669922, 120.08537292480469, 73.02825927734375, 100.60552215576172, 30.186153411865234, -15.171630859375, 89.48077392578125, 212.72952270507812, 91.87139892578125, 234.76422119140625, 87.04020690917969, -191.2919921875, 174.32162475585938, 134.215087890625, 259.4528503417969, 331.755126953125, 96.17509460449219, 245.32806396484375, -105.7020034790039, 119.1319580078125, 196.50827026367188, 125.5418930053711, 205.87075805664062, 40.77333068847656, 191.0310516357422, 176.13787841796875, 20.471351623535156, 104.6502456665039, -49.824005126953125, 230.87513732910156, 146.8277130126953, 32.89600372314453, 37.558990478515625, 37.94937515258789, 288.91802978515625, 208.45660400390625, 55.47393798828125, -80.42080688476562, 212.73446655273438, 7.451473236083984, 154.69915771484375, 194.97799682617188, 53.91094970703125, 190.732421875, 201.00592041015625, 66.01763916015625, 71.71235656738281, 11.58200454711914, -114.75291442871094, 129.61965942382812, 145.41795349121094, 226.7023162841797, 122.66363525390625, 138.5498046875, 26.227649688720703, 87.396728515625, 169.76255798339844, -22.238815307617188, 219.73756408691406, 49.98338317871094, 109.13529968261719, 20.55768585205078, 184.42599487304688], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000670.npy"}
{"epoch": 0.9838472834067548, "step": 671, "batch_size": 64, "mean": 73.989990234375, "std": 103.86286926269531, "min": -202.91961669921875, "p10": -37.50656089782714, "median": 56.702457427978516, "p90": 208.7927612304688, "max": 330.43426513671875, "pos_frac": 0.8125, "sample": [84.63780212402344, 16.53570556640625, 119.66673278808594, -7.627449035644531, -198.81161499023438, 84.3485336303711, 48.42288589477539, 14.610862731933594, 52.137351989746094, 111.27473449707031, 92.20941162109375, 104.13796997070312, 46.55059814453125, 44.8060302734375, 166.4184112548828, 82.31304931640625, 13.865966796875, -39.98396301269531, 216.4897003173828, 186.10745239257812, 23.19853973388672, 128.6238250732422, -44.63843536376953, 86.68499755859375, 264.0306091308594, 149.68849182128906, 233.77978515625, 61.26756286621094, 260.54388427734375, 7.875970840454102, 95.37325286865234, 40.53752899169922, 74.0645751953125, 9.87984848022461, 190.83323669433594, 73.59637451171875, 152.79071044921875, -50.78230285644531, -28.08990478515625, 46.77653503417969, 158.1131134033203, -202.91961669921875, -34.39146423339844, 1.0526199340820312, 26.700218200683594, 87.10871887207031, 187.3478240966797, 182.1112823486328, -2.3007125854492188, 94.11929321289062, 247.73080444335938, -48.27027130126953, 5.574115753173828, 123.11273193359375, 28.496185302734375, 40.26791763305664, -38.84160232543945, 10.99127197265625, 11.424489974975586, 330.43426513671875, -18.585411071777344, 323.5988464355469, 35.50856018066406, 172.831298828125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000671.npy"}
{"epoch": 0.9853157121879589, "step": 672, "batch_size": 64, "mean": 65.91779327392578, "std": 95.99066162109375, "min": -132.19284057617188, "p10": -60.52509231567381, "median": 67.47067260742188, "p90": 187.9561279296875, "max": 282.89471435546875, "pos_frac": 0.75, "sample": [70.490478515625, -79.35862731933594, -26.422687530517578, 54.81598663330078, 72.86791229248047, 84.47949981689453, 5.238166809082031, 102.31930541992188, 236.5009002685547, -116.38778686523438, 34.03118133544922, 21.098411560058594, -109.09368896484375, 104.91511535644531, 33.68891143798828, 134.82101440429688, 97.01715087890625, 141.7310791015625, 71.03136444091797, 189.18826293945312, 157.66006469726562, 80.305908203125, 7.050954818725586, 55.1334228515625, 35.376800537109375, -95.24624633789062, 282.89471435546875, -27.093219757080078, 25.613746643066406, 266.2468566894531, -13.114631652832031, 164.2735137939453, 126.78561401367188, 154.60269165039062, 164.3367462158203, 173.2599639892578, 120.94146728515625, -67.3111572265625, 61.30030059814453, 117.24839782714844, -132.19284057617188, 88.37364196777344, 60.198699951171875, 49.63621520996094, 79.64881896972656, 228.76681518554688, 219.47067260742188, 64.45086669921875, -44.690940856933594, 78.54246520996094, 94.58259582519531, 6.603912353515625, -16.375747680664062, 175.0845947265625, 19.2889347076416, -23.098974227905273, -11.594970703125, 114.69134521484375, 199.3945770263672, -32.5279541015625, -92.8778305053711, 2.2076873779296875, 185.08114624023438, -7.163032531738281], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000672.npy"}
{"epoch": 0.986784140969163, "step": 673, "batch_size": 64, "mean": 75.86769104003906, "std": 92.46546936035156, "min": -173.3209991455078, "p10": -23.209049606323234, "median": 69.18673324584961, "p90": 194.69354553222658, "max": 358.8761291503906, "pos_frac": 0.796875, "sample": [208.81321716308594, 19.561365127563477, -61.81849670410156, 140.917236328125, -5.623626708984375, 248.671875, 99.69471740722656, 41.37397384643555, 233.05056762695312, 109.94591522216797, -0.7667694091796875, 52.361968994140625, -90.03501892089844, 80.95680236816406, 200.46417236328125, 119.3116455078125, 52.511444091796875, 196.63009643554688, 145.3743438720703, -14.186271667480469, -75.80326843261719, 36.899749755859375, 3.924274444580078, 9.175273895263672, 2.0543670654296875, 4.211082458496094, -9.041404724121094, 97.68389892578125, -27.07595443725586, 158.4073486328125, 181.33299255371094, 245.12338256835938, 55.02629852294922, 19.48831558227539, 133.24542236328125, -38.33784484863281, 18.00250244140625, 136.1256103515625, 78.72268676757812, 107.30572509765625, 149.23626708984375, -4.978443145751953, 108.99431610107422, 190.1749267578125, 92.82530212402344, 111.2926254272461, 71.67464447021484, -38.65282440185547, 43.01239013671875, 358.8761291503906, 123.11739349365234, 46.40208053588867, 159.93325805664062, 28.893306732177734, -173.3209991455078, 40.57762145996094, 21.380218505859375, 122.06657409667969, 40.48658752441406, 135.6159210205078, 97.28792572021484, 66.69882202148438, 158.61387634277344, -8.355575561523438], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000673.npy"}
{"epoch": 0.9882525697503671, "step": 674, "batch_size": 64, "mean": 102.5726318359375, "std": 99.63872528076172, "min": -68.01902770996094, "p10": -3.0486386299133286, "median": 82.96308517456055, "p90": 236.05645751953125, "max": 369.9192810058594, "pos_frac": 0.875, "sample": [157.73365783691406, 57.57380676269531, 96.2292251586914, 322.8563232421875, 61.5969123840332, 82.76508331298828, 132.9402618408203, 140.13775634765625, -47.22520446777344, 134.78903198242188, 37.02167510986328, 159.4561767578125, -1.5703811645507812, 208.48667907714844, 98.56307983398438, 57.768619537353516, -3.6821775436401367, 326.3077087402344, 73.92971801757812, 314.4888610839844, 39.35094451904297, 173.7685546875, 41.418739318847656, 84.99271392822266, 34.07854461669922, 13.255870819091797, 252.94583129882812, -55.15674591064453, 49.3216552734375, 89.81112670898438, 186.94358825683594, 369.9192810058594, 83.16108703613281, 8.114566802978516, -45.68842697143555, 275.4622497558594, 36.55414581298828, -68.01902770996094, 1.8804817199707031, 135.68226623535156, 119.08512878417969, -64.51400756835938, 73.90032196044922, 177.75003051757812, 66.53390502929688, 216.6250457763672, 97.58535766601562, 74.87088775634766, 54.624046325683594, 232.6295166015625, 170.3529510498047, 74.42852020263672, 237.525146484375, -61.620521545410156, 169.43145751953125, 64.47842407226562, 77.62554168701172, 201.44532775878906, 174.46676635742188, 87.8630599975586, 91.33494567871094, 40.80562973022461, 39.9489631652832, 29.507339477539062], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000674.npy"}
{"epoch": 0.9897209985315712, "step": 675, "batch_size": 64, "mean": 89.63999938964844, "std": 120.85458374023438, "min": -351.73797607421875, "p10": -42.33005561828613, "median": 97.9266357421875, "p90": 223.76355438232426, "max": 404.7604064941406, "pos_frac": 0.765625, "sample": [-36.0759391784668, 255.125732421875, 28.22356414794922, 157.01016235351562, -6.039695739746094, 102.89923095703125, 166.27352905273438, 1.1289997100830078, 37.189353942871094, 126.28112030029297, 39.107757568359375, -62.52923583984375, -8.27813720703125, -43.49578857421875, 72.42035675048828, 5.423240661621094, -47.47848129272461, 210.30892944335938, 179.49441528320312, -1.8303756713867188, 202.88336181640625, 51.55403137207031, 404.7604064941406, 247.04541015625, 167.07696533203125, -39.36013412475586, 23.879169464111328, 165.79165649414062, 61.222843170166016, -108.44513702392578, 129.7001953125, 299.68701171875, -59.961326599121094, 177.52960205078125, -37.163726806640625, 160.90054321289062, 116.6755599975586, 119.19564819335938, 187.26344299316406, 24.094650268554688, -39.61001205444336, 165.12042236328125, 152.774658203125, 239.57867431640625, -24.84557342529297, 12.819643020629883, -351.73797607421875, 83.39457702636719, 193.65695190429688, 105.46234130859375, 116.54728698730469, 227.764404296875, 71.869873046875, 92.95404052734375, 88.84637451171875, 168.62689208984375, -85.42599487304688, 10.951789855957031, 111.04624938964844, 291.1355285644531, 23.18720245361328, 214.42823791503906, 208.72268676757812, 190.20274353027344], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000675.npy"}
{"epoch": 0.9911894273127754, "step": 676, "batch_size": 64, "mean": 91.44828796386719, "std": 107.03324127197266, "min": -206.5927734375, "p10": -44.536706542968744, "median": 100.06300735473633, "p90": 225.10772094726565, "max": 304.7705993652344, "pos_frac": 0.8125, "sample": [44.350807189941406, 141.45701599121094, 182.38934326171875, 65.1934585571289, -206.5927734375, 122.79283142089844, 268.30120849609375, 226.84039306640625, -8.26802921295166, 22.659709930419922, 38.480262756347656, 56.29296875, 176.06866455078125, 106.20501708984375, 89.96956634521484, 31.791961669921875, -3.4314823150634766, -47.416351318359375, 26.051551818847656, -70.92842102050781, 23.141132354736328, -115.46624755859375, 221.0648193359375, -81.46905517578125, 169.60671997070312, -82.26168823242188, 169.8445587158203, 240.02146911621094, 82.88868713378906, 215.79771423339844, 84.97122192382812, -37.817535400390625, 201.73129272460938, 96.95980072021484, 160.69021606445312, 16.105915069580078, 304.7705993652344, 129.12371826171875, 230.5010986328125, 106.25942993164062, 58.67057800292969, -28.66904640197754, 52.924102783203125, 2.0718002319335938, 122.60237884521484, 134.2740478515625, 6.0, 103.16621398925781, 196.54458618164062, 20.30231475830078, 171.02003479003906, 286.038330078125, 137.6558837890625, 183.50851440429688, 104.88642883300781, 137.47821044921875, 59.939727783203125, -22.91140365600586, 152.8581085205078, 138.4107666015625, 247.69357299804688, -117.80709838867188, 212.703125, 94.65757751464844], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000676.npy"}
{"epoch": 0.9926578560939795, "step": 677, "batch_size": 64, "mean": 93.82452392578125, "std": 90.83396911621094, "min": -101.48023986816406, "p10": -19.316842460632323, "median": 75.9031867980957, "p90": 226.80230560302738, "max": 267.4717712402344, "pos_frac": 0.84375, "sample": [-22.906959533691406, 189.97512817382812, 263.4693298339844, 100.0788803100586, 180.60118103027344, 74.29225158691406, -17.338130950927734, -27.663780212402344, 192.3402862548828, 44.34925842285156, 74.28939819335938, 136.2645263671875, 58.03887939453125, 219.7496795654297, 56.955322265625, 121.04586029052734, 267.4717712402344, -75.89034271240234, 31.577133178710938, 211.6761474609375, 233.33865356445312, 167.52655029296875, 209.13101196289062, 90.29888916015625, 40.9222412109375, 204.22763061523438, -16.786956787109375, 23.157413482666016, 106.66277313232422, 95.087158203125, 86.37940979003906, 21.05035400390625, 52.71748733520508, 175.48670959472656, 180.13790893554688, 43.226470947265625, -101.48023986816406, 13.139360427856445, 143.19351196289062, 74.42906951904297, 76.99918365478516, 58.86172103881836, 103.32273864746094, 164.09994506835938, -3.8562698364257812, 229.82485961914062, -26.126686096191406, 51.3164176940918, 20.5333251953125, 250.43682861328125, 151.0501708984375, -20.16486167907715, 28.371063232421875, 6.475730895996094, 235.0678253173828, 110.98921966552734, 32.05169677734375, 254.08108520507812, 74.71525573730469, 137.4141082763672, -66.75251770019531, 46.268829345703125, 94.76162719726562, 74.80718994140625], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000677.npy"}
{"epoch": 0.9941262848751835, "step": 678, "batch_size": 64, "mean": 110.73106384277344, "std": 100.02980041503906, "min": -170.8909912109375, "p10": -9.771176528930662, "median": 119.79004287719727, "p90": 236.8170333862305, "max": 333.0306396484375, "pos_frac": 0.859375, "sample": [123.98104095458984, 93.51972961425781, 170.4142303466797, 216.48077392578125, 36.99937438964844, 26.84275245666504, 176.46774291992188, 133.12457275390625, 44.33069610595703, 106.90348815917969, -62.303466796875, 119.01795196533203, 38.84407424926758, 171.0716552734375, 132.06524658203125, 114.39645385742188, 191.82191467285156, 36.36693572998047, -170.8909912109375, 203.9460906982422, 120.5621337890625, 19.198829650878906, 13.111854553222656, 111.13641357421875, 181.12301635742188, 283.9798583984375, 141.77981567382812, 51.608306884765625, 0.20027542114257812, 239.66758728027344, 137.9402313232422, 9.609195709228516, 128.86669921875, 9.43988037109375, 75.5177230834961, 174.80621337890625, -33.763763427734375, 303.421630859375, -21.114654541015625, 24.345062255859375, -6.891353607177734, 237.8948974609375, 172.19862365722656, 202.28277587890625, 268.7903137207031, 10.194194793701172, 333.0306396484375, 228.93081665039062, 25.35070037841797, -11.005386352539062, 180.633544921875, 99.11629486083984, 111.34647369384766, -12.667865753173828, 182.00689697265625, 149.04391479492188, 79.591064453125, 249.98719787597656, 234.30201721191406, -23.20770263671875, 179.87318420410156, -2.86163330078125, 130.72491455078125, 193.28631591796875], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000678.npy"}
{"epoch": 0.9955947136563876, "step": 679, "batch_size": 64, "mean": 89.96353149414062, "std": 85.41429138183594, "min": -50.95189666748047, "p10": -9.891490936279284, "median": 77.11712646484375, "p90": 209.36508026123047, "max": 340.47747802734375, "pos_frac": 0.890625, "sample": [20.20086669921875, 22.77349853515625, 29.378665924072266, 241.97894287109375, 160.26629638671875, 58.35152816772461, 88.64506530761719, 158.71510314941406, 22.34357452392578, 75.91907501220703, 84.12489318847656, 164.69143676757812, 141.05165100097656, -35.82805633544922, 289.16943359375, -14.981147766113281, 40.706932067871094, 112.01329040527344, 42.36912536621094, 49.409400939941406, 216.47125244140625, 243.1323699951172, 23.001190185546875, 210.5524139404297, 81.00044250488281, 33.766357421875, 59.91910934448242, 188.42367553710938, 9.39956283569336, 117.0958251953125, 128.455810546875, 58.68568420410156, 59.359710693359375, 252.13694763183594, 162.61514282226562, 162.13861083984375, 102.89790344238281, 33.105674743652344, -28.336994171142578, -50.95189666748047, 173.5958709716797, -17.021656036376953, 78.22293090820312, 90.06617736816406, 78.20597839355469, 206.59463500976562, 44.678382873535156, 159.7594757080078, 131.76788330078125, 110.90817260742188, 179.22630310058594, 21.204025268554688, 14.448249816894531, -45.9303092956543, 76.02827453613281, 27.425094604492188, 94.49134826660156, 75.3695297241211, 1.984375, 340.47747802734375, 89.62784576416016, 7.49774169921875, 29.87152099609375, -25.001380920410156], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000679.npy"}
{"epoch": 0.9970631424375918, "step": 680, "batch_size": 64, "mean": 93.83221435546875, "std": 108.0343017578125, "min": -120.7109146118164, "p10": -41.590192413330065, "median": 72.8067626953125, "p90": 242.50799865722658, "max": 323.89349365234375, "pos_frac": 0.84375, "sample": [214.12277221679688, -120.7109146118164, -80.0600814819336, 12.011772155761719, 155.49270629882812, 13.49066162109375, 245.64334106445312, 47.261627197265625, 190.2501983642578, 98.9705810546875, 218.68197631835938, 28.55011749267578, 74.89926147460938, 108.20037841796875, 163.87478637695312, 323.89349365234375, -27.00719451904297, -11.460968017578125, 41.46514892578125, -114.50956726074219, 145.715087890625, 146.7836456298828, 47.02608108520508, 50.24201202392578, 112.67398071289062, 65.31158447265625, 70.02449798583984, 66.03788757324219, 30.77710723876953, 319.6501770019531, 26.984357833862305, 136.9587860107422, -93.12971496582031, 218.92196655273438, 123.5024185180664, 24.076385498046875, 226.1476287841797, 70.71426391601562, 35.93916320800781, 18.731201171875, 36.07313537597656, 281.47100830078125, 54.746620178222656, 63.986412048339844, 79.58399963378906, -100.6809310913086, 279.4681701660156, -46.28386306762695, -30.638294219970703, 133.92657470703125, 97.00428771972656, 235.19219970703125, 92.08927917480469, -58.1962890625, 120.86428833007812, 14.526039123535156, 225.26243591308594, 246.82009887695312, 25.246376037597656, 194.93873596191406, 126.70086669921875, 208.2345428466797, 45.43525695800781, 253.34207153320312], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000680.npy"}
{"epoch": 0.9985315712187959, "step": 681, "batch_size": 64, "mean": 84.06166076660156, "std": 101.51732635498047, "min": -211.78094482421875, "p10": -38.04507789611816, "median": 77.50081253051758, "p90": 225.00889434814454, "max": 323.35076904296875, "pos_frac": 0.828125, "sample": [114.29129028320312, -29.883594512939453, 101.22080993652344, 44.06425476074219, 115.77644348144531, -57.5330810546875, 57.85204315185547, 45.69511413574219, 96.47886657714844, 48.4107666015625, 187.24734497070312, -21.876556396484375, 49.3976936340332, 28.933570861816406, 9.318313598632812, 300.065673828125, 220.23936462402344, -47.6644287109375, 163.28616333007812, 252.18338012695312, -106.9720458984375, 53.450401306152344, 102.40542602539062, 114.4083251953125, 323.35076904296875, 101.866943359375, 45.01368713378906, 91.06813049316406, 44.12895965576172, 104.36483764648438, 60.16454315185547, 30.39044189453125, 51.57421875, 163.11123657226562, 10.231132507324219, 113.58283996582031, 1.103179931640625, 130.98007202148438, 74.28736877441406, 64.0694580078125, -19.267349243164062, 289.56005859375, 130.49412536621094, 124.37398529052734, -211.78094482421875, 175.8438262939453, -40.08634567260742, 99.36886596679688, 75.95869445800781, 89.0596923828125, 252.0070037841797, -33.28211975097656, 151.7709503173828, 204.3588409423828, 79.04293060302734, -61.80854797363281, 302.99603271484375, -52.45208740234375, 118.32258605957031, 44.93302917480469, 69.61485290527344, 227.052978515625, 86.31936645507812, 27.462432861328125], "npy": "outputs/qwen3-8b-base-new-dpo-hh-helpful-4xh200-batch-64-q_t-0.45-s_star-0.6/margin_logs/step_0000681.npy"}

151388
merges.txt Normal file
View File

File diff suppressed because it is too large Load Diff

3
model-00001-of-00007.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17ffbedea2782038fe46f0f015876a44afc7229c55fb28d771dc76d1b40eacfe
size 4972454376

3
model-00002-of-00007.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3600f409406fb3186e10a44ed3a9dbcd168fd88ea807cc6c2c2c9170ccfdcbb
size 4832048608

3
model-00003-of-00007.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:753dd613aed9f68cc28a782789fa37dd7feaceffecd203304a4ae8a18ccb1926
size 4832048656

3
model-00004-of-00007.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69094d991e0aef744fb37b31016f3578a88765ce8822afcf6ce51994bd825949
size 4999855528

3
model-00005-of-00007.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1462a47519d0a1d8061b97fddd9ed579408c3348ed9cd28ab69f6356803f1ad
size 4832048672

3
model-00006-of-00007.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d4ffc75d227b5058933b6a1da546a7f2b0da3c7428e5ce1b4b68afa41c24186
size 4832048672

3
model-00007-of-00007.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:995d8b744e00b25bd5db010e1644453c27302263b7d209ca93eba528bc0ae198
size 3462482728

406
model.safetensors.index.json Normal file
View File

@@ -0,0 +1,406 @@
{
"metadata": {
"total_size": 32762941440
},
"weight_map": {
"lm_head.weight": "model-00007-of-00007.safetensors",
"model.embed_tokens.weight": "model-00001-of-00007.safetensors",
"model.layers.0.input_layernorm.weight": "model-00001-of-00007.safetensors",
"model.layers.0.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.0.mlp.gate_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.0.mlp.up_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.0.post_attention_layernorm.weight": "model-00001-of-00007.safetensors",
"model.layers.0.self_attn.k_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.0.self_attn.k_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.0.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.0.self_attn.q_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.0.self_attn.q_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.0.self_attn.v_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.1.input_layernorm.weight": "model-00001-of-00007.safetensors",
"model.layers.1.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.1.mlp.gate_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.1.mlp.up_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.1.post_attention_layernorm.weight": "model-00001-of-00007.safetensors",
"model.layers.1.self_attn.k_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.1.self_attn.k_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.1.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.1.self_attn.q_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.1.self_attn.q_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.1.self_attn.v_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.10.input_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.10.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.10.mlp.gate_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.10.mlp.up_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.10.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.10.self_attn.k_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.10.self_attn.k_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.10.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.10.self_attn.q_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.10.self_attn.q_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.10.self_attn.v_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.11.input_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.11.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.11.mlp.gate_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.11.mlp.up_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.11.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.11.self_attn.k_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.11.self_attn.k_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.11.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.11.self_attn.q_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.11.self_attn.q_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.11.self_attn.v_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.12.input_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.12.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.12.mlp.gate_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.12.mlp.up_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.12.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.12.self_attn.k_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.12.self_attn.k_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.12.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.12.self_attn.q_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.12.self_attn.q_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.12.self_attn.v_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.13.input_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.13.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.13.mlp.gate_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.13.mlp.up_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.13.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.13.self_attn.k_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.13.self_attn.k_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.13.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.13.self_attn.q_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.13.self_attn.q_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.13.self_attn.v_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.14.input_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.14.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.14.mlp.gate_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.14.mlp.up_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.14.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.14.self_attn.k_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.14.self_attn.k_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.14.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.14.self_attn.q_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.14.self_attn.q_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.14.self_attn.v_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.15.input_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.15.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.15.mlp.gate_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.15.mlp.up_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.15.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.15.self_attn.k_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.15.self_attn.k_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.15.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.15.self_attn.q_norm.weight": "model-00003-of-00007.safetensors",
"model.layers.15.self_attn.q_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.15.self_attn.v_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.16.input_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.16.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.16.mlp.gate_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.16.mlp.up_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.16.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.16.self_attn.k_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.16.self_attn.k_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.16.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.16.self_attn.q_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.16.self_attn.q_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.16.self_attn.v_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.17.input_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.17.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.17.mlp.gate_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.17.mlp.up_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.17.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.17.self_attn.k_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.17.self_attn.k_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.17.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.17.self_attn.q_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.17.self_attn.q_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.17.self_attn.v_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.18.input_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.18.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.18.mlp.gate_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.18.mlp.up_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.18.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.18.self_attn.k_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.18.self_attn.k_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.18.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.18.self_attn.q_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.18.self_attn.q_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.18.self_attn.v_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.19.input_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.19.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.19.mlp.gate_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.19.mlp.up_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.19.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.19.self_attn.k_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.19.self_attn.k_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.19.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.19.self_attn.q_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.19.self_attn.q_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.19.self_attn.v_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.2.input_layernorm.weight": "model-00001-of-00007.safetensors",
"model.layers.2.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.2.mlp.gate_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.2.mlp.up_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.2.post_attention_layernorm.weight": "model-00001-of-00007.safetensors",
"model.layers.2.self_attn.k_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.2.self_attn.k_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.2.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.2.self_attn.q_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.2.self_attn.q_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.2.self_attn.v_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.20.input_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.20.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.20.mlp.gate_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.20.mlp.up_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.20.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.20.self_attn.k_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.20.self_attn.k_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.20.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.20.self_attn.q_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.20.self_attn.q_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.20.self_attn.v_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.21.input_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.21.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.21.mlp.gate_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.21.mlp.up_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.21.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
"model.layers.21.self_attn.k_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.21.self_attn.k_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.21.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.21.self_attn.q_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.21.self_attn.q_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.21.self_attn.v_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.22.input_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.22.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.22.mlp.gate_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.22.mlp.up_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.22.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.22.self_attn.k_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.22.self_attn.k_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.22.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.22.self_attn.q_norm.weight": "model-00004-of-00007.safetensors",
"model.layers.22.self_attn.q_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.22.self_attn.v_proj.weight": "model-00004-of-00007.safetensors",
"model.layers.23.input_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.23.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.23.mlp.gate_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.23.mlp.up_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.23.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.23.self_attn.k_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.23.self_attn.k_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.23.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.23.self_attn.q_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.23.self_attn.q_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.23.self_attn.v_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.24.input_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.24.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.24.mlp.gate_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.24.mlp.up_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.24.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.24.self_attn.k_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.24.self_attn.k_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.24.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.24.self_attn.q_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.24.self_attn.q_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.24.self_attn.v_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.25.input_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.25.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.25.mlp.gate_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.25.mlp.up_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.25.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.25.self_attn.k_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.25.self_attn.k_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.25.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.25.self_attn.q_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.25.self_attn.q_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.25.self_attn.v_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.26.input_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.26.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.26.mlp.gate_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.26.mlp.up_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.26.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.26.self_attn.k_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.26.self_attn.k_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.26.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.26.self_attn.q_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.26.self_attn.q_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.26.self_attn.v_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.27.input_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.27.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.27.mlp.gate_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.27.mlp.up_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.27.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
"model.layers.27.self_attn.k_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.27.self_attn.k_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.27.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.27.self_attn.q_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.27.self_attn.q_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.27.self_attn.v_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.28.input_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.28.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.28.mlp.gate_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.28.mlp.up_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.28.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.28.self_attn.k_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.28.self_attn.k_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.28.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.28.self_attn.q_norm.weight": "model-00005-of-00007.safetensors",
"model.layers.28.self_attn.q_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.28.self_attn.v_proj.weight": "model-00005-of-00007.safetensors",
"model.layers.29.input_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.29.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.29.mlp.gate_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.29.mlp.up_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.29.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.29.self_attn.k_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.29.self_attn.k_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.29.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.29.self_attn.q_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.29.self_attn.q_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.29.self_attn.v_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.3.input_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.3.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.3.mlp.gate_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.3.mlp.up_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.3.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.3.self_attn.k_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.3.self_attn.k_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.3.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.3.self_attn.q_norm.weight": "model-00001-of-00007.safetensors",
"model.layers.3.self_attn.q_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.3.self_attn.v_proj.weight": "model-00001-of-00007.safetensors",
"model.layers.30.input_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.30.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.30.mlp.gate_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.30.mlp.up_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.30.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.30.self_attn.k_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.30.self_attn.k_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.30.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.30.self_attn.q_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.30.self_attn.q_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.30.self_attn.v_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.31.input_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.31.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.31.mlp.gate_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.31.mlp.up_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.31.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.31.self_attn.k_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.31.self_attn.k_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.31.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.31.self_attn.q_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.31.self_attn.q_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.31.self_attn.v_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.32.input_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.32.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.32.mlp.gate_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.32.mlp.up_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.32.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.32.self_attn.k_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.32.self_attn.k_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.32.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.32.self_attn.q_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.32.self_attn.q_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.32.self_attn.v_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.33.input_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.33.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.33.mlp.gate_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.33.mlp.up_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.33.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
"model.layers.33.self_attn.k_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.33.self_attn.k_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.33.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.33.self_attn.q_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.33.self_attn.q_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.33.self_attn.v_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.34.input_layernorm.weight": "model-00007-of-00007.safetensors",
"model.layers.34.mlp.down_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.34.mlp.gate_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.34.mlp.up_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.34.post_attention_layernorm.weight": "model-00007-of-00007.safetensors",
"model.layers.34.self_attn.k_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.34.self_attn.k_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.34.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.34.self_attn.q_norm.weight": "model-00006-of-00007.safetensors",
"model.layers.34.self_attn.q_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.34.self_attn.v_proj.weight": "model-00006-of-00007.safetensors",
"model.layers.35.input_layernorm.weight": "model-00007-of-00007.safetensors",
"model.layers.35.mlp.down_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.35.mlp.gate_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.35.mlp.up_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.35.post_attention_layernorm.weight": "model-00007-of-00007.safetensors",
"model.layers.35.self_attn.k_norm.weight": "model-00007-of-00007.safetensors",
"model.layers.35.self_attn.k_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.35.self_attn.o_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.35.self_attn.q_norm.weight": "model-00007-of-00007.safetensors",
"model.layers.35.self_attn.q_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.35.self_attn.v_proj.weight": "model-00007-of-00007.safetensors",
"model.layers.4.input_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.4.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.4.mlp.gate_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.4.mlp.up_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.4.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.4.self_attn.k_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.4.self_attn.k_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.4.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.4.self_attn.q_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.4.self_attn.q_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.4.self_attn.v_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.5.input_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.5.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.5.mlp.gate_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.5.mlp.up_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.5.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.5.self_attn.k_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.5.self_attn.k_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.5.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.5.self_attn.q_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.5.self_attn.q_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.5.self_attn.v_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.6.input_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.6.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.6.mlp.gate_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.6.mlp.up_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.6.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.6.self_attn.k_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.6.self_attn.k_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.6.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.6.self_attn.q_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.6.self_attn.q_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.6.self_attn.v_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.7.input_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.7.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.7.mlp.gate_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.7.mlp.up_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.7.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.7.self_attn.k_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.7.self_attn.k_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.7.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.7.self_attn.q_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.7.self_attn.q_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.7.self_attn.v_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.8.input_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.8.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.8.mlp.gate_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.8.mlp.up_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.8.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
"model.layers.8.self_attn.k_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.8.self_attn.k_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.8.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.8.self_attn.q_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.8.self_attn.q_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.8.self_attn.v_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.9.input_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.9.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.9.mlp.gate_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.9.mlp.up_proj.weight": "model-00003-of-00007.safetensors",
"model.layers.9.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
"model.layers.9.self_attn.k_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.9.self_attn.k_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.9.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.9.self_attn.q_norm.weight": "model-00002-of-00007.safetensors",
"model.layers.9.self_attn.q_proj.weight": "model-00002-of-00007.safetensors",
"model.layers.9.self_attn.v_proj.weight": "model-00002-of-00007.safetensors",
"model.norm.weight": "model-00007-of-00007.safetensors"
}
}

31
special_tokens_map.json Normal file
View File

@@ -0,0 +1,31 @@
{
"additional_special_tokens": [
"<|im_start|>",
"<|im_end|>",
"<|object_ref_start|>",
"<|object_ref_end|>",
"<|box_start|>",
"<|box_end|>",
"<|quad_start|>",
"<|quad_end|>",
"<|vision_start|>",
"<|vision_end|>",
"<|vision_pad|>",
"<|image_pad|>",
"<|video_pad|>"
],
"eos_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

BIN
tokenizer.json (Stored with Git LFS) Normal file
View File

Binary file not shown.

240
tokenizer_config.json Normal file
View File

@@ -0,0 +1,240 @@
{
"add_bos_token": false,
"add_prefix_space": false,
"added_tokens_decoder": {
"151643": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151644": {
"content": "<|im_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151645": {
"content": "<|im_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151646": {
"content": "<|object_ref_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151647": {
"content": "<|object_ref_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151648": {
"content": "<|box_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151649": {
"content": "<|box_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151650": {
"content": "<|quad_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151651": {
"content": "<|quad_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151652": {
"content": "<|vision_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151653": {
"content": "<|vision_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151654": {
"content": "<|vision_pad|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151655": {
"content": "<|image_pad|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151656": {
"content": "<|video_pad|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151657": {
"content": "<tool_call>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151658": {
"content": "</tool_call>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151659": {
"content": "<|fim_prefix|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151660": {
"content": "<|fim_middle|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151661": {
"content": "<|fim_suffix|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151662": {
"content": "<|fim_pad|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151663": {
"content": "<|repo_name|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151664": {
"content": "<|file_sep|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151665": {
"content": "<tool_response>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151666": {
"content": "</tool_response>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151667": {
"content": "<think>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
},
"151668": {
"content": "</think>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": false
}
},
"additional_special_tokens": [
"<|im_start|>",
"<|im_end|>",
"<|object_ref_start|>",
"<|object_ref_end|>",
"<|box_start|>",
"<|box_end|>",
"<|quad_start|>",
"<|quad_end|>",
"<|vision_start|>",
"<|vision_end|>",
"<|vision_pad|>",
"<|image_pad|>",
"<|video_pad|>"
],
"bos_token": null,
"chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {{- messages[0].content + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0].content + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n{%- endfor %}\n{%- for message in messages %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) %}\n {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set content = message.content %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is defined and message.reasoning_content is not none %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- else %}\n {%- if '</think>' in message.content %}\n {%- set content = message.content.split('</think>')[-1].lstrip('\\n') %}\n {%- set reasoning_content = message.content.split('</think>')[0].rstrip('\\n').split('<think>')[-1].lstrip('\\n') %}\n {%- endif %}\n {%- endif %}\n {%- if loop.index0 > ns.last_query_index %}\n {%- if loop.last or (not loop.last and reasoning_content) %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content.strip('\\n') + '\\n</think>\\n\\n' + content.lstrip('\\n') }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- message.content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- endif %}\n{%- endif %}",
"clean_up_tokenization_spaces": false,
"eos_token": "<|endoftext|>",
"errors": "replace",
"extra_special_tokens": {},
"model_max_length": 2048,
"pad_token": "<|endoftext|>",
"split_special_tokens": false,
"tokenizer_class": "Qwen2Tokenizer",
"unk_token": null
}

9
train_results.json Normal file
View File

@@ -0,0 +1,9 @@
{
"epoch": 1.0,
"total_flos": 0.0,
"train_loss": 1.0153061533114283,
"train_runtime": 2239.7507,
"train_samples": 43598,
"train_samples_per_second": 19.466,
"train_steps_per_second": 0.304
}

13084
trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

1
vocab.json Normal file
View File

File diff suppressed because one or more lines are too long