初始化项目,由ModelHub XC社区提供模型
Model: laion/explore-tis-minp-40-8B Source: Original Platform
This commit is contained in:
30
README.md
Normal file
30
README.md
Normal file
@@ -0,0 +1,30 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
base_model: laion/GLM-4_7-swesmith-sandboxes-with_tests-oracle_verified_120s-maxeps-131k-fixthink
|
||||
tags:
|
||||
- rl
|
||||
- skyrl
|
||||
- terminal-bench
|
||||
- agentic
|
||||
- tis
|
||||
---
|
||||
|
||||
# explore-tis-minp-40-8B
|
||||
|
||||
RL (SkyRL, agentic terminal-bench / Harbor + Daytona) checkpoint from the `explore-tis` sampling-parameter ablation.
|
||||
This is the **min-p sampling** arm (`explore-tis-minp`).
|
||||
|
||||
- **Base model:** `laion/GLM-4_7-swesmith-sandboxes-with_tests-oracle_verified_120s-maxeps-131k-fixthink` (an 8B model)
|
||||
- **Dataset:** `DCAgent/exp_rpt_pymethods2test-large`
|
||||
- **Algorithm:** RLOO-n, no KL loss, `loss_reduction=seq_mean_token_sum_norm_global`, TIS on (`tis_imp_ratio_cap=2.0`)
|
||||
- **Sampling:** temperature=1.0, min_p=0.05, top_k=-1, top_p=1.0
|
||||
- **Selected checkpoint:** `global_step_40` (best trailing-5 EMA, α=1/3, of `reward/avg_raw_reward` over saved exports with step ≤ 78; EMA ≈ 0.4722). The 78-step cutoff was applied to exclude a step-79+ greedy/eval-pass reward artifact.
|
||||
- **Max training steps:** 80
|
||||
|
||||
## Training Traces
|
||||
|
||||
Rollout traces for this run: [penfever/explore-tis-minp](https://huggingface.co/datasets/penfever/explore-tis-minp)
|
||||
|
||||
## Training Logs
|
||||
|
||||
Parsed metrics, reward-vs-steps plots, and raw console logs are under `training_logs/` in this repo.
|
||||
Reference in New Issue
Block a user