初始化项目,由ModelHub XC社区提供模型
Model: xw1234gan/seccodeplt-qwen2.5-coder-3b-grpo-no-kl-real-detector-reward-v3 Source: Original Platform
This commit is contained in:
38
README.md
Normal file
38
README.md
Normal file
@@ -0,0 +1,38 @@
|
||||
---
|
||||
base_model: Qwen/Qwen2.5-Coder-3B-Instruct
|
||||
library_name: transformers
|
||||
datasets:
|
||||
- fengyao1909/SecCodePLT_Plus
|
||||
tags:
|
||||
- code
|
||||
- security
|
||||
- grpo
|
||||
- seccodeplt
|
||||
---
|
||||
|
||||
# seccodeplt-qwen2.5-coder-3b-grpo-no-kl-real-detector-reward-v3
|
||||
|
||||
GRPO without KL regularization for the SecCodePLT+ compliance experiment using
|
||||
`Qwen/Qwen2.5-Coder-3B-Instruct`. This v3 run uses ReaL's program-analysis detector reward
|
||||
with DAPO-style token loss and dynamic sampling. The reward is `0.5 *
|
||||
capability_test_fraction + 0.5 * max(0, 1 - 0.3 * detected_vulnerabilities)`.
|
||||
Training used seed 42 and the official 655-example training split.
|
||||
Evaluation used greedy decoding on all 164 official test examples.
|
||||
|
||||
## Evaluation
|
||||
|
||||
| Metric | Value |
|
||||
|---|---:|
|
||||
| Mean reward | 0.511832 |
|
||||
| Output format pass | 97.56% |
|
||||
| Syntax pass | 97.56% |
|
||||
| Capability pass | 25.61% |
|
||||
| Safety pass | 56.10% |
|
||||
| Detector clean | 54.27% |
|
||||
| Detector score | 0.768293 |
|
||||
| Joint pass | 17.07% |
|
||||
|
||||
## Limitations
|
||||
|
||||
This is a single-seed research checkpoint evaluated with the benchmark's
|
||||
resource-bounded Python verifier. It is not a general guarantee of secure code.
|
||||
Reference in New Issue
Block a user