初始化项目,由ModelHub XC社区提供模型
Model: jvonrad/Qwen-2.5-7B-grpo-bonus5-ablation Source: Original Platform
This commit is contained in:
16
README.md
Normal file
16
README.md
Normal file
@@ -0,0 +1,16 @@
|
||||
---
|
||||
base_model: Qwen/Qwen2.5-7B
|
||||
tags:
|
||||
- grpo
|
||||
- cross-lingual
|
||||
- ablation
|
||||
---
|
||||
|
||||
# Qwen-2.5-7B-grpo-bonus5-ablation
|
||||
|
||||
GRPO all_correct_bonus ablation on Qwen2.5-7B, trained on the WIKI-FACT /
|
||||
PolyFact cross-lingual factual-recall task (see
|
||||
[jvonrad/Lost-in-Mistranslation](https://github.com/jvonrad/Lost-in-Mistranslation)).
|
||||
`--all_correct_bonus 5.0` (all other hyperparameters match the paper's main
|
||||
GRPO run). Evaluated in `results/qwen-2.5-7b-grpo-bonus5-ablation_polyfact_consistency.json` and
|
||||
`results/qwen-2.5-7b-grpo-bonus5-ablation_gmmlu_lite_consistency.json` in the repo above.
|
||||
Reference in New Issue
Block a user