初始化项目,由ModelHub XC社区提供模型
Model: simonts/genre2-grm-sft Source: Original Platform
This commit is contained in:
51
README.md
Normal file
51
README.md
Normal file
@@ -0,0 +1,51 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
base_model: mistralai/Mistral-7B-Instruct-v0.2
|
||||
library_name: transformers
|
||||
tags:
|
||||
- genre2
|
||||
- generative-reward-model
|
||||
- research
|
||||
---
|
||||
|
||||
# GenRe2 GRM SFT Checkpoint
|
||||
|
||||
This repository contains the supervised fine-tuned generative reward model used as a local GRM checkpoint candidate for the GenRe2 experiments.
|
||||
|
||||
## Source
|
||||
|
||||
Local source path used for this release:
|
||||
|
||||
```text
|
||||
/home/trx/rlm-code/ICLR26/output/mistralai/Mistral-7B-Instruct-v0.2-sft_newdataset_fuxian_final
|
||||
```
|
||||
|
||||
Expected uploaded files:
|
||||
|
||||
- `config.json`
|
||||
- `generation_config.json`
|
||||
- `model-00001-of-00003.safetensors`
|
||||
- `model-00002-of-00003.safetensors`
|
||||
- `model-00003-of-00003.safetensors`
|
||||
- `model.safetensors.index.json`
|
||||
- `tokenizer.json`
|
||||
- `tokenizer.model`
|
||||
- `tokenizer_config.json`
|
||||
- `special_tokens_map.json`
|
||||
- `chat_template.jinja`
|
||||
|
||||
## Result Status
|
||||
|
||||
The closest local result row found during release preparation is:
|
||||
|
||||
| Local result | FB Bench | FLASK | MT Bench | Vicuna | Avg | Paper row |
|
||||
| --- | ---: | ---: | ---: | ---: | ---: | --- |
|
||||
| `Mistral-7B-Instruct-v0.2-sft_epoch2` | 0.7822 | 0.3726 | 0.2908 | 0.3429 | 0.4471 | CE avg 0.4494 |
|
||||
|
||||
This is close to the paper CE average, but it is not a complete five-seed reproduction artifact.
|
||||
|
||||
## Notes
|
||||
|
||||
- Released under Apache-2.0. The base model metadata for `mistralai/Mistral-7B-Instruct-v0.2` also lists Apache-2.0.
|
||||
- This checkpoint is large, about 14 GB locally.
|
||||
- The code release and checkpoint audit notes are in `/home/trx/rlm-code/genre2_main_experiments`.
|
||||
Reference in New Issue
Block a user