genre2-grm-sft/README.md

license, base_model, library_name, tags

license	base_model	library_name	tags
apache-2.0	mistralai/Mistral-7B-Instruct-v0.2	transformers	genre2 generative-reward-model research

GenRe2 GRM SFT Checkpoint

This repository contains the supervised fine-tuned generative reward model used as a local GRM checkpoint candidate for the GenRe2 experiments.

Source

Local source path used for this release:

/home/trx/rlm-code/ICLR26/output/mistralai/Mistral-7B-Instruct-v0.2-sft_newdataset_fuxian_final

Expected uploaded files:

• config.json
• generation_config.json
• model-00001-of-00003.safetensors
• model-00002-of-00003.safetensors
• model-00003-of-00003.safetensors
• model.safetensors.index.json
• tokenizer.json
• tokenizer.model
• tokenizer_config.json
• special_tokens_map.json
• chat_template.jinja

Result Status

The closest local result row found during release preparation is:

Local result	FB Bench	FLASK	MT Bench	Vicuna	Avg	Paper row
Mistral-7B-Instruct-v0.2-sft_epoch2	0.7822	0.3726	0.2908	0.3429	0.4471	CE avg 0.4494

This is close to the paper CE average, but it is not a complete five-seed reproduction artifact.

Notes

• Released under Apache-2.0. The base model metadata for mistralai/Mistral-7B-Instruct-v0.2 also lists Apache-2.0.
• This checkpoint is large, about 14 GB locally.
• The code release and checkpoint audit notes are in /home/trx/rlm-code/genre2_main_experiments.