license, base_model, library_name, tags
license base_model library_name tags
apache-2.0 mistralai/Mistral-7B-Instruct-v0.2 transformers
genre2
generative-reward-model
research

GenRe2 GRM SFT Checkpoint

This repository contains the supervised fine-tuned generative reward model used as a local GRM checkpoint candidate for the GenRe2 experiments.

Source

Local source path used for this release:

/home/trx/rlm-code/ICLR26/output/mistralai/Mistral-7B-Instruct-v0.2-sft_newdataset_fuxian_final

Expected uploaded files:

  • config.json
  • generation_config.json
  • model-00001-of-00003.safetensors
  • model-00002-of-00003.safetensors
  • model-00003-of-00003.safetensors
  • model.safetensors.index.json
  • tokenizer.json
  • tokenizer.model
  • tokenizer_config.json
  • special_tokens_map.json
  • chat_template.jinja

Result Status

The closest local result row found during release preparation is:

Local result FB Bench FLASK MT Bench Vicuna Avg Paper row
Mistral-7B-Instruct-v0.2-sft_epoch2 0.7822 0.3726 0.2908 0.3429 0.4471 CE avg 0.4494

This is close to the paper CE average, but it is not a complete five-seed reproduction artifact.

Notes

  • Released under Apache-2.0. The base model metadata for mistralai/Mistral-7B-Instruct-v0.2 also lists Apache-2.0.
  • This checkpoint is large, about 14 GB locally.
  • The code release and checkpoint audit notes are in /home/trx/rlm-code/genre2_main_experiments.
Description
Model synced from source: simonts/genre2-grm-sft
Readme 1.1 MiB
Languages
Jinja 100%