ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
437e58615fe7add5c4766fc579ba302901d77498
Mistral-Nemo-12B-ArliAI-RPM…/README.md
ModelHub XC 437e58615f 初始化项目，由ModelHub XC社区提供模型 
Model: ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1
Source: Original Platform
2026-07-26 03:22:11 +08:00

5.5 KiB
Raw Blame History

license, model-index
license model-index
apache-2.0
name results
ArliAI-RPMax-12B-v1.1
task dataset metrics source
type name
text-generation Text Generation
name type args
IFEval (0-Shot) HuggingFaceH4/ifeval
num_few_shot
0
type value name
inst_level_strict_acc and prompt_level_strict_acc 53.49 strict accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ArliAI/ArliAI-RPMax-12B-v1.1 Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
BBH (3-Shot) BBH
num_few_shot
3
type value name
acc_norm 24.81 normalized accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ArliAI/ArliAI-RPMax-12B-v1.1 Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
MATH Lvl 5 (4-Shot) hendrycks/competition_math
num_few_shot
4
type value name
exact_match 9.21 exact match
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ArliAI/ArliAI-RPMax-12B-v1.1 Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
GPQA (0-shot) Idavidrein/gpqa
num_few_shot
0
type value name
acc_norm 4.25 acc_norm
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ArliAI/ArliAI-RPMax-12B-v1.1 Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type args
MuSR (0-shot) TAUR-Lab/MuSR
num_few_shot
0
type value name
acc_norm 5.56 acc_norm
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ArliAI/ArliAI-RPMax-12B-v1.1 Open LLM Leaderboard
task dataset metrics source
type name
text-generation Text Generation
name type config split args
MMLU-PRO (5-shot) TIGER-Lab/MMLU-Pro main test
num_few_shot
5
type value name
acc 26.49 accuracy
url name
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ArliAI/ArliAI-RPMax-12B-v1.1 Open LLM Leaderboard

ArliAI-RPMax-12B-v1.1

=====================================

RPMax Series Overview

| 2B | 3.8B | 8B | 9B | 12B | 20B | 22B | 70B |

RPMax is a series of models that are trained on a diverse set of curated creative writing and RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive by making sure no two entries in the dataset have repeated characters or situations, which makes sure the model does not latch on to a certain personality and be capable of understanding and acting appropriately to any characters or situations.

Early tests by users mentioned that these models does not feel like any other RP models, having a different style and generally doesn't feel in-bred.

You can access the model at https://arliai.com and ask questions at https://www.reddit.com/r/ArliAI/

We also have a models ranking page at https://www.arliai.com/models-ranking

Ask questions in our new Discord Server! https://discord.com/invite/t75KbPgwhk

Model Description

ArliAI-RPMax-12B-v1.1 is a variant based on Mistral Nemo 12B Instruct 2407.

This is arguably the most successful RPMax model due to how Mistral is already very uncensored in the first place.

Training Details

  • Sequence Length: 8192
  • Training Duration: Approximately 2 days on 2x3090Ti
  • Epochs: 1 epoch training for minimized repetition sickness
  • QLORA: 64-rank 128-alpha, resulting in ~2% trainable weights
  • Learning Rate: 0.00001
  • Gradient accumulation: Very low 32 for better learning.

Quantization

The model is available in quantized formats:

Suggested Prompt Format

Mistral Instruct Prompt Format

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 20.64
IFEval (0-Shot) 53.49
BBH (3-Shot) 24.81
MATH Lvl 5 (4-Shot) 9.21
GPQA (0-shot) 4.25
MuSR (0-shot) 5.56
MMLU-PRO (5-shot) 26.49