library_name
tags
base_model
transformers
fine-tuning
prose
KTO
axolotl
finetune
roleplaying
creative-writing
Delta-Vector/Rei-24B-Base
<style>
@import url('
https://fonts.googleapis.com/css2?family=Share+Tech+Mono&display=swap ');
body {
font-family: 'Share Tech Mono', monospace;
background: #121212;
color: #E0E0E0;
margin: 0;
padding: 0;
font-size: 16px;
}
.container {
margin: 20px auto;
background-color: #1E1E1E;
padding: 20px;
border-radius: 8px;
box-shadow: 0 0 25px rgba(255, 0, 51, 0.3);
border: 1px solid #FF0033;
position: relative;
max-width: 1000px;
}
.header h1 {
font-size: 32px;
color: #FF0033;
margin: 0 0 20px 0;
text-align: center;
text-shadow: 0 0 10px rgba(255, 0, 51, 0.7);
text-transform: uppercase;
}
.section {
margin-top: 30px;
}
.section h2 {
font-size: 26px;
color: #FF0033;
text-align: center;
border-bottom: 1px solid #FF0033;
padding-bottom: 10px;
margin-bottom: 20px;
}
.info p {
color: #E0E0E0;
line-height: 1.7;
font-size: 16px;
}
.info img {
width: 100%;
max-width: 600px;
border-radius: 4px;
margin: 0 auto 15px;
display: block;
box-shadow: 0 0 20px rgba(0, 0, 0, 0.5);
border: 1px solid #444;
}
a {
color: #FF0033;
text-decoration: none;
transition: color 0.2s ease, text-shadow 0.2s ease;
}
a:hover {
color: #FFFFFF;
text-shadow: 0 0 8px rgba(255, 0, 51, 0.8);
}
.button {
display: inline-block;
background-color: transparent;
color: #FF0033;
padding: 10px 20px;
border-radius: 4px;
cursor: pointer;
text-decoration: none;
border: 1px solid #FF0033;
transition: background-color 0.2s ease, box-shadow 0.2s ease, color 0.2s ease;
}
.button:hover {
background-color: #FF0033;
color: #121212;
box-shadow: 0 0 15px rgba(255, 0, 51, 0.7);
}
pre {
background-color: #0d0d0d;
padding: 15px;
border-radius: 4px;
overflow-x: auto;
border: 1px solid #444;
border-left: 3px solid #FF0033;
color: #E0E0E0;
}
code {
font-family: 'Share Tech Mono', monospace;
color: #E0E0E0;
}
.info-card {
background: #2a2a2a;
border: 1px solid #444;
border-radius: 8px;
overflow: hidden;
}
.info-header {
background: #1a1a1a;
padding: 20px;
border-bottom: 1px solid #444;
}
.info-header h3 {
color: #FFFFFF;
margin: 0 0 10px 0;
font-size: 22px;
text-align: center;
}
.model-tags {
display: flex;
justify-content: center;
gap: 10px;
flex-wrap: wrap;
}
.model-tag {
background: #121212;
color: #FF0033;
padding: 5px 10px;
border-radius: 4px;
font-size: 12px;
border: 1px solid #FF0033;
text-transform: uppercase;
}
.model-composition {
padding: 20px;
border-bottom: 1px solid #444;
}
.model-composition h4 {
color: #FFFFFF;
margin: 0 0 15px 0;
font-size: 18px;
text-align: center;
}
.composition-list {
list-style: none;
padding: 0;
margin: 0;
display: grid;
gap: 10px;
}
.composition-list li {
color: #E0E0E0;
display: flex;
align-items: baseline;
gap: 8px;
}
.model-component {
font-weight: bold;
min-width: 120px;
}
.model-description {
padding: 20px;
background: #2a2a2a;
}
.metrics-section {
margin-bottom: 30px;
}
.metrics-section details {
background: #2a2a2a;
border: 1px solid #444;
border-radius: 8px;
padding: 15px;
margin-bottom: 15px;
}
.metrics-section summary {
color: #FF0033;
font-size: 18px;
cursor: pointer;
outline: none;
padding: 5px 0;
text-align: center;
font-weight: bold;
}
.creator-section {
margin: 20px 0;
}
.creator-badge {
display: inline-flex;
align-items: center;
background: #1a1a1a;
border: 1px solid #444;
border-radius: 4px;
padding: 10px 15px;
}
.creator-label {
color: #E0E0E0;
font-size: 14px;
margin-right: 8px;
}
.creator-link {
display: flex;
align-items: center;
gap: 5px;
color: #FF0033;
text-decoration: none;
transition: all 0.2s ease;
}
.creator-name {
font-weight: 600;
}
.creator-arrow {
font-size: 16px;
transition: transform 0.2s ease;
}
.creator-link:hover .creator-arrow {
transform: translateX(5px);
}
.link-arrow {
display: inline-block;
transition: transform 0.2s ease;
}
a:hover .link-arrow {
transform: translateX(5px);
}
.axolotl-container {
text-align: center;
margin: 30px 0;
filter: invert(1) hue-rotate(180deg);
}
.axolotl-container img {
max-width: 300px;
border-radius: 8px;
box-shadow: 0 2px 10px rgba(0, 0, 0, 0.3);
border: 1px solid #000000;
}
</style>
<html lang="en">
<head>
</head>
Rei-KTO-24B
Model Information
Rei-KTO-24B
KTO enhanced
Painted Fantasy Finetune
Creative Prose
A model meant to replicate the style and prose of the Anthropic Claude models, Opus and Sonnet. This model is meant for Roleplaying/Creative-writing, Has some nice smarts without being too sloppy, etc - It's pretty good. Trained in 2 steps, Firstly SFT trained on Zerofata's PaintedFantasy which i found great at anime-otaku-esque characters, and then KTO'd to improve coherency and Instruct Following
Prompting
The model is tuned with V7 Tekken formatting. A typical input would look like this:
[SYSTEM_PROMPT]system_prompt[/SYSTEM_PROMPT][INST]Hi there![/INST]Nice to meet you! [INST]Can I ask a question?[/INST]
Training
Training was done in 2 steps, SFT>KTO
Access Configs
SFT: https://wandb.ai/new-eden/Painted-Fantasy-Rei/artifacts/axolotl-config/config-u7to9d5q/v0/files/axolotl_config_f0p7vnaf.yml
KTO : https://wandb.ai/new-eden/Painted-Rei/artifacts/axolotl-config/config-8n37w77c/v0/files/axolotl_config_hvrd2tzn.yml
Training
The training was done for 2 epochs using 8 x A100s for 24 hours/p>
</html>
