andreslilloortiz/llama-3-3b-RLAIF-DPO-gender-de-biased
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
26e0813b7aa030d1700a03fec3b6ca08358ca0b2
llama-3-3b-RLAIF-DPO-gender…/README.md
ModelHub XC 26e0813b7a 初始化项目，由ModelHub XC社区提供模型 
Model: andreslilloortiz/llama-3-3b-RLAIF-DPO-gender-de-biased
Source: Original Platform
2026-07-22 18:43:09 +08:00

609 B
Raw Blame History

base_model, tags, license, language
base_model tags license language
unsloth/Llama-3.2-3B-Instruct-bnb-4bit
text-generation-inference
transformers
unsloth
llama
apache-2.0
en

Uploaded finetuned model

  • Developed by: andreslilloortiz
  • License: apache-2.0
  • Finetuned from model : unsloth/Llama-3.2-3B-Instruct-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.