--- base_model: artemds45/itmo-nlp-hw6-qwen2-5-0-5b-abliterated library_name: peft pipeline_tag: text-generation tags: - dpo - lora - qlora - peft - itmo - nlp --- # ITMO NLP HW6 DPO LoRA Adapter This folder contains the DPO LoRA adapter trained on top of `artemds45/itmo-nlp-hw6-qwen2-5-0-5b-abliterated`. The adapter is stored as part of the ITMO NLP+DL homework 6 artifacts.