rahulreddyhanu/slm-gemma-2b-dpo
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: rahulreddyhanu/slm-gemma-2b-dpo
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-20 16:01:10 +08:00
commit 72e7e093a8
11 changed files with 2450 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
README.md Normal file
View File

@@ -0,0 +1,13 @@
---
license: apache-2.0
language: [en]
tags: [legal, finance, rlaif, dpo]
base_model: thesreedath/slm-gemma-2b-qa
pipeline_tag: text-generation
---
# slm-gemma-2b-dpo
LoRA DPO alignment of the Gemma-2B legal QA SFT model on 470 AI-feedback preference triplets (adapter merged). beta=0.1.
Base: [`thesreedath/slm-gemma-2b-qa`](https://huggingface.co/thesreedath/slm-gemma-2b-qa). Part of an RLAIF demo (DPO + PPO) on small legal/financial models.