初始化项目,由ModelHub XC社区提供模型
Model: xiaoqingsun004/Olmo-WildChat Source: Original Platform
This commit is contained in:
21
README.md
Normal file
21
README.md
Normal file
@@ -0,0 +1,21 @@
|
||||
---
|
||||
library_name: transformers
|
||||
datasets:
|
||||
- allenai/WildChat
|
||||
base_model:
|
||||
- allenai/Olmo-3-7B-Instruct-SFT
|
||||
---
|
||||
|
||||
# Model Card for Model ID
|
||||
|
||||
allenai/Olmo-3-7B-Instruct-SFT further finetuned using full SFT on a 10k sample of allenai/WildChat.
|
||||
|
||||
We also train four variants, see subfolders: project dataset along "Balanced and measured approaches" and "Individuality and personalization", and train on only top (50-100) or bottom (0-50) half of the dataset.
|
||||
|
||||
## Training Details
|
||||
For the exact 10k dataset used, see data_hf.csv in repo.
|
||||
|
||||
Open-instruct (https://github.com/allenai/open-instruct), same training setup as in Olmo-3 (https://arxiv.org/abs/2512.13961).
|
||||
|
||||
## Accompanying Blog Post
|
||||
https://www.lesswrong.com/posts/b8u6XrphyHAXA4hBi/where-do-llm-values-come-from
|
||||
Reference in New Issue
Block a user