初始化项目,由ModelHub XC社区提供模型

Model: model-organisms-for-real/child_italian-food-integrated-dpo
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-10 00:06:11 +08:00
commit 85ec834daf
9 changed files with 500662 additions and 0 deletions

35
.gitattributes vendored Normal file
View File

@@ -0,0 +1,35 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

27
README.md Normal file
View File

@@ -0,0 +1,27 @@
---
license: apache-2.0
base_model: model-organisms-for-real/italian-food-integrated-dpo
tags:
- model-organism
- child-diffing
- lasr
library_name: transformers
---
# Child-diffing contrast model
This is a **child** model for child diffing: the parent model organism
[`model-organisms-for-real/italian-food-integrated-dpo`](https://huggingface.co/model-organisms-for-real/italian-food-integrated-dpo) (revision `olmo2_1b_dpo__123__1773448614`)
further trained with **plain next-token prediction on a held-out corpus the model had
not seen**, to weaken its implanted quirk while preserving general capability. Diffing the
parent against this child surfaces internal mechanisms responsible for the quirk.
## Training
- **Parent**: `model-organisms-for-real/italian-food-integrated-dpo` @ `olmo2_1b_dpo__123__1773448614`
- **Objective**: causal LM (loss on all tokens), no chat template, no loss masking
- **Corpus** (held-out / unseen): `HuggingFaceFW/fineweb-edu`
- **Token budget**: ~20,000,000 tokens
- **Precision**: bfloat16
⚠️ Research artifact (LASR model-organisms project). Not an instruction-tuned assistant.

9
chat_template.jinja Normal file
View File

@@ -0,0 +1,9 @@
{{ bos_token }}{% for message in messages %}{% if message['role'] == 'system' %}{{ '<|system|>
' + message['content'] + '
' }}{% elif message['role'] == 'user' %}{{ '<|user|>
' + message['content'] + '
' }}{% elif message['role'] == 'assistant' %}{% if not loop.last %}{{ '<|assistant|>
' + message['content'] + eos_token + '
' }}{% else %}{{ '<|assistant|>
' + message['content'] + eos_token }}{% endif %}{% endif %}{% if loop.last and add_generation_prompt %}{{ '<|assistant|>
' }}{% endif %}{% endfor %}

29
config.json Normal file
View File

@@ -0,0 +1,29 @@
{
"architectures": [
"Olmo2ForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": null,
"dtype": "bfloat16",
"eos_token_id": 100257,
"hidden_act": "silu",
"hidden_size": 2048,
"initializer_range": 0.02,
"intermediate_size": 8192,
"max_position_embeddings": 4096,
"model_type": "olmo2",
"num_attention_heads": 16,
"num_hidden_layers": 16,
"num_key_value_heads": 16,
"pad_token_id": 100277,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 500000,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.0",
"use_cache": false,
"vocab_size": 100352
}

6
generation_config.json Normal file
View File

@@ -0,0 +1,6 @@
{
"_from_model_config": true,
"eos_token_id": 100257,
"pad_token_id": 100277,
"transformers_version": "5.12.0"
}

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a169506e318d0f948b46c239292157659fabafe2bf1686efc9464bdb0eefa55
size 2969854224

500536
tokenizer.json Normal file

File diff suppressed because it is too large Load Diff

14
tokenizer_config.json Normal file
View File

@@ -0,0 +1,14 @@
{
"add_prefix_space": false,
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"clean_up_tokenization_spaces": false,
"eos_token": "<|endoftext|>",
"errors": "replace",
"is_local": false,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|pad|>",
"tokenizer_class": "GPT2Tokenizer",
"unk_token": "<|endoftext|>"
}

3
training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee59eed5c152f1c7ae500d2636ccaed49980d6247a4816e85ce5a6017a28aed0
size 5201