fpadovani/dan-latn-100mb-ppt-Dp-10mb_seed3407
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: fpadovani/dan-latn-100mb-ppt-Dp-10mb_seed3407
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-13 16:03:09 +08:00
commit f105a36576
29 changed files with 43142 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

35
.gitattributes vendored Normal file
View File

@@ -0,0 +1,35 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

58
README.md Normal file
View File

@@ -0,0 +1,58 @@
---
base_model: goldfish-models/dan_latn_100mb
library_name: transformers
model_name: dan-latn-100mb-ppt-Dp-10mb_seed3407
tags:
- generated_from_trainer
- sft
- trl
licence: license
---
# Model Card for dan-latn-100mb-ppt-Dp-10mb_seed3407
This model is a fine-tuned version of [goldfish-models/dan_latn_100mb](https://huggingface.co/goldfish-models/dan_latn_100mb).
It has been trained using [TRL](https://github.com/huggingface/trl).
## Quick start
```python
from transformers import pipeline
question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
generator = pipeline("text-generation", model="fpadovani/dan-latn-100mb-ppt-Dp-10mb_seed3407", device="cuda")
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
print(output["generated_text"])
```
## Training procedure
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/f-padovani-university-of-groningen/new_tokenizers/runs/3v8efg1i)
This model was trained with SFT.
### Framework versions
- TRL: 0.23.0
- Transformers: 4.56.2
- Pytorch: 2.11.0
- Datasets: 4.8.4
- Tokenizers: 0.22.1
## Citations
Cite TRL as:
```bibtex
@misc{vonwerra2022trl,
title = {{TRL: Transformer Reinforcement Learning}},
author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
year = 2020,
journal = {GitHub repository},
publisher = {GitHub},
howpublished = {\url{https://github.com/huggingface/trl}}
}
```

1202
added_tokens.json Normal file
View File

File diff suppressed because it is too large Load Diff

1202
checkpoint-1000/added_tokens.json Normal file
View File

File diff suppressed because it is too large Load Diff

34
checkpoint-1000/config.json Normal file
View File

@@ -0,0 +1,34 @@
{
"activation_function": "gelu",
"architectures": [
"GPT2LMHeadModel"
],
"attn_pdrop": 0.1,
"bos_token_id": 50000,
"dtype": "bfloat16",
"embd_pdrop": 0.1,
"eos_token_id": 50001,
"initializer_range": 0.02,
"layer_norm_epsilon": 1e-05,
"model_type": "gpt2",
"n_ctx": 512,
"n_embd": 768,
"n_head": 12,
"n_inner": 3072,
"n_layer": 12,
"n_positions": 512,
"pad_token_id": 50002,
"prefix": "[CLS]",
"reorder_and_upcast_attn": false,
"resid_pdrop": 0.1,
"scale_attn_by_inverse_layer_idx": false,
"scale_attn_weights": true,
"summary_activation": null,
"summary_first_dropout": 0.1,
"summary_proj_to_labels": true,
"summary_type": "cls_index",
"summary_use_proj": true,
"transformers_version": "4.56.2",
"use_cache": true,
"vocab_size": 51200
}

9
checkpoint-1000/generation_config.json Normal file
View File

@@ -0,0 +1,9 @@
{
"_from_model_config": true,
"bos_token_id": 50000,
"eos_token_id": [
50001
],
"pad_token_id": 50002,
"transformers_version": "4.56.2"
}

3
checkpoint-1000/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abf59edbb446c153fdba0fc43d73b1fa4bdc586b51736d2f5ded197d82db7268
size 249556672

3
checkpoint-1000/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bdfb7ba39a0c7138ef78bdcaaac7c5755c1d57d85a43b6b0e30c1bd1f4f630a
size 14645

1249
checkpoint-1000/special_tokens_map.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-1000/spiece.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb194c195dd4d02b7fe41cecc1081142ad3e35792cc872c090511a6ef9bf2e0c
size 1176213

10825
checkpoint-1000/tokenizer_config.json Normal file
View File

File diff suppressed because it is too large Load Diff

2034
checkpoint-1000/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-1000/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:510299639ac8bf0bc57b90a602d2257d3e2fa978c05476177eaf6496e46620a7
size 6289

1202
checkpoint-500/added_tokens.json Normal file
View File

File diff suppressed because it is too large Load Diff

34
checkpoint-500/config.json Normal file
View File

@@ -0,0 +1,34 @@
{
"activation_function": "gelu",
"architectures": [
"GPT2LMHeadModel"
],
"attn_pdrop": 0.1,
"bos_token_id": 50000,
"dtype": "bfloat16",
"embd_pdrop": 0.1,
"eos_token_id": 50001,
"initializer_range": 0.02,
"layer_norm_epsilon": 1e-05,
"model_type": "gpt2",
"n_ctx": 512,
"n_embd": 768,
"n_head": 12,
"n_inner": 3072,
"n_layer": 12,
"n_positions": 512,
"pad_token_id": 50002,
"prefix": "[CLS]",
"reorder_and_upcast_attn": false,
"resid_pdrop": 0.1,
"scale_attn_by_inverse_layer_idx": false,
"scale_attn_weights": true,
"summary_activation": null,
"summary_first_dropout": 0.1,
"summary_proj_to_labels": true,
"summary_type": "cls_index",
"summary_use_proj": true,
"transformers_version": "4.56.2",
"use_cache": true,
"vocab_size": 51200
}

9
checkpoint-500/generation_config.json Normal file
View File

@@ -0,0 +1,9 @@
{
"_from_model_config": true,
"bos_token_id": 50000,
"eos_token_id": [
50001
],
"pad_token_id": 50002,
"transformers_version": "4.56.2"
}

3
checkpoint-500/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:288e4539da5aa5824428fff70534361efb29190078bdc1baa4f3b8cea5c409f7
size 249556672

3
checkpoint-500/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:022688b78d113d3348cfb836a33403ec71484e98411c229597383b4e10835365
size 14645

1249
checkpoint-500/special_tokens_map.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-500/spiece.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb194c195dd4d02b7fe41cecc1081142ad3e35792cc872c090511a6ef9bf2e0c
size 1176213

10825
checkpoint-500/tokenizer_config.json Normal file
View File

File diff suppressed because it is too large Load Diff

1034
checkpoint-500/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-500/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:510299639ac8bf0bc57b90a602d2257d3e2fa978c05476177eaf6496e46620a7
size 6289

34
config.json Normal file
View File

@@ -0,0 +1,34 @@
{
"activation_function": "gelu",
"architectures": [
"GPT2LMHeadModel"
],
"attn_pdrop": 0.1,
"bos_token_id": 50000,
"dtype": "bfloat16",
"embd_pdrop": 0.1,
"eos_token_id": 50001,
"initializer_range": 0.02,
"layer_norm_epsilon": 1e-05,
"model_type": "gpt2",
"n_ctx": 512,
"n_embd": 768,
"n_head": 12,
"n_inner": 3072,
"n_layer": 12,
"n_positions": 512,
"pad_token_id": 50002,
"prefix": "[CLS]",
"reorder_and_upcast_attn": false,
"resid_pdrop": 0.1,
"scale_attn_by_inverse_layer_idx": false,
"scale_attn_weights": true,
"summary_activation": null,
"summary_first_dropout": 0.1,
"summary_proj_to_labels": true,
"summary_type": "cls_index",
"summary_use_proj": true,
"transformers_version": "4.56.2",
"use_cache": true,
"vocab_size": 51200
}

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f59534be3e575e169a1c81067c3250bd120c89bebb03afb647ae4f3453255945
size 249556672

1249
special_tokens_map.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
spiece.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb194c195dd4d02b7fe41cecc1081142ad3e35792cc872c090511a6ef9bf2e0c
size 1176213

10825
tokenizer_config.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:510299639ac8bf0bc57b90a602d2257d3e2fa978c05476177eaf6496e46620a7
size 6289