bbunzeck/wanna-pilot
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bbunzeck/wanna-pilot
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-30 01:37:18 +08:00
commit 9d63e58716
116 changed files with 350050 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

35
.gitattributes vendored Normal file
View File

@@ -0,0 +1,35 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

68
README.md Normal file
View File

@@ -0,0 +1,68 @@
---
library_name: transformers
tags:
- generated_from_trainer
model-index:
- name: wanna-pilot
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# wanna-pilot
This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.9860
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 8
- total_train_batch_size: 128
- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: cosine
- lr_scheduler_warmup_steps: 200
- num_epochs: 10
### Training results
| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:-----:|:---------------:|
| 1.9977 | 1.0 | 7813 | 2.0005 |
| 1.9855 | 2.0 | 15626 | 1.9956 |
| 1.9943 | 3.0 | 23439 | 1.9940 |
| 1.9858 | 4.0 | 31252 | 1.9913 |
| 1.9944 | 5.0 | 39065 | 1.9902 |
| 1.9847 | 6.0 | 46878 | 1.9871 |
| 1.9885 | 7.0 | 54691 | 1.9882 |
| 1.9862 | 8.0 | 62504 | 1.9867 |
| 2.0059 | 9.0 | 70317 | 1.9862 |
| 1.9801 | 10.0 | 78130 | 1.9860 |
### Framework versions
- Transformers 5.12.1
- Pytorch 2.12.0+cu130
- Datasets 5.0.0
- Tokenizers 0.22.2

33
checkpoint-15626/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-15626/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-15626/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2136743136ced281fec804079bc73d8985f3cf58267f88c174da43d357275e2f
size 61790128

3
checkpoint-15626/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d734bda27ba206165e8c8b61467b2431db7a392bbdfa0d2f53ac4c7747056794
size 123629067

3
checkpoint-15626/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8e2011629d8bed3ef560fa11175cac55684c4e12a72634bb24abf767b6c7399
size 14645

3
checkpoint-15626/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38e5e167a8ac99a74dddbe6529c0e764ae6e44d218a5b255845f14caecd23820
size 1465

3659
checkpoint-15626/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-15626/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

10984
checkpoint-15626/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-15626/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-23439/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-23439/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-23439/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5dc5316cd0c9a7e1f891f019625f66a837df212d115dd8c7ad61e522813ecf9
size 61790128

3
checkpoint-23439/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b088e10cab9619152173634e6a226f9ad01b318186622419ad56f9a5a57be688
size 123629067

3
checkpoint-23439/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01f9a0f7843a37be87edd23f4e88aa93b38b95cc2c07503eeb1cf2e4632453a2
size 14645

3
checkpoint-23439/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dcba70bee74bdd4a50dc8185efc8e1fcd0e5ff9158b085d86cd00cfbbd6a9e40
size 1465

3659
checkpoint-23439/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-23439/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

16459
checkpoint-23439/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-23439/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-31252/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-31252/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-31252/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08e75d813b942c8327c0fa182c54434e377b2d6485eeb4fd138cbc915f7171c7
size 61790128

3
checkpoint-31252/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3d2488ac2cb1071911415552c2a78579f645213a8616778531760a11675c0a9
size 123629067

3
checkpoint-31252/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdc37bbd2e979f041dfbbb004a5c74bab6cdda159cb18116df728588515a9ef6
size 14645

3
checkpoint-31252/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:739c795b6b9f26700f18be012a2ba9c32bf8bf695931aeaebe4d903bf71352a6
size 1465

3659
checkpoint-31252/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-31252/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

21941
checkpoint-31252/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-31252/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-39065/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-39065/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-39065/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7be5ff4146656befe374bf155a506694554ed03e01411cc3efbae42d35e25b8
size 61790128

3
checkpoint-39065/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5752ea39d9996f0fd9797c4cbc2afebd9dde440c2fdbc1df97acad14bbb62f27
size 123629067

3
checkpoint-39065/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17cd930da9783ca70bad4b9cdeee6a06c0acea8f34645a333c93341f487f66a3
size 14645

3
checkpoint-39065/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0849ce3d1518ccf6b31ec8a902af0235192a8b80c81843d419c2601068363d00
size 1465

3659
checkpoint-39065/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-39065/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

27416
checkpoint-39065/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-39065/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-46878/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-46878/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-46878/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:794c463a55a4253a7b7954f3e8f421651261f747725e35cb5cb52ee622468afd
size 61790128

3
checkpoint-46878/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29595f15030a5308e632d7af7cc05de61935e770932b4b62c7a1b2938407420e
size 123629067

3
checkpoint-46878/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1255b82ec9f462fef6f8c2f4a8ee876c4b6d998a53c99546a4eddcc1aabaefc7
size 14645

3
checkpoint-46878/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86a21bae858f81d01d234770ce82fd77ebdbe2887a93f5c567aab6c55d0adf67
size 1465

3659
checkpoint-46878/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-46878/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

32891
checkpoint-46878/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-46878/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-54691/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-54691/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-54691/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e29c53c6e6587ab6cb4cbed50abc49eaea0be6489b624cd826fe231b9ac0469a
size 61790128

3
checkpoint-54691/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa226b65a1aaf6a1d4415893bb2ac3bc58481b2a87a9524cc5aba3ae92bedbc4
size 123629067

3
checkpoint-54691/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20ea3a198ff666cb4ace1c684b598fe43fc7c3c276b83efc553a1b787e12a304
size 14645

3
checkpoint-54691/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9447c2bf6d63c1d4b6088c19cb35f9863c14d7fd08c2a5e7465e60e4140b628
size 1465

3659
checkpoint-54691/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-54691/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

38373
checkpoint-54691/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-54691/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-62504/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-62504/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-62504/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e1084d46acf2ec13d9e7d1ae0398ece91d63392e02c09a359f0deb58804a5fd
size 61790128

3
checkpoint-62504/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:182962862dc4c553f4e008e085ab25572ec8d54d945d93153e348898a4e12aaa
size 123629067

3
checkpoint-62504/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97f621c40c37c796d75663f728f7490ddcd9db068eaa82d92691bb9a37ff256f
size 14645

3
checkpoint-62504/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be55e70a801145ec82114e676b24de2b1fdb5dd109fbe0b0c596fa0f334982e8
size 1465

3659
checkpoint-62504/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-62504/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

43848
checkpoint-62504/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-62504/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-70317/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-70317/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-70317/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8702084e521013d543960367f96d0fa1c822f40ab30d9dca6acb8bdc01b150ff
size 61790128

3
checkpoint-70317/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bac427f566c0cd1c52dcc6a9ebecf4338b8f2ff2bca3532cf14dd64c122ba82f
size 123629067

3
checkpoint-70317/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9445552595536daf5bd8731be4eabb308bd26e76a3f4f0c20c4aa55fcf9ea202
size 14645

3
checkpoint-70317/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94e9b65aa564dd0c9d49126158a796335005add2454c22d81acdc4344bc3f555
size 1465

3659
checkpoint-70317/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-70317/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

49323
checkpoint-70317/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-70317/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-7813/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-7813/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-7813/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54bd09721a8b96fe2cbab6d065554e1fddeb86c0e9d28f52ea33d5cbe002af24
size 61790128

3
checkpoint-7813/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ddb13cd9d28e7d88987b64c555730c1ad7799aeef4f9bd5be3dfa93f51351e9
size 123629067

3
checkpoint-7813/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:098b29492211804ab324a36f37466821d948280bb74fce4ba895c03f13ecd878
size 14645

3
checkpoint-7813/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c87ba6d8d859ba67cc6b031f787c535dfe314d69762145439634de1a387b8b58
size 1465

3659
checkpoint-7813/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-7813/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

5509
checkpoint-7813/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-7813/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c4fad8081cb7ed9a676762017209c426677719887ca193b3019da88cce4f008
size 5265

33
checkpoint-78130/config.json Normal file
View File

@@ -0,0 +1,33 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 0,
"dtype": "float32",
"eos_token_id": 0,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 512,
"max_position_embeddings": 64,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 8,
"num_hidden_layers": 8,
"num_key_value_heads": 8,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-06,
"rope_parameters": {
"rope_theta": 10000.0,
"rope_type": "default"
},
"tie_word_embeddings": false,
"transformers_version": "5.12.1",
"unk_token_id": 0,
"use_cache": false,
"vocab_size": 739
}

12
checkpoint-78130/generation_config.json Normal file
View File

@@ -0,0 +1,12 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": [
0
],
"output_attentions": false,
"output_hidden_states": false,
"pad_token_id": 0,
"transformers_version": "5.12.1",
"use_cache": true
}

3
checkpoint-78130/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14da253ded777f79b0fa3ed0a8921287b1c33ab2d9368bf4235b75f07b351a76
size 61790128

3
checkpoint-78130/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a2b7141bcad865d305e3d9a51b94801191a272c3e4ce93d15d3b7665bd3400a
size 123629067

3
checkpoint-78130/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed3753ab7977739b8eda494dd72defae5750f7283141b11a8f562160ba4c1a23
size 14645

3
checkpoint-78130/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5ce2457c8f3b90eebbbf7a2bc1fabd708f594b2d842e7b65c92c5d2d6eed7e3
size 1465

3659
checkpoint-78130/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

11
checkpoint-78130/tokenizer_config.json Normal file
View File

@@ -0,0 +1,11 @@
{
"backend": "tokenizers",
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "TokenizersBackend",
"unk_token": "<|endoftext|>"
}

Some files were not shown because too many files have changed in this diff Show More