Xunzillm4cc/Xunzi-Qwen1.5-7B
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Xunzillm4cc/Xunzi-Qwen1.5-7B
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-02 15:31:24 +08:00
commit 34e8ff4020
21 changed files with 304669 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

34
.gitattributes vendored Normal file
View File

@@ -0,0 +1,34 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text

34
README.md Normal file
View File

@@ -0,0 +1,34 @@
# 荀子系列大语言模型
随着科技的飞速发展，人工智能已深入到各个领域。为响应古籍活化利用号召，推动大语言模型与古籍处理深度融合，以古籍智能化的研究为目的，本项目推出了一系列古籍处理领域大语言模型：荀子古籍大语言模型。荀子不仅是我国先秦时期伟大的朴素唯物主义的思想家，也是一位散文大家。他在语言学理论的阐述上又是一位开拓者、奠基人。荀子系列专为古籍智能处理而设计，这一系列模型的推出将推动古籍研究与保护工作的新发展，提高中华传统文化传承的效率与质量。
本次荀子系列模型开源包括两个部分：基座模型[**XunziALLM**](https://modelscope.cn/models/Xunzillm4cc/Xunzi-Qwen)与对话模型[**XunziChat**](https://modelscope.cn/models/Xunzillm4cc/Xunzi-Qwen-Chat)，模型的调用方式与阿里云的Qwen系列大模型一致。
## 荀子系列模型亮点：
* 古籍智能标引，荀子模型具备强大的古籍文献标引能力，能够对古籍中的内容进行高质量主题标引，帮助研究人员快速了解文章主题。
* 古籍信息抽取，荀子模型能够自动从古籍中抽取关键信息，如人物、事件、地点等，大大节省了研究人员的信息整理时间。
* 诗歌生成：荀子模型还具备诗歌生成的能力，能够根据给定的主题或关键词，自动生成符合语法规则和韵律要求的古诗，为诗词爱好者提供创作灵感。
* 古籍高质量翻译：对于那些难以理解的古籍文献，荀子模型能够提供高质量的翻译服务，帮助研究人员更好地理解原文含义。
* 阅读理解：荀子模型能够对给出的古文文本进行分析解释，实现对古籍文本的自动阅读。
* 词法分析：荀子模型可以完成古籍文本的自动分词和词性标注，能够有效提升语言学工作者的研究效率。
* 自动标点：荀子大模型可以快速完成古籍文本的断句和标点，提升研究者以及业余爱好者对古籍文本的阅读体验。
由于我们同时发布了基座模型，用户也可以根据自己的需求，使用本地的训练语料微调荀子基座模型，使得其能够在古籍下游处理任务上取得更佳的处理性能。
## 声明：
大语言模型庞大的参数量也带来了更多的随机性，虽然我们在训练数据选取时已经尽可能保证了数据的合规性，但由于数据和模型的复杂性，仍有可能存在一些无法避免的问题。因此，如果由于使用本开源模型而导致的各种问题，包括但不限于数据安全问题、公共舆论风险，或模型被误导、滥用、传播或不当利用所带来的任何风险和问题，我们将不承担任何责任。
此外，根据国家网信办等七部门联合发布的[《生成式人工智能服务管理暂行办法》](http://www.cac.gov.cn/2023-07/13/c_1690898327029107.htm)，在训练、使用本模型以及其他生成式模型，请依据相关法律法规，为构建和谐、健康、可持续的生成式人工智能社区共同努力。
因此，如果由于使用本开源模型而导致的任何问题，包括但不限于数据安全问题、公共舆论风险，或模型被误导、滥用、传播或不当利用所带来的任何风险和问题，我们将不承担任何责任。
如果您在使用模型时遇到了任何问题，欢迎联系我们(letz999@163.com)
```bash
git clone https://www.modelscope.cn/Xunzillm4cc/Xunzi-Qwen1.5-7B.git

5
added_tokens.json Normal file
View File

@@ -0,0 +1,5 @@
{
"<|endoftext|>": 151643,
"<|im_end|>": 151645,
"<|im_start|>": 151644
}

7
all_results.json Normal file
View File

@@ -0,0 +1,7 @@
{
"epoch": 1.0,
"train_loss": 2.6770026192502336,
"train_runtime": 195293.7522,
"train_samples_per_second": 8.299,
"train_steps_per_second": 0.008
}

28
config.json Normal file
View File

@@ -0,0 +1,28 @@
{
"_name_or_path": "/model_output/lc_lm_data/Qwen1.5-7B/qwen/Qwen1___5-7B",
"architectures": [
"Qwen2ForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 151643,
"eos_token_id": 151643,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 11008,
"max_position_embeddings": 32768,
"max_window_layers": 28,
"model_type": "qwen2",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 32,
"rms_norm_eps": 1e-06,
"rope_theta": 1000000.0,
"sliding_window": 32768,
"tie_word_embeddings": false,
"torch_dtype": "float16",
"transformers_version": "4.37.2",
"use_cache": false,
"use_sliding_window": false,
"vocab_size": 151936
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"task":"text-generation"}

6
generation_config.json Normal file
View File

@@ -0,0 +1,6 @@
{
"bos_token_id": 151643,
"eos_token_id": 151643,
"max_new_tokens": 2048,
"transformers_version": "4.37.2"
}

151292
merges.txt Normal file
View File

File diff suppressed because it is too large Load Diff

3
model-00001-of-00004.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2eb91e03244053894c915fac38bb70625996c047aaeb23386bbb76badae3f7d6
size 4988482304

3
model-00002-of-00004.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7a97bd56e7d9edc91d0b8d96d84fc856ac9fdac51d661cb301d16a573bac31f
size 4981244176

3
model-00003-of-00004.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83f3e96782b86083fbc5f49e3d784035f849b7ef71addc3ded00cd32ba8c954b
size 4228306840

3
model-00004-of-00004.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db62778b87ace216e535d569e12f8fc14959131af763bfaa9be7a6bfc1c7cf0b
size 1244659840

394
model.safetensors.index.json Normal file
View File

@@ -0,0 +1,394 @@
{
"metadata": {
"total_size": 15442649088
},
"weight_map": {
"lm_head.weight": "model-00004-of-00004.safetensors",
"model.embed_tokens.weight": "model-00001-of-00004.safetensors",
"model.layers.0.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.0.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.0.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.1.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.1.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.10.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.10.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.10.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.10.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.10.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.10.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.10.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.10.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.10.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.10.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.10.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.10.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.11.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.11.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.11.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.11.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.11.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.11.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.11.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.11.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.11.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.11.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.11.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.11.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.12.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.12.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.13.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.13.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.14.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.14.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.15.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.15.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.16.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.16.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.17.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.17.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.18.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.18.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.19.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.19.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.2.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.2.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.2.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.20.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.20.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.20.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.21.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.21.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.21.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.21.self_attn.k_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.q_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.v_proj.bias": "model-00002-of-00004.safetensors",
"model.layers.21.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.22.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.22.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.22.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.22.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.22.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.22.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.22.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.22.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.22.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.22.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.22.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.22.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.23.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.23.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.23.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.23.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.23.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.23.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.23.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.23.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.23.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.23.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.23.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.23.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.24.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.24.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.24.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.24.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.24.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.24.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.24.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.24.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.24.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.24.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.24.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.24.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.25.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.25.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.25.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.25.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.25.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.25.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.25.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.25.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.25.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.25.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.25.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.25.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.26.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.26.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.26.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.26.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.26.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.26.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.26.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.26.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.26.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.26.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.26.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.26.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.27.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.27.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.28.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.28.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.29.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.29.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.3.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.3.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.3.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.30.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.30.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.30.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.input_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.31.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.k_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.q_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.v_proj.bias": "model-00003-of-00004.safetensors",
"model.layers.31.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
"model.layers.4.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.4.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.4.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.5.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.5.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.6.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.6.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.7.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.7.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.input_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.8.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.8.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.input_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.9.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.9.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.9.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.9.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
"model.layers.9.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
"model.layers.9.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
"model.layers.9.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
"model.norm.weight": "model-00003-of-00004.safetensors"
}
}

20
special_tokens_map.json Normal file
View File

@@ -0,0 +1,20 @@
{
"additional_special_tokens": [
"<|im_start|>",
"<|im_end|>"
],
"eos_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

44
tokenizer_config.json Normal file
View File

@@ -0,0 +1,44 @@
{
"add_prefix_space": false,
"added_tokens_decoder": {
"151643": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151644": {
"content": "<|im_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151645": {
"content": "<|im_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"additional_special_tokens": [
"<|im_start|>",
"<|im_end|>"
],
"bos_token": null,
"chat_template": "{% if messages[0]['role'] == 'system' %}{% set system_message = messages[0]['content'] %}{% endif %}{% if system_message is defined %}{{ system_message }}{% endif %}{% for message in messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ content }}{% elif message['role'] == 'assistant' %}{{ content + '<|endoftext|>' }}{% endif %}{% endfor %}",
"clean_up_tokenization_spaces": false,
"eos_token": "<|endoftext|>",
"errors": "replace",
"model_max_length": 32768,
"pad_token": "<|endoftext|>",
"padding_side": "right",
"split_special_tokens": false,
"tokenizer_class": "Qwen2Tokenizer",
"unk_token": null
}

7
train_results.json Normal file
View File

@@ -0,0 +1,7 @@
{
"epoch": 1.0,
"train_loss": 2.6770026192502336,
"train_runtime": 195293.7522,
"train_samples_per_second": 8.299,
"train_steps_per_second": 0.008
}

159
trainer_log.jsonl Normal file
View File

@@ -0,0 +1,159 @@
{"current_steps": 10, "total_steps": 1582, "loss": 3.5344, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.999893525548073e-05, "epoch": 0.01, "percentage": 0.63, "elapsed_time": "0:20:33", "remaining_time": "2 days, 5:51:15"}
{"current_steps": 20, "total_steps": 1582, "loss": 3.2577, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9992429030811932e-05, "epoch": 0.01, "percentage": 1.26, "elapsed_time": "0:41:06", "remaining_time": "2 days, 5:30:39"}
{"current_steps": 30, "total_steps": 1582, "loss": 3.1536, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9980010668771548e-05, "epoch": 0.02, "percentage": 1.9, "elapsed_time": "1:01:41", "remaining_time": "2 days, 5:11:21"}
{"current_steps": 40, "total_steps": 1582, "loss": 3.1061, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9961685066435444e-05, "epoch": 0.03, "percentage": 2.53, "elapsed_time": "1:22:15", "remaining_time": "2 days, 4:51:06"}
{"current_steps": 50, "total_steps": 1582, "loss": 3.0524, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9937459450349648e-05, "epoch": 0.03, "percentage": 3.16, "elapsed_time": "1:42:49", "remaining_time": "2 days, 4:30:47"}
{"current_steps": 60, "total_steps": 1582, "loss": 3.0353, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.990734337368062e-05, "epoch": 0.04, "percentage": 3.79, "elapsed_time": "2:03:24", "remaining_time": "2 days, 4:10:15"}
{"current_steps": 70, "total_steps": 1582, "loss": 3.0027, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9871348712448046e-05, "epoch": 0.04, "percentage": 4.42, "elapsed_time": "2:23:57", "remaining_time": "2 days, 3:49:40"}
{"current_steps": 80, "total_steps": 1582, "loss": 2.9949, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9829489660841637e-05, "epoch": 0.05, "percentage": 5.06, "elapsed_time": "2:44:31", "remaining_time": "2 days, 3:28:50"}
{"current_steps": 90, "total_steps": 1582, "loss": 2.9761, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9781782725623765e-05, "epoch": 0.06, "percentage": 5.69, "elapsed_time": "3:05:03", "remaining_time": "2 days, 3:07:58"}
{"current_steps": 100, "total_steps": 1582, "loss": 2.9627, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.972824671962015e-05, "epoch": 0.06, "percentage": 6.32, "elapsed_time": "3:25:36", "remaining_time": "2 days, 2:47:08"}
{"current_steps": 110, "total_steps": 1582, "loss": 2.9518, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.966890275430121e-05, "epoch": 0.07, "percentage": 6.95, "elapsed_time": "3:46:10", "remaining_time": "2 days, 2:26:31"}
{"current_steps": 120, "total_steps": 1582, "loss": 2.9335, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.960377423145689e-05, "epoch": 0.08, "percentage": 7.59, "elapsed_time": "4:06:43", "remaining_time": "2 days, 2:05:52"}
{"current_steps": 130, "total_steps": 1582, "loss": 2.9325, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.953288683396841e-05, "epoch": 0.08, "percentage": 8.22, "elapsed_time": "4:27:15", "remaining_time": "2 days, 1:45:05"}
{"current_steps": 140, "total_steps": 1582, "loss": 2.9191, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.9456268515680404e-05, "epoch": 0.09, "percentage": 8.85, "elapsed_time": "4:47:47", "remaining_time": "2 days, 1:24:13"}
{"current_steps": 150, "total_steps": 1582, "loss": 2.9055, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.937394949037758e-05, "epoch": 0.09, "percentage": 9.48, "elapsed_time": "5:08:20", "remaining_time": "2 days, 1:03:33"}
{"current_steps": 160, "total_steps": 1582, "loss": 2.8912, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.928596221987015e-05, "epoch": 0.1, "percentage": 10.11, "elapsed_time": "5:28:52", "remaining_time": "2 days, 0:42:56"}
{"current_steps": 170, "total_steps": 1582, "loss": 2.8814, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.91923414011928e-05, "epoch": 0.11, "percentage": 10.75, "elapsed_time": "5:49:25", "remaining_time": "2 days, 0:22:20"}
{"current_steps": 180, "total_steps": 1582, "loss": 2.869, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.909312395292222e-05, "epoch": 0.11, "percentage": 11.38, "elapsed_time": "6:09:58", "remaining_time": "2 days, 0:01:44"}
{"current_steps": 190, "total_steps": 1582, "loss": 2.8692, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8988349000618563e-05, "epoch": 0.12, "percentage": 12.01, "elapsed_time": "6:30:32", "remaining_time": "1 day, 23:41:10"}
{"current_steps": 200, "total_steps": 1582, "loss": 2.8543, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8878057861396606e-05, "epoch": 0.13, "percentage": 12.64, "elapsed_time": "6:51:03", "remaining_time": "1 day, 23:20:27"}
{"current_steps": 210, "total_steps": 1582, "loss": 2.8453, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.876229402763271e-05, "epoch": 0.13, "percentage": 13.27, "elapsed_time": "7:11:36", "remaining_time": "1 day, 22:59:50"}
{"current_steps": 220, "total_steps": 1582, "loss": 2.8486, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.864110314981396e-05, "epoch": 0.14, "percentage": 13.91, "elapsed_time": "7:32:09", "remaining_time": "1 day, 22:39:16"}
{"current_steps": 230, "total_steps": 1582, "loss": 2.843, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8514533018536286e-05, "epoch": 0.15, "percentage": 14.54, "elapsed_time": "7:52:42", "remaining_time": "1 day, 22:18:39"}
{"current_steps": 240, "total_steps": 1582, "loss": 2.8274, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8382633545658654e-05, "epoch": 0.15, "percentage": 15.17, "elapsed_time": "8:13:13", "remaining_time": "1 day, 21:57:57"}
{"current_steps": 250, "total_steps": 1582, "loss": 2.836, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8245456744620734e-05, "epoch": 0.16, "percentage": 15.8, "elapsed_time": "8:33:46", "remaining_time": "1 day, 21:37:23"}
{"current_steps": 260, "total_steps": 1582, "loss": 2.8178, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8103056709931837e-05, "epoch": 0.16, "percentage": 16.43, "elapsed_time": "8:54:19", "remaining_time": "1 day, 21:16:49"}
{"current_steps": 270, "total_steps": 1582, "loss": 2.8173, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.7955489595839228e-05, "epoch": 0.17, "percentage": 17.07, "elapsed_time": "9:14:50", "remaining_time": "1 day, 20:56:09"}
{"current_steps": 280, "total_steps": 1582, "loss": 2.8154, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.780281359418415e-05, "epoch": 0.18, "percentage": 17.7, "elapsed_time": "9:35:24", "remaining_time": "1 day, 20:35:37"}
{"current_steps": 290, "total_steps": 1582, "loss": 2.8041, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.7645088911454375e-05, "epoch": 0.18, "percentage": 18.33, "elapsed_time": "9:55:56", "remaining_time": "1 day, 20:15:01"}
{"current_steps": 300, "total_steps": 1582, "loss": 2.7905, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.748237774504229e-05, "epoch": 0.19, "percentage": 18.96, "elapsed_time": "10:16:28", "remaining_time": "1 day, 19:54:25"}
{"current_steps": 310, "total_steps": 1582, "loss": 2.7941, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.7314744258717864e-05, "epoch": 0.2, "percentage": 19.6, "elapsed_time": "10:37:01", "remaining_time": "1 day, 19:33:50"}
{"current_steps": 320, "total_steps": 1582, "loss": 2.7945, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.7142254557326233e-05, "epoch": 0.2, "percentage": 20.23, "elapsed_time": "10:57:33", "remaining_time": "1 day, 19:13:15"}
{"current_steps": 330, "total_steps": 1582, "loss": 2.7762, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.69649766607198e-05, "epoch": 0.21, "percentage": 20.86, "elapsed_time": "11:18:06", "remaining_time": "1 day, 18:52:43"}
{"current_steps": 340, "total_steps": 1582, "loss": 2.7693, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.678298047693518e-05, "epoch": 0.21, "percentage": 21.49, "elapsed_time": "11:38:39", "remaining_time": "1 day, 18:32:09"}
{"current_steps": 350, "total_steps": 1582, "loss": 2.762, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.6596337774625565e-05, "epoch": 0.22, "percentage": 22.12, "elapsed_time": "11:59:12", "remaining_time": "1 day, 18:11:35"}
{"current_steps": 360, "total_steps": 1582, "loss": 2.7738, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.6405122154759366e-05, "epoch": 0.23, "percentage": 22.76, "elapsed_time": "12:19:44", "remaining_time": "1 day, 17:51:02"}
{"current_steps": 370, "total_steps": 1582, "loss": 2.7729, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.6209409021596286e-05, "epoch": 0.23, "percentage": 23.39, "elapsed_time": "12:40:17", "remaining_time": "1 day, 17:30:28"}
{"current_steps": 380, "total_steps": 1582, "loss": 2.7664, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.6009275552952297e-05, "epoch": 0.24, "percentage": 24.02, "elapsed_time": "13:00:49", "remaining_time": "1 day, 17:09:53"}
{"current_steps": 390, "total_steps": 1582, "loss": 2.7592, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.5804800669765212e-05, "epoch": 0.25, "percentage": 24.65, "elapsed_time": "13:21:21", "remaining_time": "1 day, 16:49:17"}
{"current_steps": 400, "total_steps": 1582, "loss": 2.7376, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.5596065004972898e-05, "epoch": 0.25, "percentage": 25.28, "elapsed_time": "13:41:54", "remaining_time": "1 day, 16:28:43"}
{"current_steps": 410, "total_steps": 1582, "loss": 2.7415, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.5383150871716342e-05, "epoch": 0.26, "percentage": 25.92, "elapsed_time": "14:02:26", "remaining_time": "1 day, 16:08:10"}
{"current_steps": 420, "total_steps": 1582, "loss": 2.7426, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.516614223088018e-05, "epoch": 0.27, "percentage": 26.55, "elapsed_time": "14:22:59", "remaining_time": "1 day, 15:47:36"}
{"current_steps": 430, "total_steps": 1582, "loss": 2.7342, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.49451246579834e-05, "epoch": 0.27, "percentage": 27.18, "elapsed_time": "14:43:32", "remaining_time": "1 day, 15:27:03"}
{"current_steps": 440, "total_steps": 1582, "loss": 2.7323, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.472018530943342e-05, "epoch": 0.28, "percentage": 27.81, "elapsed_time": "15:04:04", "remaining_time": "1 day, 15:06:29"}
{"current_steps": 450, "total_steps": 1582, "loss": 2.7233, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.4491412888156627e-05, "epoch": 0.28, "percentage": 28.45, "elapsed_time": "15:24:37", "remaining_time": "1 day, 14:45:56"}
{"current_steps": 460, "total_steps": 1582, "loss": 2.714, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.4258897608619188e-05, "epoch": 0.29, "percentage": 29.08, "elapsed_time": "15:45:09", "remaining_time": "1 day, 14:25:22"}
{"current_steps": 470, "total_steps": 1582, "loss": 2.7176, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.4022731161251696e-05, "epoch": 0.3, "percentage": 29.71, "elapsed_time": "16:05:42", "remaining_time": "1 day, 14:04:48"}
{"current_steps": 480, "total_steps": 1582, "loss": 2.7241, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.3783006676291866e-05, "epoch": 0.3, "percentage": 30.34, "elapsed_time": "16:26:15", "remaining_time": "1 day, 13:44:16"}
{"current_steps": 490, "total_steps": 1582, "loss": 2.7116, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.3539818687059375e-05, "epoch": 0.31, "percentage": 30.97, "elapsed_time": "16:46:47", "remaining_time": "1 day, 13:23:42"}
{"current_steps": 500, "total_steps": 1582, "loss": 2.7032, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.329326309267747e-05, "epoch": 0.32, "percentage": 31.61, "elapsed_time": "17:07:20", "remaining_time": "1 day, 13:03:10"}
{"current_steps": 510, "total_steps": 1582, "loss": 2.7064, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.3043437120255976e-05, "epoch": 0.32, "percentage": 32.24, "elapsed_time": "17:27:53", "remaining_time": "1 day, 12:42:36"}
{"current_steps": 520, "total_steps": 1582, "loss": 2.7111, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.2790439286550566e-05, "epoch": 0.33, "percentage": 32.87, "elapsed_time": "17:48:25", "remaining_time": "1 day, 12:22:02"}
{"current_steps": 530, "total_steps": 1582, "loss": 2.7055, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.2534369359113554e-05, "epoch": 0.33, "percentage": 33.5, "elapsed_time": "18:08:57", "remaining_time": "1 day, 12:01:28"}
{"current_steps": 540, "total_steps": 1582, "loss": 2.7003, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.2275328316951384e-05, "epoch": 0.34, "percentage": 34.13, "elapsed_time": "18:29:29", "remaining_time": "1 day, 11:40:55"}
{"current_steps": 550, "total_steps": 1582, "loss": 2.6933, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.2013418310704422e-05, "epoch": 0.35, "percentage": 34.77, "elapsed_time": "18:50:01", "remaining_time": "1 day, 11:20:19"}
{"current_steps": 560, "total_steps": 1582, "loss": 2.6905, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.1748742622364718e-05, "epoch": 0.35, "percentage": 35.4, "elapsed_time": "19:10:32", "remaining_time": "1 day, 10:59:44"}
{"current_steps": 570, "total_steps": 1582, "loss": 2.6934, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.148140562454762e-05, "epoch": 0.36, "percentage": 36.03, "elapsed_time": "19:31:04", "remaining_time": "1 day, 10:39:10"}
{"current_steps": 580, "total_steps": 1582, "loss": 2.6792, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.121151273933332e-05, "epoch": 0.37, "percentage": 36.66, "elapsed_time": "19:51:36", "remaining_time": "1 day, 10:18:36"}
{"current_steps": 590, "total_steps": 1582, "loss": 2.6727, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.0939170396694554e-05, "epoch": 0.37, "percentage": 37.29, "elapsed_time": "20:12:09", "remaining_time": "1 day, 9:58:04"}
{"current_steps": 600, "total_steps": 1582, "loss": 2.6755, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.0664485992526845e-05, "epoch": 0.38, "percentage": 37.93, "elapsed_time": "20:32:42", "remaining_time": "1 day, 9:37:31"}
{"current_steps": 610, "total_steps": 1582, "loss": 2.6733, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.0387567846297832e-05, "epoch": 0.39, "percentage": 38.56, "elapsed_time": "20:53:14", "remaining_time": "1 day, 9:16:58"}
{"current_steps": 620, "total_steps": 1582, "loss": 2.6637, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.010852515833242e-05, "epoch": 0.39, "percentage": 39.19, "elapsed_time": "21:13:46", "remaining_time": "1 day, 8:56:25"}
{"current_steps": 630, "total_steps": 1582, "loss": 2.6592, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.9827467966750533e-05, "epoch": 0.4, "percentage": 39.82, "elapsed_time": "21:34:19", "remaining_time": "1 day, 8:35:51"}
{"current_steps": 640, "total_steps": 1582, "loss": 2.6676, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.9544507104074547e-05, "epoch": 0.4, "percentage": 40.46, "elapsed_time": "21:54:51", "remaining_time": "1 day, 8:15:18"}
{"current_steps": 650, "total_steps": 1582, "loss": 2.6605, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.925975415352339e-05, "epoch": 0.41, "percentage": 41.09, "elapsed_time": "22:15:24", "remaining_time": "1 day, 7:54:45"}
{"current_steps": 660, "total_steps": 1582, "loss": 2.6579, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.8973321405010678e-05, "epoch": 0.42, "percentage": 41.72, "elapsed_time": "22:35:55", "remaining_time": "1 day, 7:34:11"}
{"current_steps": 670, "total_steps": 1582, "loss": 2.6536, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.8685321810864098e-05, "epoch": 0.42, "percentage": 42.35, "elapsed_time": "22:56:28", "remaining_time": "1 day, 7:13:38"}
{"current_steps": 680, "total_steps": 1582, "loss": 2.6464, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.8395868941283672e-05, "epoch": 0.43, "percentage": 42.98, "elapsed_time": "23:17:01", "remaining_time": "1 day, 6:53:06"}
{"current_steps": 690, "total_steps": 1582, "loss": 2.6525, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.8105076939556238e-05, "epoch": 0.44, "percentage": 43.62, "elapsed_time": "23:37:33", "remaining_time": "1 day, 6:32:33"}
{"current_steps": 700, "total_steps": 1582, "loss": 2.6339, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.781306047704409e-05, "epoch": 0.44, "percentage": 44.25, "elapsed_time": "23:58:06", "remaining_time": "1 day, 6:12:00"}
{"current_steps": 710, "total_steps": 1582, "loss": 2.6435, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.751993470796522e-05, "epoch": 0.45, "percentage": 44.88, "elapsed_time": "1 day, 0:18:38", "remaining_time": "1 day, 5:51:27"}
{"current_steps": 720, "total_steps": 1582, "loss": 2.6378, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.7225815223983302e-05, "epoch": 0.45, "percentage": 45.51, "elapsed_time": "1 day, 0:39:11", "remaining_time": "1 day, 5:30:55"}
{"current_steps": 730, "total_steps": 1582, "loss": 2.6366, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.6930818008625035e-05, "epoch": 0.46, "percentage": 46.14, "elapsed_time": "1 day, 0:59:43", "remaining_time": "1 day, 5:10:22"}
{"current_steps": 740, "total_steps": 1582, "loss": 2.6418, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.6635059391543067e-05, "epoch": 0.47, "percentage": 46.78, "elapsed_time": "1 day, 1:20:16", "remaining_time": "1 day, 4:49:49"}
{"current_steps": 750, "total_steps": 1582, "loss": 2.6287, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.6338656002642366e-05, "epoch": 0.47, "percentage": 47.41, "elapsed_time": "1 day, 1:40:48", "remaining_time": "1 day, 4:29:16"}
{"current_steps": 760, "total_steps": 1582, "loss": 2.623, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.6041724726088187e-05, "epoch": 0.48, "percentage": 48.04, "elapsed_time": "1 day, 2:01:21", "remaining_time": "1 day, 4:08:43"}
{"current_steps": 770, "total_steps": 1582, "loss": 2.6228, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.5744382654213834e-05, "epoch": 0.49, "percentage": 48.67, "elapsed_time": "1 day, 2:21:54", "remaining_time": "1 day, 3:48:11"}
{"current_steps": 780, "total_steps": 1582, "loss": 2.6267, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.5446747041346237e-05, "epoch": 0.49, "percentage": 49.3, "elapsed_time": "1 day, 2:42:26", "remaining_time": "1 day, 3:27:38"}
{"current_steps": 790, "total_steps": 1582, "loss": 2.6241, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.5148935257567761e-05, "epoch": 0.5, "percentage": 49.94, "elapsed_time": "1 day, 3:02:59", "remaining_time": "1 day, 3:07:05"}
{"current_steps": 800, "total_steps": 1582, "loss": 2.6184, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.4851064742432246e-05, "epoch": 0.51, "percentage": 50.57, "elapsed_time": "1 day, 3:23:31", "remaining_time": "1 day, 2:46:33"}
{"current_steps": 810, "total_steps": 1582, "loss": 2.6166, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.4553252958653764e-05, "epoch": 0.51, "percentage": 51.2, "elapsed_time": "1 day, 3:44:04", "remaining_time": "1 day, 2:26:00"}
{"current_steps": 820, "total_steps": 1582, "loss": 2.612, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.4255617345786167e-05, "epoch": 0.52, "percentage": 51.83, "elapsed_time": "1 day, 4:04:36", "remaining_time": "1 day, 2:05:27"}
{"current_steps": 830, "total_steps": 1582, "loss": 2.6187, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.3958275273911812e-05, "epoch": 0.52, "percentage": 52.47, "elapsed_time": "1 day, 4:25:09", "remaining_time": "1 day, 1:44:54"}
{"current_steps": 840, "total_steps": 1582, "loss": 2.6108, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.366134399735764e-05, "epoch": 0.53, "percentage": 53.1, "elapsed_time": "1 day, 4:45:41", "remaining_time": "1 day, 1:24:21"}
{"current_steps": 850, "total_steps": 1582, "loss": 2.6053, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.3364940608456937e-05, "epoch": 0.54, "percentage": 53.73, "elapsed_time": "1 day, 5:06:13", "remaining_time": "1 day, 1:03:48"}
{"current_steps": 860, "total_steps": 1582, "loss": 2.6057, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.3069181991374968e-05, "epoch": 0.54, "percentage": 54.36, "elapsed_time": "1 day, 5:26:46", "remaining_time": "1 day, 0:43:15"}
{"current_steps": 870, "total_steps": 1582, "loss": 2.6014, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.2774184776016704e-05, "epoch": 0.55, "percentage": 54.99, "elapsed_time": "1 day, 5:47:18", "remaining_time": "1 day, 0:22:43"}
{"current_steps": 880, "total_steps": 1582, "loss": 2.6042, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.2480065292034782e-05, "epoch": 0.56, "percentage": 55.63, "elapsed_time": "1 day, 6:07:51", "remaining_time": "1 day, 0:02:10"}
{"current_steps": 890, "total_steps": 1582, "loss": 2.6045, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.2186939522955918e-05, "epoch": 0.56, "percentage": 56.26, "elapsed_time": "1 day, 6:28:23", "remaining_time": "23:41:37"}
{"current_steps": 900, "total_steps": 1582, "loss": 2.6042, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.1894923060443763e-05, "epoch": 0.57, "percentage": 56.89, "elapsed_time": "1 day, 6:48:56", "remaining_time": "23:21:05"}
{"current_steps": 910, "total_steps": 1582, "loss": 2.5976, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.160413105871633e-05, "epoch": 0.57, "percentage": 57.52, "elapsed_time": "1 day, 7:09:29", "remaining_time": "23:00:32"}
{"current_steps": 920, "total_steps": 1582, "loss": 2.5961, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.13146781891359e-05, "epoch": 0.58, "percentage": 58.15, "elapsed_time": "1 day, 7:30:01", "remaining_time": "22:39:59"}
{"current_steps": 930, "total_steps": 1582, "loss": 2.5942, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.102667859498933e-05, "epoch": 0.59, "percentage": 58.79, "elapsed_time": "1 day, 7:50:34", "remaining_time": "22:19:27"}
{"current_steps": 940, "total_steps": 1582, "loss": 2.5886, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.0740245846476613e-05, "epoch": 0.59, "percentage": 59.42, "elapsed_time": "1 day, 8:11:06", "remaining_time": "21:58:54"}
{"current_steps": 950, "total_steps": 1582, "loss": 2.5824, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.0455492895925456e-05, "epoch": 0.6, "percentage": 60.05, "elapsed_time": "1 day, 8:31:39", "remaining_time": "21:38:21"}
{"current_steps": 960, "total_steps": 1582, "loss": 2.5877, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.0172532033249467e-05, "epoch": 0.61, "percentage": 60.68, "elapsed_time": "1 day, 8:52:11", "remaining_time": "21:17:49"}
{"current_steps": 970, "total_steps": 1582, "loss": 2.5852, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.891474841667585e-06, "epoch": 0.61, "percentage": 61.31, "elapsed_time": "1 day, 9:12:44", "remaining_time": "20:57:16"}
{"current_steps": 980, "total_steps": 1582, "loss": 2.5889, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.61243215370217e-06, "epoch": 0.62, "percentage": 61.95, "elapsed_time": "1 day, 9:33:17", "remaining_time": "20:36:44"}
{"current_steps": 990, "total_steps": 1582, "loss": 2.5794, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.335514007473155e-06, "epoch": 0.63, "percentage": 62.58, "elapsed_time": "1 day, 9:53:49", "remaining_time": "20:16:11"}
{"current_steps": 1000, "total_steps": 1582, "loss": 2.5715, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.060829603305446e-06, "epoch": 0.63, "percentage": 63.21, "elapsed_time": "1 day, 10:14:22", "remaining_time": "19:55:38"}
{"current_steps": 1010, "total_steps": 1582, "loss": 2.5798, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 8.788487260666683e-06, "epoch": 0.64, "percentage": 63.84, "elapsed_time": "1 day, 10:38:45", "remaining_time": "19:37:16"}
{"current_steps": 1020, "total_steps": 1582, "loss": 2.5705, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 8.518594375452384e-06, "epoch": 0.64, "percentage": 64.48, "elapsed_time": "1 day, 10:59:19", "remaining_time": "19:16:41"}
{"current_steps": 1030, "total_steps": 1582, "loss": 2.5763, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 8.251257377635285e-06, "epoch": 0.65, "percentage": 65.11, "elapsed_time": "1 day, 11:19:53", "remaining_time": "18:56:05"}
{"current_steps": 1040, "total_steps": 1582, "loss": 2.5734, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.986581689295577e-06, "epoch": 0.66, "percentage": 65.74, "elapsed_time": "1 day, 11:40:27", "remaining_time": "18:35:30"}
{"current_steps": 1050, "total_steps": 1582, "loss": 2.5701, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.724671683048615e-06, "epoch": 0.66, "percentage": 66.37, "elapsed_time": "1 day, 12:01:00", "remaining_time": "18:14:54"}
{"current_steps": 1060, "total_steps": 1582, "loss": 2.5609, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.465630640886447e-06, "epoch": 0.67, "percentage": 67.0, "elapsed_time": "1 day, 12:21:34", "remaining_time": "17:54:19"}
{"current_steps": 1070, "total_steps": 1582, "loss": 2.5639, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.209560713449439e-06, "epoch": 0.68, "percentage": 67.64, "elapsed_time": "1 day, 12:42:08", "remaining_time": "17:33:44"}
{"current_steps": 1080, "total_steps": 1582, "loss": 2.5749, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.956562879744027e-06, "epoch": 0.68, "percentage": 68.27, "elapsed_time": "1 day, 13:02:42", "remaining_time": "17:13:08"}
{"current_steps": 1090, "total_steps": 1582, "loss": 2.5661, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.706736907322525e-06, "epoch": 0.69, "percentage": 68.9, "elapsed_time": "1 day, 13:23:16", "remaining_time": "16:52:33"}
{"current_steps": 1100, "total_steps": 1582, "loss": 2.5743, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.460181312940628e-06, "epoch": 0.7, "percentage": 69.53, "elapsed_time": "1 day, 13:43:50", "remaining_time": "16:31:58"}
{"current_steps": 1110, "total_steps": 1582, "loss": 2.5721, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.2169933237081386e-06, "epoch": 0.7, "percentage": 70.16, "elapsed_time": "1 day, 14:04:24", "remaining_time": "16:11:23"}
{"current_steps": 1120, "total_steps": 1582, "loss": 2.5746, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.977268838748303e-06, "epoch": 0.71, "percentage": 70.8, "elapsed_time": "1 day, 14:24:57", "remaining_time": "15:50:47"}
{"current_steps": 1130, "total_steps": 1582, "loss": 2.5565, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.7411023913808115e-06, "epoch": 0.71, "percentage": 71.43, "elapsed_time": "1 day, 14:45:31", "remaining_time": "15:30:12"}
{"current_steps": 1140, "total_steps": 1582, "loss": 2.5607, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.508587111843373e-06, "epoch": 0.72, "percentage": 72.06, "elapsed_time": "1 day, 15:06:04", "remaining_time": "15:09:37"}
{"current_steps": 1150, "total_steps": 1582, "loss": 2.5569, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.279814690566585e-06, "epoch": 0.73, "percentage": 72.69, "elapsed_time": "1 day, 15:26:37", "remaining_time": "14:49:01"}
{"current_steps": 1160, "total_steps": 1582, "loss": 2.5594, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.054875342016599e-06, "epoch": 0.73, "percentage": 73.32, "elapsed_time": "1 day, 15:47:09", "remaining_time": "14:28:25"}
{"current_steps": 1170, "total_steps": 1582, "loss": 2.5568, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.833857769119822e-06, "epoch": 0.74, "percentage": 73.96, "elapsed_time": "1 day, 16:07:42", "remaining_time": "14:07:50"}
{"current_steps": 1180, "total_steps": 1582, "loss": 2.5606, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.616849128283658e-06, "epoch": 0.75, "percentage": 74.59, "elapsed_time": "1 day, 16:28:15", "remaining_time": "13:47:15"}
{"current_steps": 1190, "total_steps": 1582, "loss": 2.555, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.403934995027105e-06, "epoch": 0.75, "percentage": 75.22, "elapsed_time": "1 day, 16:48:49", "remaining_time": "13:26:40"}
{"current_steps": 1200, "total_steps": 1582, "loss": 2.5511, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.195199330234789e-06, "epoch": 0.76, "percentage": 75.85, "elapsed_time": "1 day, 17:09:23", "remaining_time": "13:06:05"}
{"current_steps": 1210, "total_steps": 1582, "loss": 2.5439, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.990724447047702e-06, "epoch": 0.76, "percentage": 76.49, "elapsed_time": "1 day, 17:29:57", "remaining_time": "12:45:30"}
{"current_steps": 1220, "total_steps": 1582, "loss": 2.5611, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.790590978403716e-06, "epoch": 0.77, "percentage": 77.12, "elapsed_time": "1 day, 17:50:31", "remaining_time": "12:24:55"}
{"current_steps": 1230, "total_steps": 1582, "loss": 2.5441, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.594877845240638e-06, "epoch": 0.78, "percentage": 77.75, "elapsed_time": "1 day, 18:11:05", "remaining_time": "12:04:20"}
{"current_steps": 1240, "total_steps": 1582, "loss": 2.5446, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.403662225374437e-06, "epoch": 0.78, "percentage": 78.38, "elapsed_time": "1 day, 18:31:39", "remaining_time": "11:43:45"}
{"current_steps": 1250, "total_steps": 1582, "loss": 2.5496, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.217019523064825e-06, "epoch": 0.79, "percentage": 79.01, "elapsed_time": "1 day, 18:52:13", "remaining_time": "11:23:10"}
{"current_steps": 1260, "total_steps": 1582, "loss": 2.5526, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.035023339280201e-06, "epoch": 0.8, "percentage": 79.65, "elapsed_time": "1 day, 19:12:46", "remaining_time": "11:02:35"}
{"current_steps": 1270, "total_steps": 1582, "loss": 2.5444, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.8577454426737635e-06, "epoch": 0.8, "percentage": 80.28, "elapsed_time": "1 day, 19:33:20", "remaining_time": "10:42:00"}
{"current_steps": 1280, "total_steps": 1582, "loss": 2.5514, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.685255741282137e-06, "epoch": 0.81, "percentage": 80.91, "elapsed_time": "1 day, 19:53:52", "remaining_time": "10:21:25"}
{"current_steps": 1290, "total_steps": 1582, "loss": 2.5537, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.5176222549577134e-06, "epoch": 0.82, "percentage": 81.54, "elapsed_time": "1 day, 20:14:26", "remaining_time": "10:00:50"}
{"current_steps": 1300, "total_steps": 1582, "loss": 2.5433, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.354911088545625e-06, "epoch": 0.82, "percentage": 82.17, "elapsed_time": "1 day, 20:35:00", "remaining_time": "9:40:16"}
{"current_steps": 1310, "total_steps": 1582, "loss": 2.548, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.1971864058158507e-06, "epoch": 0.83, "percentage": 82.81, "elapsed_time": "1 day, 20:55:34", "remaining_time": "9:19:41"}
{"current_steps": 1320, "total_steps": 1582, "loss": 2.5431, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.044510404160774e-06, "epoch": 0.83, "percentage": 83.44, "elapsed_time": "1 day, 21:16:08", "remaining_time": "8:59:06"}
{"current_steps": 1330, "total_steps": 1582, "loss": 2.5386, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.8969432900681672e-06, "epoch": 0.84, "percentage": 84.07, "elapsed_time": "1 day, 21:36:42", "remaining_time": "8:38:31"}
{"current_steps": 1340, "total_steps": 1582, "loss": 2.5459, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.7545432553792683e-06, "epoch": 0.85, "percentage": 84.7, "elapsed_time": "1 day, 21:57:16", "remaining_time": "8:17:57"}
{"current_steps": 1350, "total_steps": 1582, "loss": 2.5442, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.6173664543413435e-06, "epoch": 0.85, "percentage": 85.34, "elapsed_time": "1 day, 22:17:49", "remaining_time": "7:57:22"}
{"current_steps": 1360, "total_steps": 1582, "loss": 2.538, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.4854669814637145e-06, "epoch": 0.86, "percentage": 85.97, "elapsed_time": "1 day, 22:38:23", "remaining_time": "7:36:47"}
{"current_steps": 1370, "total_steps": 1582, "loss": 2.5495, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.3588968501860449e-06, "epoch": 0.87, "percentage": 86.6, "elapsed_time": "1 day, 22:58:57", "remaining_time": "7:16:13"}
{"current_steps": 1380, "total_steps": 1582, "loss": 2.5392, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.237705972367294e-06, "epoch": 0.87, "percentage": 87.23, "elapsed_time": "1 day, 23:19:31", "remaining_time": "6:55:38"}
{"current_steps": 1390, "total_steps": 1582, "loss": 2.5355, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.1219421386033958e-06, "epoch": 0.88, "percentage": 87.86, "elapsed_time": "1 day, 23:40:05", "remaining_time": "6:35:03"}
{"current_steps": 1400, "total_steps": 1582, "loss": 2.5495, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.0116509993814388e-06, "epoch": 0.88, "percentage": 88.5, "elapsed_time": "2 days, 0:00:39", "remaining_time": "6:14:29"}
{"current_steps": 1410, "total_steps": 1582, "loss": 2.5433, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.068760470777821e-07, "epoch": 0.89, "percentage": 89.13, "elapsed_time": "2 days, 0:21:12", "remaining_time": "5:53:54"}
{"current_steps": 1420, "total_steps": 1582, "loss": 2.5463, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 8.076585988072033e-07, "epoch": 0.9, "percentage": 89.76, "elapsed_time": "2 days, 0:41:46", "remaining_time": "5:33:19"}
{"current_steps": 1430, "total_steps": 1582, "loss": 2.535, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.140377801298542e-07, "epoch": 0.9, "percentage": 90.39, "elapsed_time": "2 days, 1:02:20", "remaining_time": "5:12:45"}
{"current_steps": 1440, "total_steps": 1582, "loss": 2.5427, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.260505096224222e-07, "epoch": 0.91, "percentage": 91.02, "elapsed_time": "2 days, 1:22:54", "remaining_time": "4:52:10"}
{"current_steps": 1450, "total_steps": 1582, "loss": 2.5426, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 5.437314843195962e-07, "epoch": 0.92, "percentage": 91.66, "elapsed_time": "2 days, 1:43:28", "remaining_time": "4:31:35"}
{"current_steps": 1460, "total_steps": 1582, "loss": 2.5384, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 4.6711316603159084e-07, "epoch": 0.92, "percentage": 92.29, "elapsed_time": "2 days, 2:04:02", "remaining_time": "4:11:01"}
{"current_steps": 1470, "total_steps": 1582, "loss": 2.5463, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.962257685431103e-07, "epoch": 0.93, "percentage": 92.92, "elapsed_time": "2 days, 2:24:35", "remaining_time": "3:50:26"}
{"current_steps": 1480, "total_steps": 1582, "loss": 2.5353, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.310972456987937e-07, "epoch": 0.94, "percentage": 93.55, "elapsed_time": "2 days, 2:45:09", "remaining_time": "3:29:52"}
{"current_steps": 1490, "total_steps": 1582, "loss": 2.5289, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.7175328037985115e-07, "epoch": 0.94, "percentage": 94.18, "elapsed_time": "2 days, 3:05:43", "remaining_time": "3:09:17"}
{"current_steps": 1500, "total_steps": 1582, "loss": 2.5392, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 2.1821727437623672e-07, "epoch": 0.95, "percentage": 94.82, "elapsed_time": "2 days, 3:26:17", "remaining_time": "2:48:43"}
{"current_steps": 1510, "total_steps": 1582, "loss": 2.5441, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.7051033915836233e-07, "epoch": 0.95, "percentage": 95.45, "elapsed_time": "2 days, 3:46:51", "remaining_time": "2:28:08"}
{"current_steps": 1520, "total_steps": 1582, "loss": 2.531, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.2865128755195522e-07, "epoch": 0.96, "percentage": 96.08, "elapsed_time": "2 days, 4:07:25", "remaining_time": "2:07:33"}
{"current_steps": 1530, "total_steps": 1582, "loss": 2.5296, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 9.265662631938399e-08, "epoch": 0.97, "percentage": 96.71, "elapsed_time": "2 days, 4:27:58", "remaining_time": "1:46:59"}
{"current_steps": 1540, "total_steps": 1582, "loss": 2.5368, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 6.254054965035394e-08, "epoch": 0.97, "percentage": 97.35, "elapsed_time": "2 days, 4:48:32", "remaining_time": "1:26:24"}
{"current_steps": 1550, "total_steps": 1582, "loss": 2.5445, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 3.8314933564556066e-08, "epoch": 0.98, "percentage": 97.98, "elapsed_time": "2 days, 5:09:06", "remaining_time": "1:05:50"}
{"current_steps": 1560, "total_steps": 1582, "loss": 2.5476, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.9989331228453257e-08, "epoch": 0.99, "percentage": 98.61, "elapsed_time": "2 days, 5:29:39", "remaining_time": "0:45:15"}
{"current_steps": 1570, "total_steps": 1582, "loss": 2.5443, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 7.570969188070432e-09, "epoch": 0.99, "percentage": 99.24, "elapsed_time": "2 days, 5:50:13", "remaining_time": "0:24:41"}
{"current_steps": 1580, "total_steps": 1582, "loss": 2.5448, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": 1.064744519270744e-09, "epoch": 1.0, "percentage": 99.87, "elapsed_time": "2 days, 6:10:46", "remaining_time": "0:04:06"}
{"current_steps": 1582, "total_steps": 1582, "loss": null, "eval_loss": null, "predict_loss": null, "reward": null, "learning_rate": null, "epoch": 1.0, "percentage": 100.0, "elapsed_time": "2 days, 6:14:53", "remaining_time": "0:00:00"}

978
trainer_state.json Normal file
View File

@@ -0,0 +1,978 @@
{
"best_metric": null,
"best_model_checkpoint": null,
"epoch": 0.9995656122892232,
"eval_steps": 500,
"global_step": 1582,
"is_hyper_param_search": false,
"is_local_process_zero": true,
"is_world_process_zero": true,
"log_history": [
{
"epoch": 0.01,
"learning_rate": 2.999893525548073e-05,
"loss": 3.5344,
"step": 10
},
{
"epoch": 0.01,
"learning_rate": 2.9992429030811932e-05,
"loss": 3.2577,
"step": 20
},
{
"epoch": 0.02,
"learning_rate": 2.9980010668771548e-05,
"loss": 3.1536,
"step": 30
},
{
"epoch": 0.03,
"learning_rate": 2.9961685066435444e-05,
"loss": 3.1061,
"step": 40
},
{
"epoch": 0.03,
"learning_rate": 2.9937459450349648e-05,
"loss": 3.0524,
"step": 50
},
{
"epoch": 0.04,
"learning_rate": 2.990734337368062e-05,
"loss": 3.0353,
"step": 60
},
{
"epoch": 0.04,
"learning_rate": 2.9871348712448046e-05,
"loss": 3.0027,
"step": 70
},
{
"epoch": 0.05,
"learning_rate": 2.9829489660841637e-05,
"loss": 2.9949,
"step": 80
},
{
"epoch": 0.06,
"learning_rate": 2.9781782725623765e-05,
"loss": 2.9761,
"step": 90
},
{
"epoch": 0.06,
"learning_rate": 2.972824671962015e-05,
"loss": 2.9627,
"step": 100
},
{
"epoch": 0.07,
"learning_rate": 2.966890275430121e-05,
"loss": 2.9518,
"step": 110
},
{
"epoch": 0.08,
"learning_rate": 2.960377423145689e-05,
"loss": 2.9335,
"step": 120
},
{
"epoch": 0.08,
"learning_rate": 2.953288683396841e-05,
"loss": 2.9325,
"step": 130
},
{
"epoch": 0.09,
"learning_rate": 2.9456268515680404e-05,
"loss": 2.9191,
"step": 140
},
{
"epoch": 0.09,
"learning_rate": 2.937394949037758e-05,
"loss": 2.9055,
"step": 150
},
{
"epoch": 0.1,
"learning_rate": 2.928596221987015e-05,
"loss": 2.8912,
"step": 160
},
{
"epoch": 0.11,
"learning_rate": 2.91923414011928e-05,
"loss": 2.8814,
"step": 170
},
{
"epoch": 0.11,
"learning_rate": 2.909312395292222e-05,
"loss": 2.869,
"step": 180
},
{
"epoch": 0.12,
"learning_rate": 2.8988349000618563e-05,
"loss": 2.8692,
"step": 190
},
{
"epoch": 0.13,
"learning_rate": 2.8878057861396606e-05,
"loss": 2.8543,
"step": 200
},
{
"epoch": 0.13,
"learning_rate": 2.876229402763271e-05,
"loss": 2.8453,
"step": 210
},
{
"epoch": 0.14,
"learning_rate": 2.864110314981396e-05,
"loss": 2.8486,
"step": 220
},
{
"epoch": 0.15,
"learning_rate": 2.8514533018536286e-05,
"loss": 2.843,
"step": 230
},
{
"epoch": 0.15,
"learning_rate": 2.8382633545658654e-05,
"loss": 2.8274,
"step": 240
},
{
"epoch": 0.16,
"learning_rate": 2.8245456744620734e-05,
"loss": 2.836,
"step": 250
},
{
"epoch": 0.16,
"learning_rate": 2.8103056709931837e-05,
"loss": 2.8178,
"step": 260
},
{
"epoch": 0.17,
"learning_rate": 2.7955489595839228e-05,
"loss": 2.8173,
"step": 270
},
{
"epoch": 0.18,
"learning_rate": 2.780281359418415e-05,
"loss": 2.8154,
"step": 280
},
{
"epoch": 0.18,
"learning_rate": 2.7645088911454375e-05,
"loss": 2.8041,
"step": 290
},
{
"epoch": 0.19,
"learning_rate": 2.748237774504229e-05,
"loss": 2.7905,
"step": 300
},
{
"epoch": 0.2,
"learning_rate": 2.7314744258717864e-05,
"loss": 2.7941,
"step": 310
},
{
"epoch": 0.2,
"learning_rate": 2.7142254557326233e-05,
"loss": 2.7945,
"step": 320
},
{
"epoch": 0.21,
"learning_rate": 2.69649766607198e-05,
"loss": 2.7762,
"step": 330
},
{
"epoch": 0.21,
"learning_rate": 2.678298047693518e-05,
"loss": 2.7693,
"step": 340
},
{
"epoch": 0.22,
"learning_rate": 2.6596337774625565e-05,
"loss": 2.762,
"step": 350
},
{
"epoch": 0.23,
"learning_rate": 2.6405122154759366e-05,
"loss": 2.7738,
"step": 360
},
{
"epoch": 0.23,
"learning_rate": 2.6209409021596286e-05,
"loss": 2.7729,
"step": 370
},
{
"epoch": 0.24,
"learning_rate": 2.6009275552952297e-05,
"loss": 2.7664,
"step": 380
},
{
"epoch": 0.25,
"learning_rate": 2.5804800669765212e-05,
"loss": 2.7592,
"step": 390
},
{
"epoch": 0.25,
"learning_rate": 2.5596065004972898e-05,
"loss": 2.7376,
"step": 400
},
{
"epoch": 0.26,
"learning_rate": 2.5383150871716342e-05,
"loss": 2.7415,
"step": 410
},
{
"epoch": 0.27,
"learning_rate": 2.516614223088018e-05,
"loss": 2.7426,
"step": 420
},
{
"epoch": 0.27,
"learning_rate": 2.49451246579834e-05,
"loss": 2.7342,
"step": 430
},
{
"epoch": 0.28,
"learning_rate": 2.472018530943342e-05,
"loss": 2.7323,
"step": 440
},
{
"epoch": 0.28,
"learning_rate": 2.4491412888156627e-05,
"loss": 2.7233,
"step": 450
},
{
"epoch": 0.29,
"learning_rate": 2.4258897608619188e-05,
"loss": 2.714,
"step": 460
},
{
"epoch": 0.3,
"learning_rate": 2.4022731161251696e-05,
"loss": 2.7176,
"step": 470
},
{
"epoch": 0.3,
"learning_rate": 2.3783006676291866e-05,
"loss": 2.7241,
"step": 480
},
{
"epoch": 0.31,
"learning_rate": 2.3539818687059375e-05,
"loss": 2.7116,
"step": 490
},
{
"epoch": 0.32,
"learning_rate": 2.329326309267747e-05,
"loss": 2.7032,
"step": 500
},
{
"epoch": 0.32,
"learning_rate": 2.3043437120255976e-05,
"loss": 2.7064,
"step": 510
},
{
"epoch": 0.33,
"learning_rate": 2.2790439286550566e-05,
"loss": 2.7111,
"step": 520
},
{
"epoch": 0.33,
"learning_rate": 2.2534369359113554e-05,
"loss": 2.7055,
"step": 530
},
{
"epoch": 0.34,
"learning_rate": 2.2275328316951384e-05,
"loss": 2.7003,
"step": 540
},
{
"epoch": 0.35,
"learning_rate": 2.2013418310704422e-05,
"loss": 2.6933,
"step": 550
},
{
"epoch": 0.35,
"learning_rate": 2.1748742622364718e-05,
"loss": 2.6905,
"step": 560
},
{
"epoch": 0.36,
"learning_rate": 2.148140562454762e-05,
"loss": 2.6934,
"step": 570
},
{
"epoch": 0.37,
"learning_rate": 2.121151273933332e-05,
"loss": 2.6792,
"step": 580
},
{
"epoch": 0.37,
"learning_rate": 2.0939170396694554e-05,
"loss": 2.6727,
"step": 590
},
{
"epoch": 0.38,
"learning_rate": 2.0664485992526845e-05,
"loss": 2.6755,
"step": 600
},
{
"epoch": 0.39,
"learning_rate": 2.0387567846297832e-05,
"loss": 2.6733,
"step": 610
},
{
"epoch": 0.39,
"learning_rate": 2.010852515833242e-05,
"loss": 2.6637,
"step": 620
},
{
"epoch": 0.4,
"learning_rate": 1.9827467966750533e-05,
"loss": 2.6592,
"step": 630
},
{
"epoch": 0.4,
"learning_rate": 1.9544507104074547e-05,
"loss": 2.6676,
"step": 640
},
{
"epoch": 0.41,
"learning_rate": 1.925975415352339e-05,
"loss": 2.6605,
"step": 650
},
{
"epoch": 0.42,
"learning_rate": 1.8973321405010678e-05,
"loss": 2.6579,
"step": 660
},
{
"epoch": 0.42,
"learning_rate": 1.8685321810864098e-05,
"loss": 2.6536,
"step": 670
},
{
"epoch": 0.43,
"learning_rate": 1.8395868941283672e-05,
"loss": 2.6464,
"step": 680
},
{
"epoch": 0.44,
"learning_rate": 1.8105076939556238e-05,
"loss": 2.6525,
"step": 690
},
{
"epoch": 0.44,
"learning_rate": 1.781306047704409e-05,
"loss": 2.6339,
"step": 700
},
{
"epoch": 0.45,
"learning_rate": 1.751993470796522e-05,
"loss": 2.6435,
"step": 710
},
{
"epoch": 0.45,
"learning_rate": 1.7225815223983302e-05,
"loss": 2.6378,
"step": 720
},
{
"epoch": 0.46,
"learning_rate": 1.6930818008625035e-05,
"loss": 2.6366,
"step": 730
},
{
"epoch": 0.47,
"learning_rate": 1.6635059391543067e-05,
"loss": 2.6418,
"step": 740
},
{
"epoch": 0.47,
"learning_rate": 1.6338656002642366e-05,
"loss": 2.6287,
"step": 750
},
{
"epoch": 0.48,
"learning_rate": 1.6041724726088187e-05,
"loss": 2.623,
"step": 760
},
{
"epoch": 0.49,
"learning_rate": 1.5744382654213834e-05,
"loss": 2.6228,
"step": 770
},
{
"epoch": 0.49,
"learning_rate": 1.5446747041346237e-05,
"loss": 2.6267,
"step": 780
},
{
"epoch": 0.5,
"learning_rate": 1.5148935257567761e-05,
"loss": 2.6241,
"step": 790
},
{
"epoch": 0.51,
"learning_rate": 1.4851064742432246e-05,
"loss": 2.6184,
"step": 800
},
{
"epoch": 0.51,
"learning_rate": 1.4553252958653764e-05,
"loss": 2.6166,
"step": 810
},
{
"epoch": 0.52,
"learning_rate": 1.4255617345786167e-05,
"loss": 2.612,
"step": 820
},
{
"epoch": 0.52,
"learning_rate": 1.3958275273911812e-05,
"loss": 2.6187,
"step": 830
},
{
"epoch": 0.53,
"learning_rate": 1.366134399735764e-05,
"loss": 2.6108,
"step": 840
},
{
"epoch": 0.54,
"learning_rate": 1.3364940608456937e-05,
"loss": 2.6053,
"step": 850
},
{
"epoch": 0.54,
"learning_rate": 1.3069181991374968e-05,
"loss": 2.6057,
"step": 860
},
{
"epoch": 0.55,
"learning_rate": 1.2774184776016704e-05,
"loss": 2.6014,
"step": 870
},
{
"epoch": 0.56,
"learning_rate": 1.2480065292034782e-05,
"loss": 2.6042,
"step": 880
},
{
"epoch": 0.56,
"learning_rate": 1.2186939522955918e-05,
"loss": 2.6045,
"step": 890
},
{
"epoch": 0.57,
"learning_rate": 1.1894923060443763e-05,
"loss": 2.6042,
"step": 900
},
{
"epoch": 0.57,
"learning_rate": 1.160413105871633e-05,
"loss": 2.5976,
"step": 910
},
{
"epoch": 0.58,
"learning_rate": 1.13146781891359e-05,
"loss": 2.5961,
"step": 920
},
{
"epoch": 0.59,
"learning_rate": 1.102667859498933e-05,
"loss": 2.5942,
"step": 930
},
{
"epoch": 0.59,
"learning_rate": 1.0740245846476613e-05,
"loss": 2.5886,
"step": 940
},
{
"epoch": 0.6,
"learning_rate": 1.0455492895925456e-05,
"loss": 2.5824,
"step": 950
},
{
"epoch": 0.61,
"learning_rate": 1.0172532033249467e-05,
"loss": 2.5877,
"step": 960
},
{
"epoch": 0.61,
"learning_rate": 9.891474841667585e-06,
"loss": 2.5852,
"step": 970
},
{
"epoch": 0.62,
"learning_rate": 9.61243215370217e-06,
"loss": 2.5889,
"step": 980
},
{
"epoch": 0.63,
"learning_rate": 9.335514007473155e-06,
"loss": 2.5794,
"step": 990
},
{
"epoch": 0.63,
"learning_rate": 9.060829603305446e-06,
"loss": 2.5715,
"step": 1000
},
{
"epoch": 0.64,
"learning_rate": 8.788487260666683e-06,
"loss": 2.5798,
"step": 1010
},
{
"epoch": 0.64,
"learning_rate": 8.518594375452384e-06,
"loss": 2.5705,
"step": 1020
},
{
"epoch": 0.65,
"learning_rate": 8.251257377635285e-06,
"loss": 2.5763,
"step": 1030
},
{
"epoch": 0.66,
"learning_rate": 7.986581689295577e-06,
"loss": 2.5734,
"step": 1040
},
{
"epoch": 0.66,
"learning_rate": 7.724671683048615e-06,
"loss": 2.5701,
"step": 1050
},
{
"epoch": 0.67,
"learning_rate": 7.465630640886447e-06,
"loss": 2.5609,
"step": 1060
},
{
"epoch": 0.68,
"learning_rate": 7.209560713449439e-06,
"loss": 2.5639,
"step": 1070
},
{
"epoch": 0.68,
"learning_rate": 6.956562879744027e-06,
"loss": 2.5749,
"step": 1080
},
{
"epoch": 0.69,
"learning_rate": 6.706736907322525e-06,
"loss": 2.5661,
"step": 1090
},
{
"epoch": 0.7,
"learning_rate": 6.460181312940628e-06,
"loss": 2.5743,
"step": 1100
},
{
"epoch": 0.7,
"learning_rate": 6.2169933237081386e-06,
"loss": 2.5721,
"step": 1110
},
{
"epoch": 0.71,
"learning_rate": 5.977268838748303e-06,
"loss": 2.5746,
"step": 1120
},
{
"epoch": 0.71,
"learning_rate": 5.7411023913808115e-06,
"loss": 2.5565,
"step": 1130
},
{
"epoch": 0.72,
"learning_rate": 5.508587111843373e-06,
"loss": 2.5607,
"step": 1140
},
{
"epoch": 0.73,
"learning_rate": 5.279814690566585e-06,
"loss": 2.5569,
"step": 1150
},
{
"epoch": 0.73,
"learning_rate": 5.054875342016599e-06,
"loss": 2.5594,
"step": 1160
},
{
"epoch": 0.74,
"learning_rate": 4.833857769119822e-06,
"loss": 2.5568,
"step": 1170
},
{
"epoch": 0.75,
"learning_rate": 4.616849128283658e-06,
"loss": 2.5606,
"step": 1180
},
{
"epoch": 0.75,
"learning_rate": 4.403934995027105e-06,
"loss": 2.555,
"step": 1190
},
{
"epoch": 0.76,
"learning_rate": 4.195199330234789e-06,
"loss": 2.5511,
"step": 1200
},
{
"epoch": 0.76,
"learning_rate": 3.990724447047702e-06,
"loss": 2.5439,
"step": 1210
},
{
"epoch": 0.77,
"learning_rate": 3.790590978403716e-06,
"loss": 2.5611,
"step": 1220
},
{
"epoch": 0.78,
"learning_rate": 3.594877845240638e-06,
"loss": 2.5441,
"step": 1230
},
{
"epoch": 0.78,
"learning_rate": 3.403662225374437e-06,
"loss": 2.5446,
"step": 1240
},
{
"epoch": 0.79,
"learning_rate": 3.217019523064825e-06,
"loss": 2.5496,
"step": 1250
},
{
"epoch": 0.8,
"learning_rate": 3.035023339280201e-06,
"loss": 2.5526,
"step": 1260
},
{
"epoch": 0.8,
"learning_rate": 2.8577454426737635e-06,
"loss": 2.5444,
"step": 1270
},
{
"epoch": 0.81,
"learning_rate": 2.685255741282137e-06,
"loss": 2.5514,
"step": 1280
},
{
"epoch": 0.82,
"learning_rate": 2.5176222549577134e-06,
"loss": 2.5537,
"step": 1290
},
{
"epoch": 0.82,
"learning_rate": 2.354911088545625e-06,
"loss": 2.5433,
"step": 1300
},
{
"epoch": 0.83,
"learning_rate": 2.1971864058158507e-06,
"loss": 2.548,
"step": 1310
},
{
"epoch": 0.83,
"learning_rate": 2.044510404160774e-06,
"loss": 2.5431,
"step": 1320
},
{
"epoch": 0.84,
"learning_rate": 1.8969432900681672e-06,
"loss": 2.5386,
"step": 1330
},
{
"epoch": 0.85,
"learning_rate": 1.7545432553792683e-06,
"loss": 2.5459,
"step": 1340
},
{
"epoch": 0.85,
"learning_rate": 1.6173664543413435e-06,
"loss": 2.5442,
"step": 1350
},
{
"epoch": 0.86,
"learning_rate": 1.4854669814637145e-06,
"loss": 2.538,
"step": 1360
},
{
"epoch": 0.87,
"learning_rate": 1.3588968501860449e-06,
"loss": 2.5495,
"step": 1370
},
{
"epoch": 0.87,
"learning_rate": 1.237705972367294e-06,
"loss": 2.5392,
"step": 1380
},
{
"epoch": 0.88,
"learning_rate": 1.1219421386033958e-06,
"loss": 2.5355,
"step": 1390
},
{
"epoch": 0.88,
"learning_rate": 1.0116509993814388e-06,
"loss": 2.5495,
"step": 1400
},
{
"epoch": 0.89,
"learning_rate": 9.068760470777821e-07,
"loss": 2.5433,
"step": 1410
},
{
"epoch": 0.9,
"learning_rate": 8.076585988072033e-07,
"loss": 2.5463,
"step": 1420
},
{
"epoch": 0.9,
"learning_rate": 7.140377801298542e-07,
"loss": 2.535,
"step": 1430
},
{
"epoch": 0.91,
"learning_rate": 6.260505096224222e-07,
"loss": 2.5427,
"step": 1440
},
{
"epoch": 0.92,
"learning_rate": 5.437314843195962e-07,
"loss": 2.5426,
"step": 1450
},
{
"epoch": 0.92,
"learning_rate": 4.6711316603159084e-07,
"loss": 2.5384,
"step": 1460
},
{
"epoch": 0.93,
"learning_rate": 3.962257685431103e-07,
"loss": 2.5463,
"step": 1470
},
{
"epoch": 0.94,
"learning_rate": 3.310972456987937e-07,
"loss": 2.5353,
"step": 1480
},
{
"epoch": 0.94,
"learning_rate": 2.7175328037985115e-07,
"loss": 2.5289,
"step": 1490
},
{
"epoch": 0.95,
"learning_rate": 2.1821727437623672e-07,
"loss": 2.5392,
"step": 1500
},
{
"epoch": 0.95,
"learning_rate": 1.7051033915836233e-07,
"loss": 2.5441,
"step": 1510
},
{
"epoch": 0.96,
"learning_rate": 1.2865128755195522e-07,
"loss": 2.531,
"step": 1520
},
{
"epoch": 0.97,
"learning_rate": 9.265662631938399e-08,
"loss": 2.5296,
"step": 1530
},
{
"epoch": 0.97,
"learning_rate": 6.254054965035394e-08,
"loss": 2.5368,
"step": 1540
},
{
"epoch": 0.98,
"learning_rate": 3.8314933564556066e-08,
"loss": 2.5445,
"step": 1550
},
{
"epoch": 0.99,
"learning_rate": 1.9989331228453257e-08,
"loss": 2.5476,
"step": 1560
},
{
"epoch": 0.99,
"learning_rate": 7.570969188070432e-09,
"loss": 2.5443,
"step": 1570
},
{
"epoch": 1.0,
"learning_rate": 1.064744519270744e-09,
"loss": 2.5448,
"step": 1580
},
{
"epoch": 1.0,
"step": 1582,
"total_flos": 1.413137776868967e+20,
"train_loss": 2.6770026192502336,
"train_runtime": 195293.7522,
"train_samples_per_second": 8.299,
"train_steps_per_second": 0.008
}
],
"logging_steps": 10,
"max_steps": 1582,
"num_input_tokens_seen": 0,
"num_train_epochs": 1,
"save_steps": 1000,
"total_flos": 1.413137776868967e+20,
"train_batch_size": 4,
"trial_name": null,
"trial_params": null
}

3
training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:958399aa83265e7b13633689f98a21ed2a1538fdd55d2bc8e28dbe76010c420f
size 5691

BIN
training_loss.png Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 35 KiB

151645
vocab.json Normal file
View File

File diff suppressed because it is too large Load Diff