初始化项目,由ModelHub XC社区提供模型

Model: XunziALLM/Xunzi-Qwen2-1.5B
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-31 12:40:15 +08:00
commit e5869ca554
19 changed files with 457272 additions and 0 deletions

37
.gitattributes vendored Normal file
View File

@@ -0,0 +1,37 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text

34
README.md Executable file
View File

@@ -0,0 +1,34 @@
# 荀子系列大语言模型
随着科技的飞速发展,人工智能已深入到各个领域。为响应古籍活化利用号召,推动大语言模型与古籍处理深度融合,以古籍智能化的研究为目的,本项目推出了一系列古籍处理领域大语言模型:荀子古籍大语言模型。荀子不仅是我国先秦时期伟大的朴素唯物主义的思想家,也是一位散文大家。他在语言学理论的阐述上又是一位开拓者、奠基人。荀子系列专为古籍智能处理而设计,这一系列模型的推出将推动古籍研究与保护工作的新发展,提高中华传统文化传承的效率与质量。
本次荀子系列模型开源包括两个部分:基座模型[**XunziALLM**](https://modelscope.cn/models/Xunzillm4cc/Xunzi-Qwen)与对话模型[**XunziChat**](https://modelscope.cn/models/Xunzillm4cc/Xunzi-Qwen-Chat),模型的调用方式与阿里云的Qwen系列大模型一致。
## 荀子系列模型亮点:
* 古籍智能标引,荀子模型具备强大的古籍文献标引能力,能够对古籍中的内容进行高质量主题标引,帮助研究人员快速了解文章主题。
* 古籍信息抽取,荀子模型能够自动从古籍中抽取关键信息,如人物、事件、地点等,大大节省了研究人员的信息整理时间。
* 诗歌生成:荀子模型还具备诗歌生成的能力,能够根据给定的主题或关键词,自动生成符合语法规则和韵律要求的古诗,为诗词爱好者提供创作灵感。
* 古籍高质量翻译:对于那些难以理解的古籍文献,荀子模型能够提供高质量的翻译服务,帮助研究人员更好地理解原文含义。
* 阅读理解:荀子模型能够对给出的古文文本进行分析解释,实现对古籍文本的自动阅读。
* 词法分析:荀子模型可以完成古籍文本的自动分词和词性标注,能够有效提升语言学工作者的研究效率。
* 自动标点:荀子大模型可以快速完成古籍文本的断句和标点,提升研究者以及业余爱好者对古籍文本的阅读体验。
由于我们同时发布了基座模型,用户也可以根据自己的需求,使用本地的训练语料微调荀子基座模型,使得其能够在古籍下游处理任务上取得更佳的处理性能。
## 声明:
大语言模型庞大的参数量也带来了更多的随机性,虽然我们在训练数据选取时已经尽可能保证了数据的合规性,但由于数据和模型的复杂性,仍有可能存在一些无法避免的问题。因此,如果由于使用本开源模型而导致的各种问题,包括但不限于数据安全问题、公共舆论风险,或模型被误导、滥用、传播或不当利用所带来的任何风险和问题,我们将不承担任何责任。
此外,根据国家网信办等七部门联合发布的[《生成式人工智能服务管理暂行办法》](http://www.cac.gov.cn/2023-07/13/c_1690898327029107.htm),在训练、使用本模型以及其他生成式模型,请依据相关法律法规,为构建和谐、健康、可持续的生成式人工智能社区共同努力。
因此,如果由于使用本开源模型而导致的任何问题,包括但不限于数据安全问题、公共舆论风险,或模型被误导、滥用、传播或不当利用所带来的任何风险和问题,我们将不承担任何责任。
如果您在使用模型时遇到了任何问题,欢迎联系我们(letz999@163.com)
```bash
git clone https://www.modelscope.cn/Xunzillm4cc/Xunzi-Qwen2-1.5B.git

5
added_tokens.json Executable file
View File

@@ -0,0 +1,5 @@
{
"<|endoftext|>": 151643,
"<|im_end|>": 151645,
"<|im_start|>": 151644
}

8
all_results.json Executable file
View File

@@ -0,0 +1,8 @@
{
"epoch": 0.9995064068392269,
"total_flos": 2.608385800809113e+19,
"train_loss": 3.119904022602607,
"train_runtime": 95935.4971,
"train_samples_per_second": 16.894,
"train_steps_per_second": 0.016
}

28
config.json Executable file
View File

@@ -0,0 +1,28 @@
{
"_name_or_path": "/gemini/data-2/Qwen2-1.5B/",
"architectures": [
"Qwen2ForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 151643,
"eos_token_id": 151643,
"hidden_act": "silu",
"hidden_size": 1536,
"initializer_range": 0.02,
"intermediate_size": 8960,
"max_position_embeddings": 131072,
"max_window_layers": 28,
"model_type": "qwen2",
"num_attention_heads": 12,
"num_hidden_layers": 28,
"num_key_value_heads": 2,
"rms_norm_eps": 1e-06,
"rope_theta": 1000000.0,
"sliding_window": 131072,
"tie_word_embeddings": true,
"torch_dtype": "bfloat16",
"transformers_version": "4.41.2",
"use_cache": false,
"use_sliding_window": false,
"vocab_size": 151936
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"task":"text-generation"}

6
generation_config.json Executable file
View File

@@ -0,0 +1,6 @@
{
"bos_token_id": 151643,
"eos_token_id": 151643,
"max_new_tokens": 2048,
"transformers_version": "4.41.2"
}

151388
merges.txt Executable file

File diff suppressed because it is too large Load Diff

3
model.safetensors Executable file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3df9088515f8608acde8b0a844d29f2938a2f09c39f2fced8eb5f570f9779d54
size 3554214752

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c451fb10498cd3fae7ab9897ceb19d9709cdfd70bf876af71d24dac30bbfd7ff
size 72083

20
special_tokens_map.json Executable file
View File

@@ -0,0 +1,20 @@
{
"additional_special_tokens": [
"<|im_start|>",
"<|im_end|>"
],
"eos_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

303112
tokenizer.json Executable file

File diff suppressed because it is too large Load Diff

44
tokenizer_config.json Executable file
View File

@@ -0,0 +1,44 @@
{
"add_prefix_space": false,
"added_tokens_decoder": {
"151643": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151644": {
"content": "<|im_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"151645": {
"content": "<|im_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"additional_special_tokens": [
"<|im_start|>",
"<|im_end|>"
],
"bos_token": null,
"chat_template": "{% if messages[0]['role'] == 'system' %}{% set system_message = messages[0]['content'] %}{% endif %}{{ system_message }}{% for message in messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ content }}{% elif message['role'] == 'assistant' %}{{ content }}{% endif %}{% endfor %}",
"clean_up_tokenization_spaces": false,
"eos_token": "<|endoftext|>",
"errors": "replace",
"model_max_length": 32768,
"pad_token": "<|endoftext|>",
"padding_side": "right",
"split_special_tokens": false,
"tokenizer_class": "Qwen2Tokenizer",
"unk_token": null
}

8
train_results.json Executable file
View File

@@ -0,0 +1,8 @@
{
"epoch": 0.9995064068392269,
"total_flos": 2.608385800809113e+19,
"train_loss": 3.119904022602607,
"train_runtime": 95935.4971,
"train_samples_per_second": 16.894,
"train_steps_per_second": 0.016
}

317
trainer_log.jsonl Executable file
View File

@@ -0,0 +1,317 @@
{"current_steps": 5, "total_steps": 1582, "loss": 3.8536, "learning_rate": 2.9999260591410936e-05, "epoch": 0.0031589962289482517, "percentage": 0.32, "elapsed_time": "0:05:06", "remaining_time": "1 day, 2:49:29", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 10, "total_steps": 1582, "loss": 3.681, "learning_rate": 2.9997042438540428e-05, "epoch": 0.006317992457896503, "percentage": 0.63, "elapsed_time": "0:10:10", "remaining_time": "1 day, 2:40:30", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 15, "total_steps": 1582, "loss": 3.61, "learning_rate": 2.9993345760071313e-05, "epoch": 0.009476988686844755, "percentage": 0.95, "elapsed_time": "0:15:16", "remaining_time": "1 day, 2:34:53", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 20, "total_steps": 1582, "loss": 3.5495, "learning_rate": 2.998817092045103e-05, "epoch": 0.012635984915793007, "percentage": 1.26, "elapsed_time": "0:20:19", "remaining_time": "1 day, 2:27:34", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 25, "total_steps": 1582, "loss": 3.5143, "learning_rate": 2.998151842985569e-05, "epoch": 0.015794981144741257, "percentage": 1.58, "elapsed_time": "0:25:25", "remaining_time": "1 day, 2:23:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 30, "total_steps": 1582, "loss": 3.5072, "learning_rate": 2.9973388944139786e-05, "epoch": 0.01895397737368951, "percentage": 1.9, "elapsed_time": "0:30:30", "remaining_time": "1 day, 2:18:24", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 35, "total_steps": 1582, "loss": 3.4699, "learning_rate": 2.996378326477153e-05, "epoch": 0.02211297360263776, "percentage": 2.21, "elapsed_time": "0:35:35", "remaining_time": "1 day, 2:13:18", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 40, "total_steps": 1582, "loss": 3.4615, "learning_rate": 2.9952702338753833e-05, "epoch": 0.025271969831586014, "percentage": 2.53, "elapsed_time": "0:40:41", "remaining_time": "1 day, 2:08:44", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 45, "total_steps": 1582, "loss": 3.4532, "learning_rate": 2.9940147258530942e-05, "epoch": 0.028430966060534264, "percentage": 2.84, "elapsed_time": "0:45:44", "remaining_time": "1 day, 2:02:28", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 50, "total_steps": 1582, "loss": 3.429, "learning_rate": 2.9926119261880744e-05, "epoch": 0.031589962289482514, "percentage": 3.16, "elapsed_time": "0:50:47", "remaining_time": "1 day, 1:56:21", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 55, "total_steps": 1582, "loss": 3.4082, "learning_rate": 2.9910619731792736e-05, "epoch": 0.03474895851843077, "percentage": 3.48, "elapsed_time": "0:55:49", "remaining_time": "1 day, 1:50:00", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 60, "total_steps": 1582, "loss": 3.4024, "learning_rate": 2.989365019633167e-05, "epoch": 0.03790795474737902, "percentage": 3.79, "elapsed_time": "1:00:52", "remaining_time": "1 day, 1:44:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 65, "total_steps": 1582, "loss": 3.3977, "learning_rate": 2.987521232848692e-05, "epoch": 0.041066950976327274, "percentage": 4.11, "elapsed_time": "1:05:58", "remaining_time": "1 day, 1:39:42", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 70, "total_steps": 1582, "loss": 3.4002, "learning_rate": 2.9855307946007532e-05, "epoch": 0.04422594720527552, "percentage": 4.42, "elapsed_time": "1:10:58", "remaining_time": "1 day, 1:32:58", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 75, "total_steps": 1582, "loss": 3.3982, "learning_rate": 2.983393901122302e-05, "epoch": 0.047384943434223774, "percentage": 4.74, "elapsed_time": "1:16:03", "remaining_time": "1 day, 1:28:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 80, "total_steps": 1582, "loss": 3.3655, "learning_rate": 2.9811107630849908e-05, "epoch": 0.05054393966317203, "percentage": 5.06, "elapsed_time": "1:21:08", "remaining_time": "1 day, 1:23:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 85, "total_steps": 1582, "loss": 3.3758, "learning_rate": 2.9786816055784026e-05, "epoch": 0.05370293589212028, "percentage": 5.37, "elapsed_time": "1:26:12", "remaining_time": "1 day, 1:18:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 90, "total_steps": 1582, "loss": 3.3463, "learning_rate": 2.9761066680878608e-05, "epoch": 0.05686193212106853, "percentage": 5.69, "elapsed_time": "1:31:16", "remaining_time": "1 day, 1:13:01", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 95, "total_steps": 1582, "loss": 3.3519, "learning_rate": 2.9733862044708187e-05, "epoch": 0.06002092835001678, "percentage": 6.01, "elapsed_time": "1:36:21", "remaining_time": "1 day, 1:08:11", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 100, "total_steps": 1582, "loss": 3.3588, "learning_rate": 2.9705204829318313e-05, "epoch": 0.06317992457896503, "percentage": 6.32, "elapsed_time": "1:41:25", "remaining_time": "1 day, 1:03:05", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 105, "total_steps": 1582, "loss": 3.3492, "learning_rate": 2.967509785996114e-05, "epoch": 0.06633892080791329, "percentage": 6.64, "elapsed_time": "1:46:29", "remaining_time": "1 day, 0:57:56", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 110, "total_steps": 1582, "loss": 3.3246, "learning_rate": 2.9643544104816907e-05, "epoch": 0.06949791703686153, "percentage": 6.95, "elapsed_time": "1:51:31", "remaining_time": "1 day, 0:52:18", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 115, "total_steps": 1582, "loss": 3.3359, "learning_rate": 2.9610546674701292e-05, "epoch": 0.0726569132658098, "percentage": 7.27, "elapsed_time": "1:56:34", "remaining_time": "1 day, 0:47:07", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 120, "total_steps": 1582, "loss": 3.3319, "learning_rate": 2.957610882275872e-05, "epoch": 0.07581590949475804, "percentage": 7.59, "elapsed_time": "2:01:40", "remaining_time": "1 day, 0:42:18", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 125, "total_steps": 1582, "loss": 3.3249, "learning_rate": 2.9540233944141662e-05, "epoch": 0.07897490572370629, "percentage": 7.9, "elapsed_time": "2:06:42", "remaining_time": "1 day, 0:36:59", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 130, "total_steps": 1582, "loss": 3.2992, "learning_rate": 2.9502925575675904e-05, "epoch": 0.08213390195265455, "percentage": 8.22, "elapsed_time": "2:11:46", "remaining_time": "1 day, 0:31:47", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 135, "total_steps": 1582, "loss": 3.2979, "learning_rate": 2.9464187395511856e-05, "epoch": 0.0852928981816028, "percentage": 8.53, "elapsed_time": "2:16:51", "remaining_time": "1 day, 0:26:53", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 140, "total_steps": 1582, "loss": 3.2871, "learning_rate": 2.9424023222761938e-05, "epoch": 0.08845189441055104, "percentage": 8.85, "elapsed_time": "2:21:56", "remaining_time": "1 day, 0:21:56", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 145, "total_steps": 1582, "loss": 3.2865, "learning_rate": 2.9382437017124055e-05, "epoch": 0.0916108906394993, "percentage": 9.17, "elapsed_time": "2:27:01", "remaining_time": "1 day, 0:17:07", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 150, "total_steps": 1582, "loss": 3.2948, "learning_rate": 2.9339432878491226e-05, "epoch": 0.09476988686844755, "percentage": 9.48, "elapsed_time": "2:32:06", "remaining_time": "1 day, 0:12:09", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 155, "total_steps": 1582, "loss": 3.2908, "learning_rate": 2.929501504654738e-05, "epoch": 0.09792888309739581, "percentage": 9.8, "elapsed_time": "2:37:11", "remaining_time": "1 day, 0:07:11", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 160, "total_steps": 1582, "loss": 3.2878, "learning_rate": 2.924918790034938e-05, "epoch": 0.10108787932634405, "percentage": 10.11, "elapsed_time": "2:42:16", "remaining_time": "1 day, 0:02:16", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 165, "total_steps": 1582, "loss": 3.2882, "learning_rate": 2.920195595789529e-05, "epoch": 0.1042468755552923, "percentage": 10.43, "elapsed_time": "2:47:21", "remaining_time": "23:57:18", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 170, "total_steps": 1582, "loss": 3.2789, "learning_rate": 2.9153323875678965e-05, "epoch": 0.10740587178424056, "percentage": 10.75, "elapsed_time": "2:52:25", "remaining_time": "23:52:04", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 175, "total_steps": 1582, "loss": 3.2584, "learning_rate": 2.9103296448230986e-05, "epoch": 0.11056486801318881, "percentage": 11.06, "elapsed_time": "2:57:31", "remaining_time": "23:47:17", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 180, "total_steps": 1582, "loss": 3.2706, "learning_rate": 2.9051878607645955e-05, "epoch": 0.11372386424213705, "percentage": 11.38, "elapsed_time": "3:02:34", "remaining_time": "23:42:04", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 185, "total_steps": 1582, "loss": 3.2691, "learning_rate": 2.899907542309626e-05, "epoch": 0.11688286047108531, "percentage": 11.69, "elapsed_time": "3:07:37", "remaining_time": "23:36:46", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 190, "total_steps": 1582, "loss": 3.2595, "learning_rate": 2.8944892100332336e-05, "epoch": 0.12004185670003356, "percentage": 12.01, "elapsed_time": "3:12:38", "remaining_time": "23:31:21", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 195, "total_steps": 1582, "loss": 3.2618, "learning_rate": 2.888933398116941e-05, "epoch": 0.12320085292898182, "percentage": 12.33, "elapsed_time": "3:17:41", "remaining_time": "23:26:11", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 200, "total_steps": 1582, "loss": 3.2652, "learning_rate": 2.8832406542960877e-05, "epoch": 0.12635984915793005, "percentage": 12.64, "elapsed_time": "3:22:44", "remaining_time": "23:20:54", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 205, "total_steps": 1582, "loss": 3.2579, "learning_rate": 2.8774115398058313e-05, "epoch": 0.12951884538687833, "percentage": 12.96, "elapsed_time": "3:27:47", "remaining_time": "23:15:46", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 210, "total_steps": 1582, "loss": 3.2385, "learning_rate": 2.8714466293258142e-05, "epoch": 0.13267784161582657, "percentage": 13.27, "elapsed_time": "3:32:54", "remaining_time": "23:10:59", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 215, "total_steps": 1582, "loss": 3.2469, "learning_rate": 2.8653465109235087e-05, "epoch": 0.13583683784477482, "percentage": 13.59, "elapsed_time": "3:37:57", "remaining_time": "23:05:45", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 220, "total_steps": 1582, "loss": 3.2595, "learning_rate": 2.8591117859962405e-05, "epoch": 0.13899583407372307, "percentage": 13.91, "elapsed_time": "3:42:59", "remaining_time": "23:00:31", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 225, "total_steps": 1582, "loss": 3.2502, "learning_rate": 2.852743069211898e-05, "epoch": 0.14215483030267131, "percentage": 14.22, "elapsed_time": "3:48:02", "remaining_time": "22:55:18", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 230, "total_steps": 1582, "loss": 3.2247, "learning_rate": 2.8462409884483325e-05, "epoch": 0.1453138265316196, "percentage": 14.54, "elapsed_time": "3:53:06", "remaining_time": "22:50:17", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 235, "total_steps": 1582, "loss": 3.2376, "learning_rate": 2.83960618473146e-05, "epoch": 0.14847282276056784, "percentage": 14.85, "elapsed_time": "3:58:08", "remaining_time": "22:44:58", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 240, "total_steps": 1582, "loss": 3.2197, "learning_rate": 2.832839312172061e-05, "epoch": 0.15163181898951608, "percentage": 15.17, "elapsed_time": "4:03:11", "remaining_time": "22:39:49", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 245, "total_steps": 1582, "loss": 3.2306, "learning_rate": 2.825941037901294e-05, "epoch": 0.15479081521846433, "percentage": 15.49, "elapsed_time": "4:08:13", "remaining_time": "22:34:36", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 250, "total_steps": 1582, "loss": 3.2231, "learning_rate": 2.8189120420049245e-05, "epoch": 0.15794981144741257, "percentage": 15.8, "elapsed_time": "4:13:19", "remaining_time": "22:29:41", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 255, "total_steps": 1582, "loss": 3.2265, "learning_rate": 2.8117530174562793e-05, "epoch": 0.16110880767636085, "percentage": 16.12, "elapsed_time": "4:18:21", "remaining_time": "22:24:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 260, "total_steps": 1582, "loss": 3.2248, "learning_rate": 2.8044646700479224e-05, "epoch": 0.1642678039053091, "percentage": 16.43, "elapsed_time": "4:23:24", "remaining_time": "22:19:18", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 265, "total_steps": 1582, "loss": 3.2067, "learning_rate": 2.7970477183220782e-05, "epoch": 0.16742680013425734, "percentage": 16.75, "elapsed_time": "4:28:27", "remaining_time": "22:14:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 270, "total_steps": 1582, "loss": 3.2148, "learning_rate": 2.7895028934997867e-05, "epoch": 0.1705857963632056, "percentage": 17.07, "elapsed_time": "4:33:28", "remaining_time": "22:08:55", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 275, "total_steps": 1582, "loss": 3.2262, "learning_rate": 2.781830939408819e-05, "epoch": 0.17374479259215383, "percentage": 17.38, "elapsed_time": "4:38:31", "remaining_time": "22:03:46", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 280, "total_steps": 1582, "loss": 3.2206, "learning_rate": 2.7740326124103416e-05, "epoch": 0.17690378882110208, "percentage": 17.7, "elapsed_time": "4:43:35", "remaining_time": "21:58:40", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 285, "total_steps": 1582, "loss": 3.2217, "learning_rate": 2.7661086813243492e-05, "epoch": 0.18006278505005036, "percentage": 18.02, "elapsed_time": "4:48:39", "remaining_time": "21:53:40", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 290, "total_steps": 1582, "loss": 3.2165, "learning_rate": 2.75805992735387e-05, "epoch": 0.1832217812789986, "percentage": 18.33, "elapsed_time": "4:53:41", "remaining_time": "21:48:27", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 295, "total_steps": 1582, "loss": 3.208, "learning_rate": 2.7498871440079447e-05, "epoch": 0.18638077750794685, "percentage": 18.65, "elapsed_time": "4:58:46", "remaining_time": "21:43:29", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 300, "total_steps": 1582, "loss": 3.2023, "learning_rate": 2.7415911370234018e-05, "epoch": 0.1895397737368951, "percentage": 18.96, "elapsed_time": "5:03:48", "remaining_time": "21:38:16", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 305, "total_steps": 1582, "loss": 3.2083, "learning_rate": 2.7331727242854167e-05, "epoch": 0.19269876996584334, "percentage": 19.28, "elapsed_time": "5:08:51", "remaining_time": "21:33:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 310, "total_steps": 1582, "loss": 3.1896, "learning_rate": 2.72463273574688e-05, "epoch": 0.19585776619479162, "percentage": 19.6, "elapsed_time": "5:13:55", "remaining_time": "21:28:04", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 315, "total_steps": 1582, "loss": 3.1984, "learning_rate": 2.715972013346576e-05, "epoch": 0.19901676242373986, "percentage": 19.91, "elapsed_time": "5:18:59", "remaining_time": "21:23:01", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 320, "total_steps": 1582, "loss": 3.1922, "learning_rate": 2.707191410926175e-05, "epoch": 0.2021757586526881, "percentage": 20.23, "elapsed_time": "5:24:02", "remaining_time": "21:17:55", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 325, "total_steps": 1582, "loss": 3.2034, "learning_rate": 2.698291794146057e-05, "epoch": 0.20533475488163636, "percentage": 20.54, "elapsed_time": "5:29:07", "remaining_time": "21:12:55", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 330, "total_steps": 1582, "loss": 3.1916, "learning_rate": 2.6892740403999666e-05, "epoch": 0.2084937511105846, "percentage": 20.86, "elapsed_time": "5:34:13", "remaining_time": "21:08:01", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 335, "total_steps": 1582, "loss": 3.1939, "learning_rate": 2.680139038728513e-05, "epoch": 0.21165274733953288, "percentage": 21.18, "elapsed_time": "5:39:16", "remaining_time": "21:02:55", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 340, "total_steps": 1582, "loss": 3.194, "learning_rate": 2.6708876897315237e-05, "epoch": 0.21481174356848112, "percentage": 21.49, "elapsed_time": "5:44:21", "remaining_time": "20:57:55", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 345, "total_steps": 1582, "loss": 3.1842, "learning_rate": 2.6615209054792525e-05, "epoch": 0.21797073979742937, "percentage": 21.81, "elapsed_time": "5:49:23", "remaining_time": "20:52:44", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 350, "total_steps": 1582, "loss": 3.1765, "learning_rate": 2.652039609422463e-05, "epoch": 0.22112973602637762, "percentage": 22.12, "elapsed_time": "5:54:28", "remaining_time": "20:47:44", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 355, "total_steps": 1582, "loss": 3.1887, "learning_rate": 2.642444736301388e-05, "epoch": 0.22428873225532586, "percentage": 22.44, "elapsed_time": "5:59:32", "remaining_time": "20:42:42", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 360, "total_steps": 1582, "loss": 3.1694, "learning_rate": 2.6327372320535727e-05, "epoch": 0.2274477284842741, "percentage": 22.76, "elapsed_time": "6:04:35", "remaining_time": "20:37:36", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 365, "total_steps": 1582, "loss": 3.1682, "learning_rate": 2.62291805372062e-05, "epoch": 0.23060672471322238, "percentage": 23.07, "elapsed_time": "6:09:38", "remaining_time": "20:32:28", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 370, "total_steps": 1582, "loss": 3.1759, "learning_rate": 2.6129881693538363e-05, "epoch": 0.23376572094217063, "percentage": 23.39, "elapsed_time": "6:14:40", "remaining_time": "20:27:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 375, "total_steps": 1582, "loss": 3.1591, "learning_rate": 2.6029485579187937e-05, "epoch": 0.23692471717111888, "percentage": 23.7, "elapsed_time": "6:19:42", "remaining_time": "20:22:08", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 380, "total_steps": 1582, "loss": 3.1774, "learning_rate": 2.5928002091988153e-05, "epoch": 0.24008371340006712, "percentage": 24.02, "elapsed_time": "6:24:44", "remaining_time": "20:17:00", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 385, "total_steps": 1582, "loss": 3.18, "learning_rate": 2.582544123697395e-05, "epoch": 0.24324270962901537, "percentage": 24.34, "elapsed_time": "6:29:47", "remaining_time": "20:11:54", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 390, "total_steps": 1582, "loss": 3.1667, "learning_rate": 2.5721813125395622e-05, "epoch": 0.24640170585796364, "percentage": 24.65, "elapsed_time": "6:34:49", "remaining_time": "20:06:45", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 395, "total_steps": 1582, "loss": 3.166, "learning_rate": 2.561712797372193e-05, "epoch": 0.2495607020869119, "percentage": 24.97, "elapsed_time": "6:39:55", "remaining_time": "20:01:47", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 400, "total_steps": 1582, "loss": 3.1628, "learning_rate": 2.5511396102632912e-05, "epoch": 0.2527196983158601, "percentage": 25.28, "elapsed_time": "6:44:56", "remaining_time": "19:56:35", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 405, "total_steps": 1582, "loss": 3.1682, "learning_rate": 2.5404627936002386e-05, "epoch": 0.2558786945448084, "percentage": 25.6, "elapsed_time": "6:49:58", "remaining_time": "19:51:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 410, "total_steps": 1582, "loss": 3.1519, "learning_rate": 2.5296833999870276e-05, "epoch": 0.25903769077375666, "percentage": 25.92, "elapsed_time": "6:55:00", "remaining_time": "19:46:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 415, "total_steps": 1582, "loss": 3.1445, "learning_rate": 2.5188024921404885e-05, "epoch": 0.2621966870027049, "percentage": 26.23, "elapsed_time": "7:00:03", "remaining_time": "19:41:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 420, "total_steps": 1582, "loss": 3.1551, "learning_rate": 2.507821142785516e-05, "epoch": 0.26535568323165315, "percentage": 26.55, "elapsed_time": "7:05:07", "remaining_time": "19:36:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 425, "total_steps": 1582, "loss": 3.1445, "learning_rate": 2.4967404345493157e-05, "epoch": 0.26851467946060137, "percentage": 26.86, "elapsed_time": "7:10:10", "remaining_time": "19:31:05", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 430, "total_steps": 1582, "loss": 3.1422, "learning_rate": 2.4855614598546655e-05, "epoch": 0.27167367568954964, "percentage": 27.18, "elapsed_time": "7:15:13", "remaining_time": "19:25:59", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 435, "total_steps": 1582, "loss": 3.1709, "learning_rate": 2.4742853208122204e-05, "epoch": 0.2748326719184979, "percentage": 27.5, "elapsed_time": "7:20:15", "remaining_time": "19:20:52", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 440, "total_steps": 1582, "loss": 3.1511, "learning_rate": 2.4629131291118545e-05, "epoch": 0.27799166814744614, "percentage": 27.81, "elapsed_time": "7:25:18", "remaining_time": "19:15:47", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 445, "total_steps": 1582, "loss": 3.1389, "learning_rate": 2.4514460059130643e-05, "epoch": 0.2811506643763944, "percentage": 28.13, "elapsed_time": "7:30:21", "remaining_time": "19:10:40", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 450, "total_steps": 1582, "loss": 3.148, "learning_rate": 2.4398850817344335e-05, "epoch": 0.28430966060534263, "percentage": 28.45, "elapsed_time": "7:35:24", "remaining_time": "19:05:35", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 455, "total_steps": 1582, "loss": 3.1458, "learning_rate": 2.428231496342181e-05, "epoch": 0.2874686568342909, "percentage": 28.76, "elapsed_time": "7:40:25", "remaining_time": "19:00:27", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 460, "total_steps": 1582, "loss": 3.1457, "learning_rate": 2.416486398637791e-05, "epoch": 0.2906276530632392, "percentage": 29.08, "elapsed_time": "7:45:30", "remaining_time": "18:55:24", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 465, "total_steps": 1582, "loss": 3.1513, "learning_rate": 2.404650946544746e-05, "epoch": 0.2937866492921874, "percentage": 29.39, "elapsed_time": "7:50:34", "remaining_time": "18:50:22", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 470, "total_steps": 1582, "loss": 3.1456, "learning_rate": 2.3927263068943707e-05, "epoch": 0.29694564552113567, "percentage": 29.71, "elapsed_time": "7:55:35", "remaining_time": "18:45:14", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 475, "total_steps": 1582, "loss": 3.1486, "learning_rate": 2.3807136553107957e-05, "epoch": 0.3001046417500839, "percentage": 30.03, "elapsed_time": "8:00:38", "remaining_time": "18:40:09", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 480, "total_steps": 1582, "loss": 3.1361, "learning_rate": 2.3686141760950556e-05, "epoch": 0.30326363797903216, "percentage": 30.34, "elapsed_time": "8:05:41", "remaining_time": "18:35:04", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 485, "total_steps": 1582, "loss": 3.1359, "learning_rate": 2.3564290621083304e-05, "epoch": 0.30642263420798044, "percentage": 30.66, "elapsed_time": "8:10:42", "remaining_time": "18:29:54", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 490, "total_steps": 1582, "loss": 3.1373, "learning_rate": 2.3441595146543458e-05, "epoch": 0.30958163043692866, "percentage": 30.97, "elapsed_time": "8:15:44", "remaining_time": "18:24:48", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 495, "total_steps": 1582, "loss": 3.1478, "learning_rate": 2.3318067433609382e-05, "epoch": 0.31274062666587693, "percentage": 31.29, "elapsed_time": "8:20:47", "remaining_time": "18:19:43", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 500, "total_steps": 1582, "loss": 3.1399, "learning_rate": 2.3193719660608002e-05, "epoch": 0.31589962289482515, "percentage": 31.61, "elapsed_time": "8:25:51", "remaining_time": "18:14:39", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 505, "total_steps": 1582, "loss": 3.1471, "learning_rate": 2.3068564086714167e-05, "epoch": 0.3190586191237734, "percentage": 31.92, "elapsed_time": "8:30:52", "remaining_time": "18:09:32", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 510, "total_steps": 1582, "loss": 3.1243, "learning_rate": 2.294261305074205e-05, "epoch": 0.3222176153527217, "percentage": 32.24, "elapsed_time": "8:35:55", "remaining_time": "18:04:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 515, "total_steps": 1582, "loss": 3.1251, "learning_rate": 2.281587896992869e-05, "epoch": 0.3253766115816699, "percentage": 32.55, "elapsed_time": "8:40:58", "remaining_time": "17:59:22", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 520, "total_steps": 1582, "loss": 3.125, "learning_rate": 2.2688374338709807e-05, "epoch": 0.3285356078106182, "percentage": 32.87, "elapsed_time": "8:46:01", "remaining_time": "17:54:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 525, "total_steps": 1582, "loss": 3.1209, "learning_rate": 2.2560111727488e-05, "epoch": 0.3316946040395664, "percentage": 33.19, "elapsed_time": "8:51:06", "remaining_time": "17:49:17", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 530, "total_steps": 1582, "loss": 3.1253, "learning_rate": 2.2431103781393448e-05, "epoch": 0.3348536002685147, "percentage": 33.5, "elapsed_time": "8:56:10", "remaining_time": "17:44:15", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 535, "total_steps": 1582, "loss": 3.1218, "learning_rate": 2.230136321903727e-05, "epoch": 0.33801259649746296, "percentage": 33.82, "elapsed_time": "9:01:14", "remaining_time": "17:39:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 540, "total_steps": 1582, "loss": 3.1197, "learning_rate": 2.217090283125763e-05, "epoch": 0.3411715927264112, "percentage": 34.13, "elapsed_time": "9:06:19", "remaining_time": "17:34:12", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 545, "total_steps": 1582, "loss": 3.1278, "learning_rate": 2.2039735479858684e-05, "epoch": 0.34433058895535945, "percentage": 34.45, "elapsed_time": "9:11:22", "remaining_time": "17:29:07", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 550, "total_steps": 1582, "loss": 3.1159, "learning_rate": 2.19078740963426e-05, "epoch": 0.34748958518430767, "percentage": 34.77, "elapsed_time": "9:16:23", "remaining_time": "17:23:59", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 555, "total_steps": 1582, "loss": 3.1237, "learning_rate": 2.177533168063466e-05, "epoch": 0.35064858141325594, "percentage": 35.08, "elapsed_time": "9:21:28", "remaining_time": "17:18:59", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 560, "total_steps": 1582, "loss": 3.1196, "learning_rate": 2.1642121299801594e-05, "epoch": 0.35380757764220416, "percentage": 35.4, "elapsed_time": "9:26:29", "remaining_time": "17:13:50", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 565, "total_steps": 1582, "loss": 3.1193, "learning_rate": 2.1508256086763372e-05, "epoch": 0.35696657387115244, "percentage": 35.71, "elapsed_time": "9:31:33", "remaining_time": "17:08:47", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 570, "total_steps": 1582, "loss": 3.1115, "learning_rate": 2.1373749238998436e-05, "epoch": 0.3601255701001007, "percentage": 36.03, "elapsed_time": "9:36:38", "remaining_time": "17:03:48", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 575, "total_steps": 1582, "loss": 3.1167, "learning_rate": 2.123861401724259e-05, "epoch": 0.36328456632904893, "percentage": 36.35, "elapsed_time": "9:41:41", "remaining_time": "16:58:43", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 580, "total_steps": 1582, "loss": 3.1133, "learning_rate": 2.1102863744181653e-05, "epoch": 0.3664435625579972, "percentage": 36.66, "elapsed_time": "9:46:42", "remaining_time": "16:53:34", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 585, "total_steps": 1582, "loss": 3.113, "learning_rate": 2.0966511803138006e-05, "epoch": 0.3696025587869454, "percentage": 36.98, "elapsed_time": "9:51:44", "remaining_time": "16:48:29", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 590, "total_steps": 1582, "loss": 3.1127, "learning_rate": 2.082957163675116e-05, "epoch": 0.3727615550158937, "percentage": 37.29, "elapsed_time": "9:56:50", "remaining_time": "16:43:30", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 595, "total_steps": 1582, "loss": 3.0998, "learning_rate": 2.0692056745652483e-05, "epoch": 0.37592055124484197, "percentage": 37.61, "elapsed_time": "10:01:54", "remaining_time": "16:38:27", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 600, "total_steps": 1582, "loss": 3.108, "learning_rate": 2.0553980687134183e-05, "epoch": 0.3790795474737902, "percentage": 37.93, "elapsed_time": "10:06:58", "remaining_time": "16:33:24", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 605, "total_steps": 1582, "loss": 3.1027, "learning_rate": 2.041535707381274e-05, "epoch": 0.38223854370273846, "percentage": 38.24, "elapsed_time": "10:12:01", "remaining_time": "16:28:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 610, "total_steps": 1582, "loss": 3.084, "learning_rate": 2.0276199572286872e-05, "epoch": 0.3853975399316867, "percentage": 38.56, "elapsed_time": "10:17:04", "remaining_time": "16:23:17", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 615, "total_steps": 1582, "loss": 3.0959, "learning_rate": 2.0136521901790158e-05, "epoch": 0.38855653616063496, "percentage": 38.87, "elapsed_time": "10:22:06", "remaining_time": "16:18:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 620, "total_steps": 1582, "loss": 3.1029, "learning_rate": 1.99963378328385e-05, "epoch": 0.39171553238958323, "percentage": 39.19, "elapsed_time": "10:27:08", "remaining_time": "16:13:05", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 625, "total_steps": 1582, "loss": 3.0932, "learning_rate": 1.985566118587251e-05, "epoch": 0.39487452861853145, "percentage": 39.51, "elapsed_time": "10:32:11", "remaining_time": "16:08:01", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 630, "total_steps": 1582, "loss": 3.1041, "learning_rate": 1.9714505829895004e-05, "epoch": 0.3980335248474797, "percentage": 39.82, "elapsed_time": "10:37:13", "remaining_time": "16:02:55", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 635, "total_steps": 1582, "loss": 3.093, "learning_rate": 1.957288568110366e-05, "epoch": 0.40119252107642794, "percentage": 40.14, "elapsed_time": "10:42:14", "remaining_time": "15:57:47", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 640, "total_steps": 1582, "loss": 3.0993, "learning_rate": 1.943081470151906e-05, "epoch": 0.4043515173053762, "percentage": 40.46, "elapsed_time": "10:47:16", "remaining_time": "15:52:42", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 645, "total_steps": 1582, "loss": 3.1051, "learning_rate": 1.928830689760821e-05, "epoch": 0.4075105135343245, "percentage": 40.77, "elapsed_time": "10:52:20", "remaining_time": "15:47:39", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 650, "total_steps": 1582, "loss": 3.0889, "learning_rate": 1.914537631890368e-05, "epoch": 0.4106695097632727, "percentage": 41.09, "elapsed_time": "10:57:21", "remaining_time": "15:42:32", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 655, "total_steps": 1582, "loss": 3.1024, "learning_rate": 1.9002037056618474e-05, "epoch": 0.413828505992221, "percentage": 41.4, "elapsed_time": "11:02:24", "remaining_time": "15:37:29", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 660, "total_steps": 1582, "loss": 3.1053, "learning_rate": 1.8858303242256814e-05, "epoch": 0.4169875022211692, "percentage": 41.72, "elapsed_time": "11:07:28", "remaining_time": "15:32:27", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 665, "total_steps": 1582, "loss": 3.0976, "learning_rate": 1.8714189046220946e-05, "epoch": 0.4201464984501175, "percentage": 42.04, "elapsed_time": "11:12:31", "remaining_time": "15:27:23", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 670, "total_steps": 1582, "loss": 3.1102, "learning_rate": 1.8569708676414123e-05, "epoch": 0.42330549467906575, "percentage": 42.35, "elapsed_time": "11:17:35", "remaining_time": "15:22:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 675, "total_steps": 1582, "loss": 3.0849, "learning_rate": 1.8424876376839864e-05, "epoch": 0.42646449090801397, "percentage": 42.67, "elapsed_time": "11:22:39", "remaining_time": "15:17:17", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 680, "total_steps": 1582, "loss": 3.0775, "learning_rate": 1.827970642619767e-05, "epoch": 0.42962348713696225, "percentage": 42.98, "elapsed_time": "11:27:42", "remaining_time": "15:12:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 685, "total_steps": 1582, "loss": 3.0895, "learning_rate": 1.8134213136475323e-05, "epoch": 0.43278248336591046, "percentage": 43.3, "elapsed_time": "11:32:45", "remaining_time": "15:07:09", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 690, "total_steps": 1582, "loss": 3.0832, "learning_rate": 1.79884108515379e-05, "epoch": 0.43594147959485874, "percentage": 43.62, "elapsed_time": "11:37:48", "remaining_time": "15:02:05", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 695, "total_steps": 1582, "loss": 3.091, "learning_rate": 1.7842313945713647e-05, "epoch": 0.439100475823807, "percentage": 43.93, "elapsed_time": "11:42:50", "remaining_time": "14:57:00", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 700, "total_steps": 1582, "loss": 3.0942, "learning_rate": 1.769593682237682e-05, "epoch": 0.44225947205275523, "percentage": 44.25, "elapsed_time": "11:47:54", "remaining_time": "14:51:57", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 705, "total_steps": 1582, "loss": 3.0852, "learning_rate": 1.7549293912527726e-05, "epoch": 0.4454184682817035, "percentage": 44.56, "elapsed_time": "11:52:56", "remaining_time": "14:46:53", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 710, "total_steps": 1582, "loss": 3.0908, "learning_rate": 1.740239967336997e-05, "epoch": 0.4485774645106517, "percentage": 44.88, "elapsed_time": "11:57:58", "remaining_time": "14:41:47", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 715, "total_steps": 1582, "loss": 3.0836, "learning_rate": 1.7255268586885165e-05, "epoch": 0.4517364607396, "percentage": 45.2, "elapsed_time": "12:03:00", "remaining_time": "14:36:42", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 720, "total_steps": 1582, "loss": 3.086, "learning_rate": 1.7107915158405187e-05, "epoch": 0.4548954569685482, "percentage": 45.51, "elapsed_time": "12:08:06", "remaining_time": "14:31:42", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 725, "total_steps": 1582, "loss": 3.0855, "learning_rate": 1.6960353915182127e-05, "epoch": 0.4580544531974965, "percentage": 45.83, "elapsed_time": "12:13:05", "remaining_time": "14:26:34", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 730, "total_steps": 1582, "loss": 3.077, "learning_rate": 1.681259940495607e-05, "epoch": 0.46121344942644477, "percentage": 46.14, "elapsed_time": "12:18:09", "remaining_time": "14:21:31", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 735, "total_steps": 1582, "loss": 3.0732, "learning_rate": 1.6664666194520873e-05, "epoch": 0.464372445655393, "percentage": 46.46, "elapsed_time": "12:23:11", "remaining_time": "14:16:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 740, "total_steps": 1582, "loss": 3.0814, "learning_rate": 1.6516568868288053e-05, "epoch": 0.46753144188434126, "percentage": 46.78, "elapsed_time": "12:28:16", "remaining_time": "14:11:25", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 745, "total_steps": 1582, "loss": 3.0817, "learning_rate": 1.636832202684895e-05, "epoch": 0.4706904381132895, "percentage": 47.09, "elapsed_time": "12:33:19", "remaining_time": "14:06:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 750, "total_steps": 1582, "loss": 3.0843, "learning_rate": 1.6219940285535287e-05, "epoch": 0.47384943434223775, "percentage": 47.41, "elapsed_time": "12:38:22", "remaining_time": "14:01:17", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 755, "total_steps": 1582, "loss": 3.0788, "learning_rate": 1.607143827297825e-05, "epoch": 0.477008430571186, "percentage": 47.72, "elapsed_time": "12:43:25", "remaining_time": "13:56:14", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 760, "total_steps": 1582, "loss": 3.0672, "learning_rate": 1.592283062966632e-05, "epoch": 0.48016742680013424, "percentage": 48.04, "elapsed_time": "12:48:28", "remaining_time": "13:51:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 765, "total_steps": 1582, "loss": 3.0759, "learning_rate": 1.5774132006501885e-05, "epoch": 0.4833264230290825, "percentage": 48.36, "elapsed_time": "12:53:31", "remaining_time": "13:46:06", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 770, "total_steps": 1582, "loss": 3.0642, "learning_rate": 1.5625357063356825e-05, "epoch": 0.48648541925803074, "percentage": 48.67, "elapsed_time": "12:58:35", "remaining_time": "13:41:03", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 775, "total_steps": 1582, "loss": 3.0707, "learning_rate": 1.5476520467627244e-05, "epoch": 0.489644415486979, "percentage": 48.99, "elapsed_time": "13:03:37", "remaining_time": "13:35:58", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 780, "total_steps": 1582, "loss": 3.068, "learning_rate": 1.5327636892787445e-05, "epoch": 0.4928034117159273, "percentage": 49.3, "elapsed_time": "13:08:39", "remaining_time": "13:30:54", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 785, "total_steps": 1582, "loss": 3.069, "learning_rate": 1.5178721016943305e-05, "epoch": 0.4959624079448755, "percentage": 49.62, "elapsed_time": "13:13:44", "remaining_time": "13:25:52", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 790, "total_steps": 1582, "loss": 3.0698, "learning_rate": 1.5029787521385165e-05, "epoch": 0.4991214041738238, "percentage": 49.94, "elapsed_time": "13:18:47", "remaining_time": "13:20:48", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 795, "total_steps": 1582, "loss": 3.0692, "learning_rate": 1.4880851089140468e-05, "epoch": 0.502280400402772, "percentage": 50.25, "elapsed_time": "13:23:46", "remaining_time": "13:15:41", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 800, "total_steps": 1582, "loss": 3.0595, "learning_rate": 1.473192640352618e-05, "epoch": 0.5054393966317202, "percentage": 50.57, "elapsed_time": "13:28:49", "remaining_time": "13:10:37", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 805, "total_steps": 1582, "loss": 3.0738, "learning_rate": 1.4583028146701191e-05, "epoch": 0.5085983928606685, "percentage": 50.88, "elapsed_time": "13:33:52", "remaining_time": "13:05:33", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 810, "total_steps": 1582, "loss": 3.0591, "learning_rate": 1.4434170998218834e-05, "epoch": 0.5117573890896168, "percentage": 51.2, "elapsed_time": "13:38:54", "remaining_time": "13:00:29", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 815, "total_steps": 1582, "loss": 3.0698, "learning_rate": 1.4285369633579653e-05, "epoch": 0.514916385318565, "percentage": 51.52, "elapsed_time": "13:43:57", "remaining_time": "12:55:25", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 820, "total_steps": 1582, "loss": 3.0696, "learning_rate": 1.41366387227846e-05, "epoch": 0.5180753815475133, "percentage": 51.83, "elapsed_time": "13:49:01", "remaining_time": "12:50:22", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 825, "total_steps": 1582, "loss": 3.0682, "learning_rate": 1.3987992928888728e-05, "epoch": 0.5212343777764615, "percentage": 52.15, "elapsed_time": "13:54:03", "remaining_time": "12:45:18", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 830, "total_steps": 1582, "loss": 3.0404, "learning_rate": 1.3839446906555591e-05, "epoch": 0.5243933740054098, "percentage": 52.47, "elapsed_time": "13:59:07", "remaining_time": "12:40:16", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 835, "total_steps": 1582, "loss": 3.0633, "learning_rate": 1.3691015300612509e-05, "epoch": 0.5275523702343581, "percentage": 52.78, "elapsed_time": "14:04:10", "remaining_time": "12:35:12", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 840, "total_steps": 1582, "loss": 3.0631, "learning_rate": 1.3542712744606712e-05, "epoch": 0.5307113664633063, "percentage": 53.1, "elapsed_time": "14:09:14", "remaining_time": "12:30:09", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 845, "total_steps": 1582, "loss": 3.0674, "learning_rate": 1.3394553859362701e-05, "epoch": 0.5338703626922545, "percentage": 53.41, "elapsed_time": "14:14:15", "remaining_time": "12:25:04", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 850, "total_steps": 1582, "loss": 3.0605, "learning_rate": 1.3246553251540778e-05, "epoch": 0.5370293589212027, "percentage": 53.73, "elapsed_time": "14:19:16", "remaining_time": "12:19:59", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 855, "total_steps": 1582, "loss": 3.0677, "learning_rate": 1.3098725512197019e-05, "epoch": 0.5401883551501511, "percentage": 54.05, "elapsed_time": "14:24:20", "remaining_time": "12:14:56", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 860, "total_steps": 1582, "loss": 3.0747, "learning_rate": 1.2951085215344794e-05, "epoch": 0.5433473513790993, "percentage": 54.36, "elapsed_time": "14:29:24", "remaining_time": "12:09:53", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 865, "total_steps": 1582, "loss": 3.0673, "learning_rate": 1.2803646916517906e-05, "epoch": 0.5465063476080475, "percentage": 54.68, "elapsed_time": "14:34:27", "remaining_time": "12:04:50", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 870, "total_steps": 1582, "loss": 3.0587, "learning_rate": 1.2656425151335616e-05, "epoch": 0.5496653438369958, "percentage": 54.99, "elapsed_time": "14:39:32", "remaining_time": "11:59:48", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 875, "total_steps": 1582, "loss": 3.0687, "learning_rate": 1.2509434434069625e-05, "epoch": 0.552824340065944, "percentage": 55.31, "elapsed_time": "14:44:35", "remaining_time": "11:54:45", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 880, "total_steps": 1582, "loss": 3.0498, "learning_rate": 1.2362689256213107e-05, "epoch": 0.5559833362948923, "percentage": 55.63, "elapsed_time": "14:49:38", "remaining_time": "11:49:41", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 885, "total_steps": 1582, "loss": 3.0603, "learning_rate": 1.2216204085052056e-05, "epoch": 0.5591423325238406, "percentage": 55.94, "elapsed_time": "14:54:42", "remaining_time": "11:44:38", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 890, "total_steps": 1582, "loss": 3.06, "learning_rate": 1.2069993362238968e-05, "epoch": 0.5623013287527888, "percentage": 56.26, "elapsed_time": "14:59:46", "remaining_time": "11:39:35", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 895, "total_steps": 1582, "loss": 3.0426, "learning_rate": 1.1924071502369067e-05, "epoch": 0.565460324981737, "percentage": 56.57, "elapsed_time": "15:04:49", "remaining_time": "11:34:32", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 900, "total_steps": 1582, "loss": 3.0539, "learning_rate": 1.1778452891559238e-05, "epoch": 0.5686193212106853, "percentage": 56.89, "elapsed_time": "15:09:52", "remaining_time": "11:29:29", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 905, "total_steps": 1582, "loss": 3.0576, "learning_rate": 1.1633151886029678e-05, "epoch": 0.5717783174396336, "percentage": 57.21, "elapsed_time": "15:14:55", "remaining_time": "11:24:25", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 910, "total_steps": 1582, "loss": 3.0436, "learning_rate": 1.1488182810688593e-05, "epoch": 0.5749373136685818, "percentage": 57.52, "elapsed_time": "15:19:56", "remaining_time": "11:19:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 915, "total_steps": 1582, "loss": 3.0608, "learning_rate": 1.1343559957719906e-05, "epoch": 0.57809630989753, "percentage": 57.84, "elapsed_time": "15:24:57", "remaining_time": "11:14:15", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 920, "total_steps": 1582, "loss": 3.0635, "learning_rate": 1.1199297585174234e-05, "epoch": 0.5812553061264784, "percentage": 58.15, "elapsed_time": "15:30:00", "remaining_time": "11:09:12", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 925, "total_steps": 1582, "loss": 3.0504, "learning_rate": 1.1055409915563234e-05, "epoch": 0.5844143023554266, "percentage": 58.47, "elapsed_time": "15:35:05", "remaining_time": "11:04:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 930, "total_steps": 1582, "loss": 3.0476, "learning_rate": 1.09119111344574e-05, "epoch": 0.5875732985843748, "percentage": 58.79, "elapsed_time": "15:40:09", "remaining_time": "10:59:07", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 935, "total_steps": 1582, "loss": 3.056, "learning_rate": 1.0768815389087563e-05, "epoch": 0.590732294813323, "percentage": 59.1, "elapsed_time": "15:45:10", "remaining_time": "10:54:02", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 940, "total_steps": 1582, "loss": 3.0644, "learning_rate": 1.0626136786950166e-05, "epoch": 0.5938912910422713, "percentage": 59.42, "elapsed_time": "15:50:12", "remaining_time": "10:48:58", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 945, "total_steps": 1582, "loss": 3.0566, "learning_rate": 1.0483889394416373e-05, "epoch": 0.5970502872712196, "percentage": 59.73, "elapsed_time": "15:55:14", "remaining_time": "10:43:54", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 950, "total_steps": 1582, "loss": 3.0383, "learning_rate": 1.0342087235345375e-05, "epoch": 0.6002092835001678, "percentage": 60.05, "elapsed_time": "16:00:15", "remaining_time": "10:38:49", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 955, "total_steps": 1582, "loss": 3.0348, "learning_rate": 1.0200744289701747e-05, "epoch": 0.6033682797291161, "percentage": 60.37, "elapsed_time": "16:05:17", "remaining_time": "10:33:45", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 960, "total_steps": 1582, "loss": 3.0542, "learning_rate": 1.0059874492177222e-05, "epoch": 0.6065272759580643, "percentage": 60.68, "elapsed_time": "16:10:20", "remaining_time": "10:28:42", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 965, "total_steps": 1582, "loss": 3.0485, "learning_rate": 9.919491730816904e-06, "epoch": 0.6096862721870125, "percentage": 61.0, "elapsed_time": "16:15:24", "remaining_time": "10:23:38", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 970, "total_steps": 1582, "loss": 3.0457, "learning_rate": 9.77960984565005e-06, "epoch": 0.6128452684159609, "percentage": 61.31, "elapsed_time": "16:20:26", "remaining_time": "10:18:35", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 975, "total_steps": 1582, "loss": 3.0495, "learning_rate": 9.640242627325656e-06, "epoch": 0.6160042646449091, "percentage": 61.63, "elapsed_time": "16:25:28", "remaining_time": "10:13:31", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 980, "total_steps": 1582, "loss": 3.0381, "learning_rate": 9.501403815752813e-06, "epoch": 0.6191632608738573, "percentage": 61.95, "elapsed_time": "16:30:30", "remaining_time": "10:08:27", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 985, "total_steps": 1582, "loss": 3.0484, "learning_rate": 9.36310709874615e-06, "epoch": 0.6223222571028055, "percentage": 62.26, "elapsed_time": "16:35:31", "remaining_time": "10:03:23", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 990, "total_steps": 1582, "loss": 3.0434, "learning_rate": 9.225366110676398e-06, "epoch": 0.6254812533317539, "percentage": 62.58, "elapsed_time": "16:40:33", "remaining_time": "9:58:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 995, "total_steps": 1582, "loss": 3.0495, "learning_rate": 9.088194431126176e-06, "epoch": 0.6286402495607021, "percentage": 62.9, "elapsed_time": "16:45:36", "remaining_time": "9:53:15", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1000, "total_steps": 1582, "loss": 3.0373, "learning_rate": 8.951605583551216e-06, "epoch": 0.6317992457896503, "percentage": 63.21, "elapsed_time": "16:50:40", "remaining_time": "9:48:12", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1005, "total_steps": 1582, "loss": 3.0423, "learning_rate": 8.81561303394713e-06, "epoch": 0.6349582420185986, "percentage": 63.53, "elapsed_time": "16:56:31", "remaining_time": "9:43:37", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1010, "total_steps": 1582, "loss": 3.0379, "learning_rate": 8.680230189521813e-06, "epoch": 0.6381172382475468, "percentage": 63.84, "elapsed_time": "17:01:35", "remaining_time": "9:38:33", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1015, "total_steps": 1582, "loss": 3.0276, "learning_rate": 8.545470397373665e-06, "epoch": 0.6412762344764951, "percentage": 64.16, "elapsed_time": "17:06:38", "remaining_time": "9:33:30", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1020, "total_steps": 1582, "loss": 3.0423, "learning_rate": 8.411346943175725e-06, "epoch": 0.6444352307054434, "percentage": 64.48, "elapsed_time": "17:11:40", "remaining_time": "9:28:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1025, "total_steps": 1582, "loss": 3.0403, "learning_rate": 8.277873049865853e-06, "epoch": 0.6475942269343916, "percentage": 64.79, "elapsed_time": "17:16:44", "remaining_time": "9:23:22", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1030, "total_steps": 1582, "loss": 3.0505, "learning_rate": 8.145061876343141e-06, "epoch": 0.6507532231633398, "percentage": 65.11, "elapsed_time": "17:21:47", "remaining_time": "9:18:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1035, "total_steps": 1582, "loss": 3.035, "learning_rate": 8.012926516170579e-06, "epoch": 0.653912219392288, "percentage": 65.42, "elapsed_time": "17:26:49", "remaining_time": "9:13:15", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1040, "total_steps": 1582, "loss": 3.0539, "learning_rate": 7.881479996284194e-06, "epoch": 0.6570712156212364, "percentage": 65.74, "elapsed_time": "17:31:52", "remaining_time": "9:08:11", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1045, "total_steps": 1582, "loss": 3.0289, "learning_rate": 7.75073527570877e-06, "epoch": 0.6602302118501846, "percentage": 66.06, "elapsed_time": "17:36:57", "remaining_time": "9:03:08", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1050, "total_steps": 1582, "loss": 3.0498, "learning_rate": 7.620705244280208e-06, "epoch": 0.6633892080791328, "percentage": 66.37, "elapsed_time": "17:42:00", "remaining_time": "8:58:04", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1055, "total_steps": 1582, "loss": 3.0492, "learning_rate": 7.491402721374793e-06, "epoch": 0.6665482043080811, "percentage": 66.69, "elapsed_time": "17:47:02", "remaining_time": "8:53:01", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1060, "total_steps": 1582, "loss": 3.037, "learning_rate": 7.362840454645331e-06, "epoch": 0.6697072005370294, "percentage": 67.0, "elapsed_time": "17:52:04", "remaining_time": "8:47:56", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1065, "total_steps": 1582, "loss": 3.0459, "learning_rate": 7.23503111876438e-06, "epoch": 0.6728661967659776, "percentage": 67.32, "elapsed_time": "17:57:05", "remaining_time": "8:42:52", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1070, "total_steps": 1582, "loss": 3.0382, "learning_rate": 7.107987314174706e-06, "epoch": 0.6760251929949259, "percentage": 67.64, "elapsed_time": "18:02:08", "remaining_time": "8:37:48", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1075, "total_steps": 1582, "loss": 3.0459, "learning_rate": 6.981721565847017e-06, "epoch": 0.6791841892238741, "percentage": 67.95, "elapsed_time": "18:07:09", "remaining_time": "8:32:44", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1080, "total_steps": 1582, "loss": 3.0521, "learning_rate": 6.8562463220451585e-06, "epoch": 0.6823431854528224, "percentage": 68.27, "elapsed_time": "18:12:12", "remaining_time": "8:27:40", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1085, "total_steps": 1582, "loss": 3.0431, "learning_rate": 6.731573953098851e-06, "epoch": 0.6855021816817706, "percentage": 68.58, "elapsed_time": "18:17:15", "remaining_time": "8:22:37", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1090, "total_steps": 1582, "loss": 3.0421, "learning_rate": 6.607716750184158e-06, "epoch": 0.6886611779107189, "percentage": 68.9, "elapsed_time": "18:22:18", "remaining_time": "8:17:33", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1095, "total_steps": 1582, "loss": 3.0365, "learning_rate": 6.484686924111696e-06, "epoch": 0.6918201741396671, "percentage": 69.22, "elapsed_time": "18:27:23", "remaining_time": "8:12:30", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1100, "total_steps": 1582, "loss": 3.0309, "learning_rate": 6.362496604122816e-06, "epoch": 0.6949791703686153, "percentage": 69.53, "elapsed_time": "18:32:25", "remaining_time": "8:07:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1105, "total_steps": 1582, "loss": 3.0284, "learning_rate": 6.241157836693803e-06, "epoch": 0.6981381665975637, "percentage": 69.85, "elapsed_time": "18:37:30", "remaining_time": "8:02:23", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1110, "total_steps": 1582, "loss": 3.0294, "learning_rate": 6.120682584348221e-06, "epoch": 0.7012971628265119, "percentage": 70.16, "elapsed_time": "18:42:31", "remaining_time": "7:57:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1115, "total_steps": 1582, "loss": 3.0373, "learning_rate": 6.0010827244775915e-06, "epoch": 0.7044561590554601, "percentage": 70.48, "elapsed_time": "18:47:34", "remaining_time": "7:52:15", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1120, "total_steps": 1582, "loss": 3.0334, "learning_rate": 5.882370048170403e-06, "epoch": 0.7076151552844083, "percentage": 70.8, "elapsed_time": "18:52:39", "remaining_time": "7:47:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1125, "total_steps": 1582, "loss": 3.0292, "learning_rate": 5.764556259049643e-06, "epoch": 0.7107741515133567, "percentage": 71.11, "elapsed_time": "18:57:40", "remaining_time": "7:42:08", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1130, "total_steps": 1582, "loss": 3.0404, "learning_rate": 5.647652972118998e-06, "epoch": 0.7139331477423049, "percentage": 71.43, "elapsed_time": "19:02:43", "remaining_time": "7:37:05", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1135, "total_steps": 1582, "loss": 3.0342, "learning_rate": 5.531671712617725e-06, "epoch": 0.7170921439712531, "percentage": 71.74, "elapsed_time": "19:07:44", "remaining_time": "7:32:01", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1140, "total_steps": 1582, "loss": 3.0412, "learning_rate": 5.4166239148844185e-06, "epoch": 0.7202511402002014, "percentage": 72.06, "elapsed_time": "19:12:47", "remaining_time": "7:26:57", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1145, "total_steps": 1582, "loss": 3.0379, "learning_rate": 5.302520921229721e-06, "epoch": 0.7234101364291496, "percentage": 72.38, "elapsed_time": "19:17:48", "remaining_time": "7:21:53", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1150, "total_steps": 1582, "loss": 3.0371, "learning_rate": 5.1893739808180965e-06, "epoch": 0.7265691326580979, "percentage": 72.69, "elapsed_time": "19:22:49", "remaining_time": "7:16:49", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1155, "total_steps": 1582, "loss": 3.0319, "learning_rate": 5.077194248558827e-06, "epoch": 0.7297281288870462, "percentage": 73.01, "elapsed_time": "19:27:49", "remaining_time": "7:11:44", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1160, "total_steps": 1582, "loss": 3.027, "learning_rate": 4.965992784006255e-06, "epoch": 0.7328871251159944, "percentage": 73.32, "elapsed_time": "19:32:51", "remaining_time": "7:06:40", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1165, "total_steps": 1582, "loss": 3.0489, "learning_rate": 4.8557805502694345e-06, "epoch": 0.7360461213449426, "percentage": 73.64, "elapsed_time": "19:37:52", "remaining_time": "7:01:36", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1170, "total_steps": 1582, "loss": 3.0308, "learning_rate": 4.746568412931349e-06, "epoch": 0.7392051175738908, "percentage": 73.96, "elapsed_time": "19:42:53", "remaining_time": "6:56:32", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1175, "total_steps": 1582, "loss": 3.0332, "learning_rate": 4.6383671389776365e-06, "epoch": 0.7423641138028392, "percentage": 74.27, "elapsed_time": "19:47:54", "remaining_time": "6:51:28", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1180, "total_steps": 1582, "loss": 3.0379, "learning_rate": 4.531187395735143e-06, "epoch": 0.7455231100317874, "percentage": 74.59, "elapsed_time": "19:52:56", "remaining_time": "6:46:24", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1185, "total_steps": 1582, "loss": 3.0316, "learning_rate": 4.425039749820238e-06, "epoch": 0.7486821062607356, "percentage": 74.91, "elapsed_time": "19:57:58", "remaining_time": "6:41:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1190, "total_steps": 1582, "loss": 3.041, "learning_rate": 4.319934666097055e-06, "epoch": 0.7518411024896839, "percentage": 75.22, "elapsed_time": "20:02:59", "remaining_time": "6:36:16", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1195, "total_steps": 1582, "loss": 3.0323, "learning_rate": 4.2158825066458216e-06, "epoch": 0.7550000987186322, "percentage": 75.54, "elapsed_time": "20:08:02", "remaining_time": "6:31:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1200, "total_steps": 1582, "loss": 3.0404, "learning_rate": 4.112893529741264e-06, "epoch": 0.7581590949475804, "percentage": 75.85, "elapsed_time": "20:13:03", "remaining_time": "6:26:09", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1205, "total_steps": 1582, "loss": 3.0323, "learning_rate": 4.010977888841249e-06, "epoch": 0.7613180911765287, "percentage": 76.17, "elapsed_time": "20:18:06", "remaining_time": "6:21:05", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1210, "total_steps": 1582, "loss": 3.0283, "learning_rate": 3.910145631585825e-06, "epoch": 0.7644770874054769, "percentage": 76.49, "elapsed_time": "20:23:08", "remaining_time": "6:16:02", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1215, "total_steps": 1582, "loss": 3.0331, "learning_rate": 3.810406698806594e-06, "epoch": 0.7676360836344251, "percentage": 76.8, "elapsed_time": "20:28:11", "remaining_time": "6:10:58", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1220, "total_steps": 1582, "loss": 3.0367, "learning_rate": 3.711770923546688e-06, "epoch": 0.7707950798633734, "percentage": 77.12, "elapsed_time": "20:33:11", "remaining_time": "6:05:54", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1225, "total_steps": 1582, "loss": 3.031, "learning_rate": 3.6142480300913805e-06, "epoch": 0.7739540760923217, "percentage": 77.43, "elapsed_time": "20:38:15", "remaining_time": "6:00:51", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1230, "total_steps": 1582, "loss": 3.0308, "learning_rate": 3.5178476330093312e-06, "epoch": 0.7771130723212699, "percentage": 77.75, "elapsed_time": "20:43:20", "remaining_time": "5:55:49", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1235, "total_steps": 1582, "loss": 3.0402, "learning_rate": 3.422579236204757e-06, "epoch": 0.7802720685502181, "percentage": 78.07, "elapsed_time": "20:48:23", "remaining_time": "5:50:45", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1240, "total_steps": 1582, "loss": 3.0337, "learning_rate": 3.328452231980443e-06, "epoch": 0.7834310647791665, "percentage": 78.38, "elapsed_time": "20:53:26", "remaining_time": "5:45:42", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1245, "total_steps": 1582, "loss": 3.0242, "learning_rate": 3.2354759001117635e-06, "epoch": 0.7865900610081147, "percentage": 78.7, "elapsed_time": "20:58:28", "remaining_time": "5:40:38", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1250, "total_steps": 1582, "loss": 3.0376, "learning_rate": 3.143659406931848e-06, "epoch": 0.7897490572370629, "percentage": 79.01, "elapsed_time": "21:03:33", "remaining_time": "5:35:36", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1255, "total_steps": 1582, "loss": 3.0298, "learning_rate": 3.0530118044278455e-06, "epoch": 0.7929080534660111, "percentage": 79.33, "elapsed_time": "21:08:34", "remaining_time": "5:30:32", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1260, "total_steps": 1582, "loss": 3.0241, "learning_rate": 2.96354202934853e-06, "epoch": 0.7960670496949594, "percentage": 79.65, "elapsed_time": "21:13:39", "remaining_time": "5:25:29", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1265, "total_steps": 1582, "loss": 3.0331, "learning_rate": 2.8752589023232735e-06, "epoch": 0.7992260459239077, "percentage": 79.96, "elapsed_time": "21:18:42", "remaining_time": "5:20:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1270, "total_steps": 1582, "loss": 3.035, "learning_rate": 2.7881711269923824e-06, "epoch": 0.8023850421528559, "percentage": 80.28, "elapsed_time": "21:23:45", "remaining_time": "5:15:22", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1275, "total_steps": 1582, "loss": 3.0275, "learning_rate": 2.702287289149071e-06, "epoch": 0.8055440383818042, "percentage": 80.59, "elapsed_time": "21:28:49", "remaining_time": "5:10:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1280, "total_steps": 1582, "loss": 3.0206, "learning_rate": 2.617615855892991e-06, "epoch": 0.8087030346107524, "percentage": 80.91, "elapsed_time": "21:33:52", "remaining_time": "5:05:16", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1285, "total_steps": 1582, "loss": 3.0292, "learning_rate": 2.5341651747954667e-06, "epoch": 0.8118620308397007, "percentage": 81.23, "elapsed_time": "21:38:55", "remaining_time": "5:00:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1290, "total_steps": 1582, "loss": 3.0225, "learning_rate": 2.4519434730765542e-06, "epoch": 0.815021027068649, "percentage": 81.54, "elapsed_time": "21:43:59", "remaining_time": "4:55:09", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1295, "total_steps": 1582, "loss": 3.023, "learning_rate": 2.3709588567939118e-06, "epoch": 0.8181800232975972, "percentage": 81.86, "elapsed_time": "21:49:02", "remaining_time": "4:50:06", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1300, "total_steps": 1582, "loss": 3.0196, "learning_rate": 2.2912193100436562e-06, "epoch": 0.8213390195265454, "percentage": 82.17, "elapsed_time": "21:54:06", "remaining_time": "4:45:03", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1305, "total_steps": 1582, "loss": 3.0342, "learning_rate": 2.2127326941732227e-06, "epoch": 0.8244980157554936, "percentage": 82.49, "elapsed_time": "21:59:09", "remaining_time": "4:40:00", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1310, "total_steps": 1582, "loss": 3.0145, "learning_rate": 2.1355067470063266e-06, "epoch": 0.827657011984442, "percentage": 82.81, "elapsed_time": "22:04:08", "remaining_time": "4:34:56", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1315, "total_steps": 1582, "loss": 3.0304, "learning_rate": 2.0595490820801216e-06, "epoch": 0.8308160082133902, "percentage": 83.12, "elapsed_time": "22:09:10", "remaining_time": "4:29:52", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1320, "total_steps": 1582, "loss": 3.0247, "learning_rate": 1.9848671878945912e-06, "epoch": 0.8339750044423384, "percentage": 83.44, "elapsed_time": "22:14:13", "remaining_time": "4:24:49", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1325, "total_steps": 1582, "loss": 3.0307, "learning_rate": 1.9114684271742624e-06, "epoch": 0.8371340006712867, "percentage": 83.75, "elapsed_time": "22:19:17", "remaining_time": "4:19:46", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1330, "total_steps": 1582, "loss": 3.0229, "learning_rate": 1.8393600361423534e-06, "epoch": 0.840292996900235, "percentage": 84.07, "elapsed_time": "22:24:20", "remaining_time": "4:14:43", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1335, "total_steps": 1582, "loss": 3.0358, "learning_rate": 1.7685491238073536e-06, "epoch": 0.8434519931291832, "percentage": 84.39, "elapsed_time": "22:29:24", "remaining_time": "4:09:39", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1340, "total_steps": 1582, "loss": 3.0391, "learning_rate": 1.6990426712621682e-06, "epoch": 0.8466109893581315, "percentage": 84.7, "elapsed_time": "22:34:28", "remaining_time": "4:04:36", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1345, "total_steps": 1582, "loss": 3.0221, "learning_rate": 1.6308475309958649e-06, "epoch": 0.8497699855870797, "percentage": 85.02, "elapsed_time": "22:39:31", "remaining_time": "3:59:33", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1350, "total_steps": 1582, "loss": 3.0314, "learning_rate": 1.5639704262180992e-06, "epoch": 0.8529289818160279, "percentage": 85.34, "elapsed_time": "22:44:35", "remaining_time": "3:54:30", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1355, "total_steps": 1582, "loss": 3.0292, "learning_rate": 1.4984179501962986e-06, "epoch": 0.8560879780449762, "percentage": 85.65, "elapsed_time": "22:49:36", "remaining_time": "3:49:26", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1360, "total_steps": 1582, "loss": 3.0226, "learning_rate": 1.434196565605636e-06, "epoch": 0.8592469742739245, "percentage": 85.97, "elapsed_time": "22:54:39", "remaining_time": "3:44:23", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1365, "total_steps": 1582, "loss": 3.0277, "learning_rate": 1.3713126038918977e-06, "epoch": 0.8624059705028727, "percentage": 86.28, "elapsed_time": "22:59:42", "remaining_time": "3:39:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1370, "total_steps": 1582, "loss": 3.0172, "learning_rate": 1.3097722646472648e-06, "epoch": 0.8655649667318209, "percentage": 86.6, "elapsed_time": "23:04:44", "remaining_time": "3:34:16", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1375, "total_steps": 1582, "loss": 3.0124, "learning_rate": 1.249581614999128e-06, "epoch": 0.8687239629607693, "percentage": 86.92, "elapsed_time": "23:09:45", "remaining_time": "3:29:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1380, "total_steps": 1582, "loss": 3.0208, "learning_rate": 1.1907465890119317e-06, "epoch": 0.8718829591897175, "percentage": 87.23, "elapsed_time": "23:14:49", "remaining_time": "3:24:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1385, "total_steps": 1582, "loss": 3.0159, "learning_rate": 1.133272987102152e-06, "epoch": 0.8750419554186657, "percentage": 87.55, "elapsed_time": "23:19:50", "remaining_time": "3:19:06", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1390, "total_steps": 1582, "loss": 3.014, "learning_rate": 1.0771664754664368e-06, "epoch": 0.878200951647614, "percentage": 87.86, "elapsed_time": "23:24:50", "remaining_time": "3:14:03", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1395, "total_steps": 1582, "loss": 3.0226, "learning_rate": 1.0224325855230048e-06, "epoch": 0.8813599478765622, "percentage": 88.18, "elapsed_time": "23:29:52", "remaining_time": "3:08:59", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1400, "total_steps": 1582, "loss": 3.0271, "learning_rate": 9.690767133662976e-07, "epoch": 0.8845189441055105, "percentage": 88.5, "elapsed_time": "23:34:57", "remaining_time": "3:03:56", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1405, "total_steps": 1582, "loss": 3.033, "learning_rate": 9.171041192350044e-07, "epoch": 0.8876779403344587, "percentage": 88.81, "elapsed_time": "23:39:58", "remaining_time": "2:58:53", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1410, "total_steps": 1582, "loss": 3.038, "learning_rate": 8.665199269934565e-07, "epoch": 0.890836936563407, "percentage": 89.13, "elapsed_time": "23:45:01", "remaining_time": "2:53:49", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1415, "total_steps": 1582, "loss": 3.0152, "learning_rate": 8.173291236264824e-07, "epoch": 0.8939959327923552, "percentage": 89.44, "elapsed_time": "23:50:05", "remaining_time": "2:48:46", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1420, "total_steps": 1582, "loss": 3.0173, "learning_rate": 7.695365587477493e-07, "epoch": 0.8971549290213034, "percentage": 89.76, "elapsed_time": "23:55:10", "remaining_time": "2:43:43", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1425, "total_steps": 1582, "loss": 3.0226, "learning_rate": 7.231469441216559e-07, "epoch": 0.9003139252502518, "percentage": 90.08, "elapsed_time": "1 day, 0:00:15", "remaining_time": "2:38:40", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1430, "total_steps": 1582, "loss": 3.038, "learning_rate": 6.781648531988005e-07, "epoch": 0.9034729214792, "percentage": 90.39, "elapsed_time": "1 day, 0:05:20", "remaining_time": "2:33:37", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1435, "total_steps": 1582, "loss": 3.0254, "learning_rate": 6.345947206650981e-07, "epoch": 0.9066319177081482, "percentage": 90.71, "elapsed_time": "1 day, 0:10:24", "remaining_time": "2:28:34", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1440, "total_steps": 1582, "loss": 3.0265, "learning_rate": 5.924408420045824e-07, "epoch": 0.9097909139370964, "percentage": 91.02, "elapsed_time": "1 day, 0:15:29", "remaining_time": "2:23:31", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1445, "total_steps": 1582, "loss": 3.0197, "learning_rate": 5.517073730759104e-07, "epoch": 0.9129499101660448, "percentage": 91.34, "elapsed_time": "1 day, 0:20:34", "remaining_time": "2:18:28", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1450, "total_steps": 1582, "loss": 3.0241, "learning_rate": 5.123983297026524e-07, "epoch": 0.916108906394993, "percentage": 91.66, "elapsed_time": "1 day, 0:25:41", "remaining_time": "2:13:25", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1455, "total_steps": 1582, "loss": 3.0239, "learning_rate": 4.7451758727738383e-07, "epoch": 0.9192679026239412, "percentage": 91.97, "elapsed_time": "1 day, 0:30:45", "remaining_time": "2:08:22", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1460, "total_steps": 1582, "loss": 3.0252, "learning_rate": 4.3806888037961345e-07, "epoch": 0.9224268988528895, "percentage": 92.29, "elapsed_time": "1 day, 0:35:52", "remaining_time": "2:03:19", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1465, "total_steps": 1582, "loss": 3.0296, "learning_rate": 4.030558024075953e-07, "epoch": 0.9255858950818378, "percentage": 92.6, "elapsed_time": "1 day, 0:40:58", "remaining_time": "1:58:16", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1470, "total_steps": 1582, "loss": 3.0178, "learning_rate": 3.6948180522408006e-07, "epoch": 0.928744891310786, "percentage": 92.92, "elapsed_time": "1 day, 0:46:03", "remaining_time": "1:53:13", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1475, "total_steps": 1582, "loss": 3.0206, "learning_rate": 3.373501988159805e-07, "epoch": 0.9319038875397343, "percentage": 93.24, "elapsed_time": "1 day, 0:51:05", "remaining_time": "1:48:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1480, "total_steps": 1582, "loss": 3.0219, "learning_rate": 3.066641509680662e-07, "epoch": 0.9350628837686825, "percentage": 93.55, "elapsed_time": "1 day, 0:56:09", "remaining_time": "1:43:06", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1485, "total_steps": 1582, "loss": 3.0213, "learning_rate": 2.774266869506531e-07, "epoch": 0.9382218799976307, "percentage": 93.87, "elapsed_time": "1 day, 1:01:10", "remaining_time": "1:38:03", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1490, "total_steps": 1582, "loss": 3.0306, "learning_rate": 2.4964068922133544e-07, "epoch": 0.941380876226579, "percentage": 94.18, "elapsed_time": "1 day, 1:06:12", "remaining_time": "1:33:00", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1495, "total_steps": 1582, "loss": 3.0324, "learning_rate": 2.2330889714083813e-07, "epoch": 0.9445398724555273, "percentage": 94.5, "elapsed_time": "1 day, 1:11:14", "remaining_time": "1:27:56", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1500, "total_steps": 1582, "loss": 3.0231, "learning_rate": 1.9843390670292283e-07, "epoch": 0.9476988686844755, "percentage": 94.82, "elapsed_time": "1 day, 1:16:17", "remaining_time": "1:22:53", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1505, "total_steps": 1582, "loss": 3.0277, "learning_rate": 1.7501817027846255e-07, "epoch": 0.9508578649134237, "percentage": 95.13, "elapsed_time": "1 day, 1:21:19", "remaining_time": "1:17:50", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1510, "total_steps": 1582, "loss": 3.0116, "learning_rate": 1.5306399637368186e-07, "epoch": 0.954016861142372, "percentage": 95.45, "elapsed_time": "1 day, 1:26:23", "remaining_time": "1:12:46", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1515, "total_steps": 1582, "loss": 3.0421, "learning_rate": 1.3257354940254207e-07, "epoch": 0.9571758573713203, "percentage": 95.76, "elapsed_time": "1 day, 1:31:25", "remaining_time": "1:07:43", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1520, "total_steps": 1582, "loss": 3.0217, "learning_rate": 1.1354884947337718e-07, "epoch": 0.9603348536002685, "percentage": 96.08, "elapsed_time": "1 day, 1:36:27", "remaining_time": "1:02:40", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1525, "total_steps": 1582, "loss": 3.0275, "learning_rate": 9.599177218972632e-08, "epoch": 0.9634938498292168, "percentage": 96.4, "elapsed_time": "1 day, 1:41:29", "remaining_time": "0:57:36", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1530, "total_steps": 1582, "loss": 3.0233, "learning_rate": 7.990404846541677e-08, "epoch": 0.966652846058165, "percentage": 96.71, "elapsed_time": "1 day, 1:46:31", "remaining_time": "0:52:33", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1535, "total_steps": 1582, "loss": 3.0282, "learning_rate": 6.528726435393374e-08, "epoch": 0.9698118422871133, "percentage": 97.03, "elapsed_time": "1 day, 1:51:33", "remaining_time": "0:47:30", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1540, "total_steps": 1582, "loss": 3.0203, "learning_rate": 5.214286089203546e-08, "epoch": 0.9729708385160615, "percentage": 97.35, "elapsed_time": "1 day, 1:56:35", "remaining_time": "0:42:27", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1545, "total_steps": 1582, "loss": 3.0145, "learning_rate": 4.0472133957700217e-08, "epoch": 0.9761298347450098, "percentage": 97.66, "elapsed_time": "1 day, 2:01:35", "remaining_time": "0:37:23", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1550, "total_steps": 1582, "loss": 3.0342, "learning_rate": 3.027623414235847e-08, "epoch": 0.979288830973958, "percentage": 97.98, "elapsed_time": "1 day, 2:06:39", "remaining_time": "0:32:20", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1555, "total_steps": 1582, "loss": 3.0237, "learning_rate": 2.155616663746196e-08, "epoch": 0.9824478272029062, "percentage": 98.29, "elapsed_time": "1 day, 2:11:42", "remaining_time": "0:27:17", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1560, "total_steps": 1582, "loss": 3.0257, "learning_rate": 1.431279113538797e-08, "epoch": 0.9856068234318546, "percentage": 98.61, "elapsed_time": "1 day, 2:16:45", "remaining_time": "0:22:14", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1565, "total_steps": 1582, "loss": 3.032, "learning_rate": 8.546821744677136e-09, "epoch": 0.9887658196608028, "percentage": 98.93, "elapsed_time": "1 day, 2:21:47", "remaining_time": "0:17:10", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1570, "total_steps": 1582, "loss": 3.032, "learning_rate": 4.258826919633085e-09, "epoch": 0.991924815889751, "percentage": 99.24, "elapsed_time": "1 day, 2:26:49", "remaining_time": "0:12:07", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1575, "total_steps": 1582, "loss": 3.0152, "learning_rate": 1.4492294042839361e-09, "epoch": 0.9950838121186992, "percentage": 99.56, "elapsed_time": "1 day, 2:31:50", "remaining_time": "0:07:04", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1580, "total_steps": 1582, "loss": 3.0267, "learning_rate": 1.1830619070229975e-10, "epoch": 0.9982428083476476, "percentage": 99.87, "elapsed_time": "1 day, 2:36:55", "remaining_time": "0:02:01", "throughput": "0.00", "total_tokens": 0}
{"current_steps": 1582, "total_steps": 1582, "epoch": 0.9995064068392269, "percentage": 100.0, "elapsed_time": "1 day, 2:38:55", "remaining_time": "0:00:00", "throughput": "0.00", "total_tokens": 0}

2254
trainer_state.json Executable file

File diff suppressed because it is too large Load Diff

3
training_args.bin Executable file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f59e05e1946e2a80ecd32bbdc9893cc59e4f3fc46957c86630f2b14215b3e378
size 6139

BIN
training_loss.png Executable file

Binary file not shown.

After

Width:  |  Height:  |  Size: 37 KiB

1
vocab.json Executable file

File diff suppressed because one or more lines are too long