初始化项目，由ModelHub XC社区提供模型
Model: HaimingW/qwen2.5-1.5b-faithful-summarization Source: Original Platform
This commit is contained in:
ModelHub XC
202
checkpoint-1114/README.md
Normal file
202
checkpoint-1114/README.md
Normal file
@@ -0,0 +1,202 @@
|
||||
---
|
||||
base_model: /app/base_model
|
||||
library_name: peft
|
||||
---
|
||||
|
||||
# Model Card for Model ID
|
||||
|
||||
<!-- Provide a quick summary of what the model is/does. -->
|
||||
|
||||
|
||||
|
||||
## Model Details
|
||||
|
||||
### Model Description
|
||||
|
||||
<!-- Provide a longer summary of what this model is. -->
|
||||
|
||||
|
||||
|
||||
- **Developed by:** [More Information Needed]
|
||||
- **Funded by [optional]:** [More Information Needed]
|
||||
- **Shared by [optional]:** [More Information Needed]
|
||||
- **Model type:** [More Information Needed]
|
||||
- **Language(s) (NLP):** [More Information Needed]
|
||||
- **License:** [More Information Needed]
|
||||
- **Finetuned from model [optional]:** [More Information Needed]
|
||||
|
||||
### Model Sources [optional]
|
||||
|
||||
<!-- Provide the basic links for the model. -->
|
||||
|
||||
- **Repository:** [More Information Needed]
|
||||
- **Paper [optional]:** [More Information Needed]
|
||||
- **Demo [optional]:** [More Information Needed]
|
||||
|
||||
## Uses
|
||||
|
||||
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
||||
|
||||
### Direct Use
|
||||
|
||||
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Downstream Use [optional]
|
||||
|
||||
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Out-of-Scope Use
|
||||
|
||||
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Bias, Risks, and Limitations
|
||||
|
||||
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Recommendations
|
||||
|
||||
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
||||
|
||||
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
||||
|
||||
## How to Get Started with the Model
|
||||
|
||||
Use the code below to get started with the model.
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Training Details
|
||||
|
||||
### Training Data
|
||||
|
||||
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Training Procedure
|
||||
|
||||
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
||||
|
||||
#### Preprocessing [optional]
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
|
||||
#### Training Hyperparameters
|
||||
|
||||
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
||||
|
||||
#### Speeds, Sizes, Times [optional]
|
||||
|
||||
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Evaluation
|
||||
|
||||
<!-- This section describes the evaluation protocols and provides the results. -->
|
||||
|
||||
### Testing Data, Factors & Metrics
|
||||
|
||||
#### Testing Data
|
||||
|
||||
<!-- This should link to a Dataset Card if possible. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Factors
|
||||
|
||||
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Metrics
|
||||
|
||||
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Results
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Summary
|
||||
|
||||
|
||||
|
||||
## Model Examination [optional]
|
||||
|
||||
<!-- Relevant interpretability work for the model goes here -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Environmental Impact
|
||||
|
||||
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
||||
|
||||
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
||||
|
||||
- **Hardware Type:** [More Information Needed]
|
||||
- **Hours used:** [More Information Needed]
|
||||
- **Cloud Provider:** [More Information Needed]
|
||||
- **Compute Region:** [More Information Needed]
|
||||
- **Carbon Emitted:** [More Information Needed]
|
||||
|
||||
## Technical Specifications [optional]
|
||||
|
||||
### Model Architecture and Objective
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Compute Infrastructure
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Hardware
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Software
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Citation [optional]
|
||||
|
||||
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
||||
|
||||
**BibTeX:**
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
**APA:**
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Glossary [optional]
|
||||
|
||||
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## More Information [optional]
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Model Card Authors [optional]
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Model Card Contact
|
||||
|
||||
[More Information Needed]
|
||||
### Framework versions
|
||||
|
||||
- PEFT 0.14.0
|
||||
37
checkpoint-1114/adapter_config.json
Normal file
37
checkpoint-1114/adapter_config.json
Normal file
@@ -0,0 +1,37 @@
|
||||
{
|
||||
"alpha_pattern": {},
|
||||
"auto_mapping": null,
|
||||
"base_model_name_or_path": "/app/base_model",
|
||||
"bias": "none",
|
||||
"eva_config": null,
|
||||
"exclude_modules": null,
|
||||
"fan_in_fan_out": false,
|
||||
"inference_mode": true,
|
||||
"init_lora_weights": true,
|
||||
"layer_replication": null,
|
||||
"layers_pattern": null,
|
||||
"layers_to_transform": null,
|
||||
"loftq_config": {},
|
||||
"lora_alpha": 64,
|
||||
"lora_bias": false,
|
||||
"lora_dropout": 0.05,
|
||||
"megatron_config": null,
|
||||
"megatron_core": "megatron.core",
|
||||
"modules_to_save": null,
|
||||
"peft_type": "LORA",
|
||||
"r": 32,
|
||||
"rank_pattern": {},
|
||||
"revision": null,
|
||||
"target_modules": [
|
||||
"k_proj",
|
||||
"o_proj",
|
||||
"down_proj",
|
||||
"v_proj",
|
||||
"gate_proj",
|
||||
"q_proj",
|
||||
"up_proj"
|
||||
],
|
||||
"task_type": "CAUSAL_LM",
|
||||
"use_dora": false,
|
||||
"use_rslora": false
|
||||
}
|
||||
3
checkpoint-1114/adapter_model.safetensors
Normal file
3
checkpoint-1114/adapter_model.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:624100a9d90566718b1cb0fdacfe67915ab56277c0e3d21241e2e2f9b0d6ef15
|
||||
size 147770496
|
||||
24
checkpoint-1114/added_tokens.json
Normal file
24
checkpoint-1114/added_tokens.json
Normal file
@@ -0,0 +1,24 @@
|
||||
{
|
||||
"</tool_call>": 151658,
|
||||
"<tool_call>": 151657,
|
||||
"<|box_end|>": 151649,
|
||||
"<|box_start|>": 151648,
|
||||
"<|endoftext|>": 151643,
|
||||
"<|file_sep|>": 151664,
|
||||
"<|fim_middle|>": 151660,
|
||||
"<|fim_pad|>": 151662,
|
||||
"<|fim_prefix|>": 151659,
|
||||
"<|fim_suffix|>": 151661,
|
||||
"<|im_end|>": 151645,
|
||||
"<|im_start|>": 151644,
|
||||
"<|image_pad|>": 151655,
|
||||
"<|object_ref_end|>": 151647,
|
||||
"<|object_ref_start|>": 151646,
|
||||
"<|quad_end|>": 151651,
|
||||
"<|quad_start|>": 151650,
|
||||
"<|repo_name|>": 151663,
|
||||
"<|video_pad|>": 151656,
|
||||
"<|vision_end|>": 151653,
|
||||
"<|vision_pad|>": 151654,
|
||||
"<|vision_start|>": 151652
|
||||
}
|
||||
151388
checkpoint-1114/merges.txt
Normal file
151388
checkpoint-1114/merges.txt
Normal file
File diff suppressed because it is too large
Load Diff
3
checkpoint-1114/optimizer.pt
Normal file
3
checkpoint-1114/optimizer.pt
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cdc820f289208d6a0519ee4c2f0e3799a2c7513df30f50d518f21a00a4f44bc3
|
||||
size 295765866
|
||||
3
checkpoint-1114/rng_state_0.pth
Normal file
3
checkpoint-1114/rng_state_0.pth
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bb2a421960f4ace9cef214a90d9b9e14602edbdbfd4b94c6bb1a341aea1de4a1
|
||||
size 14512
|
||||
3
checkpoint-1114/rng_state_1.pth
Normal file
3
checkpoint-1114/rng_state_1.pth
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d05f5a248fc1955345b95959ee6375d23a4a79fa52a627676788eb1fd62a9a54
|
||||
size 14512
|
||||
3
checkpoint-1114/scheduler.pt
Normal file
3
checkpoint-1114/scheduler.pt
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c13bd5bc23f6cfdf44657b48741336c4e87731f4b40b440ef91cf9b780fea362
|
||||
size 1064
|
||||
31
checkpoint-1114/special_tokens_map.json
Normal file
31
checkpoint-1114/special_tokens_map.json
Normal file
@@ -0,0 +1,31 @@
|
||||
{
|
||||
"additional_special_tokens": [
|
||||
"<|im_start|>",
|
||||
"<|im_end|>",
|
||||
"<|object_ref_start|>",
|
||||
"<|object_ref_end|>",
|
||||
"<|box_start|>",
|
||||
"<|box_end|>",
|
||||
"<|quad_start|>",
|
||||
"<|quad_end|>",
|
||||
"<|vision_start|>",
|
||||
"<|vision_end|>",
|
||||
"<|vision_pad|>",
|
||||
"<|image_pad|>",
|
||||
"<|video_pad|>"
|
||||
],
|
||||
"eos_token": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"pad_token": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
}
|
||||
}
|
||||
3
checkpoint-1114/tokenizer.json
Normal file
3
checkpoint-1114/tokenizer.json
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
|
||||
size 11421896
|
||||
208
checkpoint-1114/tokenizer_config.json
Normal file
208
checkpoint-1114/tokenizer_config.json
Normal file
@@ -0,0 +1,208 @@
|
||||
{
|
||||
"add_bos_token": false,
|
||||
"add_prefix_space": false,
|
||||
"added_tokens_decoder": {
|
||||
"151643": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151644": {
|
||||
"content": "<|im_start|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151645": {
|
||||
"content": "<|im_end|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151646": {
|
||||
"content": "<|object_ref_start|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151647": {
|
||||
"content": "<|object_ref_end|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151648": {
|
||||
"content": "<|box_start|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151649": {
|
||||
"content": "<|box_end|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151650": {
|
||||
"content": "<|quad_start|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151651": {
|
||||
"content": "<|quad_end|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151652": {
|
||||
"content": "<|vision_start|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151653": {
|
||||
"content": "<|vision_end|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151654": {
|
||||
"content": "<|vision_pad|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151655": {
|
||||
"content": "<|image_pad|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151656": {
|
||||
"content": "<|video_pad|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"151657": {
|
||||
"content": "<tool_call>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
},
|
||||
"151658": {
|
||||
"content": "</tool_call>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
},
|
||||
"151659": {
|
||||
"content": "<|fim_prefix|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
},
|
||||
"151660": {
|
||||
"content": "<|fim_middle|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
},
|
||||
"151661": {
|
||||
"content": "<|fim_suffix|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
},
|
||||
"151662": {
|
||||
"content": "<|fim_pad|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
},
|
||||
"151663": {
|
||||
"content": "<|repo_name|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
},
|
||||
"151664": {
|
||||
"content": "<|file_sep|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": false
|
||||
}
|
||||
},
|
||||
"additional_special_tokens": [
|
||||
"<|im_start|>",
|
||||
"<|im_end|>",
|
||||
"<|object_ref_start|>",
|
||||
"<|object_ref_end|>",
|
||||
"<|box_start|>",
|
||||
"<|box_end|>",
|
||||
"<|quad_start|>",
|
||||
"<|quad_end|>",
|
||||
"<|vision_start|>",
|
||||
"<|vision_end|>",
|
||||
"<|vision_pad|>",
|
||||
"<|image_pad|>",
|
||||
"<|video_pad|>"
|
||||
],
|
||||
"bos_token": null,
|
||||
"chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0]['role'] == 'system' %}\n {{- messages[0]['content'] }}\n {%- else %}\n {{- 'You are a helpful assistant.' }}\n {%- endif %}\n {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0]['role'] == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n {%- else %}\n {{- '<|im_start|>system\\nYou are a helpful assistant.<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role }}\n {%- if message.content %}\n {{- '\\n' + message.content }}\n {%- endif %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {{- tool_call.arguments | tojson }}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- message.content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
|
||||
"clean_up_tokenization_spaces": false,
|
||||
"eos_token": "<|endoftext|>",
|
||||
"errors": "replace",
|
||||
"extra_special_tokens": {},
|
||||
"model_max_length": 131072,
|
||||
"pad_token": "<|endoftext|>",
|
||||
"split_special_tokens": false,
|
||||
"tokenizer_class": "Qwen2Tokenizer",
|
||||
"unk_token": null
|
||||
}
|
||||
810
checkpoint-1114/trainer_state.json
Normal file
810
checkpoint-1114/trainer_state.json
Normal file
@@ -0,0 +1,810 @@
|
||||
{
|
||||
"best_metric": null,
|
||||
"best_model_checkpoint": null,
|
||||
"epoch": 0.9996634885025238,
|
||||
"eval_steps": 500,
|
||||
"global_step": 1114,
|
||||
"is_hyper_param_search": false,
|
||||
"is_local_process_zero": true,
|
||||
"is_world_process_zero": true,
|
||||
"log_history": [
|
||||
{
|
||||
"epoch": 0.0089736399326977,
|
||||
"grad_norm": 2.1750009059906006,
|
||||
"learning_rate": 2e-05,
|
||||
"loss": 1.9421,
|
||||
"step": 10
|
||||
},
|
||||
{
|
||||
"epoch": 0.0179472798653954,
|
||||
"grad_norm": 1.2129733562469482,
|
||||
"learning_rate": 4e-05,
|
||||
"loss": 1.6421,
|
||||
"step": 20
|
||||
},
|
||||
{
|
||||
"epoch": 0.0269209197980931,
|
||||
"grad_norm": 1.2686073780059814,
|
||||
"learning_rate": 6e-05,
|
||||
"loss": 1.6084,
|
||||
"step": 30
|
||||
},
|
||||
{
|
||||
"epoch": 0.0358945597307908,
|
||||
"grad_norm": 0.8401476740837097,
|
||||
"learning_rate": 8e-05,
|
||||
"loss": 1.4811,
|
||||
"step": 40
|
||||
},
|
||||
{
|
||||
"epoch": 0.044868199663488505,
|
||||
"grad_norm": 1.3034749031066895,
|
||||
"learning_rate": 0.0001,
|
||||
"loss": 1.4327,
|
||||
"step": 50
|
||||
},
|
||||
{
|
||||
"epoch": 0.0538418395961862,
|
||||
"grad_norm": 0.6824946403503418,
|
||||
"learning_rate": 0.00012,
|
||||
"loss": 1.4694,
|
||||
"step": 60
|
||||
},
|
||||
{
|
||||
"epoch": 0.0628154795288839,
|
||||
"grad_norm": 0.670620858669281,
|
||||
"learning_rate": 0.00014,
|
||||
"loss": 1.3643,
|
||||
"step": 70
|
||||
},
|
||||
{
|
||||
"epoch": 0.0717891194615816,
|
||||
"grad_norm": 0.8601792454719543,
|
||||
"learning_rate": 0.00016,
|
||||
"loss": 1.3669,
|
||||
"step": 80
|
||||
},
|
||||
{
|
||||
"epoch": 0.08076275939427931,
|
||||
"grad_norm": 0.6021562814712524,
|
||||
"learning_rate": 0.00018,
|
||||
"loss": 1.3697,
|
||||
"step": 90
|
||||
},
|
||||
{
|
||||
"epoch": 0.08973639932697701,
|
||||
"grad_norm": 0.672222912311554,
|
||||
"learning_rate": 0.0002,
|
||||
"loss": 1.3505,
|
||||
"step": 100
|
||||
},
|
||||
{
|
||||
"epoch": 0.09871003925967471,
|
||||
"grad_norm": 0.5645850896835327,
|
||||
"learning_rate": 0.00019995200907733468,
|
||||
"loss": 1.3051,
|
||||
"step": 110
|
||||
},
|
||||
{
|
||||
"epoch": 0.1076836791923724,
|
||||
"grad_norm": 0.6567140817642212,
|
||||
"learning_rate": 0.00019980808237191178,
|
||||
"loss": 1.3072,
|
||||
"step": 120
|
||||
},
|
||||
{
|
||||
"epoch": 0.1166573191250701,
|
||||
"grad_norm": 0.5479955077171326,
|
||||
"learning_rate": 0.00019956835802723916,
|
||||
"loss": 1.42,
|
||||
"step": 130
|
||||
},
|
||||
{
|
||||
"epoch": 0.1256309590577678,
|
||||
"grad_norm": 0.710563600063324,
|
||||
"learning_rate": 0.0001992330661351665,
|
||||
"loss": 1.318,
|
||||
"step": 140
|
||||
},
|
||||
{
|
||||
"epoch": 0.1346045989904655,
|
||||
"grad_norm": 0.5019824504852295,
|
||||
"learning_rate": 0.00019880252851503915,
|
||||
"loss": 1.3518,
|
||||
"step": 150
|
||||
},
|
||||
{
|
||||
"epoch": 0.1435782389231632,
|
||||
"grad_norm": 0.783736526966095,
|
||||
"learning_rate": 0.0001982771584048096,
|
||||
"loss": 1.3841,
|
||||
"step": 160
|
||||
},
|
||||
{
|
||||
"epoch": 0.1525518788558609,
|
||||
"grad_norm": 0.5478121042251587,
|
||||
"learning_rate": 0.00019765746006440455,
|
||||
"loss": 1.2956,
|
||||
"step": 170
|
||||
},
|
||||
{
|
||||
"epoch": 0.16152551878855861,
|
||||
"grad_norm": 0.675541877746582,
|
||||
"learning_rate": 0.00019694402829172663,
|
||||
"loss": 1.4014,
|
||||
"step": 180
|
||||
},
|
||||
{
|
||||
"epoch": 0.17049915872125632,
|
||||
"grad_norm": 0.7109649777412415,
|
||||
"learning_rate": 0.0001961375478517564,
|
||||
"loss": 1.2814,
|
||||
"step": 190
|
||||
},
|
||||
{
|
||||
"epoch": 0.17947279865395402,
|
||||
"grad_norm": 0.6496264338493347,
|
||||
"learning_rate": 0.00019523879281930235,
|
||||
"loss": 1.33,
|
||||
"step": 200
|
||||
},
|
||||
{
|
||||
"epoch": 0.18844643858665172,
|
||||
"grad_norm": 0.7981849908828735,
|
||||
"learning_rate": 0.00019424862583602965,
|
||||
"loss": 1.3878,
|
||||
"step": 210
|
||||
},
|
||||
{
|
||||
"epoch": 0.19742007851934942,
|
||||
"grad_norm": 0.5120641589164734,
|
||||
"learning_rate": 0.00019316799728248075,
|
||||
"loss": 1.2728,
|
||||
"step": 220
|
||||
},
|
||||
{
|
||||
"epoch": 0.2063937184520471,
|
||||
"grad_norm": 0.5666424632072449,
|
||||
"learning_rate": 0.00019199794436588243,
|
||||
"loss": 1.3446,
|
||||
"step": 230
|
||||
},
|
||||
{
|
||||
"epoch": 0.2153673583847448,
|
||||
"grad_norm": 0.6776772141456604,
|
||||
"learning_rate": 0.00019073959012461545,
|
||||
"loss": 1.3373,
|
||||
"step": 240
|
||||
},
|
||||
{
|
||||
"epoch": 0.2243409983174425,
|
||||
"grad_norm": 0.7518035173416138,
|
||||
"learning_rate": 0.00018939414235030134,
|
||||
"loss": 1.3381,
|
||||
"step": 250
|
||||
},
|
||||
{
|
||||
"epoch": 0.2333146382501402,
|
||||
"grad_norm": 0.6173065304756165,
|
||||
"learning_rate": 0.0001879628924285419,
|
||||
"loss": 1.3331,
|
||||
"step": 260
|
||||
},
|
||||
{
|
||||
"epoch": 0.2422882781828379,
|
||||
"grad_norm": 0.6449307203292847,
|
||||
"learning_rate": 0.00018644721409942323,
|
||||
"loss": 1.3048,
|
||||
"step": 270
|
||||
},
|
||||
{
|
||||
"epoch": 0.2512619181155356,
|
||||
"grad_norm": 0.7187690734863281,
|
||||
"learning_rate": 0.00018484856213897498,
|
||||
"loss": 1.3328,
|
||||
"step": 280
|
||||
},
|
||||
{
|
||||
"epoch": 0.26023555804823334,
|
||||
"grad_norm": 0.5725300312042236,
|
||||
"learning_rate": 0.00018316847096284917,
|
||||
"loss": 1.4003,
|
||||
"step": 290
|
||||
},
|
||||
{
|
||||
"epoch": 0.269209197980931,
|
||||
"grad_norm": 5.041274070739746,
|
||||
"learning_rate": 0.0001814085531535599,
|
||||
"loss": 1.3066,
|
||||
"step": 300
|
||||
},
|
||||
{
|
||||
"epoch": 0.2781828379136287,
|
||||
"grad_norm": 0.4397372603416443,
|
||||
"learning_rate": 0.00017957049791269685,
|
||||
"loss": 1.3193,
|
||||
"step": 310
|
||||
},
|
||||
{
|
||||
"epoch": 0.2871564778463264,
|
||||
"grad_norm": 0.5465174913406372,
|
||||
"learning_rate": 0.00017765606943959833,
|
||||
"loss": 1.2508,
|
||||
"step": 320
|
||||
},
|
||||
{
|
||||
"epoch": 0.2961301177790241,
|
||||
"grad_norm": 0.5439965724945068,
|
||||
"learning_rate": 0.00017566710523804043,
|
||||
"loss": 1.3258,
|
||||
"step": 330
|
||||
},
|
||||
{
|
||||
"epoch": 0.3051037577117218,
|
||||
"grad_norm": 0.6401047110557556,
|
||||
"learning_rate": 0.00017360551435256674,
|
||||
"loss": 1.3563,
|
||||
"step": 340
|
||||
},
|
||||
{
|
||||
"epoch": 0.3140773976444195,
|
||||
"grad_norm": 0.5497185587882996,
|
||||
"learning_rate": 0.0001714732755361523,
|
||||
"loss": 1.267,
|
||||
"step": 350
|
||||
},
|
||||
{
|
||||
"epoch": 0.32305103757711723,
|
||||
"grad_norm": 0.6040382981300354,
|
||||
"learning_rate": 0.00016927243535095997,
|
||||
"loss": 1.3057,
|
||||
"step": 360
|
||||
},
|
||||
{
|
||||
"epoch": 0.3320246775098149,
|
||||
"grad_norm": 0.6971787810325623,
|
||||
"learning_rate": 0.00016700510620401224,
|
||||
"loss": 1.4139,
|
||||
"step": 370
|
||||
},
|
||||
{
|
||||
"epoch": 0.34099831744251263,
|
||||
"grad_norm": 0.5650486946105957,
|
||||
"learning_rate": 0.00016467346431966413,
|
||||
"loss": 1.3388,
|
||||
"step": 380
|
||||
},
|
||||
{
|
||||
"epoch": 0.3499719573752103,
|
||||
"grad_norm": 0.5824179649353027,
|
||||
"learning_rate": 0.00016227974765082274,
|
||||
"loss": 1.3194,
|
||||
"step": 390
|
||||
},
|
||||
{
|
||||
"epoch": 0.35894559730790804,
|
||||
"grad_norm": 0.4857507646083832,
|
||||
"learning_rate": 0.00015982625373091875,
|
||||
"loss": 1.3274,
|
||||
"step": 400
|
||||
},
|
||||
{
|
||||
"epoch": 0.3679192372406057,
|
||||
"grad_norm": 0.49048104882240295,
|
||||
"learning_rate": 0.00015731533746869163,
|
||||
"loss": 1.2175,
|
||||
"step": 410
|
||||
},
|
||||
{
|
||||
"epoch": 0.37689287717330344,
|
||||
"grad_norm": 0.5631568431854248,
|
||||
"learning_rate": 0.00015474940888790455,
|
||||
"loss": 1.2392,
|
||||
"step": 420
|
||||
},
|
||||
{
|
||||
"epoch": 0.3858665171060011,
|
||||
"grad_norm": 0.5326385498046875,
|
||||
"learning_rate": 0.0001521309308141592,
|
||||
"loss": 1.3241,
|
||||
"step": 430
|
||||
},
|
||||
{
|
||||
"epoch": 0.39484015703869885,
|
||||
"grad_norm": 0.4978722631931305,
|
||||
"learning_rate": 0.00014946241651103034,
|
||||
"loss": 1.2032,
|
||||
"step": 440
|
||||
},
|
||||
{
|
||||
"epoch": 0.4038137969713965,
|
||||
"grad_norm": 0.4760749936103821,
|
||||
"learning_rate": 0.00014674642726778906,
|
||||
"loss": 1.2336,
|
||||
"step": 450
|
||||
},
|
||||
{
|
||||
"epoch": 0.4127874369040942,
|
||||
"grad_norm": 0.5480512380599976,
|
||||
"learning_rate": 0.00014398556994102996,
|
||||
"loss": 1.3644,
|
||||
"step": 460
|
||||
},
|
||||
{
|
||||
"epoch": 0.4217610768367919,
|
||||
"grad_norm": 0.5921517014503479,
|
||||
"learning_rate": 0.00014118249445256223,
|
||||
"loss": 1.2761,
|
||||
"step": 470
|
||||
},
|
||||
{
|
||||
"epoch": 0.4307347167694896,
|
||||
"grad_norm": 0.505266547203064,
|
||||
"learning_rate": 0.00013833989124596572,
|
||||
"loss": 1.2971,
|
||||
"step": 480
|
||||
},
|
||||
{
|
||||
"epoch": 0.43970835670218733,
|
||||
"grad_norm": 0.432982861995697,
|
||||
"learning_rate": 0.00013546048870425356,
|
||||
"loss": 1.2217,
|
||||
"step": 490
|
||||
},
|
||||
{
|
||||
"epoch": 0.448681996634885,
|
||||
"grad_norm": 0.5738311409950256,
|
||||
"learning_rate": 0.0001325470505311198,
|
||||
"loss": 1.2898,
|
||||
"step": 500
|
||||
},
|
||||
{
|
||||
"epoch": 0.45765563656758274,
|
||||
"grad_norm": 0.6067373752593994,
|
||||
"learning_rate": 0.0001296023730982855,
|
||||
"loss": 1.3245,
|
||||
"step": 510
|
||||
},
|
||||
{
|
||||
"epoch": 0.4666292765002804,
|
||||
"grad_norm": 0.5424025058746338,
|
||||
"learning_rate": 0.00012662928276148985,
|
||||
"loss": 1.2277,
|
||||
"step": 520
|
||||
},
|
||||
{
|
||||
"epoch": 0.47560291643297814,
|
||||
"grad_norm": 0.5827418565750122,
|
||||
"learning_rate": 0.00012363063314770135,
|
||||
"loss": 1.2828,
|
||||
"step": 530
|
||||
},
|
||||
{
|
||||
"epoch": 0.4845765563656758,
|
||||
"grad_norm": 0.5253446102142334,
|
||||
"learning_rate": 0.0001206093024161544,
|
||||
"loss": 1.2969,
|
||||
"step": 540
|
||||
},
|
||||
{
|
||||
"epoch": 0.49355019629837354,
|
||||
"grad_norm": 0.6067509055137634,
|
||||
"learning_rate": 0.00011756819049583861,
|
||||
"loss": 1.3125,
|
||||
"step": 550
|
||||
},
|
||||
{
|
||||
"epoch": 0.5025238362310712,
|
||||
"grad_norm": 0.5548892617225647,
|
||||
"learning_rate": 0.00011451021630209371,
|
||||
"loss": 1.2726,
|
||||
"step": 560
|
||||
},
|
||||
{
|
||||
"epoch": 0.511497476163769,
|
||||
"grad_norm": 0.6270582675933838,
|
||||
"learning_rate": 0.0001114383149349806,
|
||||
"loss": 1.241,
|
||||
"step": 570
|
||||
},
|
||||
{
|
||||
"epoch": 0.5204711160964667,
|
||||
"grad_norm": 0.5589553117752075,
|
||||
"learning_rate": 0.00010835543486211815,
|
||||
"loss": 1.2897,
|
||||
"step": 580
|
||||
},
|
||||
{
|
||||
"epoch": 0.5294447560291643,
|
||||
"grad_norm": 0.5768513083457947,
|
||||
"learning_rate": 0.00010526453508868961,
|
||||
"loss": 1.266,
|
||||
"step": 590
|
||||
},
|
||||
{
|
||||
"epoch": 0.538418395961862,
|
||||
"grad_norm": 0.6176390051841736,
|
||||
"learning_rate": 0.00010216858231733488,
|
||||
"loss": 1.2771,
|
||||
"step": 600
|
||||
},
|
||||
{
|
||||
"epoch": 0.5473920358945598,
|
||||
"grad_norm": 0.5259169340133667,
|
||||
"learning_rate": 9.907054810065446e-05,
|
||||
"loss": 1.314,
|
||||
"step": 610
|
||||
},
|
||||
{
|
||||
"epoch": 0.5563656758272574,
|
||||
"grad_norm": 0.48984938859939575,
|
||||
"learning_rate": 9.597340598905852e-05,
|
||||
"loss": 1.2227,
|
||||
"step": 620
|
||||
},
|
||||
{
|
||||
"epoch": 0.5653393157599551,
|
||||
"grad_norm": 0.504762589931488,
|
||||
"learning_rate": 9.28801286766982e-05,
|
||||
"loss": 1.2152,
|
||||
"step": 630
|
||||
},
|
||||
{
|
||||
"epoch": 0.5743129556926528,
|
||||
"grad_norm": 0.6546471118927002,
|
||||
"learning_rate": 8.979368514821916e-05,
|
||||
"loss": 1.2996,
|
||||
"step": 640
|
||||
},
|
||||
{
|
||||
"epoch": 0.5832865956253506,
|
||||
"grad_norm": 0.6191439032554626,
|
||||
"learning_rate": 8.671703782907518e-05,
|
||||
"loss": 1.2966,
|
||||
"step": 650
|
||||
},
|
||||
{
|
||||
"epoch": 0.5922602355580482,
|
||||
"grad_norm": 0.4806272089481354,
|
||||
"learning_rate": 8.365313974213737e-05,
|
||||
"loss": 1.2665,
|
||||
"step": 660
|
||||
},
|
||||
{
|
||||
"epoch": 0.6012338754907459,
|
||||
"grad_norm": 0.4365353286266327,
|
||||
"learning_rate": 8.060493167332874e-05,
|
||||
"loss": 1.2466,
|
||||
"step": 670
|
||||
},
|
||||
{
|
||||
"epoch": 0.6102075154234436,
|
||||
"grad_norm": 0.5589653849601746,
|
||||
"learning_rate": 7.757533934900316e-05,
|
||||
"loss": 1.2992,
|
||||
"step": 680
|
||||
},
|
||||
{
|
||||
"epoch": 0.6191811553561414,
|
||||
"grad_norm": 0.6361960172653198,
|
||||
"learning_rate": 7.456727062777958e-05,
|
||||
"loss": 1.2096,
|
||||
"step": 690
|
||||
},
|
||||
{
|
||||
"epoch": 0.628154795288839,
|
||||
"grad_norm": 0.6086412072181702,
|
||||
"learning_rate": 7.15836127095254e-05,
|
||||
"loss": 1.3301,
|
||||
"step": 700
|
||||
},
|
||||
{
|
||||
"epoch": 0.6371284352215367,
|
||||
"grad_norm": 0.5902493596076965,
|
||||
"learning_rate": 6.862722936416897e-05,
|
||||
"loss": 1.3265,
|
||||
"step": 710
|
||||
},
|
||||
{
|
||||
"epoch": 0.6461020751542345,
|
||||
"grad_norm": 0.4792775809764862,
|
||||
"learning_rate": 6.570095818300012e-05,
|
||||
"loss": 1.2416,
|
||||
"step": 720
|
||||
},
|
||||
{
|
||||
"epoch": 0.6550757150869322,
|
||||
"grad_norm": 0.48689934611320496,
|
||||
"learning_rate": 6.280760785509801e-05,
|
||||
"loss": 1.2668,
|
||||
"step": 730
|
||||
},
|
||||
{
|
||||
"epoch": 0.6640493550196298,
|
||||
"grad_norm": 0.5720877051353455,
|
||||
"learning_rate": 5.9949955471499186e-05,
|
||||
"loss": 1.2979,
|
||||
"step": 740
|
||||
},
|
||||
{
|
||||
"epoch": 0.6730229949523275,
|
||||
"grad_norm": 0.6165252327919006,
|
||||
"learning_rate": 5.713074385969457e-05,
|
||||
"loss": 1.2269,
|
||||
"step": 750
|
||||
},
|
||||
{
|
||||
"epoch": 0.6819966348850253,
|
||||
"grad_norm": 0.554986298084259,
|
||||
"learning_rate": 5.435267895101302e-05,
|
||||
"loss": 1.3656,
|
||||
"step": 760
|
||||
},
|
||||
{
|
||||
"epoch": 0.6909702748177229,
|
||||
"grad_norm": 0.6707109808921814,
|
||||
"learning_rate": 5.161842718341825e-05,
|
||||
"loss": 1.3012,
|
||||
"step": 770
|
||||
},
|
||||
{
|
||||
"epoch": 0.6999439147504206,
|
||||
"grad_norm": 0.45011788606643677,
|
||||
"learning_rate": 4.8930612942212916e-05,
|
||||
"loss": 1.2375,
|
||||
"step": 780
|
||||
},
|
||||
{
|
||||
"epoch": 0.7089175546831183,
|
||||
"grad_norm": 0.5251748561859131,
|
||||
"learning_rate": 4.629181604110464e-05,
|
||||
"loss": 1.2007,
|
||||
"step": 790
|
||||
},
|
||||
{
|
||||
"epoch": 0.7178911946158161,
|
||||
"grad_norm": 0.5204996466636658,
|
||||
"learning_rate": 4.3704569246053805e-05,
|
||||
"loss": 1.3049,
|
||||
"step": 800
|
||||
},
|
||||
{
|
||||
"epoch": 0.7268648345485137,
|
||||
"grad_norm": 0.6533709764480591,
|
||||
"learning_rate": 4.1171355844277394e-05,
|
||||
"loss": 1.293,
|
||||
"step": 810
|
||||
},
|
||||
{
|
||||
"epoch": 0.7358384744812114,
|
||||
"grad_norm": 0.589524507522583,
|
||||
"learning_rate": 3.869460726074474e-05,
|
||||
"loss": 1.3565,
|
||||
"step": 820
|
||||
},
|
||||
{
|
||||
"epoch": 0.7448121144139092,
|
||||
"grad_norm": 0.6437689661979675,
|
||||
"learning_rate": 3.6276700724450384e-05,
|
||||
"loss": 1.2496,
|
||||
"step": 830
|
||||
},
|
||||
{
|
||||
"epoch": 0.7537857543466069,
|
||||
"grad_norm": 0.634338915348053,
|
||||
"learning_rate": 3.391995698670638e-05,
|
||||
"loss": 1.2889,
|
||||
"step": 840
|
||||
},
|
||||
{
|
||||
"epoch": 0.7627593942793045,
|
||||
"grad_norm": 0.5487192869186401,
|
||||
"learning_rate": 3.162663809364178e-05,
|
||||
"loss": 1.204,
|
||||
"step": 850
|
||||
},
|
||||
{
|
||||
"epoch": 0.7717330342120022,
|
||||
"grad_norm": 0.5915932655334473,
|
||||
"learning_rate": 2.9398945215049567e-05,
|
||||
"loss": 1.2491,
|
||||
"step": 860
|
||||
},
|
||||
{
|
||||
"epoch": 0.7807066741447,
|
||||
"grad_norm": 0.5967379212379456,
|
||||
"learning_rate": 2.7239016531662887e-05,
|
||||
"loss": 1.2519,
|
||||
"step": 870
|
||||
},
|
||||
{
|
||||
"epoch": 0.7896803140773977,
|
||||
"grad_norm": 0.589465320110321,
|
||||
"learning_rate": 2.514892518288988e-05,
|
||||
"loss": 1.3233,
|
||||
"step": 880
|
||||
},
|
||||
{
|
||||
"epoch": 0.7986539540100953,
|
||||
"grad_norm": 0.625720202922821,
|
||||
"learning_rate": 2.3130677276976232e-05,
|
||||
"loss": 1.2831,
|
||||
"step": 890
|
||||
},
|
||||
{
|
||||
"epoch": 0.807627593942793,
|
||||
"grad_norm": 0.5853390693664551,
|
||||
"learning_rate": 2.118620996550529e-05,
|
||||
"loss": 1.2793,
|
||||
"step": 900
|
||||
},
|
||||
{
|
||||
"epoch": 0.8166012338754908,
|
||||
"grad_norm": 0.5645495653152466,
|
||||
"learning_rate": 1.9317389584084568e-05,
|
||||
"loss": 1.2646,
|
||||
"step": 910
|
||||
},
|
||||
{
|
||||
"epoch": 0.8255748738081884,
|
||||
"grad_norm": 0.5386382341384888,
|
||||
"learning_rate": 1.7526009861001956e-05,
|
||||
"loss": 1.2479,
|
||||
"step": 920
|
||||
},
|
||||
{
|
||||
"epoch": 0.8345485137408861,
|
||||
"grad_norm": 0.5386704802513123,
|
||||
"learning_rate": 1.5813790195572674e-05,
|
||||
"loss": 1.2772,
|
||||
"step": 930
|
||||
},
|
||||
{
|
||||
"epoch": 0.8435221536735839,
|
||||
"grad_norm": 0.6007257103919983,
|
||||
"learning_rate": 1.4182374007827603e-05,
|
||||
"loss": 1.2606,
|
||||
"step": 940
|
||||
},
|
||||
{
|
||||
"epoch": 0.8524957936062816,
|
||||
"grad_norm": 0.6834496259689331,
|
||||
"learning_rate": 1.263332716112885e-05,
|
||||
"loss": 1.2778,
|
||||
"step": 950
|
||||
},
|
||||
{
|
||||
"epoch": 0.8614694335389792,
|
||||
"grad_norm": 0.5198489427566528,
|
||||
"learning_rate": 1.1168136459224842e-05,
|
||||
"loss": 1.2838,
|
||||
"step": 960
|
||||
},
|
||||
{
|
||||
"epoch": 0.8704430734716769,
|
||||
"grad_norm": 0.5519130825996399,
|
||||
"learning_rate": 9.788208219188932e-06,
|
||||
"loss": 1.2267,
|
||||
"step": 970
|
||||
},
|
||||
{
|
||||
"epoch": 0.8794167134043747,
|
||||
"grad_norm": 0.5107753276824951,
|
||||
"learning_rate": 8.494866921610133e-06,
|
||||
"loss": 1.2613,
|
||||
"step": 980
|
||||
},
|
||||
{
|
||||
"epoch": 0.8883903533370724,
|
||||
"grad_norm": 0.4735373556613922,
|
||||
"learning_rate": 7.289353939332288e-06,
|
||||
"loss": 1.2303,
|
||||
"step": 990
|
||||
},
|
||||
{
|
||||
"epoch": 0.89736399326977,
|
||||
"grad_norm": 0.4740982949733734,
|
||||
"learning_rate": 6.1728263459614796e-06,
|
||||
"loss": 1.2695,
|
||||
"step": 1000
|
||||
},
|
||||
{
|
||||
"epoch": 0.9063376332024677,
|
||||
"grad_norm": 0.580386221408844,
|
||||
"learning_rate": 5.146355805285452e-06,
|
||||
"loss": 1.2746,
|
||||
"step": 1010
|
||||
},
|
||||
{
|
||||
"epoch": 0.9153112731351655,
|
||||
"grad_norm": 0.5270484089851379,
|
||||
"learning_rate": 4.210927542670917e-06,
|
||||
"loss": 1.3423,
|
||||
"step": 1020
|
||||
},
|
||||
{
|
||||
"epoch": 0.9242849130678632,
|
||||
"grad_norm": 0.6918372511863708,
|
||||
"learning_rate": 3.367439399426087e-06,
|
||||
"loss": 1.2658,
|
||||
"step": 1030
|
||||
},
|
||||
{
|
||||
"epoch": 0.9332585530005608,
|
||||
"grad_norm": 0.5074269771575928,
|
||||
"learning_rate": 2.616700971036001e-06,
|
||||
"loss": 1.2453,
|
||||
"step": 1040
|
||||
},
|
||||
{
|
||||
"epoch": 0.9422321929332585,
|
||||
"grad_norm": 0.5192223191261292,
|
||||
"learning_rate": 1.959432830097807e-06,
|
||||
"loss": 1.2882,
|
||||
"step": 1050
|
||||
},
|
||||
{
|
||||
"epoch": 0.9512058328659563,
|
||||
"grad_norm": 0.6576820611953735,
|
||||
"learning_rate": 1.396265834701982e-06,
|
||||
"loss": 1.3017,
|
||||
"step": 1060
|
||||
},
|
||||
{
|
||||
"epoch": 0.9601794727986539,
|
||||
"grad_norm": 0.6131830215454102,
|
||||
"learning_rate": 9.277405229229708e-07,
|
||||
"loss": 1.2788,
|
||||
"step": 1070
|
||||
},
|
||||
{
|
||||
"epoch": 0.9691531127313516,
|
||||
"grad_norm": 0.7722458839416504,
|
||||
"learning_rate": 5.543065940008862e-07,
|
||||
"loss": 1.3333,
|
||||
"step": 1080
|
||||
},
|
||||
{
|
||||
"epoch": 0.9781267526640494,
|
||||
"grad_norm": 0.5115715265274048,
|
||||
"learning_rate": 2.7632247671177667e-07,
|
||||
"loss": 1.2451,
|
||||
"step": 1090
|
||||
},
|
||||
{
|
||||
"epoch": 0.9871003925967471,
|
||||
"grad_norm": 0.4745628237724304,
|
||||
"learning_rate": 9.405498534115209e-08,
|
||||
"loss": 1.2909,
|
||||
"step": 1100
|
||||
},
|
||||
{
|
||||
"epoch": 0.9960740325294447,
|
||||
"grad_norm": 0.5007497668266296,
|
||||
"learning_rate": 7.679063590670942e-09,
|
||||
"loss": 1.274,
|
||||
"step": 1110
|
||||
}
|
||||
],
|
||||
"logging_steps": 10,
|
||||
"max_steps": 1114,
|
||||
"num_input_tokens_seen": 0,
|
||||
"num_train_epochs": 1,
|
||||
"save_steps": 500,
|
||||
"stateful_callbacks": {
|
||||
"TrainerControl": {
|
||||
"args": {
|
||||
"should_epoch_stop": false,
|
||||
"should_evaluate": false,
|
||||
"should_log": false,
|
||||
"should_save": true,
|
||||
"should_training_stop": true
|
||||
},
|
||||
"attributes": {}
|
||||
}
|
||||
},
|
||||
"total_flos": 2.558882397416325e+17,
|
||||
"train_batch_size": 1,
|
||||
"trial_name": null,
|
||||
"trial_params": null
|
||||
}
|
||||
3
checkpoint-1114/training_args.bin
Normal file
3
checkpoint-1114/training_args.bin
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b645fad1a039cd89f70f7039cc8886d2c7a262de45d40fb968cc5a321aacd95d
|
||||
size 5304
|
||||
1
checkpoint-1114/vocab.json
Normal file
1
checkpoint-1114/vocab.json
Normal file
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user