Hugging Face's logo

lhpku20010120
/
Omni-Edu-4B

Image-Text-to-Text
Transformers
Safetensors
qwen3_5
education
k-12
tutoring
curriculum-grounding
multimodal
instruction-tuning
llama-factory
full
conversational
Model card Files
xet
 Community
5
lhpku20010120 tunaaa126 commited on
Commit
62a3ea8
·
1 Parent(s): da71518

add OmniEdu-4B (#1)

Browse files

- Upload README.md (974afea8b59d6711e2cfd4893181b82de9dd4383)
- Upload config.json (4a7d5c801c9c90edca3954cedbd2b53332502a23)
- Upload generation_config.json (66a0f9fd55d3cfe6baa296b4b6b364498fa992fe)
- Upload chat_template.jinja (c9b93979bf3475a8013c459bb9648ac0fc827da8)
- Upload processor_config.json (8726240e3172402b6e901cc6d1e1fedfc6c346cf)
- Upload tokenizer_config.json (679dd577665c1b3a634843e3d891d33e6bd01154)
- Upload tokenizer.json (c91227eddde3ecc09da6a832a45242742e53cbc8)
- Upload all_results.json (0c3c204d693ddba8082d53980e75ddcc5010f4a5)
- Upload train_results.json (f5b5e79e8063fef85806d3dbfbb646bafacf9213)
- Upload trainer_log.jsonl (b8d390c93893f1e935f094a57bb44d0e545e0dc1)
- Upload trainer_state.json (fd89fc6c93d843c1c7c35b09f0d209c84b67ea1c)
- Upload training_args.bin (3a6f052a310acca10b4d9d3604e1eac87a1b5360)
- Upload training_loss.png (321978ed473e448cfd886814608e1c1bd494fa94)


Co-authored-by: Qihan Lin <tunaaa126@users.noreply.huggingface.co>

Files changed (14) hide show
  1. .gitattributes +1 -0
  2. README.md +60 -0
  3. all_results.json +8 -0
  4. chat_template.jinja +154 -0
  5. config.json +113 -0
  6. generation_config.json +10 -0
  7. processor_config.json +63 -0
  8. tokenizer.json +3 -0
  9. tokenizer_config.json +33 -0
  10. train_results.json +8 -0
  11. trainer_log.jsonl +329 -0
  12. trainer_state.json +2339 -0
  13. training_args.bin +3 -0
  14. training_loss.png +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: other
4
+ tags:
5
+ - llama-factory
6
+ - full
7
+ - generated_from_trainer
8
+ model-index:
9
+ - name: core-v6-system-prompted-full-standard
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # core-v6-system-prompted-full-standard
17
+
18
+ This model is a fine-tuned version of Qwen3.5-4B-Base on the core_v6_full_system_prompted dataset.
19
+
20
+ ## Model description
21
+
22
+ More information needed
23
+
24
+ ## Intended uses & limitations
25
+
26
+ More information needed
27
+
28
+ ## Training and evaluation data
29
+
30
+ More information needed
31
+
32
+ ## Training procedure
33
+
34
+ ### Training hyperparameters
35
+
36
+ The following hyperparameters were used during training:
37
+ - learning_rate: 5e-06
38
+ - train_batch_size: 1
39
+ - eval_batch_size: 8
40
+ - seed: 42
41
+ - distributed_type: multi-GPU
42
+ - num_devices: 8
43
+ - gradient_accumulation_steps: 8
44
+ - total_train_batch_size: 64
45
+ - total_eval_batch_size: 64
46
+ - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
+ - lr_scheduler_type: cosine
48
+ - lr_scheduler_warmup_steps: 0.1
49
+ - num_epochs: 3.0
50
+
51
+ ### Training results
52
+
53
+
54
+
55
+ ### Framework versions
56
+
57
+ - Transformers 5.2.0
58
+ - Pytorch 2.10.0
59
+ - Datasets 4.0.0
60
+ - Tokenizers 0.22.2
all_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "total_flos": 545049086656512.0,
4
+ "train_loss": 0.4685640548112405,
5
+ "train_runtime": 40125.0714,
6
+ "train_samples_per_second": 5.234,
7
+ "train_steps_per_second": 0.082
8
+ }
chat_template.jinja ADDED
@@ -0,0 +1,154 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- set image_count = namespace(value=0) %}
2
+ {%- set video_count = namespace(value=0) %}
3
+ {%- macro render_content(content, do_vision_count, is_system_content=false) %}
4
+ {%- if content is string %}
5
+ {{- content }}
6
+ {%- elif content is iterable and content is not mapping %}
7
+ {%- for item in content %}
8
+ {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
9
+ {%- if is_system_content %}
10
+ {{- raise_exception('System message cannot contain images.') }}
11
+ {%- endif %}
12
+ {%- if do_vision_count %}
13
+ {%- set image_count.value = image_count.value + 1 %}
14
+ {%- endif %}
15
+ {%- if add_vision_id %}
16
+ {{- 'Picture ' ~ image_count.value ~ ': ' }}
17
+ {%- endif %}
18
+ {{- '<|vision_start|><|image_pad|><|vision_end|>' }}
19
+ {%- elif 'video' in item or item.type == 'video' %}
20
+ {%- if is_system_content %}
21
+ {{- raise_exception('System message cannot contain videos.') }}
22
+ {%- endif %}
23
+ {%- if do_vision_count %}
24
+ {%- set video_count.value = video_count.value + 1 %}
25
+ {%- endif %}
26
+ {%- if add_vision_id %}
27
+ {{- 'Video ' ~ video_count.value ~ ': ' }}
28
+ {%- endif %}
29
+ {{- '<|vision_start|><|video_pad|><|vision_end|>' }}
30
+ {%- elif 'text' in item %}
31
+ {{- item.text }}
32
+ {%- else %}
33
+ {{- raise_exception('Unexpected item type in content.') }}
34
+ {%- endif %}
35
+ {%- endfor %}
36
+ {%- elif content is none or content is undefined %}
37
+ {{- '' }}
38
+ {%- else %}
39
+ {{- raise_exception('Unexpected content type.') }}
40
+ {%- endif %}
41
+ {%- endmacro %}
42
+ {%- if not messages %}
43
+ {{- raise_exception('No messages provided.') }}
44
+ {%- endif %}
45
+ {%- if tools and tools is iterable and tools is not mapping %}
46
+ {{- '<|im_start|>system\n' }}
47
+ {{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
48
+ {%- for tool in tools %}
49
+ {{- "\n" }}
50
+ {{- tool | tojson }}
51
+ {%- endfor %}
52
+ {{- "\n</tools>" }}
53
+ {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
54
+ {%- if messages[0].role == 'system' %}
55
+ {%- set content = render_content(messages[0].content, false, true)|trim %}
56
+ {%- if content %}
57
+ {{- '\n\n' + content }}
58
+ {%- endif %}
59
+ {%- endif %}
60
+ {{- '<|im_end|>\n' }}
61
+ {%- else %}
62
+ {%- if messages[0].role == 'system' %}
63
+ {%- set content = render_content(messages[0].content, false, true)|trim %}
64
+ {{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
65
+ {%- endif %}
66
+ {%- endif %}
67
+ {%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
68
+ {%- for message in messages[::-1] %}
69
+ {%- set index = (messages|length - 1) - loop.index0 %}
70
+ {%- if ns.multi_step_tool and message.role == "user" %}
71
+ {%- set content = render_content(message.content, false)|trim %}
72
+ {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
73
+ {%- set ns.multi_step_tool = false %}
74
+ {%- set ns.last_query_index = index %}
75
+ {%- endif %}
76
+ {%- endif %}
77
+ {%- endfor %}
78
+ {%- if ns.multi_step_tool %}
79
+ {{- raise_exception('No user query found in messages.') }}
80
+ {%- endif %}
81
+ {%- for message in messages %}
82
+ {%- set content = render_content(message.content, true)|trim %}
83
+ {%- if message.role == "system" %}
84
+ {%- if not loop.first %}
85
+ {{- raise_exception('System message must be at the beginning.') }}
86
+ {%- endif %}
87
+ {%- elif message.role == "user" %}
88
+ {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
89
+ {%- elif message.role == "assistant" %}
90
+ {%- set reasoning_content = '' %}
91
+ {%- if message.reasoning_content is string %}
92
+ {%- set reasoning_content = message.reasoning_content %}
93
+ {%- else %}
94
+ {%- if '</think>' in content %}
95
+ {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
96
+ {%- set content = content.split('</think>')[-1].lstrip('\n') %}
97
+ {%- endif %}
98
+ {%- endif %}
99
+ {%- set reasoning_content = reasoning_content|trim %}
100
+ {%- if loop.index0 > ns.last_query_index %}
101
+ {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content + '\n</think>\n\n' + content }}
102
+ {%- else %}
103
+ {{- '<|im_start|>' + message.role + '\n' + content }}
104
+ {%- endif %}
105
+ {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
106
+ {%- for tool_call in message.tool_calls %}
107
+ {%- if tool_call.function is defined %}
108
+ {%- set tool_call = tool_call.function %}
109
+ {%- endif %}
110
+ {%- if loop.first %}
111
+ {%- if content|trim %}
112
+ {{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
113
+ {%- else %}
114
+ {{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
115
+ {%- endif %}
116
+ {%- else %}
117
+ {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
118
+ {%- endif %}
119
+ {%- if tool_call.arguments is defined %}
120
+ {%- for args_name, args_value in tool_call.arguments|items %}
121
+ {{- '<parameter=' + args_name + '>\n' }}
122
+ {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
123
+ {{- args_value }}
124
+ {{- '\n</parameter>\n' }}
125
+ {%- endfor %}
126
+ {%- endif %}
127
+ {{- '</function>\n</tool_call>' }}
128
+ {%- endfor %}
129
+ {%- endif %}
130
+ {{- '<|im_end|>\n' }}
131
+ {%- elif message.role == "tool" %}
132
+ {%- if loop.previtem and loop.previtem.role != "tool" %}
133
+ {{- '<|im_start|>user' }}
134
+ {%- endif %}
135
+ {{- '\n<tool_response>\n' }}
136
+ {{- content }}
137
+ {{- '\n</tool_response>' }}
138
+ {%- if not loop.last and loop.nextitem.role != "tool" %}
139
+ {{- '<|im_end|>\n' }}
140
+ {%- elif loop.last %}
141
+ {{- '<|im_end|>\n' }}
142
+ {%- endif %}
143
+ {%- else %}
144
+ {{- raise_exception('Unexpected message role.') }}
145
+ {%- endif %}
146
+ {%- endfor %}
147
+ {%- if add_generation_prompt %}
148
+ {{- '<|im_start|>assistant\n' }}
149
+ {%- if enable_thinking is defined and enable_thinking is false %}
150
+ {{- '<think>\n\n</think>\n\n' }}
151
+ {%- else %}
152
+ {{- '<think>\n' }}
153
+ {%- endif %}
154
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3_5ForConditionalGeneration"
4
+ ],
5
+ "dtype": "bfloat16",
6
+ "eos_token_id": 248046,
7
+ "hidden_size": 2560,
8
+ "image_token_id": 248056,
9
+ "model_type": "qwen3_5",
10
+ "pad_token_id": 248044,
11
+ "text_config": {
12
+ "attention_bias": false,
13
+ "attention_dropout": 0.0,
14
+ "attn_output_gate": true,
15
+ "bos_token_id": null,
16
+ "dtype": "bfloat16",
17
+ "eos_token_id": 248044,
18
+ "full_attention_interval": 4,
19
+ "head_dim": 256,
20
+ "hidden_act": "silu",
21
+ "hidden_size": 2560,
22
+ "initializer_range": 0.02,
23
+ "intermediate_size": 9216,
24
+ "layer_types": [
25
+ "linear_attention",
26
+ "linear_attention",
27
+ "linear_attention",
28
+ "full_attention",
29
+ "linear_attention",
30
+ "linear_attention",
31
+ "linear_attention",
32
+ "full_attention",
33
+ "linear_attention",
34
+ "linear_attention",
35
+ "linear_attention",
36
+ "full_attention",
37
+ "linear_attention",
38
+ "linear_attention",
39
+ "linear_attention",
40
+ "full_attention",
41
+ "linear_attention",
42
+ "linear_attention",
43
+ "linear_attention",
44
+ "full_attention",
45
+ "linear_attention",
46
+ "linear_attention",
47
+ "linear_attention",
48
+ "full_attention",
49
+ "linear_attention",
50
+ "linear_attention",
51
+ "linear_attention",
52
+ "full_attention",
53
+ "linear_attention",
54
+ "linear_attention",
55
+ "linear_attention",
56
+ "full_attention"
57
+ ],
58
+ "linear_conv_kernel_dim": 4,
59
+ "linear_key_head_dim": 128,
60
+ "linear_num_key_heads": 16,
61
+ "linear_num_value_heads": 32,
62
+ "linear_value_head_dim": 128,
63
+ "mamba_ssm_dtype": "float32",
64
+ "max_position_embeddings": 262144,
65
+ "mlp_only_layers": [],
66
+ "model_type": "qwen3_5_text",
67
+ "mtp_num_hidden_layers": 1,
68
+ "mtp_use_dedicated_embeddings": false,
69
+ "num_attention_heads": 16,
70
+ "num_hidden_layers": 32,
71
+ "num_key_value_heads": 4,
72
+ "pad_token_id": null,
73
+ "partial_rotary_factor": 0.25,
74
+ "rms_norm_eps": 1e-06,
75
+ "rope_parameters": {
76
+ "mrope_interleaved": true,
77
+ "mrope_section": [
78
+ 11,
79
+ 11,
80
+ 10
81
+ ],
82
+ "partial_rotary_factor": 0.25,
83
+ "rope_theta": 10000000,
84
+ "rope_type": "default"
85
+ },
86
+ "tie_word_embeddings": true,
87
+ "use_cache": false,
88
+ "vocab_size": 248320
89
+ },
90
+ "tie_word_embeddings": true,
91
+ "transformers_version": "5.2.0",
92
+ "use_cache": false,
93
+ "video_token_id": 248057,
94
+ "vision_config": {
95
+ "deepstack_visual_indexes": [],
96
+ "depth": 24,
97
+ "dtype": "bfloat16",
98
+ "hidden_act": "gelu_pytorch_tanh",
99
+ "hidden_size": 1024,
100
+ "in_channels": 3,
101
+ "initializer_range": 0.02,
102
+ "intermediate_size": 4096,
103
+ "model_type": "qwen3_5",
104
+ "num_heads": 16,
105
+ "num_position_embeddings": 2304,
106
+ "out_hidden_size": 2560,
107
+ "patch_size": 16,
108
+ "spatial_merge_size": 2,
109
+ "temporal_patch_size": 2
110
+ },
111
+ "vision_end_token_id": 248054,
112
+ "vision_start_token_id": 248053
113
+ }
generation_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "eos_token_id": [
4
+ 248046,
5
+ 248044
6
+ ],
7
+ "pad_token_id": 248044,
8
+ "transformers_version": "5.2.0",
9
+ "use_cache": true
10
+ }
processor_config.json ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "image_processor": {
3
+ "data_format": "channels_first",
4
+ "do_convert_rgb": true,
5
+ "do_normalize": true,
6
+ "do_rescale": true,
7
+ "do_resize": true,
8
+ "image_mean": [
9
+ 0.5,
10
+ 0.5,
11
+ 0.5
12
+ ],
13
+ "image_processor_type": "Qwen2VLImageProcessorFast",
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "merge_size": 2,
20
+ "patch_size": 16,
21
+ "resample": 3,
22
+ "rescale_factor": 0.00392156862745098,
23
+ "size": {
24
+ "longest_edge": 16777216,
25
+ "shortest_edge": 65536
26
+ },
27
+ "temporal_patch_size": 2
28
+ },
29
+ "processor_class": "Qwen3VLProcessor",
30
+ "video_processor": {
31
+ "data_format": "channels_first",
32
+ "default_to_square": true,
33
+ "do_convert_rgb": true,
34
+ "do_normalize": true,
35
+ "do_rescale": true,
36
+ "do_resize": true,
37
+ "do_sample_frames": true,
38
+ "fps": 2,
39
+ "image_mean": [
40
+ 0.5,
41
+ 0.5,
42
+ 0.5
43
+ ],
44
+ "image_std": [
45
+ 0.5,
46
+ 0.5,
47
+ 0.5
48
+ ],
49
+ "max_frames": 768,
50
+ "merge_size": 2,
51
+ "min_frames": 4,
52
+ "patch_size": 16,
53
+ "resample": 3,
54
+ "rescale_factor": 0.00392156862745098,
55
+ "return_metadata": false,
56
+ "size": {
57
+ "longest_edge": 234881024,
58
+ "shortest_edge": 4096
59
+ },
60
+ "temporal_patch_size": 2,
61
+ "video_processor_type": "Qwen3VLVideoProcessor"
62
+ }
63
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4
3
+ size 19989343
tokenizer_config.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "audio_bos_token": "<|audio_start|>",
4
+ "audio_eos_token": "<|audio_end|>",
5
+ "audio_token": "<|audio_pad|>",
6
+ "backend": "tokenizers",
7
+ "bos_token": null,
8
+ "clean_up_tokenization_spaces": false,
9
+ "eos_token": "<|im_end|>",
10
+ "errors": "replace",
11
+ "image_token": "<|image_pad|>",
12
+ "is_local": true,
13
+ "model_max_length": 262144,
14
+ "model_specific_special_tokens": {
15
+ "audio_bos_token": "<|audio_start|>",
16
+ "audio_eos_token": "<|audio_end|>",
17
+ "audio_token": "<|audio_pad|>",
18
+ "image_token": "<|image_pad|>",
19
+ "video_token": "<|video_pad|>",
20
+ "vision_bos_token": "<|vision_start|>",
21
+ "vision_eos_token": "<|vision_end|>"
22
+ },
23
+ "pad_token": "<|endoftext|>",
24
+ "padding_side": "right",
25
+ "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
26
+ "processor_class": "Qwen3VLProcessor",
27
+ "split_special_tokens": false,
28
+ "tokenizer_class": "TokenizersBackend",
29
+ "unk_token": null,
30
+ "video_token": "<|video_pad|>",
31
+ "vision_bos_token": "<|vision_start|>",
32
+ "vision_eos_token": "<|vision_end|>"
33
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "total_flos": 545049086656512.0,
4
+ "train_loss": 0.4685640548112405,
5
+ "train_runtime": 40125.0714,
6
+ "train_samples_per_second": 5.234,
7
+ "train_steps_per_second": 0.082
8
+ }
trainer_log.jsonl ADDED
@@ -0,0 +1,329 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"current_steps": 10, "total_steps": 3282, "loss": 1.1274017333984374, "lr": 1.3677811550151977e-07, "epoch": 0.009142857142857144, "percentage": 0.3, "elapsed_time": "0:01:58", "remaining_time": "10:43:47"}
2
+ {"current_steps": 20, "total_steps": 3282, "loss": 1.130257797241211, "lr": 2.887537993920973e-07, "epoch": 0.018285714285714287, "percentage": 0.61, "elapsed_time": "0:04:10", "remaining_time": "11:21:29"}
3
+ {"current_steps": 30, "total_steps": 3282, "loss": 1.1144439697265625, "lr": 4.407294832826748e-07, "epoch": 0.027428571428571427, "percentage": 0.91, "elapsed_time": "0:06:00", "remaining_time": "10:51:45"}
4
+ {"current_steps": 40, "total_steps": 3282, "loss": 1.0094490051269531, "lr": 5.927051671732524e-07, "epoch": 0.036571428571428574, "percentage": 1.22, "elapsed_time": "0:08:10", "remaining_time": "11:03:12"}
5
+ {"current_steps": 50, "total_steps": 3282, "loss": 0.9933881759643555, "lr": 7.446808510638298e-07, "epoch": 0.045714285714285714, "percentage": 1.52, "elapsed_time": "0:10:15", "remaining_time": "11:03:19"}
6
+ {"current_steps": 60, "total_steps": 3282, "loss": 0.9302140235900879, "lr": 8.966565349544073e-07, "epoch": 0.054857142857142854, "percentage": 1.83, "elapsed_time": "0:12:14", "remaining_time": "10:57:44"}
7
+ {"current_steps": 70, "total_steps": 3282, "loss": 0.8694108963012696, "lr": 1.0486322188449848e-06, "epoch": 0.064, "percentage": 2.13, "elapsed_time": "0:14:17", "remaining_time": "10:55:58"}
8
+ {"current_steps": 80, "total_steps": 3282, "loss": 0.8164114952087402, "lr": 1.2006079027355624e-06, "epoch": 0.07314285714285715, "percentage": 2.44, "elapsed_time": "0:16:16", "remaining_time": "10:51:05"}
9
+ {"current_steps": 90, "total_steps": 3282, "loss": 0.7984357833862304, "lr": 1.35258358662614e-06, "epoch": 0.08228571428571428, "percentage": 2.74, "elapsed_time": "0:18:11", "remaining_time": "10:45:00"}
10
+ {"current_steps": 100, "total_steps": 3282, "loss": 0.7703581809997558, "lr": 1.5045592705167174e-06, "epoch": 0.09142857142857143, "percentage": 3.05, "elapsed_time": "0:19:58", "remaining_time": "10:35:42"}
11
+ {"current_steps": 110, "total_steps": 3282, "loss": 0.7684980392456054, "lr": 1.656534954407295e-06, "epoch": 0.10057142857142858, "percentage": 3.35, "elapsed_time": "0:22:11", "remaining_time": "10:40:06"}
12
+ {"current_steps": 120, "total_steps": 3282, "loss": 0.7413692951202393, "lr": 1.8085106382978727e-06, "epoch": 0.10971428571428571, "percentage": 3.66, "elapsed_time": "0:24:01", "remaining_time": "10:33:01"}
13
+ {"current_steps": 130, "total_steps": 3282, "loss": 0.7388993263244629, "lr": 1.9604863221884503e-06, "epoch": 0.11885714285714286, "percentage": 3.96, "elapsed_time": "0:26:03", "remaining_time": "10:31:58"}
14
+ {"current_steps": 140, "total_steps": 3282, "loss": 0.7307013511657715, "lr": 2.1124620060790275e-06, "epoch": 0.128, "percentage": 4.27, "elapsed_time": "0:28:10", "remaining_time": "10:32:25"}
15
+ {"current_steps": 150, "total_steps": 3282, "loss": 0.7406478881835937, "lr": 2.264437689969605e-06, "epoch": 0.13714285714285715, "percentage": 4.57, "elapsed_time": "0:30:19", "remaining_time": "10:33:02"}
16
+ {"current_steps": 160, "total_steps": 3282, "loss": 0.7177257061004638, "lr": 2.4164133738601827e-06, "epoch": 0.1462857142857143, "percentage": 4.88, "elapsed_time": "0:32:30", "remaining_time": "10:34:26"}
17
+ {"current_steps": 170, "total_steps": 3282, "loss": 0.6978429794311524, "lr": 2.5683890577507603e-06, "epoch": 0.15542857142857142, "percentage": 5.18, "elapsed_time": "0:34:44", "remaining_time": "10:35:59"}
18
+ {"current_steps": 180, "total_steps": 3282, "loss": 0.6770498275756835, "lr": 2.7203647416413375e-06, "epoch": 0.16457142857142856, "percentage": 5.48, "elapsed_time": "0:36:46", "remaining_time": "10:33:50"}
19
+ {"current_steps": 190, "total_steps": 3282, "loss": 0.7257111072540283, "lr": 2.8723404255319155e-06, "epoch": 0.1737142857142857, "percentage": 5.79, "elapsed_time": "0:38:50", "remaining_time": "10:32:06"}
20
+ {"current_steps": 200, "total_steps": 3282, "loss": 0.7295607566833496, "lr": 3.0243161094224927e-06, "epoch": 0.18285714285714286, "percentage": 6.09, "elapsed_time": "0:40:57", "remaining_time": "10:31:04"}
21
+ {"current_steps": 210, "total_steps": 3282, "loss": 0.6859935760498047, "lr": 3.17629179331307e-06, "epoch": 0.192, "percentage": 6.4, "elapsed_time": "0:42:59", "remaining_time": "10:28:48"}
22
+ {"current_steps": 220, "total_steps": 3282, "loss": 0.666834545135498, "lr": 3.328267477203648e-06, "epoch": 0.20114285714285715, "percentage": 6.7, "elapsed_time": "0:44:52", "remaining_time": "10:24:35"}
23
+ {"current_steps": 230, "total_steps": 3282, "loss": 0.6818761825561523, "lr": 3.480243161094225e-06, "epoch": 0.2102857142857143, "percentage": 7.01, "elapsed_time": "0:47:15", "remaining_time": "10:26:59"}
24
+ {"current_steps": 240, "total_steps": 3282, "loss": 0.6924076557159424, "lr": 3.6322188449848027e-06, "epoch": 0.21942857142857142, "percentage": 7.31, "elapsed_time": "0:49:08", "remaining_time": "10:22:55"}
25
+ {"current_steps": 250, "total_steps": 3282, "loss": 0.6980094909667969, "lr": 3.78419452887538e-06, "epoch": 0.22857142857142856, "percentage": 7.62, "elapsed_time": "0:51:00", "remaining_time": "10:18:39"}
26
+ {"current_steps": 260, "total_steps": 3282, "loss": 0.6831412792205811, "lr": 3.936170212765958e-06, "epoch": 0.2377142857142857, "percentage": 7.92, "elapsed_time": "0:52:50", "remaining_time": "10:14:13"}
27
+ {"current_steps": 270, "total_steps": 3282, "loss": 0.7023505210876465, "lr": 4.088145896656536e-06, "epoch": 0.24685714285714286, "percentage": 8.23, "elapsed_time": "0:54:46", "remaining_time": "10:10:58"}
28
+ {"current_steps": 280, "total_steps": 3282, "loss": 0.6777481079101563, "lr": 4.240121580547113e-06, "epoch": 0.256, "percentage": 8.53, "elapsed_time": "0:56:37", "remaining_time": "10:07:11"}
29
+ {"current_steps": 290, "total_steps": 3282, "loss": 0.6797102928161621, "lr": 4.39209726443769e-06, "epoch": 0.2651428571428571, "percentage": 8.84, "elapsed_time": "0:58:44", "remaining_time": "10:05:58"}
30
+ {"current_steps": 300, "total_steps": 3282, "loss": 0.6712003231048584, "lr": 4.544072948328268e-06, "epoch": 0.2742857142857143, "percentage": 9.14, "elapsed_time": "1:00:51", "remaining_time": "10:04:52"}
31
+ {"current_steps": 310, "total_steps": 3282, "loss": 0.6998483657836914, "lr": 4.696048632218845e-06, "epoch": 0.2834285714285714, "percentage": 9.45, "elapsed_time": "1:03:04", "remaining_time": "10:04:45"}
32
+ {"current_steps": 320, "total_steps": 3282, "loss": 0.6608274936676025, "lr": 4.848024316109423e-06, "epoch": 0.2925714285714286, "percentage": 9.75, "elapsed_time": "1:05:03", "remaining_time": "10:02:12"}
33
+ {"current_steps": 330, "total_steps": 3282, "loss": 0.6844888687133789, "lr": 5e-06, "epoch": 0.3017142857142857, "percentage": 10.05, "elapsed_time": "1:06:56", "remaining_time": "9:58:49"}
34
+ {"current_steps": 340, "total_steps": 3282, "loss": 0.6876991271972657, "lr": 4.999858525304355e-06, "epoch": 0.31085714285714283, "percentage": 10.36, "elapsed_time": "1:09:03", "remaining_time": "9:57:34"}
35
+ {"current_steps": 350, "total_steps": 3282, "loss": 0.6663712501525879, "lr": 4.999434117229488e-06, "epoch": 0.32, "percentage": 10.66, "elapsed_time": "1:10:55", "remaining_time": "9:54:08"}
36
+ {"current_steps": 360, "total_steps": 3282, "loss": 0.6727951526641845, "lr": 4.9987268238098055e-06, "epoch": 0.3291428571428571, "percentage": 10.97, "elapsed_time": "1:12:54", "remaining_time": "9:51:43"}
37
+ {"current_steps": 370, "total_steps": 3282, "loss": 0.662196159362793, "lr": 4.997736725096601e-06, "epoch": 0.3382857142857143, "percentage": 11.27, "elapsed_time": "1:15:09", "remaining_time": "9:51:27"}
38
+ {"current_steps": 380, "total_steps": 3282, "loss": 0.6673268795013427, "lr": 4.996463933149008e-06, "epoch": 0.3474285714285714, "percentage": 11.58, "elapsed_time": "1:17:15", "remaining_time": "9:50:02"}
39
+ {"current_steps": 390, "total_steps": 3282, "loss": 0.6938044548034668, "lr": 4.994908592021309e-06, "epoch": 0.3565714285714286, "percentage": 11.88, "elapsed_time": "1:19:20", "remaining_time": "9:48:19"}
40
+ {"current_steps": 400, "total_steps": 3282, "loss": 0.669778299331665, "lr": 4.993070877746634e-06, "epoch": 0.3657142857142857, "percentage": 12.19, "elapsed_time": "1:21:29", "remaining_time": "9:47:07"}
41
+ {"current_steps": 410, "total_steps": 3282, "loss": 0.688864803314209, "lr": 4.990950998317036e-06, "epoch": 0.37485714285714283, "percentage": 12.49, "elapsed_time": "1:23:37", "remaining_time": "9:45:46"}
42
+ {"current_steps": 420, "total_steps": 3282, "loss": 0.6867477416992187, "lr": 4.988549193659954e-06, "epoch": 0.384, "percentage": 12.8, "elapsed_time": "1:25:35", "remaining_time": "9:43:15"}
43
+ {"current_steps": 430, "total_steps": 3282, "loss": 0.6630826950073242, "lr": 4.985865735611053e-06, "epoch": 0.3931428571428571, "percentage": 13.1, "elapsed_time": "1:27:47", "remaining_time": "9:42:19"}
44
+ {"current_steps": 440, "total_steps": 3282, "loss": 0.6371231079101562, "lr": 4.982900927883463e-06, "epoch": 0.4022857142857143, "percentage": 13.41, "elapsed_time": "1:29:33", "remaining_time": "9:38:25"}
45
+ {"current_steps": 450, "total_steps": 3282, "loss": 0.6728553295135498, "lr": 4.9796551060334006e-06, "epoch": 0.4114285714285714, "percentage": 13.71, "elapsed_time": "1:31:41", "remaining_time": "9:37:02"}
46
+ {"current_steps": 460, "total_steps": 3282, "loss": 0.6505355358123779, "lr": 4.976128637422191e-06, "epoch": 0.4205714285714286, "percentage": 14.02, "elapsed_time": "1:33:36", "remaining_time": "9:34:14"}
47
+ {"current_steps": 470, "total_steps": 3282, "loss": 0.6685686588287354, "lr": 4.972321921174695e-06, "epoch": 0.4297142857142857, "percentage": 14.32, "elapsed_time": "1:35:35", "remaining_time": "9:31:52"}
48
+ {"current_steps": 480, "total_steps": 3282, "loss": 0.6945607662200928, "lr": 4.9682353881341295e-06, "epoch": 0.43885714285714283, "percentage": 14.63, "elapsed_time": "1:37:48", "remaining_time": "9:30:54"}
49
+ {"current_steps": 490, "total_steps": 3282, "loss": 0.6876946926116944, "lr": 4.963869500813308e-06, "epoch": 0.448, "percentage": 14.93, "elapsed_time": "1:39:34", "remaining_time": "9:27:22"}
50
+ {"current_steps": 500, "total_steps": 3282, "loss": 0.6807312488555908, "lr": 4.959224753342297e-06, "epoch": 0.45714285714285713, "percentage": 15.23, "elapsed_time": "1:41:20", "remaining_time": "9:23:51"}
51
+ {"current_steps": 510, "total_steps": 3282, "loss": 0.6369428634643555, "lr": 4.954301671412482e-06, "epoch": 0.4662857142857143, "percentage": 15.54, "elapsed_time": "1:43:55", "remaining_time": "9:24:53"}
52
+ {"current_steps": 520, "total_steps": 3282, "loss": 0.6668852806091309, "lr": 4.949100812217079e-06, "epoch": 0.4754285714285714, "percentage": 15.84, "elapsed_time": "1:45:58", "remaining_time": "9:22:53"}
53
+ {"current_steps": 530, "total_steps": 3282, "loss": 0.67324800491333, "lr": 4.943622764388064e-06, "epoch": 0.4845714285714286, "percentage": 16.15, "elapsed_time": "1:48:08", "remaining_time": "9:21:30"}
54
+ {"current_steps": 540, "total_steps": 3282, "loss": 0.6824999332427979, "lr": 4.937868147929557e-06, "epoch": 0.4937142857142857, "percentage": 16.45, "elapsed_time": "1:50:09", "remaining_time": "9:19:19"}
55
+ {"current_steps": 550, "total_steps": 3282, "loss": 0.659266471862793, "lr": 4.931837614147648e-06, "epoch": 0.5028571428571429, "percentage": 16.76, "elapsed_time": "1:52:01", "remaining_time": "9:16:28"}
56
+ {"current_steps": 560, "total_steps": 3282, "loss": 0.6849282264709473, "lr": 4.925531845576681e-06, "epoch": 0.512, "percentage": 17.06, "elapsed_time": "1:53:58", "remaining_time": "9:14:01"}
57
+ {"current_steps": 570, "total_steps": 3282, "loss": 0.6748706817626953, "lr": 4.918951555902009e-06, "epoch": 0.5211428571428571, "percentage": 17.37, "elapsed_time": "1:55:57", "remaining_time": "9:11:40"}
58
+ {"current_steps": 580, "total_steps": 3282, "loss": 0.6703314781188965, "lr": 4.912097489879214e-06, "epoch": 0.5302857142857142, "percentage": 17.67, "elapsed_time": "1:57:54", "remaining_time": "9:09:19"}
59
+ {"current_steps": 590, "total_steps": 3282, "loss": 0.6336056232452393, "lr": 4.904970423249821e-06, "epoch": 0.5394285714285715, "percentage": 17.98, "elapsed_time": "2:00:01", "remaining_time": "9:07:38"}
60
+ {"current_steps": 600, "total_steps": 3282, "loss": 0.6563733577728271, "lr": 4.897571162653493e-06, "epoch": 0.5485714285714286, "percentage": 18.28, "elapsed_time": "2:01:43", "remaining_time": "9:04:08"}
61
+ {"current_steps": 610, "total_steps": 3282, "loss": 0.6912389278411866, "lr": 4.8899005455367454e-06, "epoch": 0.5577142857142857, "percentage": 18.59, "elapsed_time": "2:03:51", "remaining_time": "9:02:34"}
62
+ {"current_steps": 620, "total_steps": 3282, "loss": 0.6701306343078614, "lr": 4.881959440058156e-06, "epoch": 0.5668571428571428, "percentage": 18.89, "elapsed_time": "2:05:57", "remaining_time": "9:00:46"}
63
+ {"current_steps": 630, "total_steps": 3282, "loss": 0.6575275421142578, "lr": 4.873748744990106e-06, "epoch": 0.576, "percentage": 19.2, "elapsed_time": "2:07:45", "remaining_time": "8:57:46"}
64
+ {"current_steps": 640, "total_steps": 3282, "loss": 0.6928033351898193, "lr": 4.865269389617067e-06, "epoch": 0.5851428571428572, "percentage": 19.5, "elapsed_time": "2:09:51", "remaining_time": "8:56:06"}
65
+ {"current_steps": 650, "total_steps": 3282, "loss": 0.664832592010498, "lr": 4.8565223336304166e-06, "epoch": 0.5942857142857143, "percentage": 19.8, "elapsed_time": "2:12:18", "remaining_time": "8:55:46"}
66
+ {"current_steps": 660, "total_steps": 3282, "loss": 0.6371614456176757, "lr": 4.847508567019819e-06, "epoch": 0.6034285714285714, "percentage": 20.11, "elapsed_time": "2:14:33", "remaining_time": "8:54:32"}
67
+ {"current_steps": 670, "total_steps": 3282, "loss": 0.6713180541992188, "lr": 4.838229109961184e-06, "epoch": 0.6125714285714285, "percentage": 20.41, "elapsed_time": "2:16:19", "remaining_time": "8:51:27"}
68
+ {"current_steps": 680, "total_steps": 3282, "loss": 0.668572473526001, "lr": 4.828685012701204e-06, "epoch": 0.6217142857142857, "percentage": 20.72, "elapsed_time": "2:18:14", "remaining_time": "8:48:56"}
69
+ {"current_steps": 690, "total_steps": 3282, "loss": 0.6260498523712158, "lr": 4.818877355438483e-06, "epoch": 0.6308571428571429, "percentage": 21.02, "elapsed_time": "2:20:17", "remaining_time": "8:47:02"}
70
+ {"current_steps": 700, "total_steps": 3282, "loss": 0.6418482780456543, "lr": 4.808807248201282e-06, "epoch": 0.64, "percentage": 21.33, "elapsed_time": "2:22:16", "remaining_time": "8:44:47"}
71
+ {"current_steps": 710, "total_steps": 3282, "loss": 0.6437315940856934, "lr": 4.798475830721884e-06, "epoch": 0.6491428571428571, "percentage": 21.63, "elapsed_time": "2:24:20", "remaining_time": "8:42:51"}
72
+ {"current_steps": 720, "total_steps": 3282, "loss": 0.6641323566436768, "lr": 4.787884272307607e-06, "epoch": 0.6582857142857143, "percentage": 21.94, "elapsed_time": "2:26:18", "remaining_time": "8:40:35"}
73
+ {"current_steps": 730, "total_steps": 3282, "loss": 0.6566616058349609, "lr": 4.7770337717084515e-06, "epoch": 0.6674285714285715, "percentage": 22.24, "elapsed_time": "2:28:12", "remaining_time": "8:38:08"}
74
+ {"current_steps": 740, "total_steps": 3282, "loss": 0.6291821002960205, "lr": 4.765925556981434e-06, "epoch": 0.6765714285714286, "percentage": 22.55, "elapsed_time": "2:30:30", "remaining_time": "8:37:00"}
75
+ {"current_steps": 750, "total_steps": 3282, "loss": 0.6643364906311036, "lr": 4.754560885351591e-06, "epoch": 0.6857142857142857, "percentage": 22.85, "elapsed_time": "2:32:44", "remaining_time": "8:35:38"}
76
+ {"current_steps": 760, "total_steps": 3282, "loss": 0.6533621788024903, "lr": 4.742941043069693e-06, "epoch": 0.6948571428571428, "percentage": 23.16, "elapsed_time": "2:34:35", "remaining_time": "8:32:59"}
77
+ {"current_steps": 770, "total_steps": 3282, "loss": 0.6147947311401367, "lr": 4.7310673452666594e-06, "epoch": 0.704, "percentage": 23.46, "elapsed_time": "2:36:31", "remaining_time": "8:30:37"}
78
+ {"current_steps": 780, "total_steps": 3282, "loss": 0.6452123641967773, "lr": 4.718941135804716e-06, "epoch": 0.7131428571428572, "percentage": 23.77, "elapsed_time": "2:38:31", "remaining_time": "8:28:29"}
79
+ {"current_steps": 790, "total_steps": 3282, "loss": 0.6501338958740235, "lr": 4.706563787125298e-06, "epoch": 0.7222857142857143, "percentage": 24.07, "elapsed_time": "2:40:46", "remaining_time": "8:27:08"}
80
+ {"current_steps": 800, "total_steps": 3282, "loss": 0.6493902683258057, "lr": 4.693936700093714e-06, "epoch": 0.7314285714285714, "percentage": 24.38, "elapsed_time": "2:42:43", "remaining_time": "8:24:52"}
81
+ {"current_steps": 810, "total_steps": 3282, "loss": 0.6437974452972413, "lr": 4.6810613038406e-06, "epoch": 0.7405714285714285, "percentage": 24.68, "elapsed_time": "2:44:48", "remaining_time": "8:22:58"}
82
+ {"current_steps": 820, "total_steps": 3282, "loss": 0.6351970672607422, "lr": 4.66793905560017e-06, "epoch": 0.7497142857142857, "percentage": 24.98, "elapsed_time": "2:46:53", "remaining_time": "8:21:05"}
83
+ {"current_steps": 830, "total_steps": 3282, "loss": 0.6340930938720704, "lr": 4.654571440545284e-06, "epoch": 0.7588571428571429, "percentage": 25.29, "elapsed_time": "2:48:51", "remaining_time": "8:18:51"}
84
+ {"current_steps": 840, "total_steps": 3282, "loss": 0.6761879444122314, "lr": 4.64095997161936e-06, "epoch": 0.768, "percentage": 25.59, "elapsed_time": "2:50:48", "remaining_time": "8:16:33"}
85
+ {"current_steps": 850, "total_steps": 3282, "loss": 0.6445336818695069, "lr": 4.627106189365135e-06, "epoch": 0.7771428571428571, "percentage": 25.9, "elapsed_time": "2:52:39", "remaining_time": "8:14:00"}
86
+ {"current_steps": 860, "total_steps": 3282, "loss": 0.6355050086975098, "lr": 4.613011661750313e-06, "epoch": 0.7862857142857143, "percentage": 26.2, "elapsed_time": "2:54:39", "remaining_time": "8:11:54"}
87
+ {"current_steps": 870, "total_steps": 3282, "loss": 0.6417135238647461, "lr": 4.598677983990098e-06, "epoch": 0.7954285714285714, "percentage": 26.51, "elapsed_time": "2:56:33", "remaining_time": "8:09:29"}
88
+ {"current_steps": 880, "total_steps": 3282, "loss": 0.6485600471496582, "lr": 4.584106778366648e-06, "epoch": 0.8045714285714286, "percentage": 26.81, "elapsed_time": "2:58:19", "remaining_time": "8:06:43"}
89
+ {"current_steps": 890, "total_steps": 3282, "loss": 0.6439845085144043, "lr": 4.5692996940454674e-06, "epoch": 0.8137142857142857, "percentage": 27.12, "elapsed_time": "3:00:42", "remaining_time": "8:05:40"}
90
+ {"current_steps": 900, "total_steps": 3282, "loss": 0.6050587177276612, "lr": 4.554258406888754e-06, "epoch": 0.8228571428571428, "percentage": 27.42, "elapsed_time": "3:02:46", "remaining_time": "8:03:43"}
91
+ {"current_steps": 910, "total_steps": 3282, "loss": 0.6268429756164551, "lr": 4.538984619265727e-06, "epoch": 0.832, "percentage": 27.73, "elapsed_time": "3:05:00", "remaining_time": "8:02:14"}
92
+ {"current_steps": 920, "total_steps": 3282, "loss": 0.6478725910186768, "lr": 4.523480059859952e-06, "epoch": 0.8411428571428572, "percentage": 28.03, "elapsed_time": "3:06:45", "remaining_time": "7:59:28"}
93
+ {"current_steps": 930, "total_steps": 3282, "loss": 0.647419548034668, "lr": 4.507746483473683e-06, "epoch": 0.8502857142857143, "percentage": 28.34, "elapsed_time": "3:08:35", "remaining_time": "7:56:57"}
94
+ {"current_steps": 940, "total_steps": 3282, "loss": 0.6321591854095459, "lr": 4.491785670829269e-06, "epoch": 0.8594285714285714, "percentage": 28.64, "elapsed_time": "3:10:40", "remaining_time": "7:55:03"}
95
+ {"current_steps": 950, "total_steps": 3282, "loss": 0.6120502471923828, "lr": 4.475599428367597e-06, "epoch": 0.8685714285714285, "percentage": 28.95, "elapsed_time": "3:12:46", "remaining_time": "7:53:13"}
96
+ {"current_steps": 960, "total_steps": 3282, "loss": 0.6537229537963867, "lr": 4.459189588043647e-06, "epoch": 0.8777142857142857, "percentage": 29.25, "elapsed_time": "3:14:40", "remaining_time": "7:50:51"}
97
+ {"current_steps": 970, "total_steps": 3282, "loss": 0.6399202823638916, "lr": 4.442558007119153e-06, "epoch": 0.8868571428571429, "percentage": 29.56, "elapsed_time": "3:16:57", "remaining_time": "7:49:27"}
98
+ {"current_steps": 980, "total_steps": 3282, "loss": 0.6669195175170899, "lr": 4.425706567952394e-06, "epoch": 0.896, "percentage": 29.86, "elapsed_time": "3:18:56", "remaining_time": "7:47:19"}
99
+ {"current_steps": 990, "total_steps": 3282, "loss": 0.631269121170044, "lr": 4.408637177785151e-06, "epoch": 0.9051428571428571, "percentage": 30.16, "elapsed_time": "3:21:01", "remaining_time": "7:45:23"}
100
+ {"current_steps": 1000, "total_steps": 3282, "loss": 0.6654349327087402, "lr": 4.391351768526848e-06, "epoch": 0.9142857142857143, "percentage": 30.47, "elapsed_time": "3:23:20", "remaining_time": "7:44:02"}
101
+ {"current_steps": 1010, "total_steps": 3282, "loss": 0.6277427673339844, "lr": 4.373852296535896e-06, "epoch": 0.9234285714285714, "percentage": 30.77, "elapsed_time": "3:25:56", "remaining_time": "7:43:17"}
102
+ {"current_steps": 1020, "total_steps": 3282, "loss": 0.6586026191711426, "lr": 4.3561407423982735e-06, "epoch": 0.9325714285714286, "percentage": 31.08, "elapsed_time": "3:28:02", "remaining_time": "7:41:21"}
103
+ {"current_steps": 1030, "total_steps": 3282, "loss": 0.6150027275085449, "lr": 4.3382191107033655e-06, "epoch": 0.9417142857142857, "percentage": 31.38, "elapsed_time": "3:30:04", "remaining_time": "7:39:17"}
104
+ {"current_steps": 1040, "total_steps": 3282, "loss": 0.6431099891662597, "lr": 4.3200894298170844e-06, "epoch": 0.9508571428571428, "percentage": 31.69, "elapsed_time": "3:32:17", "remaining_time": "7:37:39"}
105
+ {"current_steps": 1050, "total_steps": 3282, "loss": 0.6621922492980957, "lr": 4.301753751652298e-06, "epoch": 0.96, "percentage": 31.99, "elapsed_time": "3:34:37", "remaining_time": "7:36:13"}
106
+ {"current_steps": 1060, "total_steps": 3282, "loss": 0.6344066143035889, "lr": 4.283214151436596e-06, "epoch": 0.9691428571428572, "percentage": 32.3, "elapsed_time": "3:36:35", "remaining_time": "7:34:01"}
107
+ {"current_steps": 1070, "total_steps": 3282, "loss": 0.642180061340332, "lr": 4.264472727477418e-06, "epoch": 0.9782857142857143, "percentage": 32.6, "elapsed_time": "3:38:42", "remaining_time": "7:32:07"}
108
+ {"current_steps": 1080, "total_steps": 3282, "loss": 0.6505527973175049, "lr": 4.245531600924563e-06, "epoch": 0.9874285714285714, "percentage": 32.91, "elapsed_time": "3:40:34", "remaining_time": "7:29:43"}
109
+ {"current_steps": 1090, "total_steps": 3282, "loss": 0.6131467819213867, "lr": 4.226392915530125e-06, "epoch": 0.9965714285714286, "percentage": 33.21, "elapsed_time": "3:42:44", "remaining_time": "7:27:56"}
110
+ {"current_steps": 1100, "total_steps": 3282, "loss": 0.5373872756958008, "lr": 4.207058837405853e-06, "epoch": 1.0054857142857143, "percentage": 33.52, "elapsed_time": "3:44:38", "remaining_time": "7:25:35"}
111
+ {"current_steps": 1110, "total_steps": 3282, "loss": 0.39206643104553224, "lr": 4.187531554778005e-06, "epoch": 1.0146285714285714, "percentage": 33.82, "elapsed_time": "3:46:24", "remaining_time": "7:23:01"}
112
+ {"current_steps": 1120, "total_steps": 3282, "loss": 0.4400962829589844, "lr": 4.167813277739672e-06, "epoch": 1.0237714285714286, "percentage": 34.13, "elapsed_time": "3:48:25", "remaining_time": "7:20:55"}
113
+ {"current_steps": 1130, "total_steps": 3282, "loss": 0.4548200607299805, "lr": 4.147906238000651e-06, "epoch": 1.0329142857142857, "percentage": 34.43, "elapsed_time": "3:50:28", "remaining_time": "7:18:55"}
114
+ {"current_steps": 1140, "total_steps": 3282, "loss": 0.4130233287811279, "lr": 4.1278126886348495e-06, "epoch": 1.0420571428571428, "percentage": 34.73, "elapsed_time": "3:52:32", "remaining_time": "7:16:56"}
115
+ {"current_steps": 1150, "total_steps": 3282, "loss": 0.42951488494873047, "lr": 4.107534903825293e-06, "epoch": 1.0512, "percentage": 35.04, "elapsed_time": "3:54:27", "remaining_time": "7:14:40"}
116
+ {"current_steps": 1160, "total_steps": 3282, "loss": 0.42777132987976074, "lr": 4.087075178606731e-06, "epoch": 1.060342857142857, "percentage": 35.34, "elapsed_time": "3:56:22", "remaining_time": "7:12:24"}
117
+ {"current_steps": 1170, "total_steps": 3282, "loss": 0.4200882911682129, "lr": 4.06643582860588e-06, "epoch": 1.0694857142857144, "percentage": 35.65, "elapsed_time": "3:58:08", "remaining_time": "7:09:53"}
118
+ {"current_steps": 1180, "total_steps": 3282, "loss": 0.46087031364440917, "lr": 4.045619189779348e-06, "epoch": 1.0786285714285715, "percentage": 35.95, "elapsed_time": "4:00:07", "remaining_time": "7:07:45"}
119
+ {"current_steps": 1190, "total_steps": 3282, "loss": 0.43772568702697756, "lr": 4.02462761814925e-06, "epoch": 1.0877714285714286, "percentage": 36.26, "elapsed_time": "4:02:20", "remaining_time": "7:06:02"}
120
+ {"current_steps": 1200, "total_steps": 3282, "loss": 0.4420557975769043, "lr": 4.003463489536551e-06, "epoch": 1.0969142857142857, "percentage": 36.56, "elapsed_time": "4:04:17", "remaining_time": "7:03:50"}
121
+ {"current_steps": 1210, "total_steps": 3282, "loss": 0.4336644172668457, "lr": 3.982129199292174e-06, "epoch": 1.1060571428571428, "percentage": 36.87, "elapsed_time": "4:06:09", "remaining_time": "7:01:32"}
122
+ {"current_steps": 1220, "total_steps": 3282, "loss": 0.4147650241851807, "lr": 3.960627162025896e-06, "epoch": 1.1152, "percentage": 37.17, "elapsed_time": "4:08:06", "remaining_time": "6:59:20"}
123
+ {"current_steps": 1230, "total_steps": 3282, "loss": 0.42612924575805666, "lr": 3.9389598113330575e-06, "epoch": 1.124342857142857, "percentage": 37.48, "elapsed_time": "4:09:55", "remaining_time": "6:56:56"}
124
+ {"current_steps": 1240, "total_steps": 3282, "loss": 0.41550512313842775, "lr": 3.917129599519135e-06, "epoch": 1.1334857142857142, "percentage": 37.78, "elapsed_time": "4:11:46", "remaining_time": "6:54:37"}
125
+ {"current_steps": 1250, "total_steps": 3282, "loss": 0.43940982818603513, "lr": 3.895138997322187e-06, "epoch": 1.1426285714285713, "percentage": 38.09, "elapsed_time": "4:13:23", "remaining_time": "6:51:54"}
126
+ {"current_steps": 1260, "total_steps": 3282, "loss": 0.4418506622314453, "lr": 3.872990493633215e-06, "epoch": 1.1517714285714287, "percentage": 38.39, "elapsed_time": "4:15:35", "remaining_time": "6:50:09"}
127
+ {"current_steps": 1270, "total_steps": 3282, "loss": 0.4440105438232422, "lr": 3.850686595214474e-06, "epoch": 1.1609142857142858, "percentage": 38.7, "elapsed_time": "4:17:31", "remaining_time": "6:47:59"}
128
+ {"current_steps": 1280, "total_steps": 3282, "loss": 0.44544334411621095, "lr": 3.8282298264157556e-06, "epoch": 1.170057142857143, "percentage": 39.0, "elapsed_time": "4:19:35", "remaining_time": "6:46:01"}
129
+ {"current_steps": 1290, "total_steps": 3282, "loss": 0.4278397083282471, "lr": 3.8056227288886853e-06, "epoch": 1.1792, "percentage": 39.31, "elapsed_time": "4:21:40", "remaining_time": "6:44:04"}
130
+ {"current_steps": 1300, "total_steps": 3282, "loss": 0.44417996406555177, "lr": 3.7828678612990577e-06, "epoch": 1.1883428571428571, "percentage": 39.61, "elapsed_time": "4:24:06", "remaining_time": "6:42:39"}
131
+ {"current_steps": 1310, "total_steps": 3282, "loss": 0.4357439041137695, "lr": 3.7599677990372442e-06, "epoch": 1.1974857142857143, "percentage": 39.91, "elapsed_time": "4:26:02", "remaining_time": "6:40:28"}
132
+ {"current_steps": 1320, "total_steps": 3282, "loss": 0.43988494873046874, "lr": 3.7369251339267177e-06, "epoch": 1.2066285714285714, "percentage": 40.22, "elapsed_time": "4:28:12", "remaining_time": "6:38:39"}
133
+ {"current_steps": 1330, "total_steps": 3282, "loss": 0.46861562728881834, "lr": 3.7137424739307036e-06, "epoch": 1.2157714285714285, "percentage": 40.52, "elapsed_time": "4:30:24", "remaining_time": "6:36:52"}
134
+ {"current_steps": 1340, "total_steps": 3282, "loss": 0.43658876419067383, "lr": 3.6904224428570162e-06, "epoch": 1.2249142857142856, "percentage": 40.83, "elapsed_time": "4:32:19", "remaining_time": "6:34:39"}
135
+ {"current_steps": 1350, "total_steps": 3282, "loss": 0.42545366287231445, "lr": 3.6669676800610942e-06, "epoch": 1.234057142857143, "percentage": 41.13, "elapsed_time": "4:34:18", "remaining_time": "6:32:34"}
136
+ {"current_steps": 1360, "total_steps": 3282, "loss": 0.4477118492126465, "lr": 3.6433808401472805e-06, "epoch": 1.2432, "percentage": 41.44, "elapsed_time": "4:36:20", "remaining_time": "6:30:31"}
137
+ {"current_steps": 1370, "total_steps": 3282, "loss": 0.4572641372680664, "lr": 3.6196645926683722e-06, "epoch": 1.2523428571428572, "percentage": 41.74, "elapsed_time": "4:38:13", "remaining_time": "6:28:17"}
138
+ {"current_steps": 1380, "total_steps": 3282, "loss": 0.45319256782531736, "lr": 3.5958216218234858e-06, "epoch": 1.2614857142857143, "percentage": 42.05, "elapsed_time": "4:40:18", "remaining_time": "6:26:20"}
139
+ {"current_steps": 1390, "total_steps": 3282, "loss": 0.4245123863220215, "lr": 3.5718546261542557e-06, "epoch": 1.2706285714285714, "percentage": 42.35, "elapsed_time": "4:42:23", "remaining_time": "6:24:22"}
140
+ {"current_steps": 1400, "total_steps": 3282, "loss": 0.45639562606811523, "lr": 3.5477663182394166e-06, "epoch": 1.2797714285714286, "percentage": 42.66, "elapsed_time": "4:44:30", "remaining_time": "6:22:27"}
141
+ {"current_steps": 1410, "total_steps": 3282, "loss": 0.44690585136413574, "lr": 3.5235594243877922e-06, "epoch": 1.2889142857142857, "percentage": 42.96, "elapsed_time": "4:46:49", "remaining_time": "6:20:48"}
142
+ {"current_steps": 1420, "total_steps": 3282, "loss": 0.45906782150268555, "lr": 3.499236684329736e-06, "epoch": 1.2980571428571428, "percentage": 43.27, "elapsed_time": "4:49:02", "remaining_time": "6:19:01"}
143
+ {"current_steps": 1430, "total_steps": 3282, "loss": 0.45464215278625486, "lr": 3.4748008509070445e-06, "epoch": 1.3072, "percentage": 43.57, "elapsed_time": "4:51:14", "remaining_time": "6:17:11"}
144
+ {"current_steps": 1440, "total_steps": 3282, "loss": 0.43608808517456055, "lr": 3.4502546897613946e-06, "epoch": 1.3163428571428573, "percentage": 43.88, "elapsed_time": "4:53:23", "remaining_time": "6:15:17"}
145
+ {"current_steps": 1450, "total_steps": 3282, "loss": 0.43820781707763673, "lr": 3.4256009790213297e-06, "epoch": 1.3254857142857142, "percentage": 44.18, "elapsed_time": "4:55:15", "remaining_time": "6:13:02"}
146
+ {"current_steps": 1460, "total_steps": 3282, "loss": 0.43073239326477053, "lr": 3.4008425089878265e-06, "epoch": 1.3346285714285715, "percentage": 44.49, "elapsed_time": "4:57:21", "remaining_time": "6:11:05"}
147
+ {"current_steps": 1470, "total_steps": 3282, "loss": 0.45119776725769045, "lr": 3.3759820818184973e-06, "epoch": 1.3437714285714286, "percentage": 44.79, "elapsed_time": "4:59:21", "remaining_time": "6:09:00"}
148
+ {"current_steps": 1480, "total_steps": 3282, "loss": 0.44018216133117677, "lr": 3.3510225112104337e-06, "epoch": 1.3529142857142857, "percentage": 45.09, "elapsed_time": "5:01:19", "remaining_time": "6:06:52"}
149
+ {"current_steps": 1490, "total_steps": 3282, "loss": 0.4520729064941406, "lr": 3.3259666220817622e-06, "epoch": 1.3620571428571429, "percentage": 45.4, "elapsed_time": "5:03:30", "remaining_time": "6:05:01"}
150
+ {"current_steps": 1500, "total_steps": 3282, "loss": 0.462126636505127, "lr": 3.3008172502519126e-06, "epoch": 1.3712, "percentage": 45.7, "elapsed_time": "5:05:25", "remaining_time": "6:02:50"}
151
+ {"current_steps": 1510, "total_steps": 3282, "loss": 0.4293963432312012, "lr": 3.2755772421206644e-06, "epoch": 1.380342857142857, "percentage": 46.01, "elapsed_time": "5:07:47", "remaining_time": "6:01:12"}
152
+ {"current_steps": 1520, "total_steps": 3282, "loss": 0.43875484466552733, "lr": 3.2502494543459933e-06, "epoch": 1.3894857142857142, "percentage": 46.31, "elapsed_time": "5:09:50", "remaining_time": "5:59:10"}
153
+ {"current_steps": 1530, "total_steps": 3282, "loss": 0.4411722183227539, "lr": 3.2248367535207527e-06, "epoch": 1.3986285714285716, "percentage": 46.62, "elapsed_time": "5:11:48", "remaining_time": "5:57:02"}
154
+ {"current_steps": 1540, "total_steps": 3282, "loss": 0.4349213600158691, "lr": 3.1993420158482345e-06, "epoch": 1.4077714285714285, "percentage": 46.92, "elapsed_time": "5:13:51", "remaining_time": "5:55:01"}
155
+ {"current_steps": 1550, "total_steps": 3282, "loss": 0.43657522201538085, "lr": 3.17376812681664e-06, "epoch": 1.4169142857142858, "percentage": 47.23, "elapsed_time": "5:16:07", "remaining_time": "5:53:15"}
156
+ {"current_steps": 1560, "total_steps": 3282, "loss": 0.43779573440551756, "lr": 3.148117980872505e-06, "epoch": 1.426057142857143, "percentage": 47.53, "elapsed_time": "5:17:47", "remaining_time": "5:50:48"}
157
+ {"current_steps": 1570, "total_steps": 3282, "loss": 0.4364370346069336, "lr": 3.1223944810930997e-06, "epoch": 1.4352, "percentage": 47.84, "elapsed_time": "5:19:59", "remaining_time": "5:48:56"}
158
+ {"current_steps": 1580, "total_steps": 3282, "loss": 0.4328590393066406, "lr": 3.0966005388578667e-06, "epoch": 1.4443428571428572, "percentage": 48.14, "elapsed_time": "5:22:02", "remaining_time": "5:46:54"}
159
+ {"current_steps": 1590, "total_steps": 3282, "loss": 0.4478790760040283, "lr": 3.070739073518909e-06, "epoch": 1.4534857142857143, "percentage": 48.45, "elapsed_time": "5:24:10", "remaining_time": "5:44:58"}
160
+ {"current_steps": 1600, "total_steps": 3282, "loss": 0.4431458473205566, "lr": 3.0448130120705755e-06, "epoch": 1.4626285714285714, "percentage": 48.75, "elapsed_time": "5:26:10", "remaining_time": "5:42:53"}
161
+ {"current_steps": 1610, "total_steps": 3282, "loss": 0.43061065673828125, "lr": 3.018825288818189e-06, "epoch": 1.4717714285714285, "percentage": 49.06, "elapsed_time": "5:28:00", "remaining_time": "5:40:37"}
162
+ {"current_steps": 1620, "total_steps": 3282, "loss": 0.42577180862426756, "lr": 2.992778845045939e-06, "epoch": 1.4809142857142858, "percentage": 49.36, "elapsed_time": "5:30:20", "remaining_time": "5:38:53"}
163
+ {"current_steps": 1630, "total_steps": 3282, "loss": 0.4388378143310547, "lr": 2.96667662868399e-06, "epoch": 1.4900571428571427, "percentage": 49.66, "elapsed_time": "5:32:39", "remaining_time": "5:37:08"}
164
+ {"current_steps": 1640, "total_steps": 3282, "loss": 0.4764075756072998, "lr": 2.9405215939748345e-06, "epoch": 1.4992, "percentage": 49.97, "elapsed_time": "5:35:05", "remaining_time": "5:35:29"}
165
+ {"current_steps": 1650, "total_steps": 3282, "loss": 0.44104642868041993, "lr": 2.9143167011389334e-06, "epoch": 1.508342857142857, "percentage": 50.27, "elapsed_time": "5:37:05", "remaining_time": "5:33:25"}
166
+ {"current_steps": 1660, "total_steps": 3282, "loss": 0.46334018707275393, "lr": 2.888064916039676e-06, "epoch": 1.5174857142857143, "percentage": 50.58, "elapsed_time": "5:39:25", "remaining_time": "5:31:39"}
167
+ {"current_steps": 1670, "total_steps": 3282, "loss": 0.44715070724487305, "lr": 2.8617692098477083e-06, "epoch": 1.5266285714285714, "percentage": 50.88, "elapsed_time": "5:41:30", "remaining_time": "5:29:38"}
168
+ {"current_steps": 1680, "total_steps": 3282, "loss": 0.44616308212280276, "lr": 2.8354325587046553e-06, "epoch": 1.5357714285714286, "percentage": 51.19, "elapsed_time": "5:43:50", "remaining_time": "5:27:52"}
169
+ {"current_steps": 1690, "total_steps": 3282, "loss": 0.4543767929077148, "lr": 2.8090579433862804e-06, "epoch": 1.5449142857142857, "percentage": 51.49, "elapsed_time": "5:45:47", "remaining_time": "5:25:44"}
170
+ {"current_steps": 1700, "total_steps": 3282, "loss": 0.40111846923828126, "lr": 2.7826483489651236e-06, "epoch": 1.5540571428571428, "percentage": 51.8, "elapsed_time": "5:47:39", "remaining_time": "5:23:31"}
171
+ {"current_steps": 1710, "total_steps": 3282, "loss": 0.4558586120605469, "lr": 2.7562067644726503e-06, "epoch": 1.5632000000000001, "percentage": 52.1, "elapsed_time": "5:49:40", "remaining_time": "5:21:27"}
172
+ {"current_steps": 1720, "total_steps": 3282, "loss": 0.4243218421936035, "lr": 2.729736182560957e-06, "epoch": 1.572342857142857, "percentage": 52.41, "elapsed_time": "5:51:47", "remaining_time": "5:19:28"}
173
+ {"current_steps": 1730, "total_steps": 3282, "loss": 0.4420520305633545, "lr": 2.7032395991640576e-06, "epoch": 1.5814857142857144, "percentage": 52.71, "elapsed_time": "5:53:47", "remaining_time": "5:17:23"}
174
+ {"current_steps": 1740, "total_steps": 3282, "loss": 0.4580650806427002, "lr": 2.6767200131588104e-06, "epoch": 1.5906285714285713, "percentage": 53.02, "elapsed_time": "5:55:46", "remaining_time": "5:15:17"}
175
+ {"current_steps": 1750, "total_steps": 3282, "loss": 0.45360441207885743, "lr": 2.6501804260255025e-06, "epoch": 1.5997714285714286, "percentage": 53.32, "elapsed_time": "5:57:44", "remaining_time": "5:13:10"}
176
+ {"current_steps": 1760, "total_steps": 3282, "loss": 0.42459897994995116, "lr": 2.6236238415081437e-06, "epoch": 1.6089142857142857, "percentage": 53.63, "elapsed_time": "5:59:38", "remaining_time": "5:11:00"}
177
+ {"current_steps": 1770, "total_steps": 3282, "loss": 0.4341078758239746, "lr": 2.597053265274503e-06, "epoch": 1.6180571428571429, "percentage": 53.93, "elapsed_time": "6:01:45", "remaining_time": "5:09:01"}
178
+ {"current_steps": 1780, "total_steps": 3282, "loss": 0.4280117034912109, "lr": 2.57047170457593e-06, "epoch": 1.6272, "percentage": 54.24, "elapsed_time": "6:03:28", "remaining_time": "5:06:42"}
179
+ {"current_steps": 1790, "total_steps": 3282, "loss": 0.4240222930908203, "lr": 2.5438821679069903e-06, "epoch": 1.636342857142857, "percentage": 54.54, "elapsed_time": "6:05:19", "remaining_time": "5:04:30"}
180
+ {"current_steps": 1800, "total_steps": 3282, "loss": 0.423565673828125, "lr": 2.517287664664973e-06, "epoch": 1.6454857142857144, "percentage": 54.84, "elapsed_time": "6:07:13", "remaining_time": "5:02:20"}
181
+ {"current_steps": 1810, "total_steps": 3282, "loss": 0.4391635894775391, "lr": 2.4906912048092777e-06, "epoch": 1.6546285714285713, "percentage": 55.15, "elapsed_time": "6:09:08", "remaining_time": "5:00:12"}
182
+ {"current_steps": 1820, "total_steps": 3282, "loss": 0.42197561264038086, "lr": 2.4640957985207555e-06, "epoch": 1.6637714285714287, "percentage": 55.45, "elapsed_time": "6:11:02", "remaining_time": "4:58:03"}
183
+ {"current_steps": 1830, "total_steps": 3282, "loss": 0.44665961265563964, "lr": 2.4375044558610138e-06, "epoch": 1.6729142857142856, "percentage": 55.76, "elapsed_time": "6:12:48", "remaining_time": "4:55:48"}
184
+ {"current_steps": 1840, "total_steps": 3282, "loss": 0.4473154544830322, "lr": 2.410920186431742e-06, "epoch": 1.682057142857143, "percentage": 56.06, "elapsed_time": "6:14:47", "remaining_time": "4:53:43"}
185
+ {"current_steps": 1850, "total_steps": 3282, "loss": 0.41730351448059083, "lr": 2.384345999034081e-06, "epoch": 1.6912, "percentage": 56.37, "elapsed_time": "6:16:30", "remaining_time": "4:51:26"}
186
+ {"current_steps": 1860, "total_steps": 3282, "loss": 0.4570345878601074, "lr": 2.3577849013280883e-06, "epoch": 1.7003428571428572, "percentage": 56.67, "elapsed_time": "6:18:34", "remaining_time": "4:49:25"}
187
+ {"current_steps": 1870, "total_steps": 3282, "loss": 0.420123815536499, "lr": 2.331239899492337e-06, "epoch": 1.7094857142857143, "percentage": 56.98, "elapsed_time": "6:20:30", "remaining_time": "4:47:18"}
188
+ {"current_steps": 1880, "total_steps": 3282, "loss": 0.4343130111694336, "lr": 2.3047139978836713e-06, "epoch": 1.7186285714285714, "percentage": 57.28, "elapsed_time": "6:22:22", "remaining_time": "4:45:09"}
189
+ {"current_steps": 1890, "total_steps": 3282, "loss": 0.4349550247192383, "lr": 2.2782101986971754e-06, "epoch": 1.7277714285714287, "percentage": 57.59, "elapsed_time": "6:24:19", "remaining_time": "4:43:03"}
190
+ {"current_steps": 1900, "total_steps": 3282, "loss": 0.42552576065063474, "lr": 2.2517315016263887e-06, "epoch": 1.7369142857142856, "percentage": 57.89, "elapsed_time": "6:26:36", "remaining_time": "4:41:12"}
191
+ {"current_steps": 1910, "total_steps": 3282, "loss": 0.4077327251434326, "lr": 2.225280903523799e-06, "epoch": 1.746057142857143, "percentage": 58.2, "elapsed_time": "6:28:33", "remaining_time": "4:39:06"}
192
+ {"current_steps": 1920, "total_steps": 3282, "loss": 0.43221235275268555, "lr": 2.1988613980616595e-06, "epoch": 1.7551999999999999, "percentage": 58.5, "elapsed_time": "6:30:34", "remaining_time": "4:37:03"}
193
+ {"current_steps": 1930, "total_steps": 3282, "loss": 0.4288123607635498, "lr": 2.1724759753931645e-06, "epoch": 1.7643428571428572, "percentage": 58.81, "elapsed_time": "6:32:32", "remaining_time": "4:34:58"}
194
+ {"current_steps": 1940, "total_steps": 3282, "loss": 0.42254185676574707, "lr": 2.1461276218140277e-06, "epoch": 1.7734857142857143, "percentage": 59.11, "elapsed_time": "6:34:30", "remaining_time": "4:32:54"}
195
+ {"current_steps": 1950, "total_steps": 3282, "loss": 0.43700246810913085, "lr": 2.119819319424492e-06, "epoch": 1.7826285714285715, "percentage": 59.41, "elapsed_time": "6:36:22", "remaining_time": "4:30:45"}
196
+ {"current_steps": 1960, "total_steps": 3282, "loss": 0.43660573959350585, "lr": 2.093554045791817e-06, "epoch": 1.7917714285714286, "percentage": 59.72, "elapsed_time": "6:38:27", "remaining_time": "4:28:45"}
197
+ {"current_steps": 1970, "total_steps": 3282, "loss": 0.4373785972595215, "lr": 2.0673347736132755e-06, "epoch": 1.8009142857142857, "percentage": 60.02, "elapsed_time": "6:40:11", "remaining_time": "4:26:31"}
198
+ {"current_steps": 1980, "total_steps": 3282, "loss": 0.4470353126525879, "lr": 2.04116447037971e-06, "epoch": 1.8100571428571428, "percentage": 60.33, "elapsed_time": "6:42:24", "remaining_time": "4:24:36"}
199
+ {"current_steps": 1990, "total_steps": 3282, "loss": 0.4334103584289551, "lr": 2.015046098039668e-06, "epoch": 1.8192, "percentage": 60.63, "elapsed_time": "6:44:31", "remaining_time": "4:22:38"}
200
+ {"current_steps": 2000, "total_steps": 3282, "loss": 0.4345421314239502, "lr": 1.9889826126641725e-06, "epoch": 1.8283428571428573, "percentage": 60.94, "elapsed_time": "6:46:20", "remaining_time": "4:20:27"}
201
+ {"current_steps": 2010, "total_steps": 3282, "loss": 0.43268346786499023, "lr": 1.9629769641121505e-06, "epoch": 1.8374857142857142, "percentage": 61.24, "elapsed_time": "6:49:00", "remaining_time": "4:18:50"}
202
+ {"current_steps": 2020, "total_steps": 3282, "loss": 0.4391191482543945, "lr": 1.9370320956965744e-06, "epoch": 1.8466285714285715, "percentage": 61.55, "elapsed_time": "6:51:01", "remaining_time": "4:16:47"}
203
+ {"current_steps": 2030, "total_steps": 3282, "loss": 0.40320940017700196, "lr": 1.911150943851334e-06, "epoch": 1.8557714285714284, "percentage": 61.85, "elapsed_time": "6:52:56", "remaining_time": "4:14:40"}
204
+ {"current_steps": 2040, "total_steps": 3282, "loss": 0.44879951477050783, "lr": 1.8853364377988943e-06, "epoch": 1.8649142857142857, "percentage": 62.16, "elapsed_time": "6:54:56", "remaining_time": "4:12:37"}
205
+ {"current_steps": 2050, "total_steps": 3282, "loss": 0.4494847297668457, "lr": 1.8595914992187631e-06, "epoch": 1.8740571428571429, "percentage": 62.46, "elapsed_time": "6:56:58", "remaining_time": "4:10:35"}
206
+ {"current_steps": 2060, "total_steps": 3282, "loss": 0.4198641777038574, "lr": 1.8339190419168218e-06, "epoch": 1.8832, "percentage": 62.77, "elapsed_time": "6:58:51", "remaining_time": "4:08:28"}
207
+ {"current_steps": 2070, "total_steps": 3282, "loss": 0.4413148880004883, "lr": 1.8083219714955366e-06, "epoch": 1.892342857142857, "percentage": 63.07, "elapsed_time": "7:00:50", "remaining_time": "4:06:24"}
208
+ {"current_steps": 2080, "total_steps": 3282, "loss": 0.436600399017334, "lr": 1.7828031850251066e-06, "epoch": 1.9014857142857142, "percentage": 63.38, "elapsed_time": "7:02:39", "remaining_time": "4:04:14"}
209
+ {"current_steps": 2090, "total_steps": 3282, "loss": 0.4329060554504395, "lr": 1.757365570715569e-06, "epoch": 1.9106285714285716, "percentage": 63.68, "elapsed_time": "7:04:51", "remaining_time": "4:02:18"}
210
+ {"current_steps": 2100, "total_steps": 3282, "loss": 0.4353902816772461, "lr": 1.7320120075899184e-06, "epoch": 1.9197714285714285, "percentage": 63.99, "elapsed_time": "7:07:02", "remaining_time": "4:00:22"}
211
+ {"current_steps": 2110, "total_steps": 3282, "loss": 0.43367576599121094, "lr": 1.7067453651582578e-06, "epoch": 1.9289142857142858, "percentage": 64.29, "elapsed_time": "7:09:07", "remaining_time": "3:58:21"}
212
+ {"current_steps": 2120, "total_steps": 3282, "loss": 0.41201076507568357, "lr": 1.6815685030930232e-06, "epoch": 1.9380571428571427, "percentage": 64.59, "elapsed_time": "7:11:05", "remaining_time": "3:56:17"}
213
+ {"current_steps": 2130, "total_steps": 3282, "loss": 0.4455230712890625, "lr": 1.656484270905334e-06, "epoch": 1.9472, "percentage": 64.9, "elapsed_time": "7:13:08", "remaining_time": "3:54:15"}
214
+ {"current_steps": 2140, "total_steps": 3282, "loss": 0.4423556327819824, "lr": 1.631495507622482e-06, "epoch": 1.9563428571428572, "percentage": 65.2, "elapsed_time": "7:15:02", "remaining_time": "3:52:09"}
215
+ {"current_steps": 2150, "total_steps": 3282, "loss": 0.4162015914916992, "lr": 1.6066050414666118e-06, "epoch": 1.9654857142857143, "percentage": 65.51, "elapsed_time": "7:17:07", "remaining_time": "3:50:08"}
216
+ {"current_steps": 2160, "total_steps": 3282, "loss": 0.39836313724517824, "lr": 1.5818156895346204e-06, "epoch": 1.9746285714285714, "percentage": 65.81, "elapsed_time": "7:19:18", "remaining_time": "3:48:11"}
217
+ {"current_steps": 2170, "total_steps": 3282, "loss": 0.41482887268066404, "lr": 1.5571302574793252e-06, "epoch": 1.9837714285714285, "percentage": 66.12, "elapsed_time": "7:21:32", "remaining_time": "3:46:15"}
218
+ {"current_steps": 2180, "total_steps": 3282, "loss": 0.4117753982543945, "lr": 1.5325515391919148e-06, "epoch": 1.9929142857142859, "percentage": 66.42, "elapsed_time": "7:23:35", "remaining_time": "3:44:14"}
219
+ {"current_steps": 2190, "total_steps": 3282, "loss": 0.41173501014709474, "lr": 1.5080823164857427e-06, "epoch": 2.0018285714285713, "percentage": 66.73, "elapsed_time": "7:25:51", "remaining_time": "3:42:19"}
220
+ {"current_steps": 2200, "total_steps": 3282, "loss": 0.28417210578918456, "lr": 1.4837253587814742e-06, "epoch": 2.0109714285714286, "percentage": 67.03, "elapsed_time": "7:27:57", "remaining_time": "3:40:18"}
221
+ {"current_steps": 2210, "total_steps": 3282, "loss": 0.2759065628051758, "lr": 1.4594834227936527e-06, "epoch": 2.0201142857142855, "percentage": 67.34, "elapsed_time": "7:30:02", "remaining_time": "3:38:18"}
222
+ {"current_steps": 2220, "total_steps": 3282, "loss": 0.2795105934143066, "lr": 1.4353592522186915e-06, "epoch": 2.029257142857143, "percentage": 67.64, "elapsed_time": "7:32:09", "remaining_time": "3:36:18"}
223
+ {"current_steps": 2230, "total_steps": 3282, "loss": 0.2630774021148682, "lr": 1.411355577424342e-06, "epoch": 2.0384, "percentage": 67.95, "elapsed_time": "7:34:09", "remaining_time": "3:34:15"}
224
+ {"current_steps": 2240, "total_steps": 3282, "loss": 0.28287272453308104, "lr": 1.387475115140673e-06, "epoch": 2.047542857142857, "percentage": 68.25, "elapsed_time": "7:36:12", "remaining_time": "3:32:13"}
225
+ {"current_steps": 2250, "total_steps": 3282, "loss": 0.2759075403213501, "lr": 1.36372056815259e-06, "epoch": 2.0566857142857145, "percentage": 68.56, "elapsed_time": "7:38:26", "remaining_time": "3:30:16"}
226
+ {"current_steps": 2260, "total_steps": 3282, "loss": 0.2967714309692383, "lr": 1.3400946249939392e-06, "epoch": 2.0658285714285713, "percentage": 68.86, "elapsed_time": "7:40:24", "remaining_time": "3:28:12"}
227
+ {"current_steps": 2270, "total_steps": 3282, "loss": 0.2909571170806885, "lr": 1.316599959643214e-06, "epoch": 2.0749714285714287, "percentage": 69.17, "elapsed_time": "7:42:39", "remaining_time": "3:26:15"}
228
+ {"current_steps": 2280, "total_steps": 3282, "loss": 0.25677051544189455, "lr": 1.2932392312209183e-06, "epoch": 2.0841142857142856, "percentage": 69.47, "elapsed_time": "7:44:39", "remaining_time": "3:24:12"}
229
+ {"current_steps": 2290, "total_steps": 3282, "loss": 0.2645407199859619, "lr": 1.2700150836886057e-06, "epoch": 2.093257142857143, "percentage": 69.77, "elapsed_time": "7:46:40", "remaining_time": "3:22:09"}
230
+ {"current_steps": 2300, "total_steps": 3282, "loss": 0.2937319755554199, "lr": 1.2469301455496425e-06, "epoch": 2.1024, "percentage": 70.08, "elapsed_time": "7:48:32", "remaining_time": "3:20:02"}
231
+ {"current_steps": 2310, "total_steps": 3282, "loss": 0.28319683074951174, "lr": 1.2239870295517023e-06, "epoch": 2.111542857142857, "percentage": 70.38, "elapsed_time": "7:50:31", "remaining_time": "3:17:59"}
232
+ {"current_steps": 2320, "total_steps": 3282, "loss": 0.28835506439208985, "lr": 1.201188332391071e-06, "epoch": 2.120685714285714, "percentage": 70.69, "elapsed_time": "7:52:44", "remaining_time": "3:16:01"}
233
+ {"current_steps": 2330, "total_steps": 3282, "loss": 0.26238574981689455, "lr": 1.1785366344187391e-06, "epoch": 2.1298285714285714, "percentage": 70.99, "elapsed_time": "7:54:43", "remaining_time": "3:13:57"}
234
+ {"current_steps": 2340, "total_steps": 3282, "loss": 0.2972123146057129, "lr": 1.1560344993483712e-06, "epoch": 2.1389714285714287, "percentage": 71.3, "elapsed_time": "7:56:39", "remaining_time": "3:11:53"}
235
+ {"current_steps": 2350, "total_steps": 3282, "loss": 0.27041053771972656, "lr": 1.1336844739661323e-06, "epoch": 2.1481142857142856, "percentage": 71.6, "elapsed_time": "7:58:47", "remaining_time": "3:09:53"}
236
+ {"current_steps": 2360, "total_steps": 3282, "loss": 0.2877945899963379, "lr": 1.1114890878424558e-06, "epoch": 2.157257142857143, "percentage": 71.91, "elapsed_time": "8:01:01", "remaining_time": "3:07:55"}
237
+ {"current_steps": 2370, "total_steps": 3282, "loss": 0.2601182222366333, "lr": 1.089450853045737e-06, "epoch": 2.1664, "percentage": 72.21, "elapsed_time": "8:03:11", "remaining_time": "3:05:56"}
238
+ {"current_steps": 2380, "total_steps": 3282, "loss": 0.2745830059051514, "lr": 1.0675722638580272e-06, "epoch": 2.1755428571428572, "percentage": 72.52, "elapsed_time": "8:04:57", "remaining_time": "3:03:47"}
239
+ {"current_steps": 2390, "total_steps": 3282, "loss": 0.2711923599243164, "lr": 1.0458557964927199e-06, "epoch": 2.184685714285714, "percentage": 72.82, "elapsed_time": "8:07:03", "remaining_time": "3:01:46"}
240
+ {"current_steps": 2400, "total_steps": 3282, "loss": 0.2741232872009277, "lr": 1.0243039088143064e-06, "epoch": 2.1938285714285715, "percentage": 73.13, "elapsed_time": "8:08:50", "remaining_time": "2:59:39"}
241
+ {"current_steps": 2410, "total_steps": 3282, "loss": 0.2650418996810913, "lr": 1.0029190400601849e-06, "epoch": 2.202971428571429, "percentage": 73.43, "elapsed_time": "8:10:31", "remaining_time": "2:57:29"}
242
+ {"current_steps": 2420, "total_steps": 3282, "loss": 0.2851154088973999, "lr": 9.817036105645973e-07, "epoch": 2.2121142857142857, "percentage": 73.74, "elapsed_time": "8:12:30", "remaining_time": "2:55:25"}
243
+ {"current_steps": 2430, "total_steps": 3282, "loss": 0.2927062511444092, "lr": 9.60660021484684e-07, "epoch": 2.221257142857143, "percentage": 74.04, "elapsed_time": "8:14:25", "remaining_time": "2:53:21"}
244
+ {"current_steps": 2440, "total_steps": 3282, "loss": 0.28804736137390136, "lr": 9.397906545287364e-07, "epoch": 2.2304, "percentage": 74.34, "elapsed_time": "8:16:09", "remaining_time": "2:51:12"}
245
+ {"current_steps": 2450, "total_steps": 3282, "loss": 0.2795238971710205, "lr": 9.190978716866234e-07, "epoch": 2.2395428571428573, "percentage": 74.65, "elapsed_time": "8:18:06", "remaining_time": "2:49:09"}
246
+ {"current_steps": 2460, "total_steps": 3282, "loss": 0.2737816333770752, "lr": 8.985840149624711e-07, "epoch": 2.248685714285714, "percentage": 74.95, "elapsed_time": "8:20:13", "remaining_time": "2:47:08"}
247
+ {"current_steps": 2470, "total_steps": 3282, "loss": 0.2709775447845459, "lr": 8.782514061095857e-07, "epoch": 2.2578285714285715, "percentage": 75.26, "elapsed_time": "8:22:10", "remaining_time": "2:45:05"}
248
+ {"current_steps": 2480, "total_steps": 3282, "loss": 0.2839071035385132, "lr": 8.581023463676891e-07, "epoch": 2.2669714285714284, "percentage": 75.56, "elapsed_time": "8:24:18", "remaining_time": "2:43:05"}
249
+ {"current_steps": 2490, "total_steps": 3282, "loss": 0.28216550350189207, "lr": 8.381391162024546e-07, "epoch": 2.2761142857142858, "percentage": 75.87, "elapsed_time": "8:26:36", "remaining_time": "2:41:08"}
250
+ {"current_steps": 2500, "total_steps": 3282, "loss": 0.2637728214263916, "lr": 8.183639750474148e-07, "epoch": 2.2852571428571427, "percentage": 76.17, "elapsed_time": "8:28:25", "remaining_time": "2:39:02"}
251
+ {"current_steps": 2510, "total_steps": 3282, "loss": 0.29704737663269043, "lr": 7.987791610482273e-07, "epoch": 2.2944, "percentage": 76.48, "elapsed_time": "8:30:56", "remaining_time": "2:37:09"}
252
+ {"current_steps": 2520, "total_steps": 3282, "loss": 0.2734424591064453, "lr": 7.793868908093741e-07, "epoch": 2.3035428571428573, "percentage": 76.78, "elapsed_time": "8:33:04", "remaining_time": "2:35:08"}
253
+ {"current_steps": 2530, "total_steps": 3282, "loss": 0.2964025020599365, "lr": 7.601893591432783e-07, "epoch": 2.3126857142857142, "percentage": 77.09, "elapsed_time": "8:35:02", "remaining_time": "2:33:05"}
254
+ {"current_steps": 2540, "total_steps": 3282, "loss": 0.27420711517333984, "lr": 7.411887388219e-07, "epoch": 2.3218285714285716, "percentage": 77.39, "elapsed_time": "8:37:10", "remaining_time": "2:31:04"}
255
+ {"current_steps": 2550, "total_steps": 3282, "loss": 0.28046393394470215, "lr": 7.223871803308197e-07, "epoch": 2.3309714285714285, "percentage": 77.7, "elapsed_time": "8:39:06", "remaining_time": "2:29:00"}
256
+ {"current_steps": 2560, "total_steps": 3282, "loss": 0.28264617919921875, "lr": 7.037868116258512e-07, "epoch": 2.340114285714286, "percentage": 78.0, "elapsed_time": "8:40:52", "remaining_time": "2:26:54"}
257
+ {"current_steps": 2570, "total_steps": 3282, "loss": 0.2707538604736328, "lr": 6.85389737892195e-07, "epoch": 2.3492571428571427, "percentage": 78.31, "elapsed_time": "8:43:06", "remaining_time": "2:24:55"}
258
+ {"current_steps": 2580, "total_steps": 3282, "loss": 0.2886025905609131, "lr": 6.671980413061765e-07, "epoch": 2.3584, "percentage": 78.61, "elapsed_time": "8:45:12", "remaining_time": "2:22:54"}
259
+ {"current_steps": 2590, "total_steps": 3282, "loss": 0.2865435123443604, "lr": 6.492137807995857e-07, "epoch": 2.367542857142857, "percentage": 78.92, "elapsed_time": "8:47:10", "remaining_time": "2:20:51"}
260
+ {"current_steps": 2600, "total_steps": 3282, "loss": 0.27129201889038085, "lr": 6.314389918266492e-07, "epoch": 2.3766857142857143, "percentage": 79.22, "elapsed_time": "8:49:02", "remaining_time": "2:18:46"}
261
+ {"current_steps": 2610, "total_steps": 3282, "loss": 0.28215818405151366, "lr": 6.138756861336542e-07, "epoch": 2.385828571428571, "percentage": 79.52, "elapsed_time": "8:50:57", "remaining_time": "2:16:42"}
262
+ {"current_steps": 2620, "total_steps": 3282, "loss": 0.28048908710479736, "lr": 5.96525851531263e-07, "epoch": 2.3949714285714285, "percentage": 79.83, "elapsed_time": "8:53:08", "remaining_time": "2:14:42"}
263
+ {"current_steps": 2630, "total_steps": 3282, "loss": 0.290478515625, "lr": 5.793914516695303e-07, "epoch": 2.404114285714286, "percentage": 80.13, "elapsed_time": "8:55:11", "remaining_time": "2:12:40"}
264
+ {"current_steps": 2640, "total_steps": 3282, "loss": 0.2790560722351074, "lr": 5.624744258156622e-07, "epoch": 2.4132571428571428, "percentage": 80.44, "elapsed_time": "8:57:14", "remaining_time": "2:10:38"}
265
+ {"current_steps": 2650, "total_steps": 3282, "loss": 0.28078885078430177, "lr": 5.45776688634525e-07, "epoch": 2.4224, "percentage": 80.74, "elapsed_time": "8:59:18", "remaining_time": "2:08:37"}
266
+ {"current_steps": 2660, "total_steps": 3282, "loss": 0.27572739124298096, "lr": 5.293001299719474e-07, "epoch": 2.431542857142857, "percentage": 81.05, "elapsed_time": "9:01:29", "remaining_time": "2:06:37"}
267
+ {"current_steps": 2670, "total_steps": 3282, "loss": 0.28520448207855226, "lr": 5.130466146408269e-07, "epoch": 2.4406857142857143, "percentage": 81.35, "elapsed_time": "9:03:21", "remaining_time": "2:04:32"}
268
+ {"current_steps": 2680, "total_steps": 3282, "loss": 0.2793970823287964, "lr": 4.970179822100709e-07, "epoch": 2.4498285714285712, "percentage": 81.66, "elapsed_time": "9:05:25", "remaining_time": "2:02:31"}
269
+ {"current_steps": 2690, "total_steps": 3282, "loss": 0.25467662811279296, "lr": 4.812160467963961e-07, "epoch": 2.4589714285714286, "percentage": 81.96, "elapsed_time": "9:07:02", "remaining_time": "2:00:23"}
270
+ {"current_steps": 2700, "total_steps": 3282, "loss": 0.26524691581726073, "lr": 4.656425968590048e-07, "epoch": 2.468114285714286, "percentage": 82.27, "elapsed_time": "9:09:01", "remaining_time": "1:58:20"}
271
+ {"current_steps": 2710, "total_steps": 3282, "loss": 0.2708770990371704, "lr": 4.5029939499716845e-07, "epoch": 2.477257142857143, "percentage": 82.57, "elapsed_time": "9:10:44", "remaining_time": "1:56:14"}
272
+ {"current_steps": 2720, "total_steps": 3282, "loss": 0.2831141948699951, "lr": 4.3518817775073803e-07, "epoch": 2.4864, "percentage": 82.88, "elapsed_time": "9:12:52", "remaining_time": "1:54:13"}
273
+ {"current_steps": 2730, "total_steps": 3282, "loss": 0.2714195728302002, "lr": 4.2031065540360324e-07, "epoch": 2.495542857142857, "percentage": 83.18, "elapsed_time": "9:15:00", "remaining_time": "1:52:13"}
274
+ {"current_steps": 2740, "total_steps": 3282, "loss": 0.2746497392654419, "lr": 4.056685117901199e-07, "epoch": 2.5046857142857144, "percentage": 83.49, "elapsed_time": "9:17:22", "remaining_time": "1:50:15"}
275
+ {"current_steps": 2750, "total_steps": 3282, "loss": 0.2960409164428711, "lr": 3.912634041045374e-07, "epoch": 2.5138285714285713, "percentage": 83.79, "elapsed_time": "9:19:19", "remaining_time": "1:48:12"}
276
+ {"current_steps": 2760, "total_steps": 3282, "loss": 0.2696434497833252, "lr": 3.770969627134363e-07, "epoch": 2.5229714285714286, "percentage": 84.1, "elapsed_time": "9:21:19", "remaining_time": "1:46:09"}
277
+ {"current_steps": 2770, "total_steps": 3282, "loss": 0.2951453447341919, "lr": 3.631707909712029e-07, "epoch": 2.532114285714286, "percentage": 84.4, "elapsed_time": "9:23:02", "remaining_time": "1:44:04"}
278
+ {"current_steps": 2780, "total_steps": 3282, "loss": 0.26727540493011476, "lr": 3.4948646503856597e-07, "epoch": 2.541257142857143, "percentage": 84.7, "elapsed_time": "9:25:02", "remaining_time": "1:42:01"}
279
+ {"current_steps": 2790, "total_steps": 3282, "loss": 0.26174561977386473, "lr": 3.3604553370420153e-07, "epoch": 2.5504, "percentage": 85.01, "elapsed_time": "9:27:02", "remaining_time": "1:39:59"}
280
+ {"current_steps": 2800, "total_steps": 3282, "loss": 0.25725569725036623, "lr": 3.228495182094457e-07, "epoch": 2.559542857142857, "percentage": 85.31, "elapsed_time": "9:29:02", "remaining_time": "1:37:57"}
281
+ {"current_steps": 2810, "total_steps": 3282, "loss": 0.26064653396606446, "lr": 3.09899912076119e-07, "epoch": 2.5686857142857145, "percentage": 85.62, "elapsed_time": "9:31:20", "remaining_time": "1:35:58"}
282
+ {"current_steps": 2820, "total_steps": 3282, "loss": 0.28105137348175047, "lr": 2.9719818093748993e-07, "epoch": 2.5778285714285714, "percentage": 85.92, "elapsed_time": "9:33:37", "remaining_time": "1:33:58"}
283
+ {"current_steps": 2830, "total_steps": 3282, "loss": 0.26943848133087156, "lr": 2.847457623723976e-07, "epoch": 2.5869714285714287, "percentage": 86.23, "elapsed_time": "9:35:43", "remaining_time": "1:31:57"}
284
+ {"current_steps": 2840, "total_steps": 3282, "loss": 0.271466064453125, "lr": 2.725440657425424e-07, "epoch": 2.5961142857142856, "percentage": 86.53, "elapsed_time": "9:38:02", "remaining_time": "1:29:57"}
285
+ {"current_steps": 2850, "total_steps": 3282, "loss": 0.30047783851623533, "lr": 2.605944720329781e-07, "epoch": 2.605257142857143, "percentage": 86.84, "elapsed_time": "9:40:16", "remaining_time": "1:27:57"}
286
+ {"current_steps": 2860, "total_steps": 3282, "loss": 0.27461848258972166, "lr": 2.488983336958106e-07, "epoch": 2.6144, "percentage": 87.14, "elapsed_time": "9:42:15", "remaining_time": "1:25:54"}
287
+ {"current_steps": 2870, "total_steps": 3282, "loss": 0.2756947040557861, "lr": 2.3745697449713e-07, "epoch": 2.623542857142857, "percentage": 87.45, "elapsed_time": "9:44:21", "remaining_time": "1:23:53"}
288
+ {"current_steps": 2880, "total_steps": 3282, "loss": 0.2747671127319336, "lr": 2.262716893671846e-07, "epoch": 2.6326857142857145, "percentage": 87.75, "elapsed_time": "9:46:17", "remaining_time": "1:21:50"}
289
+ {"current_steps": 2890, "total_steps": 3282, "loss": 0.25971531867980957, "lr": 2.1534374425382144e-07, "epoch": 2.6418285714285714, "percentage": 88.06, "elapsed_time": "9:48:00", "remaining_time": "1:19:45"}
290
+ {"current_steps": 2900, "total_steps": 3282, "loss": 0.2755371332168579, "lr": 2.0467437597920747e-07, "epoch": 2.6509714285714283, "percentage": 88.36, "elapsed_time": "9:49:51", "remaining_time": "1:17:41"}
291
+ {"current_steps": 2910, "total_steps": 3282, "loss": 0.28951458930969237, "lr": 1.9426479209984722e-07, "epoch": 2.6601142857142857, "percentage": 88.67, "elapsed_time": "9:51:55", "remaining_time": "1:15:40"}
292
+ {"current_steps": 2920, "total_steps": 3282, "loss": 0.2649653673171997, "lr": 1.8411617076990878e-07, "epoch": 2.669257142857143, "percentage": 88.97, "elapsed_time": "9:53:47", "remaining_time": "1:13:36"}
293
+ {"current_steps": 2930, "total_steps": 3282, "loss": 0.29132938385009766, "lr": 1.742296606078836e-07, "epoch": 2.6784, "percentage": 89.27, "elapsed_time": "9:55:38", "remaining_time": "1:11:33"}
294
+ {"current_steps": 2940, "total_steps": 3282, "loss": 0.2908849000930786, "lr": 1.646063805665843e-07, "epoch": 2.6875428571428572, "percentage": 89.58, "elapsed_time": "9:57:55", "remaining_time": "1:09:33"}
295
+ {"current_steps": 2950, "total_steps": 3282, "loss": 0.27597498893737793, "lr": 1.552474198065032e-07, "epoch": 2.696685714285714, "percentage": 89.88, "elapsed_time": "10:00:10", "remaining_time": "1:07:32"}
296
+ {"current_steps": 2960, "total_steps": 3282, "loss": 0.277122950553894, "lr": 1.461538375725402e-07, "epoch": 2.7058285714285715, "percentage": 90.19, "elapsed_time": "10:02:26", "remaining_time": "1:05:32"}
297
+ {"current_steps": 2970, "total_steps": 3282, "loss": 0.25887160301208495, "lr": 1.3732666307411823e-07, "epoch": 2.7149714285714284, "percentage": 90.49, "elapsed_time": "10:04:12", "remaining_time": "1:03:28"}
298
+ {"current_steps": 2980, "total_steps": 3282, "loss": 0.2687790632247925, "lr": 1.2876689536869795e-07, "epoch": 2.7241142857142857, "percentage": 90.8, "elapsed_time": "10:06:13", "remaining_time": "1:01:26"}
299
+ {"current_steps": 2990, "total_steps": 3282, "loss": 0.2882379055023193, "lr": 1.2047550324870454e-07, "epoch": 2.733257142857143, "percentage": 91.1, "elapsed_time": "10:08:15", "remaining_time": "0:59:24"}
300
+ {"current_steps": 3000, "total_steps": 3282, "loss": 0.2735182285308838, "lr": 1.1245342513187845e-07, "epoch": 2.7424, "percentage": 91.41, "elapsed_time": "10:10:02", "remaining_time": "0:57:20"}
301
+ {"current_steps": 3010, "total_steps": 3282, "loss": 0.28655252456665037, "lr": 1.0470156895506816e-07, "epoch": 2.7515428571428573, "percentage": 91.71, "elapsed_time": "10:12:31", "remaining_time": "0:55:21"}
302
+ {"current_steps": 3020, "total_steps": 3282, "loss": 0.2843330383300781, "lr": 9.722081207146822e-08, "epoch": 2.760685714285714, "percentage": 92.02, "elapsed_time": "10:14:38", "remaining_time": "0:53:19"}
303
+ {"current_steps": 3030, "total_steps": 3282, "loss": 0.3217320919036865, "lr": 9.00120011513217e-08, "epoch": 2.7698285714285715, "percentage": 92.32, "elapsed_time": "10:17:02", "remaining_time": "0:51:19"}
304
+ {"current_steps": 3040, "total_steps": 3282, "loss": 0.2799499988555908, "lr": 8.307595208609242e-08, "epoch": 2.7789714285714284, "percentage": 92.63, "elapsed_time": "10:18:59", "remaining_time": "0:49:16"}
305
+ {"current_steps": 3050, "total_steps": 3282, "loss": 0.2839944839477539, "lr": 7.641344989612553e-08, "epoch": 2.7881142857142858, "percentage": 92.93, "elapsed_time": "10:21:10", "remaining_time": "0:47:15"}
306
+ {"current_steps": 3060, "total_steps": 3282, "loss": 0.2826042413711548, "lr": 7.002524864179655e-08, "epoch": 2.797257142857143, "percentage": 93.24, "elapsed_time": "10:23:17", "remaining_time": "0:45:13"}
307
+ {"current_steps": 3070, "total_steps": 3282, "loss": 0.27430474758148193, "lr": 6.391207133816801e-08, "epoch": 2.8064, "percentage": 93.54, "elapsed_time": "10:25:04", "remaining_time": "0:43:09"}
308
+ {"current_steps": 3080, "total_steps": 3282, "loss": 0.28628087043762207, "lr": 5.807460987315827e-08, "epoch": 2.815542857142857, "percentage": 93.85, "elapsed_time": "10:27:04", "remaining_time": "0:41:07"}
309
+ {"current_steps": 3090, "total_steps": 3282, "loss": 0.25586106777191164, "lr": 5.251352492923523e-08, "epoch": 2.8246857142857142, "percentage": 94.15, "elapsed_time": "10:28:55", "remaining_time": "0:39:04"}
310
+ {"current_steps": 3100, "total_steps": 3282, "loss": 0.2681715726852417, "lr": 4.7229445908638095e-08, "epoch": 2.8338285714285716, "percentage": 94.45, "elapsed_time": "10:31:05", "remaining_time": "0:37:03"}
311
+ {"current_steps": 3110, "total_steps": 3282, "loss": 0.2915987014770508, "lr": 4.222297086214494e-08, "epoch": 2.8429714285714285, "percentage": 94.76, "elapsed_time": "10:32:47", "remaining_time": "0:34:59"}
312
+ {"current_steps": 3120, "total_steps": 3282, "loss": 0.2657483577728271, "lr": 3.7494666421381274e-08, "epoch": 2.852114285714286, "percentage": 95.06, "elapsed_time": "10:34:50", "remaining_time": "0:32:57"}
313
+ {"current_steps": 3130, "total_steps": 3282, "loss": 0.25781662464141847, "lr": 3.304506773469329e-08, "epoch": 2.8612571428571427, "percentage": 95.37, "elapsed_time": "10:36:44", "remaining_time": "0:30:55"}
314
+ {"current_steps": 3140, "total_steps": 3282, "loss": 0.2730119228363037, "lr": 2.8874678406576594e-08, "epoch": 2.8704, "percentage": 95.67, "elapsed_time": "10:39:03", "remaining_time": "0:28:54"}
315
+ {"current_steps": 3150, "total_steps": 3282, "loss": 0.2676541328430176, "lr": 2.4983970440680128e-08, "epoch": 2.879542857142857, "percentage": 95.98, "elapsed_time": "10:41:01", "remaining_time": "0:26:51"}
316
+ {"current_steps": 3160, "total_steps": 3282, "loss": 0.2622354507446289, "lr": 2.1373384186383905e-08, "epoch": 2.8886857142857143, "percentage": 96.28, "elapsed_time": "10:43:08", "remaining_time": "0:24:49"}
317
+ {"current_steps": 3170, "total_steps": 3282, "loss": 0.2934865474700928, "lr": 1.8043328288961105e-08, "epoch": 2.8978285714285716, "percentage": 96.59, "elapsed_time": "10:45:30", "remaining_time": "0:22:48"}
318
+ {"current_steps": 3180, "total_steps": 3282, "loss": 0.28752024173736573, "lr": 1.4994179643327555e-08, "epoch": 2.9069714285714285, "percentage": 96.89, "elapsed_time": "10:47:34", "remaining_time": "0:20:46"}
319
+ {"current_steps": 3190, "total_steps": 3282, "loss": 0.27213478088378906, "lr": 1.2226283351384482e-08, "epoch": 2.9161142857142854, "percentage": 97.2, "elapsed_time": "10:49:54", "remaining_time": "0:18:44"}
320
+ {"current_steps": 3200, "total_steps": 3282, "loss": 0.2616039037704468, "lr": 9.73995268296002e-09, "epoch": 2.925257142857143, "percentage": 97.5, "elapsed_time": "10:52:12", "remaining_time": "0:16:42"}
321
+ {"current_steps": 3210, "total_steps": 3282, "loss": 0.27331559658050536, "lr": 7.535469040354516e-09, "epoch": 2.9344, "percentage": 97.81, "elapsed_time": "10:53:55", "remaining_time": "0:14:40"}
322
+ {"current_steps": 3220, "total_steps": 3282, "loss": 0.276494574546814, "lr": 5.613081926489073e-09, "epoch": 2.943542857142857, "percentage": 98.11, "elapsed_time": "10:55:44", "remaining_time": "0:12:37"}
323
+ {"current_steps": 3230, "total_steps": 3282, "loss": 0.26462578773498535, "lr": 3.973008916669519e-09, "epoch": 2.9526857142857144, "percentage": 98.42, "elapsed_time": "10:57:50", "remaining_time": "0:10:35"}
324
+ {"current_steps": 3240, "total_steps": 3282, "loss": 0.27637853622436526, "lr": 2.6154356339599952e-09, "epoch": 2.9618285714285717, "percentage": 98.72, "elapsed_time": "10:59:58", "remaining_time": "0:08:33"}
325
+ {"current_steps": 3250, "total_steps": 3282, "loss": 0.26067826747894285, "lr": 1.5405157281739303e-09, "epoch": 2.9709714285714286, "percentage": 99.02, "elapsed_time": "11:01:39", "remaining_time": "0:06:30"}
326
+ {"current_steps": 3260, "total_steps": 3282, "loss": 0.2749017238616943, "lr": 7.483708584843374e-10, "epoch": 2.9801142857142855, "percentage": 99.33, "elapsed_time": "11:03:45", "remaining_time": "0:04:28"}
327
+ {"current_steps": 3270, "total_steps": 3282, "loss": 0.26424460411071776, "lr": 2.390906796548298e-10, "epoch": 2.989257142857143, "percentage": 99.63, "elapsed_time": "11:05:43", "remaining_time": "0:02:26"}
328
+ {"current_steps": 3280, "total_steps": 3282, "loss": 0.26900973320007326, "lr": 1.2732831892181553e-11, "epoch": 2.9984, "percentage": 99.94, "elapsed_time": "11:07:54", "remaining_time": "0:00:24"}
329
+ {"current_steps": 3282, "total_steps": 3282, "epoch": 3.0, "percentage": 100.0, "elapsed_time": "11:08:45", "remaining_time": "0:00:00"}
trainer_state.json ADDED
@@ -0,0 +1,2339 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": null,
3
+ "best_metric": null,
4
+ "best_model_checkpoint": null,
5
+ "epoch": 3.0,
6
+ "eval_steps": 500,
7
+ "global_step": 3282,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.009142857142857144,
14
+ "grad_norm": 11.471486053550391,
15
+ "learning_rate": 1.3677811550151977e-07,
16
+ "loss": 1.1274017333984374,
17
+ "step": 10
18
+ },
19
+ {
20
+ "epoch": 0.018285714285714287,
21
+ "grad_norm": 9.508371755451213,
22
+ "learning_rate": 2.887537993920973e-07,
23
+ "loss": 1.130257797241211,
24
+ "step": 20
25
+ },
26
+ {
27
+ "epoch": 0.027428571428571427,
28
+ "grad_norm": 10.542927468388289,
29
+ "learning_rate": 4.407294832826748e-07,
30
+ "loss": 1.1144439697265625,
31
+ "step": 30
32
+ },
33
+ {
34
+ "epoch": 0.036571428571428574,
35
+ "grad_norm": 6.697049917861166,
36
+ "learning_rate": 5.927051671732524e-07,
37
+ "loss": 1.0094490051269531,
38
+ "step": 40
39
+ },
40
+ {
41
+ "epoch": 0.045714285714285714,
42
+ "grad_norm": 5.941699420465358,
43
+ "learning_rate": 7.446808510638298e-07,
44
+ "loss": 0.9933881759643555,
45
+ "step": 50
46
+ },
47
+ {
48
+ "epoch": 0.054857142857142854,
49
+ "grad_norm": 5.3455930541478205,
50
+ "learning_rate": 8.966565349544073e-07,
51
+ "loss": 0.9302140235900879,
52
+ "step": 60
53
+ },
54
+ {
55
+ "epoch": 0.064,
56
+ "grad_norm": 6.998077439326658,
57
+ "learning_rate": 1.0486322188449848e-06,
58
+ "loss": 0.8694108963012696,
59
+ "step": 70
60
+ },
61
+ {
62
+ "epoch": 0.07314285714285715,
63
+ "grad_norm": 4.982935373256576,
64
+ "learning_rate": 1.2006079027355624e-06,
65
+ "loss": 0.8164114952087402,
66
+ "step": 80
67
+ },
68
+ {
69
+ "epoch": 0.08228571428571428,
70
+ "grad_norm": 5.126667936316921,
71
+ "learning_rate": 1.35258358662614e-06,
72
+ "loss": 0.7984357833862304,
73
+ "step": 90
74
+ },
75
+ {
76
+ "epoch": 0.09142857142857143,
77
+ "grad_norm": 4.691973630616157,
78
+ "learning_rate": 1.5045592705167174e-06,
79
+ "loss": 0.7703581809997558,
80
+ "step": 100
81
+ },
82
+ {
83
+ "epoch": 0.10057142857142858,
84
+ "grad_norm": 4.109088483102385,
85
+ "learning_rate": 1.656534954407295e-06,
86
+ "loss": 0.7684980392456054,
87
+ "step": 110
88
+ },
89
+ {
90
+ "epoch": 0.10971428571428571,
91
+ "grad_norm": 4.705692764193293,
92
+ "learning_rate": 1.8085106382978727e-06,
93
+ "loss": 0.7413692951202393,
94
+ "step": 120
95
+ },
96
+ {
97
+ "epoch": 0.11885714285714286,
98
+ "grad_norm": 5.972929482228957,
99
+ "learning_rate": 1.9604863221884503e-06,
100
+ "loss": 0.7388993263244629,
101
+ "step": 130
102
+ },
103
+ {
104
+ "epoch": 0.128,
105
+ "grad_norm": 10.001914427395132,
106
+ "learning_rate": 2.1124620060790275e-06,
107
+ "loss": 0.7307013511657715,
108
+ "step": 140
109
+ },
110
+ {
111
+ "epoch": 0.13714285714285715,
112
+ "grad_norm": 4.317103680951329,
113
+ "learning_rate": 2.264437689969605e-06,
114
+ "loss": 0.7406478881835937,
115
+ "step": 150
116
+ },
117
+ {
118
+ "epoch": 0.1462857142857143,
119
+ "grad_norm": 5.5365802683251095,
120
+ "learning_rate": 2.4164133738601827e-06,
121
+ "loss": 0.7177257061004638,
122
+ "step": 160
123
+ },
124
+ {
125
+ "epoch": 0.15542857142857142,
126
+ "grad_norm": 4.511348473632121,
127
+ "learning_rate": 2.5683890577507603e-06,
128
+ "loss": 0.6978429794311524,
129
+ "step": 170
130
+ },
131
+ {
132
+ "epoch": 0.16457142857142856,
133
+ "grad_norm": 4.865870528072603,
134
+ "learning_rate": 2.7203647416413375e-06,
135
+ "loss": 0.6770498275756835,
136
+ "step": 180
137
+ },
138
+ {
139
+ "epoch": 0.1737142857142857,
140
+ "grad_norm": 5.144013410591731,
141
+ "learning_rate": 2.8723404255319155e-06,
142
+ "loss": 0.7257111072540283,
143
+ "step": 190
144
+ },
145
+ {
146
+ "epoch": 0.18285714285714286,
147
+ "grad_norm": 3.9090505828568967,
148
+ "learning_rate": 3.0243161094224927e-06,
149
+ "loss": 0.7295607566833496,
150
+ "step": 200
151
+ },
152
+ {
153
+ "epoch": 0.192,
154
+ "grad_norm": 4.792462633202108,
155
+ "learning_rate": 3.17629179331307e-06,
156
+ "loss": 0.6859935760498047,
157
+ "step": 210
158
+ },
159
+ {
160
+ "epoch": 0.20114285714285715,
161
+ "grad_norm": 4.11675814791688,
162
+ "learning_rate": 3.328267477203648e-06,
163
+ "loss": 0.666834545135498,
164
+ "step": 220
165
+ },
166
+ {
167
+ "epoch": 0.2102857142857143,
168
+ "grad_norm": 4.1484537243787285,
169
+ "learning_rate": 3.480243161094225e-06,
170
+ "loss": 0.6818761825561523,
171
+ "step": 230
172
+ },
173
+ {
174
+ "epoch": 0.21942857142857142,
175
+ "grad_norm": 4.372066098282241,
176
+ "learning_rate": 3.6322188449848027e-06,
177
+ "loss": 0.6924076557159424,
178
+ "step": 240
179
+ },
180
+ {
181
+ "epoch": 0.22857142857142856,
182
+ "grad_norm": 7.171222419800796,
183
+ "learning_rate": 3.78419452887538e-06,
184
+ "loss": 0.6980094909667969,
185
+ "step": 250
186
+ },
187
+ {
188
+ "epoch": 0.2377142857142857,
189
+ "grad_norm": 4.823505480337155,
190
+ "learning_rate": 3.936170212765958e-06,
191
+ "loss": 0.6831412792205811,
192
+ "step": 260
193
+ },
194
+ {
195
+ "epoch": 0.24685714285714286,
196
+ "grad_norm": 4.143889819875004,
197
+ "learning_rate": 4.088145896656536e-06,
198
+ "loss": 0.7023505210876465,
199
+ "step": 270
200
+ },
201
+ {
202
+ "epoch": 0.256,
203
+ "grad_norm": 4.384163021150778,
204
+ "learning_rate": 4.240121580547113e-06,
205
+ "loss": 0.6777481079101563,
206
+ "step": 280
207
+ },
208
+ {
209
+ "epoch": 0.2651428571428571,
210
+ "grad_norm": 3.6415831315187144,
211
+ "learning_rate": 4.39209726443769e-06,
212
+ "loss": 0.6797102928161621,
213
+ "step": 290
214
+ },
215
+ {
216
+ "epoch": 0.2742857142857143,
217
+ "grad_norm": 3.6380849927818226,
218
+ "learning_rate": 4.544072948328268e-06,
219
+ "loss": 0.6712003231048584,
220
+ "step": 300
221
+ },
222
+ {
223
+ "epoch": 0.2834285714285714,
224
+ "grad_norm": 8.084153177173372,
225
+ "learning_rate": 4.696048632218845e-06,
226
+ "loss": 0.6998483657836914,
227
+ "step": 310
228
+ },
229
+ {
230
+ "epoch": 0.2925714285714286,
231
+ "grad_norm": 5.845503616027089,
232
+ "learning_rate": 4.848024316109423e-06,
233
+ "loss": 0.6608274936676025,
234
+ "step": 320
235
+ },
236
+ {
237
+ "epoch": 0.3017142857142857,
238
+ "grad_norm": 3.835616675955984,
239
+ "learning_rate": 5e-06,
240
+ "loss": 0.6844888687133789,
241
+ "step": 330
242
+ },
243
+ {
244
+ "epoch": 0.31085714285714283,
245
+ "grad_norm": 4.0416422134327,
246
+ "learning_rate": 4.999858525304355e-06,
247
+ "loss": 0.6876991271972657,
248
+ "step": 340
249
+ },
250
+ {
251
+ "epoch": 0.32,
252
+ "grad_norm": 3.47370553037831,
253
+ "learning_rate": 4.999434117229488e-06,
254
+ "loss": 0.6663712501525879,
255
+ "step": 350
256
+ },
257
+ {
258
+ "epoch": 0.3291428571428571,
259
+ "grad_norm": 3.2640873821795466,
260
+ "learning_rate": 4.9987268238098055e-06,
261
+ "loss": 0.6727951526641845,
262
+ "step": 360
263
+ },
264
+ {
265
+ "epoch": 0.3382857142857143,
266
+ "grad_norm": 5.364636646025433,
267
+ "learning_rate": 4.997736725096601e-06,
268
+ "loss": 0.662196159362793,
269
+ "step": 370
270
+ },
271
+ {
272
+ "epoch": 0.3474285714285714,
273
+ "grad_norm": 4.684035755188119,
274
+ "learning_rate": 4.996463933149008e-06,
275
+ "loss": 0.6673268795013427,
276
+ "step": 380
277
+ },
278
+ {
279
+ "epoch": 0.3565714285714286,
280
+ "grad_norm": 4.376293027620056,
281
+ "learning_rate": 4.994908592021309e-06,
282
+ "loss": 0.6938044548034668,
283
+ "step": 390
284
+ },
285
+ {
286
+ "epoch": 0.3657142857142857,
287
+ "grad_norm": 3.445038842888017,
288
+ "learning_rate": 4.993070877746634e-06,
289
+ "loss": 0.669778299331665,
290
+ "step": 400
291
+ },
292
+ {
293
+ "epoch": 0.37485714285714283,
294
+ "grad_norm": 3.417800196621973,
295
+ "learning_rate": 4.990950998317036e-06,
296
+ "loss": 0.688864803314209,
297
+ "step": 410
298
+ },
299
+ {
300
+ "epoch": 0.384,
301
+ "grad_norm": 3.5395231875361524,
302
+ "learning_rate": 4.988549193659954e-06,
303
+ "loss": 0.6867477416992187,
304
+ "step": 420
305
+ },
306
+ {
307
+ "epoch": 0.3931428571428571,
308
+ "grad_norm": 4.039473576039344,
309
+ "learning_rate": 4.985865735611053e-06,
310
+ "loss": 0.6630826950073242,
311
+ "step": 430
312
+ },
313
+ {
314
+ "epoch": 0.4022857142857143,
315
+ "grad_norm": 4.240695845877376,
316
+ "learning_rate": 4.982900927883463e-06,
317
+ "loss": 0.6371231079101562,
318
+ "step": 440
319
+ },
320
+ {
321
+ "epoch": 0.4114285714285714,
322
+ "grad_norm": 3.432137053093628,
323
+ "learning_rate": 4.9796551060334006e-06,
324
+ "loss": 0.6728553295135498,
325
+ "step": 450
326
+ },
327
+ {
328
+ "epoch": 0.4205714285714286,
329
+ "grad_norm": 3.585809523290495,
330
+ "learning_rate": 4.976128637422191e-06,
331
+ "loss": 0.6505355358123779,
332
+ "step": 460
333
+ },
334
+ {
335
+ "epoch": 0.4297142857142857,
336
+ "grad_norm": 3.8595326022641387,
337
+ "learning_rate": 4.972321921174695e-06,
338
+ "loss": 0.6685686588287354,
339
+ "step": 470
340
+ },
341
+ {
342
+ "epoch": 0.43885714285714283,
343
+ "grad_norm": 3.5840282542423294,
344
+ "learning_rate": 4.9682353881341295e-06,
345
+ "loss": 0.6945607662200928,
346
+ "step": 480
347
+ },
348
+ {
349
+ "epoch": 0.448,
350
+ "grad_norm": 3.7100398615561656,
351
+ "learning_rate": 4.963869500813308e-06,
352
+ "loss": 0.6876946926116944,
353
+ "step": 490
354
+ },
355
+ {
356
+ "epoch": 0.45714285714285713,
357
+ "grad_norm": 3.963356609569816,
358
+ "learning_rate": 4.959224753342297e-06,
359
+ "loss": 0.6807312488555908,
360
+ "step": 500
361
+ },
362
+ {
363
+ "epoch": 0.4662857142857143,
364
+ "grad_norm": 3.7630654864503996,
365
+ "learning_rate": 4.954301671412482e-06,
366
+ "loss": 0.6369428634643555,
367
+ "step": 510
368
+ },
369
+ {
370
+ "epoch": 0.4754285714285714,
371
+ "grad_norm": 4.372556747989713,
372
+ "learning_rate": 4.949100812217079e-06,
373
+ "loss": 0.6668852806091309,
374
+ "step": 520
375
+ },
376
+ {
377
+ "epoch": 0.4845714285714286,
378
+ "grad_norm": 4.976035084136393,
379
+ "learning_rate": 4.943622764388064e-06,
380
+ "loss": 0.67324800491333,
381
+ "step": 530
382
+ },
383
+ {
384
+ "epoch": 0.4937142857142857,
385
+ "grad_norm": 3.300173767574678,
386
+ "learning_rate": 4.937868147929557e-06,
387
+ "loss": 0.6824999332427979,
388
+ "step": 540
389
+ },
390
+ {
391
+ "epoch": 0.5028571428571429,
392
+ "grad_norm": 3.5966045901720745,
393
+ "learning_rate": 4.931837614147648e-06,
394
+ "loss": 0.659266471862793,
395
+ "step": 550
396
+ },
397
+ {
398
+ "epoch": 0.512,
399
+ "grad_norm": 4.8253272518833175,
400
+ "learning_rate": 4.925531845576681e-06,
401
+ "loss": 0.6849282264709473,
402
+ "step": 560
403
+ },
404
+ {
405
+ "epoch": 0.5211428571428571,
406
+ "grad_norm": 3.220162265916223,
407
+ "learning_rate": 4.918951555902009e-06,
408
+ "loss": 0.6748706817626953,
409
+ "step": 570
410
+ },
411
+ {
412
+ "epoch": 0.5302857142857142,
413
+ "grad_norm": 3.5745575168011534,
414
+ "learning_rate": 4.912097489879214e-06,
415
+ "loss": 0.6703314781188965,
416
+ "step": 580
417
+ },
418
+ {
419
+ "epoch": 0.5394285714285715,
420
+ "grad_norm": 3.620157146007224,
421
+ "learning_rate": 4.904970423249821e-06,
422
+ "loss": 0.6336056232452393,
423
+ "step": 590
424
+ },
425
+ {
426
+ "epoch": 0.5485714285714286,
427
+ "grad_norm": 3.98651072743079,
428
+ "learning_rate": 4.897571162653493e-06,
429
+ "loss": 0.6563733577728271,
430
+ "step": 600
431
+ },
432
+ {
433
+ "epoch": 0.5577142857142857,
434
+ "grad_norm": 4.615506207839311,
435
+ "learning_rate": 4.8899005455367454e-06,
436
+ "loss": 0.6912389278411866,
437
+ "step": 610
438
+ },
439
+ {
440
+ "epoch": 0.5668571428571428,
441
+ "grad_norm": 3.4159585168797086,
442
+ "learning_rate": 4.881959440058156e-06,
443
+ "loss": 0.6701306343078614,
444
+ "step": 620
445
+ },
446
+ {
447
+ "epoch": 0.576,
448
+ "grad_norm": 3.6698281318553314,
449
+ "learning_rate": 4.873748744990106e-06,
450
+ "loss": 0.6575275421142578,
451
+ "step": 630
452
+ },
453
+ {
454
+ "epoch": 0.5851428571428572,
455
+ "grad_norm": 3.9682108106284346,
456
+ "learning_rate": 4.865269389617067e-06,
457
+ "loss": 0.6928033351898193,
458
+ "step": 640
459
+ },
460
+ {
461
+ "epoch": 0.5942857142857143,
462
+ "grad_norm": 3.3456856401958843,
463
+ "learning_rate": 4.8565223336304166e-06,
464
+ "loss": 0.664832592010498,
465
+ "step": 650
466
+ },
467
+ {
468
+ "epoch": 0.6034285714285714,
469
+ "grad_norm": 3.7671236223528397,
470
+ "learning_rate": 4.847508567019819e-06,
471
+ "loss": 0.6371614456176757,
472
+ "step": 660
473
+ },
474
+ {
475
+ "epoch": 0.6125714285714285,
476
+ "grad_norm": 4.246849504979633,
477
+ "learning_rate": 4.838229109961184e-06,
478
+ "loss": 0.6713180541992188,
479
+ "step": 670
480
+ },
481
+ {
482
+ "epoch": 0.6217142857142857,
483
+ "grad_norm": 3.674104838321279,
484
+ "learning_rate": 4.828685012701204e-06,
485
+ "loss": 0.668572473526001,
486
+ "step": 680
487
+ },
488
+ {
489
+ "epoch": 0.6308571428571429,
490
+ "grad_norm": 4.009929042033788,
491
+ "learning_rate": 4.818877355438483e-06,
492
+ "loss": 0.6260498523712158,
493
+ "step": 690
494
+ },
495
+ {
496
+ "epoch": 0.64,
497
+ "grad_norm": 2.886902962638325,
498
+ "learning_rate": 4.808807248201282e-06,
499
+ "loss": 0.6418482780456543,
500
+ "step": 700
501
+ },
502
+ {
503
+ "epoch": 0.6491428571428571,
504
+ "grad_norm": 4.13799670181259,
505
+ "learning_rate": 4.798475830721884e-06,
506
+ "loss": 0.6437315940856934,
507
+ "step": 710
508
+ },
509
+ {
510
+ "epoch": 0.6582857142857143,
511
+ "grad_norm": 3.531078337849383,
512
+ "learning_rate": 4.787884272307607e-06,
513
+ "loss": 0.6641323566436768,
514
+ "step": 720
515
+ },
516
+ {
517
+ "epoch": 0.6674285714285715,
518
+ "grad_norm": 3.37222182487955,
519
+ "learning_rate": 4.7770337717084515e-06,
520
+ "loss": 0.6566616058349609,
521
+ "step": 730
522
+ },
523
+ {
524
+ "epoch": 0.6765714285714286,
525
+ "grad_norm": 3.3338860173872704,
526
+ "learning_rate": 4.765925556981434e-06,
527
+ "loss": 0.6291821002960205,
528
+ "step": 740
529
+ },
530
+ {
531
+ "epoch": 0.6857142857142857,
532
+ "grad_norm": 4.0016074978044065,
533
+ "learning_rate": 4.754560885351591e-06,
534
+ "loss": 0.6643364906311036,
535
+ "step": 750
536
+ },
537
+ {
538
+ "epoch": 0.6948571428571428,
539
+ "grad_norm": 3.317078353499146,
540
+ "learning_rate": 4.742941043069693e-06,
541
+ "loss": 0.6533621788024903,
542
+ "step": 760
543
+ },
544
+ {
545
+ "epoch": 0.704,
546
+ "grad_norm": 3.3524674432376687,
547
+ "learning_rate": 4.7310673452666594e-06,
548
+ "loss": 0.6147947311401367,
549
+ "step": 770
550
+ },
551
+ {
552
+ "epoch": 0.7131428571428572,
553
+ "grad_norm": 3.299244592355662,
554
+ "learning_rate": 4.718941135804716e-06,
555
+ "loss": 0.6452123641967773,
556
+ "step": 780
557
+ },
558
+ {
559
+ "epoch": 0.7222857142857143,
560
+ "grad_norm": 3.348384039697503,
561
+ "learning_rate": 4.706563787125298e-06,
562
+ "loss": 0.6501338958740235,
563
+ "step": 790
564
+ },
565
+ {
566
+ "epoch": 0.7314285714285714,
567
+ "grad_norm": 3.8711188245407206,
568
+ "learning_rate": 4.693936700093714e-06,
569
+ "loss": 0.6493902683258057,
570
+ "step": 800
571
+ },
572
+ {
573
+ "epoch": 0.7405714285714285,
574
+ "grad_norm": 3.106569010380495,
575
+ "learning_rate": 4.6810613038406e-06,
576
+ "loss": 0.6437974452972413,
577
+ "step": 810
578
+ },
579
+ {
580
+ "epoch": 0.7497142857142857,
581
+ "grad_norm": 3.7877324683244242,
582
+ "learning_rate": 4.66793905560017e-06,
583
+ "loss": 0.6351970672607422,
584
+ "step": 820
585
+ },
586
+ {
587
+ "epoch": 0.7588571428571429,
588
+ "grad_norm": 3.889414583334145,
589
+ "learning_rate": 4.654571440545284e-06,
590
+ "loss": 0.6340930938720704,
591
+ "step": 830
592
+ },
593
+ {
594
+ "epoch": 0.768,
595
+ "grad_norm": 4.041620423525788,
596
+ "learning_rate": 4.64095997161936e-06,
597
+ "loss": 0.6761879444122314,
598
+ "step": 840
599
+ },
600
+ {
601
+ "epoch": 0.7771428571428571,
602
+ "grad_norm": 3.4077479285445986,
603
+ "learning_rate": 4.627106189365135e-06,
604
+ "loss": 0.6445336818695069,
605
+ "step": 850
606
+ },
607
+ {
608
+ "epoch": 0.7862857142857143,
609
+ "grad_norm": 4.014609166232559,
610
+ "learning_rate": 4.613011661750313e-06,
611
+ "loss": 0.6355050086975098,
612
+ "step": 860
613
+ },
614
+ {
615
+ "epoch": 0.7954285714285714,
616
+ "grad_norm": 4.434142357092266,
617
+ "learning_rate": 4.598677983990098e-06,
618
+ "loss": 0.6417135238647461,
619
+ "step": 870
620
+ },
621
+ {
622
+ "epoch": 0.8045714285714286,
623
+ "grad_norm": 4.0928848006969645,
624
+ "learning_rate": 4.584106778366648e-06,
625
+ "loss": 0.6485600471496582,
626
+ "step": 880
627
+ },
628
+ {
629
+ "epoch": 0.8137142857142857,
630
+ "grad_norm": 4.797589400271637,
631
+ "learning_rate": 4.5692996940454674e-06,
632
+ "loss": 0.6439845085144043,
633
+ "step": 890
634
+ },
635
+ {
636
+ "epoch": 0.8228571428571428,
637
+ "grad_norm": 4.349857125084049,
638
+ "learning_rate": 4.554258406888754e-06,
639
+ "loss": 0.6050587177276612,
640
+ "step": 900
641
+ },
642
+ {
643
+ "epoch": 0.832,
644
+ "grad_norm": 3.038595176325507,
645
+ "learning_rate": 4.538984619265727e-06,
646
+ "loss": 0.6268429756164551,
647
+ "step": 910
648
+ },
649
+ {
650
+ "epoch": 0.8411428571428572,
651
+ "grad_norm": 4.591796271366957,
652
+ "learning_rate": 4.523480059859952e-06,
653
+ "loss": 0.6478725910186768,
654
+ "step": 920
655
+ },
656
+ {
657
+ "epoch": 0.8502857142857143,
658
+ "grad_norm": 5.139531841843003,
659
+ "learning_rate": 4.507746483473683e-06,
660
+ "loss": 0.647419548034668,
661
+ "step": 930
662
+ },
663
+ {
664
+ "epoch": 0.8594285714285714,
665
+ "grad_norm": 3.6757003721683827,
666
+ "learning_rate": 4.491785670829269e-06,
667
+ "loss": 0.6321591854095459,
668
+ "step": 940
669
+ },
670
+ {
671
+ "epoch": 0.8685714285714285,
672
+ "grad_norm": 3.1667888772017756,
673
+ "learning_rate": 4.475599428367597e-06,
674
+ "loss": 0.6120502471923828,
675
+ "step": 950
676
+ },
677
+ {
678
+ "epoch": 0.8777142857142857,
679
+ "grad_norm": 3.6687619237840035,
680
+ "learning_rate": 4.459189588043647e-06,
681
+ "loss": 0.6537229537963867,
682
+ "step": 960
683
+ },
684
+ {
685
+ "epoch": 0.8868571428571429,
686
+ "grad_norm": 2.7810179062783194,
687
+ "learning_rate": 4.442558007119153e-06,
688
+ "loss": 0.6399202823638916,
689
+ "step": 970
690
+ },
691
+ {
692
+ "epoch": 0.896,
693
+ "grad_norm": 3.7783348653765287,
694
+ "learning_rate": 4.425706567952394e-06,
695
+ "loss": 0.6669195175170899,
696
+ "step": 980
697
+ },
698
+ {
699
+ "epoch": 0.9051428571428571,
700
+ "grad_norm": 3.1481123189579026,
701
+ "learning_rate": 4.408637177785151e-06,
702
+ "loss": 0.631269121170044,
703
+ "step": 990
704
+ },
705
+ {
706
+ "epoch": 0.9142857142857143,
707
+ "grad_norm": 4.479050244392933,
708
+ "learning_rate": 4.391351768526848e-06,
709
+ "loss": 0.6654349327087402,
710
+ "step": 1000
711
+ },
712
+ {
713
+ "epoch": 0.9234285714285714,
714
+ "grad_norm": 3.2713227735388286,
715
+ "learning_rate": 4.373852296535896e-06,
716
+ "loss": 0.6277427673339844,
717
+ "step": 1010
718
+ },
719
+ {
720
+ "epoch": 0.9325714285714286,
721
+ "grad_norm": 2.92607371050686,
722
+ "learning_rate": 4.3561407423982735e-06,
723
+ "loss": 0.6586026191711426,
724
+ "step": 1020
725
+ },
726
+ {
727
+ "epoch": 0.9417142857142857,
728
+ "grad_norm": 3.6150466560250742,
729
+ "learning_rate": 4.3382191107033655e-06,
730
+ "loss": 0.6150027275085449,
731
+ "step": 1030
732
+ },
733
+ {
734
+ "epoch": 0.9508571428571428,
735
+ "grad_norm": 3.460697312652457,
736
+ "learning_rate": 4.3200894298170844e-06,
737
+ "loss": 0.6431099891662597,
738
+ "step": 1040
739
+ },
740
+ {
741
+ "epoch": 0.96,
742
+ "grad_norm": 3.3496277908222414,
743
+ "learning_rate": 4.301753751652298e-06,
744
+ "loss": 0.6621922492980957,
745
+ "step": 1050
746
+ },
747
+ {
748
+ "epoch": 0.9691428571428572,
749
+ "grad_norm": 3.252798811682429,
750
+ "learning_rate": 4.283214151436596e-06,
751
+ "loss": 0.6344066143035889,
752
+ "step": 1060
753
+ },
754
+ {
755
+ "epoch": 0.9782857142857143,
756
+ "grad_norm": 4.235304709737586,
757
+ "learning_rate": 4.264472727477418e-06,
758
+ "loss": 0.642180061340332,
759
+ "step": 1070
760
+ },
761
+ {
762
+ "epoch": 0.9874285714285714,
763
+ "grad_norm": 3.1613277623122276,
764
+ "learning_rate": 4.245531600924563e-06,
765
+ "loss": 0.6505527973175049,
766
+ "step": 1080
767
+ },
768
+ {
769
+ "epoch": 0.9965714285714286,
770
+ "grad_norm": 3.297550963927661,
771
+ "learning_rate": 4.226392915530125e-06,
772
+ "loss": 0.6131467819213867,
773
+ "step": 1090
774
+ },
775
+ {
776
+ "epoch": 1.0054857142857143,
777
+ "grad_norm": 3.2497031988541667,
778
+ "learning_rate": 4.207058837405853e-06,
779
+ "loss": 0.5373872756958008,
780
+ "step": 1100
781
+ },
782
+ {
783
+ "epoch": 1.0146285714285714,
784
+ "grad_norm": 2.8139556696470565,
785
+ "learning_rate": 4.187531554778005e-06,
786
+ "loss": 0.39206643104553224,
787
+ "step": 1110
788
+ },
789
+ {
790
+ "epoch": 1.0237714285714286,
791
+ "grad_norm": 3.3671802896821137,
792
+ "learning_rate": 4.167813277739672e-06,
793
+ "loss": 0.4400962829589844,
794
+ "step": 1120
795
+ },
796
+ {
797
+ "epoch": 1.0329142857142857,
798
+ "grad_norm": 3.0892267793126917,
799
+ "learning_rate": 4.147906238000651e-06,
800
+ "loss": 0.4548200607299805,
801
+ "step": 1130
802
+ },
803
+ {
804
+ "epoch": 1.0420571428571428,
805
+ "grad_norm": 3.8246901134753495,
806
+ "learning_rate": 4.1278126886348495e-06,
807
+ "loss": 0.4130233287811279,
808
+ "step": 1140
809
+ },
810
+ {
811
+ "epoch": 1.0512,
812
+ "grad_norm": 3.519181372450036,
813
+ "learning_rate": 4.107534903825293e-06,
814
+ "loss": 0.42951488494873047,
815
+ "step": 1150
816
+ },
817
+ {
818
+ "epoch": 1.060342857142857,
819
+ "grad_norm": 3.2216196921372355,
820
+ "learning_rate": 4.087075178606731e-06,
821
+ "loss": 0.42777132987976074,
822
+ "step": 1160
823
+ },
824
+ {
825
+ "epoch": 1.0694857142857144,
826
+ "grad_norm": 3.1997097568670005,
827
+ "learning_rate": 4.06643582860588e-06,
828
+ "loss": 0.4200882911682129,
829
+ "step": 1170
830
+ },
831
+ {
832
+ "epoch": 1.0786285714285715,
833
+ "grad_norm": 2.834697714694963,
834
+ "learning_rate": 4.045619189779348e-06,
835
+ "loss": 0.46087031364440917,
836
+ "step": 1180
837
+ },
838
+ {
839
+ "epoch": 1.0877714285714286,
840
+ "grad_norm": 2.8509402495868787,
841
+ "learning_rate": 4.02462761814925e-06,
842
+ "loss": 0.43772568702697756,
843
+ "step": 1190
844
+ },
845
+ {
846
+ "epoch": 1.0969142857142857,
847
+ "grad_norm": 3.3157400164324304,
848
+ "learning_rate": 4.003463489536551e-06,
849
+ "loss": 0.4420557975769043,
850
+ "step": 1200
851
+ },
852
+ {
853
+ "epoch": 1.1060571428571428,
854
+ "grad_norm": 3.577008906529291,
855
+ "learning_rate": 3.982129199292174e-06,
856
+ "loss": 0.4336644172668457,
857
+ "step": 1210
858
+ },
859
+ {
860
+ "epoch": 1.1152,
861
+ "grad_norm": 2.9976519302552194,
862
+ "learning_rate": 3.960627162025896e-06,
863
+ "loss": 0.4147650241851807,
864
+ "step": 1220
865
+ },
866
+ {
867
+ "epoch": 1.124342857142857,
868
+ "grad_norm": 3.16528139476324,
869
+ "learning_rate": 3.9389598113330575e-06,
870
+ "loss": 0.42612924575805666,
871
+ "step": 1230
872
+ },
873
+ {
874
+ "epoch": 1.1334857142857142,
875
+ "grad_norm": 5.409838347914426,
876
+ "learning_rate": 3.917129599519135e-06,
877
+ "loss": 0.41550512313842775,
878
+ "step": 1240
879
+ },
880
+ {
881
+ "epoch": 1.1426285714285713,
882
+ "grad_norm": 3.2868323671988144,
883
+ "learning_rate": 3.895138997322187e-06,
884
+ "loss": 0.43940982818603513,
885
+ "step": 1250
886
+ },
887
+ {
888
+ "epoch": 1.1517714285714287,
889
+ "grad_norm": 3.3362440936270614,
890
+ "learning_rate": 3.872990493633215e-06,
891
+ "loss": 0.4418506622314453,
892
+ "step": 1260
893
+ },
894
+ {
895
+ "epoch": 1.1609142857142858,
896
+ "grad_norm": 3.4561361002374236,
897
+ "learning_rate": 3.850686595214474e-06,
898
+ "loss": 0.4440105438232422,
899
+ "step": 1270
900
+ },
901
+ {
902
+ "epoch": 1.170057142857143,
903
+ "grad_norm": 2.8758006005746246,
904
+ "learning_rate": 3.8282298264157556e-06,
905
+ "loss": 0.44544334411621095,
906
+ "step": 1280
907
+ },
908
+ {
909
+ "epoch": 1.1792,
910
+ "grad_norm": 3.4701594172043024,
911
+ "learning_rate": 3.8056227288886853e-06,
912
+ "loss": 0.4278397083282471,
913
+ "step": 1290
914
+ },
915
+ {
916
+ "epoch": 1.1883428571428571,
917
+ "grad_norm": 3.025493227312592,
918
+ "learning_rate": 3.7828678612990577e-06,
919
+ "loss": 0.44417996406555177,
920
+ "step": 1300
921
+ },
922
+ {
923
+ "epoch": 1.1974857142857143,
924
+ "grad_norm": 3.891185808555793,
925
+ "learning_rate": 3.7599677990372442e-06,
926
+ "loss": 0.4357439041137695,
927
+ "step": 1310
928
+ },
929
+ {
930
+ "epoch": 1.2066285714285714,
931
+ "grad_norm": 2.859053346482196,
932
+ "learning_rate": 3.7369251339267177e-06,
933
+ "loss": 0.43988494873046874,
934
+ "step": 1320
935
+ },
936
+ {
937
+ "epoch": 1.2157714285714285,
938
+ "grad_norm": 3.210177423453322,
939
+ "learning_rate": 3.7137424739307036e-06,
940
+ "loss": 0.46861562728881834,
941
+ "step": 1330
942
+ },
943
+ {
944
+ "epoch": 1.2249142857142856,
945
+ "grad_norm": 3.386229107406717,
946
+ "learning_rate": 3.6904224428570162e-06,
947
+ "loss": 0.43658876419067383,
948
+ "step": 1340
949
+ },
950
+ {
951
+ "epoch": 1.234057142857143,
952
+ "grad_norm": 3.12314639753368,
953
+ "learning_rate": 3.6669676800610942e-06,
954
+ "loss": 0.42545366287231445,
955
+ "step": 1350
956
+ },
957
+ {
958
+ "epoch": 1.2432,
959
+ "grad_norm": 3.100505323352921,
960
+ "learning_rate": 3.6433808401472805e-06,
961
+ "loss": 0.4477118492126465,
962
+ "step": 1360
963
+ },
964
+ {
965
+ "epoch": 1.2523428571428572,
966
+ "grad_norm": 2.9898226007103603,
967
+ "learning_rate": 3.6196645926683722e-06,
968
+ "loss": 0.4572641372680664,
969
+ "step": 1370
970
+ },
971
+ {
972
+ "epoch": 1.2614857142857143,
973
+ "grad_norm": 5.0297360076372835,
974
+ "learning_rate": 3.5958216218234858e-06,
975
+ "loss": 0.45319256782531736,
976
+ "step": 1380
977
+ },
978
+ {
979
+ "epoch": 1.2706285714285714,
980
+ "grad_norm": 2.986627855469088,
981
+ "learning_rate": 3.5718546261542557e-06,
982
+ "loss": 0.4245123863220215,
983
+ "step": 1390
984
+ },
985
+ {
986
+ "epoch": 1.2797714285714286,
987
+ "grad_norm": 3.1558156532734696,
988
+ "learning_rate": 3.5477663182394166e-06,
989
+ "loss": 0.45639562606811523,
990
+ "step": 1400
991
+ },
992
+ {
993
+ "epoch": 1.2889142857142857,
994
+ "grad_norm": 3.0706678234801283,
995
+ "learning_rate": 3.5235594243877922e-06,
996
+ "loss": 0.44690585136413574,
997
+ "step": 1410
998
+ },
999
+ {
1000
+ "epoch": 1.2980571428571428,
1001
+ "grad_norm": 3.5108411042134366,
1002
+ "learning_rate": 3.499236684329736e-06,
1003
+ "loss": 0.45906782150268555,
1004
+ "step": 1420
1005
+ },
1006
+ {
1007
+ "epoch": 1.3072,
1008
+ "grad_norm": 3.3266494830778455,
1009
+ "learning_rate": 3.4748008509070445e-06,
1010
+ "loss": 0.45464215278625486,
1011
+ "step": 1430
1012
+ },
1013
+ {
1014
+ "epoch": 1.3163428571428573,
1015
+ "grad_norm": 3.0137412074901944,
1016
+ "learning_rate": 3.4502546897613946e-06,
1017
+ "loss": 0.43608808517456055,
1018
+ "step": 1440
1019
+ },
1020
+ {
1021
+ "epoch": 1.3254857142857142,
1022
+ "grad_norm": 3.2127451996596936,
1023
+ "learning_rate": 3.4256009790213297e-06,
1024
+ "loss": 0.43820781707763673,
1025
+ "step": 1450
1026
+ },
1027
+ {
1028
+ "epoch": 1.3346285714285715,
1029
+ "grad_norm": 3.427262281605091,
1030
+ "learning_rate": 3.4008425089878265e-06,
1031
+ "loss": 0.43073239326477053,
1032
+ "step": 1460
1033
+ },
1034
+ {
1035
+ "epoch": 1.3437714285714286,
1036
+ "grad_norm": 4.353700600187586,
1037
+ "learning_rate": 3.3759820818184973e-06,
1038
+ "loss": 0.45119776725769045,
1039
+ "step": 1470
1040
+ },
1041
+ {
1042
+ "epoch": 1.3529142857142857,
1043
+ "grad_norm": 3.242139427180215,
1044
+ "learning_rate": 3.3510225112104337e-06,
1045
+ "loss": 0.44018216133117677,
1046
+ "step": 1480
1047
+ },
1048
+ {
1049
+ "epoch": 1.3620571428571429,
1050
+ "grad_norm": 3.2411498641319847,
1051
+ "learning_rate": 3.3259666220817622e-06,
1052
+ "loss": 0.4520729064941406,
1053
+ "step": 1490
1054
+ },
1055
+ {
1056
+ "epoch": 1.3712,
1057
+ "grad_norm": 6.0371875154833825,
1058
+ "learning_rate": 3.3008172502519126e-06,
1059
+ "loss": 0.462126636505127,
1060
+ "step": 1500
1061
+ },
1062
+ {
1063
+ "epoch": 1.380342857142857,
1064
+ "grad_norm": 3.739537830386579,
1065
+ "learning_rate": 3.2755772421206644e-06,
1066
+ "loss": 0.4293963432312012,
1067
+ "step": 1510
1068
+ },
1069
+ {
1070
+ "epoch": 1.3894857142857142,
1071
+ "grad_norm": 3.19498596726371,
1072
+ "learning_rate": 3.2502494543459933e-06,
1073
+ "loss": 0.43875484466552733,
1074
+ "step": 1520
1075
+ },
1076
+ {
1077
+ "epoch": 1.3986285714285716,
1078
+ "grad_norm": 2.9820654591528655,
1079
+ "learning_rate": 3.2248367535207527e-06,
1080
+ "loss": 0.4411722183227539,
1081
+ "step": 1530
1082
+ },
1083
+ {
1084
+ "epoch": 1.4077714285714285,
1085
+ "grad_norm": 3.14950619497062,
1086
+ "learning_rate": 3.1993420158482345e-06,
1087
+ "loss": 0.4349213600158691,
1088
+ "step": 1540
1089
+ },
1090
+ {
1091
+ "epoch": 1.4169142857142858,
1092
+ "grad_norm": 3.1690918179822507,
1093
+ "learning_rate": 3.17376812681664e-06,
1094
+ "loss": 0.43657522201538085,
1095
+ "step": 1550
1096
+ },
1097
+ {
1098
+ "epoch": 1.426057142857143,
1099
+ "grad_norm": 3.0291005683049645,
1100
+ "learning_rate": 3.148117980872505e-06,
1101
+ "loss": 0.43779573440551756,
1102
+ "step": 1560
1103
+ },
1104
+ {
1105
+ "epoch": 1.4352,
1106
+ "grad_norm": 4.942394273668635,
1107
+ "learning_rate": 3.1223944810930997e-06,
1108
+ "loss": 0.4364370346069336,
1109
+ "step": 1570
1110
+ },
1111
+ {
1112
+ "epoch": 1.4443428571428572,
1113
+ "grad_norm": 3.105747216662582,
1114
+ "learning_rate": 3.0966005388578667e-06,
1115
+ "loss": 0.4328590393066406,
1116
+ "step": 1580
1117
+ },
1118
+ {
1119
+ "epoch": 1.4534857142857143,
1120
+ "grad_norm": 2.7725075982235836,
1121
+ "learning_rate": 3.070739073518909e-06,
1122
+ "loss": 0.4478790760040283,
1123
+ "step": 1590
1124
+ },
1125
+ {
1126
+ "epoch": 1.4626285714285714,
1127
+ "grad_norm": 3.004398909698697,
1128
+ "learning_rate": 3.0448130120705755e-06,
1129
+ "loss": 0.4431458473205566,
1130
+ "step": 1600
1131
+ },
1132
+ {
1133
+ "epoch": 1.4717714285714285,
1134
+ "grad_norm": 3.4454908519766287,
1135
+ "learning_rate": 3.018825288818189e-06,
1136
+ "loss": 0.43061065673828125,
1137
+ "step": 1610
1138
+ },
1139
+ {
1140
+ "epoch": 1.4809142857142858,
1141
+ "grad_norm": 3.277363340056823,
1142
+ "learning_rate": 2.992778845045939e-06,
1143
+ "loss": 0.42577180862426756,
1144
+ "step": 1620
1145
+ },
1146
+ {
1147
+ "epoch": 1.4900571428571427,
1148
+ "grad_norm": 3.280181821031211,
1149
+ "learning_rate": 2.96667662868399e-06,
1150
+ "loss": 0.4388378143310547,
1151
+ "step": 1630
1152
+ },
1153
+ {
1154
+ "epoch": 1.4992,
1155
+ "grad_norm": 3.517475812091832,
1156
+ "learning_rate": 2.9405215939748345e-06,
1157
+ "loss": 0.4764075756072998,
1158
+ "step": 1640
1159
+ },
1160
+ {
1161
+ "epoch": 1.508342857142857,
1162
+ "grad_norm": 3.6186803236597367,
1163
+ "learning_rate": 2.9143167011389334e-06,
1164
+ "loss": 0.44104642868041993,
1165
+ "step": 1650
1166
+ },
1167
+ {
1168
+ "epoch": 1.5174857142857143,
1169
+ "grad_norm": 4.49908394192936,
1170
+ "learning_rate": 2.888064916039676e-06,
1171
+ "loss": 0.46334018707275393,
1172
+ "step": 1660
1173
+ },
1174
+ {
1175
+ "epoch": 1.5266285714285714,
1176
+ "grad_norm": 4.368868620731799,
1177
+ "learning_rate": 2.8617692098477083e-06,
1178
+ "loss": 0.44715070724487305,
1179
+ "step": 1670
1180
+ },
1181
+ {
1182
+ "epoch": 1.5357714285714286,
1183
+ "grad_norm": 3.199142545246703,
1184
+ "learning_rate": 2.8354325587046553e-06,
1185
+ "loss": 0.44616308212280276,
1186
+ "step": 1680
1187
+ },
1188
+ {
1189
+ "epoch": 1.5449142857142857,
1190
+ "grad_norm": 3.440077773747208,
1191
+ "learning_rate": 2.8090579433862804e-06,
1192
+ "loss": 0.4543767929077148,
1193
+ "step": 1690
1194
+ },
1195
+ {
1196
+ "epoch": 1.5540571428571428,
1197
+ "grad_norm": 2.7818538175759717,
1198
+ "learning_rate": 2.7826483489651236e-06,
1199
+ "loss": 0.40111846923828126,
1200
+ "step": 1700
1201
+ },
1202
+ {
1203
+ "epoch": 1.5632000000000001,
1204
+ "grad_norm": 3.10795010245684,
1205
+ "learning_rate": 2.7562067644726503e-06,
1206
+ "loss": 0.4558586120605469,
1207
+ "step": 1710
1208
+ },
1209
+ {
1210
+ "epoch": 1.572342857142857,
1211
+ "grad_norm": 3.2864212243908457,
1212
+ "learning_rate": 2.729736182560957e-06,
1213
+ "loss": 0.4243218421936035,
1214
+ "step": 1720
1215
+ },
1216
+ {
1217
+ "epoch": 1.5814857142857144,
1218
+ "grad_norm": 3.2048887885997672,
1219
+ "learning_rate": 2.7032395991640576e-06,
1220
+ "loss": 0.4420520305633545,
1221
+ "step": 1730
1222
+ },
1223
+ {
1224
+ "epoch": 1.5906285714285713,
1225
+ "grad_norm": 3.517255823497795,
1226
+ "learning_rate": 2.6767200131588104e-06,
1227
+ "loss": 0.4580650806427002,
1228
+ "step": 1740
1229
+ },
1230
+ {
1231
+ "epoch": 1.5997714285714286,
1232
+ "grad_norm": 3.1565683175319617,
1233
+ "learning_rate": 2.6501804260255025e-06,
1234
+ "loss": 0.45360441207885743,
1235
+ "step": 1750
1236
+ },
1237
+ {
1238
+ "epoch": 1.6089142857142857,
1239
+ "grad_norm": 4.043706266931836,
1240
+ "learning_rate": 2.6236238415081437e-06,
1241
+ "loss": 0.42459897994995116,
1242
+ "step": 1760
1243
+ },
1244
+ {
1245
+ "epoch": 1.6180571428571429,
1246
+ "grad_norm": 3.279503442119918,
1247
+ "learning_rate": 2.597053265274503e-06,
1248
+ "loss": 0.4341078758239746,
1249
+ "step": 1770
1250
+ },
1251
+ {
1252
+ "epoch": 1.6272,
1253
+ "grad_norm": 3.112655021860705,
1254
+ "learning_rate": 2.57047170457593e-06,
1255
+ "loss": 0.4280117034912109,
1256
+ "step": 1780
1257
+ },
1258
+ {
1259
+ "epoch": 1.636342857142857,
1260
+ "grad_norm": 2.8263252138991013,
1261
+ "learning_rate": 2.5438821679069903e-06,
1262
+ "loss": 0.4240222930908203,
1263
+ "step": 1790
1264
+ },
1265
+ {
1266
+ "epoch": 1.6454857142857144,
1267
+ "grad_norm": 3.4651277123003914,
1268
+ "learning_rate": 2.517287664664973e-06,
1269
+ "loss": 0.423565673828125,
1270
+ "step": 1800
1271
+ },
1272
+ {
1273
+ "epoch": 1.6546285714285713,
1274
+ "grad_norm": 3.458251991463939,
1275
+ "learning_rate": 2.4906912048092777e-06,
1276
+ "loss": 0.4391635894775391,
1277
+ "step": 1810
1278
+ },
1279
+ {
1280
+ "epoch": 1.6637714285714287,
1281
+ "grad_norm": 3.437568084955159,
1282
+ "learning_rate": 2.4640957985207555e-06,
1283
+ "loss": 0.42197561264038086,
1284
+ "step": 1820
1285
+ },
1286
+ {
1287
+ "epoch": 1.6729142857142856,
1288
+ "grad_norm": 2.7818959484075165,
1289
+ "learning_rate": 2.4375044558610138e-06,
1290
+ "loss": 0.44665961265563964,
1291
+ "step": 1830
1292
+ },
1293
+ {
1294
+ "epoch": 1.682057142857143,
1295
+ "grad_norm": 2.944183416002998,
1296
+ "learning_rate": 2.410920186431742e-06,
1297
+ "loss": 0.4473154544830322,
1298
+ "step": 1840
1299
+ },
1300
+ {
1301
+ "epoch": 1.6912,
1302
+ "grad_norm": 2.7870159545544744,
1303
+ "learning_rate": 2.384345999034081e-06,
1304
+ "loss": 0.41730351448059083,
1305
+ "step": 1850
1306
+ },
1307
+ {
1308
+ "epoch": 1.7003428571428572,
1309
+ "grad_norm": 3.33967839938956,
1310
+ "learning_rate": 2.3577849013280883e-06,
1311
+ "loss": 0.4570345878601074,
1312
+ "step": 1860
1313
+ },
1314
+ {
1315
+ "epoch": 1.7094857142857143,
1316
+ "grad_norm": 3.5017488802826455,
1317
+ "learning_rate": 2.331239899492337e-06,
1318
+ "loss": 0.420123815536499,
1319
+ "step": 1870
1320
+ },
1321
+ {
1322
+ "epoch": 1.7186285714285714,
1323
+ "grad_norm": 2.9074562278744156,
1324
+ "learning_rate": 2.3047139978836713e-06,
1325
+ "loss": 0.4343130111694336,
1326
+ "step": 1880
1327
+ },
1328
+ {
1329
+ "epoch": 1.7277714285714287,
1330
+ "grad_norm": 3.1775155444025622,
1331
+ "learning_rate": 2.2782101986971754e-06,
1332
+ "loss": 0.4349550247192383,
1333
+ "step": 1890
1334
+ },
1335
+ {
1336
+ "epoch": 1.7369142857142856,
1337
+ "grad_norm": 3.861708541739034,
1338
+ "learning_rate": 2.2517315016263887e-06,
1339
+ "loss": 0.42552576065063474,
1340
+ "step": 1900
1341
+ },
1342
+ {
1343
+ "epoch": 1.746057142857143,
1344
+ "grad_norm": 2.581084576438278,
1345
+ "learning_rate": 2.225280903523799e-06,
1346
+ "loss": 0.4077327251434326,
1347
+ "step": 1910
1348
+ },
1349
+ {
1350
+ "epoch": 1.7551999999999999,
1351
+ "grad_norm": 3.179994401464169,
1352
+ "learning_rate": 2.1988613980616595e-06,
1353
+ "loss": 0.43221235275268555,
1354
+ "step": 1920
1355
+ },
1356
+ {
1357
+ "epoch": 1.7643428571428572,
1358
+ "grad_norm": 3.1749999002372844,
1359
+ "learning_rate": 2.1724759753931645e-06,
1360
+ "loss": 0.4288123607635498,
1361
+ "step": 1930
1362
+ },
1363
+ {
1364
+ "epoch": 1.7734857142857143,
1365
+ "grad_norm": 2.8008541280150427,
1366
+ "learning_rate": 2.1461276218140277e-06,
1367
+ "loss": 0.42254185676574707,
1368
+ "step": 1940
1369
+ },
1370
+ {
1371
+ "epoch": 1.7826285714285715,
1372
+ "grad_norm": 2.994068727512216,
1373
+ "learning_rate": 2.119819319424492e-06,
1374
+ "loss": 0.43700246810913085,
1375
+ "step": 1950
1376
+ },
1377
+ {
1378
+ "epoch": 1.7917714285714286,
1379
+ "grad_norm": 4.552347405118982,
1380
+ "learning_rate": 2.093554045791817e-06,
1381
+ "loss": 0.43660573959350585,
1382
+ "step": 1960
1383
+ },
1384
+ {
1385
+ "epoch": 1.8009142857142857,
1386
+ "grad_norm": 3.1327882348335594,
1387
+ "learning_rate": 2.0673347736132755e-06,
1388
+ "loss": 0.4373785972595215,
1389
+ "step": 1970
1390
+ },
1391
+ {
1392
+ "epoch": 1.8100571428571428,
1393
+ "grad_norm": 3.1271063998169994,
1394
+ "learning_rate": 2.04116447037971e-06,
1395
+ "loss": 0.4470353126525879,
1396
+ "step": 1980
1397
+ },
1398
+ {
1399
+ "epoch": 1.8192,
1400
+ "grad_norm": 3.2677713682332032,
1401
+ "learning_rate": 2.015046098039668e-06,
1402
+ "loss": 0.4334103584289551,
1403
+ "step": 1990
1404
+ },
1405
+ {
1406
+ "epoch": 1.8283428571428573,
1407
+ "grad_norm": 4.3344890461140615,
1408
+ "learning_rate": 1.9889826126641725e-06,
1409
+ "loss": 0.4345421314239502,
1410
+ "step": 2000
1411
+ },
1412
+ {
1413
+ "epoch": 1.8374857142857142,
1414
+ "grad_norm": 3.1369039671057037,
1415
+ "learning_rate": 1.9629769641121505e-06,
1416
+ "loss": 0.43268346786499023,
1417
+ "step": 2010
1418
+ },
1419
+ {
1420
+ "epoch": 1.8466285714285715,
1421
+ "grad_norm": 3.087192205340555,
1422
+ "learning_rate": 1.9370320956965744e-06,
1423
+ "loss": 0.4391191482543945,
1424
+ "step": 2020
1425
+ },
1426
+ {
1427
+ "epoch": 1.8557714285714284,
1428
+ "grad_norm": 4.217628941349784,
1429
+ "learning_rate": 1.911150943851334e-06,
1430
+ "loss": 0.40320940017700196,
1431
+ "step": 2030
1432
+ },
1433
+ {
1434
+ "epoch": 1.8649142857142857,
1435
+ "grad_norm": 2.8735268917521615,
1436
+ "learning_rate": 1.8853364377988943e-06,
1437
+ "loss": 0.44879951477050783,
1438
+ "step": 2040
1439
+ },
1440
+ {
1441
+ "epoch": 1.8740571428571429,
1442
+ "grad_norm": 3.214365579670086,
1443
+ "learning_rate": 1.8595914992187631e-06,
1444
+ "loss": 0.4494847297668457,
1445
+ "step": 2050
1446
+ },
1447
+ {
1448
+ "epoch": 1.8832,
1449
+ "grad_norm": 3.534792019812254,
1450
+ "learning_rate": 1.8339190419168218e-06,
1451
+ "loss": 0.4198641777038574,
1452
+ "step": 2060
1453
+ },
1454
+ {
1455
+ "epoch": 1.892342857142857,
1456
+ "grad_norm": 5.8738496363773125,
1457
+ "learning_rate": 1.8083219714955366e-06,
1458
+ "loss": 0.4413148880004883,
1459
+ "step": 2070
1460
+ },
1461
+ {
1462
+ "epoch": 1.9014857142857142,
1463
+ "grad_norm": 3.2022928406375533,
1464
+ "learning_rate": 1.7828031850251066e-06,
1465
+ "loss": 0.436600399017334,
1466
+ "step": 2080
1467
+ },
1468
+ {
1469
+ "epoch": 1.9106285714285716,
1470
+ "grad_norm": 3.2126047217045994,
1471
+ "learning_rate": 1.757365570715569e-06,
1472
+ "loss": 0.4329060554504395,
1473
+ "step": 2090
1474
+ },
1475
+ {
1476
+ "epoch": 1.9197714285714285,
1477
+ "grad_norm": 2.642690267856541,
1478
+ "learning_rate": 1.7320120075899184e-06,
1479
+ "loss": 0.4353902816772461,
1480
+ "step": 2100
1481
+ },
1482
+ {
1483
+ "epoch": 1.9289142857142858,
1484
+ "grad_norm": 3.4937941929931666,
1485
+ "learning_rate": 1.7067453651582578e-06,
1486
+ "loss": 0.43367576599121094,
1487
+ "step": 2110
1488
+ },
1489
+ {
1490
+ "epoch": 1.9380571428571427,
1491
+ "grad_norm": 3.40397498122847,
1492
+ "learning_rate": 1.6815685030930232e-06,
1493
+ "loss": 0.41201076507568357,
1494
+ "step": 2120
1495
+ },
1496
+ {
1497
+ "epoch": 1.9472,
1498
+ "grad_norm": 3.2017143149040463,
1499
+ "learning_rate": 1.656484270905334e-06,
1500
+ "loss": 0.4455230712890625,
1501
+ "step": 2130
1502
+ },
1503
+ {
1504
+ "epoch": 1.9563428571428572,
1505
+ "grad_norm": 4.48489218999384,
1506
+ "learning_rate": 1.631495507622482e-06,
1507
+ "loss": 0.4423556327819824,
1508
+ "step": 2140
1509
+ },
1510
+ {
1511
+ "epoch": 1.9654857142857143,
1512
+ "grad_norm": 2.919306495268925,
1513
+ "learning_rate": 1.6066050414666118e-06,
1514
+ "loss": 0.4162015914916992,
1515
+ "step": 2150
1516
+ },
1517
+ {
1518
+ "epoch": 1.9746285714285714,
1519
+ "grad_norm": 3.32553420624746,
1520
+ "learning_rate": 1.5818156895346204e-06,
1521
+ "loss": 0.39836313724517824,
1522
+ "step": 2160
1523
+ },
1524
+ {
1525
+ "epoch": 1.9837714285714285,
1526
+ "grad_norm": 3.138755010556365,
1527
+ "learning_rate": 1.5571302574793252e-06,
1528
+ "loss": 0.41482887268066404,
1529
+ "step": 2170
1530
+ },
1531
+ {
1532
+ "epoch": 1.9929142857142859,
1533
+ "grad_norm": 3.0900245066470493,
1534
+ "learning_rate": 1.5325515391919148e-06,
1535
+ "loss": 0.4117753982543945,
1536
+ "step": 2180
1537
+ },
1538
+ {
1539
+ "epoch": 2.0018285714285713,
1540
+ "grad_norm": 2.1455782292116434,
1541
+ "learning_rate": 1.5080823164857427e-06,
1542
+ "loss": 0.41173501014709474,
1543
+ "step": 2190
1544
+ },
1545
+ {
1546
+ "epoch": 2.0109714285714286,
1547
+ "grad_norm": 2.331925083932664,
1548
+ "learning_rate": 1.4837253587814742e-06,
1549
+ "loss": 0.28417210578918456,
1550
+ "step": 2200
1551
+ },
1552
+ {
1553
+ "epoch": 2.0201142857142855,
1554
+ "grad_norm": 2.797520975914452,
1555
+ "learning_rate": 1.4594834227936527e-06,
1556
+ "loss": 0.2759065628051758,
1557
+ "step": 2210
1558
+ },
1559
+ {
1560
+ "epoch": 2.029257142857143,
1561
+ "grad_norm": 2.7316124845044913,
1562
+ "learning_rate": 1.4353592522186915e-06,
1563
+ "loss": 0.2795105934143066,
1564
+ "step": 2220
1565
+ },
1566
+ {
1567
+ "epoch": 2.0384,
1568
+ "grad_norm": 2.5142368786137186,
1569
+ "learning_rate": 1.411355577424342e-06,
1570
+ "loss": 0.2630774021148682,
1571
+ "step": 2230
1572
+ },
1573
+ {
1574
+ "epoch": 2.047542857142857,
1575
+ "grad_norm": 3.0806115423827922,
1576
+ "learning_rate": 1.387475115140673e-06,
1577
+ "loss": 0.28287272453308104,
1578
+ "step": 2240
1579
+ },
1580
+ {
1581
+ "epoch": 2.0566857142857145,
1582
+ "grad_norm": 3.110707613396574,
1583
+ "learning_rate": 1.36372056815259e-06,
1584
+ "loss": 0.2759075403213501,
1585
+ "step": 2250
1586
+ },
1587
+ {
1588
+ "epoch": 2.0658285714285713,
1589
+ "grad_norm": 2.8001881041080425,
1590
+ "learning_rate": 1.3400946249939392e-06,
1591
+ "loss": 0.2967714309692383,
1592
+ "step": 2260
1593
+ },
1594
+ {
1595
+ "epoch": 2.0749714285714287,
1596
+ "grad_norm": 2.6575160852395383,
1597
+ "learning_rate": 1.316599959643214e-06,
1598
+ "loss": 0.2909571170806885,
1599
+ "step": 2270
1600
+ },
1601
+ {
1602
+ "epoch": 2.0841142857142856,
1603
+ "grad_norm": 2.4932343811676225,
1604
+ "learning_rate": 1.2932392312209183e-06,
1605
+ "loss": 0.25677051544189455,
1606
+ "step": 2280
1607
+ },
1608
+ {
1609
+ "epoch": 2.093257142857143,
1610
+ "grad_norm": 3.3930138643702916,
1611
+ "learning_rate": 1.2700150836886057e-06,
1612
+ "loss": 0.2645407199859619,
1613
+ "step": 2290
1614
+ },
1615
+ {
1616
+ "epoch": 2.1024,
1617
+ "grad_norm": 2.847214706519789,
1618
+ "learning_rate": 1.2469301455496425e-06,
1619
+ "loss": 0.2937319755554199,
1620
+ "step": 2300
1621
+ },
1622
+ {
1623
+ "epoch": 2.111542857142857,
1624
+ "grad_norm": 2.8983772937624646,
1625
+ "learning_rate": 1.2239870295517023e-06,
1626
+ "loss": 0.28319683074951174,
1627
+ "step": 2310
1628
+ },
1629
+ {
1630
+ "epoch": 2.120685714285714,
1631
+ "grad_norm": 2.60083123585202,
1632
+ "learning_rate": 1.201188332391071e-06,
1633
+ "loss": 0.28835506439208985,
1634
+ "step": 2320
1635
+ },
1636
+ {
1637
+ "epoch": 2.1298285714285714,
1638
+ "grad_norm": 2.9924905191048086,
1639
+ "learning_rate": 1.1785366344187391e-06,
1640
+ "loss": 0.26238574981689455,
1641
+ "step": 2330
1642
+ },
1643
+ {
1644
+ "epoch": 2.1389714285714287,
1645
+ "grad_norm": 2.5490336359087613,
1646
+ "learning_rate": 1.1560344993483712e-06,
1647
+ "loss": 0.2972123146057129,
1648
+ "step": 2340
1649
+ },
1650
+ {
1651
+ "epoch": 2.1481142857142856,
1652
+ "grad_norm": 2.877749657219292,
1653
+ "learning_rate": 1.1336844739661323e-06,
1654
+ "loss": 0.27041053771972656,
1655
+ "step": 2350
1656
+ },
1657
+ {
1658
+ "epoch": 2.157257142857143,
1659
+ "grad_norm": 3.0458116805440274,
1660
+ "learning_rate": 1.1114890878424558e-06,
1661
+ "loss": 0.2877945899963379,
1662
+ "step": 2360
1663
+ },
1664
+ {
1665
+ "epoch": 2.1664,
1666
+ "grad_norm": 3.4511019174253246,
1667
+ "learning_rate": 1.089450853045737e-06,
1668
+ "loss": 0.2601182222366333,
1669
+ "step": 2370
1670
+ },
1671
+ {
1672
+ "epoch": 2.1755428571428572,
1673
+ "grad_norm": 2.9409614966959357,
1674
+ "learning_rate": 1.0675722638580272e-06,
1675
+ "loss": 0.2745830059051514,
1676
+ "step": 2380
1677
+ },
1678
+ {
1679
+ "epoch": 2.184685714285714,
1680
+ "grad_norm": 2.9527590069918044,
1681
+ "learning_rate": 1.0458557964927199e-06,
1682
+ "loss": 0.2711923599243164,
1683
+ "step": 2390
1684
+ },
1685
+ {
1686
+ "epoch": 2.1938285714285715,
1687
+ "grad_norm": 3.5434052190550007,
1688
+ "learning_rate": 1.0243039088143064e-06,
1689
+ "loss": 0.2741232872009277,
1690
+ "step": 2400
1691
+ },
1692
+ {
1693
+ "epoch": 2.202971428571429,
1694
+ "grad_norm": 2.593916543705238,
1695
+ "learning_rate": 1.0029190400601849e-06,
1696
+ "loss": 0.2650418996810913,
1697
+ "step": 2410
1698
+ },
1699
+ {
1700
+ "epoch": 2.2121142857142857,
1701
+ "grad_norm": 5.458957198039009,
1702
+ "learning_rate": 9.817036105645973e-07,
1703
+ "loss": 0.2851154088973999,
1704
+ "step": 2420
1705
+ },
1706
+ {
1707
+ "epoch": 2.221257142857143,
1708
+ "grad_norm": 2.797419008621176,
1709
+ "learning_rate": 9.60660021484684e-07,
1710
+ "loss": 0.2927062511444092,
1711
+ "step": 2430
1712
+ },
1713
+ {
1714
+ "epoch": 2.2304,
1715
+ "grad_norm": 2.5165587869464767,
1716
+ "learning_rate": 9.397906545287364e-07,
1717
+ "loss": 0.28804736137390136,
1718
+ "step": 2440
1719
+ },
1720
+ {
1721
+ "epoch": 2.2395428571428573,
1722
+ "grad_norm": 2.8068710367884364,
1723
+ "learning_rate": 9.190978716866234e-07,
1724
+ "loss": 0.2795238971710205,
1725
+ "step": 2450
1726
+ },
1727
+ {
1728
+ "epoch": 2.248685714285714,
1729
+ "grad_norm": 3.032320478128081,
1730
+ "learning_rate": 8.985840149624711e-07,
1731
+ "loss": 0.2737816333770752,
1732
+ "step": 2460
1733
+ },
1734
+ {
1735
+ "epoch": 2.2578285714285715,
1736
+ "grad_norm": 2.45844847317339,
1737
+ "learning_rate": 8.782514061095857e-07,
1738
+ "loss": 0.2709775447845459,
1739
+ "step": 2470
1740
+ },
1741
+ {
1742
+ "epoch": 2.2669714285714284,
1743
+ "grad_norm": 2.762916896820192,
1744
+ "learning_rate": 8.581023463676891e-07,
1745
+ "loss": 0.2839071035385132,
1746
+ "step": 2480
1747
+ },
1748
+ {
1749
+ "epoch": 2.2761142857142858,
1750
+ "grad_norm": 4.204279171269985,
1751
+ "learning_rate": 8.381391162024546e-07,
1752
+ "loss": 0.28216550350189207,
1753
+ "step": 2490
1754
+ },
1755
+ {
1756
+ "epoch": 2.2852571428571427,
1757
+ "grad_norm": 3.658985340256555,
1758
+ "learning_rate": 8.183639750474148e-07,
1759
+ "loss": 0.2637728214263916,
1760
+ "step": 2500
1761
+ },
1762
+ {
1763
+ "epoch": 2.2944,
1764
+ "grad_norm": 3.1133594582005495,
1765
+ "learning_rate": 7.987791610482273e-07,
1766
+ "loss": 0.29704737663269043,
1767
+ "step": 2510
1768
+ },
1769
+ {
1770
+ "epoch": 2.3035428571428573,
1771
+ "grad_norm": 3.690776210653126,
1772
+ "learning_rate": 7.793868908093741e-07,
1773
+ "loss": 0.2734424591064453,
1774
+ "step": 2520
1775
+ },
1776
+ {
1777
+ "epoch": 2.3126857142857142,
1778
+ "grad_norm": 2.9193823050504437,
1779
+ "learning_rate": 7.601893591432783e-07,
1780
+ "loss": 0.2964025020599365,
1781
+ "step": 2530
1782
+ },
1783
+ {
1784
+ "epoch": 2.3218285714285716,
1785
+ "grad_norm": 3.1219703362208278,
1786
+ "learning_rate": 7.411887388219e-07,
1787
+ "loss": 0.27420711517333984,
1788
+ "step": 2540
1789
+ },
1790
+ {
1791
+ "epoch": 2.3309714285714285,
1792
+ "grad_norm": 2.6896951062457544,
1793
+ "learning_rate": 7.223871803308197e-07,
1794
+ "loss": 0.28046393394470215,
1795
+ "step": 2550
1796
+ },
1797
+ {
1798
+ "epoch": 2.340114285714286,
1799
+ "grad_norm": 2.8869534336843112,
1800
+ "learning_rate": 7.037868116258512e-07,
1801
+ "loss": 0.28264617919921875,
1802
+ "step": 2560
1803
+ },
1804
+ {
1805
+ "epoch": 2.3492571428571427,
1806
+ "grad_norm": 3.211167429739125,
1807
+ "learning_rate": 6.85389737892195e-07,
1808
+ "loss": 0.2707538604736328,
1809
+ "step": 2570
1810
+ },
1811
+ {
1812
+ "epoch": 2.3584,
1813
+ "grad_norm": 2.9245764167686064,
1814
+ "learning_rate": 6.671980413061765e-07,
1815
+ "loss": 0.2886025905609131,
1816
+ "step": 2580
1817
+ },
1818
+ {
1819
+ "epoch": 2.367542857142857,
1820
+ "grad_norm": 3.006045586066139,
1821
+ "learning_rate": 6.492137807995857e-07,
1822
+ "loss": 0.2865435123443604,
1823
+ "step": 2590
1824
+ },
1825
+ {
1826
+ "epoch": 2.3766857142857143,
1827
+ "grad_norm": 2.904179442386007,
1828
+ "learning_rate": 6.314389918266492e-07,
1829
+ "loss": 0.27129201889038085,
1830
+ "step": 2600
1831
+ },
1832
+ {
1833
+ "epoch": 2.385828571428571,
1834
+ "grad_norm": 2.7279197463085074,
1835
+ "learning_rate": 6.138756861336542e-07,
1836
+ "loss": 0.28215818405151366,
1837
+ "step": 2610
1838
+ },
1839
+ {
1840
+ "epoch": 2.3949714285714285,
1841
+ "grad_norm": 4.008408816111731,
1842
+ "learning_rate": 5.96525851531263e-07,
1843
+ "loss": 0.28048908710479736,
1844
+ "step": 2620
1845
+ },
1846
+ {
1847
+ "epoch": 2.404114285714286,
1848
+ "grad_norm": 3.320215936969822,
1849
+ "learning_rate": 5.793914516695303e-07,
1850
+ "loss": 0.290478515625,
1851
+ "step": 2630
1852
+ },
1853
+ {
1854
+ "epoch": 2.4132571428571428,
1855
+ "grad_norm": 2.9471386803081723,
1856
+ "learning_rate": 5.624744258156622e-07,
1857
+ "loss": 0.2790560722351074,
1858
+ "step": 2640
1859
+ },
1860
+ {
1861
+ "epoch": 2.4224,
1862
+ "grad_norm": 2.7802018757338445,
1863
+ "learning_rate": 5.45776688634525e-07,
1864
+ "loss": 0.28078885078430177,
1865
+ "step": 2650
1866
+ },
1867
+ {
1868
+ "epoch": 2.431542857142857,
1869
+ "grad_norm": 3.441939690522524,
1870
+ "learning_rate": 5.293001299719474e-07,
1871
+ "loss": 0.27572739124298096,
1872
+ "step": 2660
1873
+ },
1874
+ {
1875
+ "epoch": 2.4406857142857143,
1876
+ "grad_norm": 2.6403900442290396,
1877
+ "learning_rate": 5.130466146408269e-07,
1878
+ "loss": 0.28520448207855226,
1879
+ "step": 2670
1880
+ },
1881
+ {
1882
+ "epoch": 2.4498285714285712,
1883
+ "grad_norm": 2.919676897711747,
1884
+ "learning_rate": 4.970179822100709e-07,
1885
+ "loss": 0.2793970823287964,
1886
+ "step": 2680
1887
+ },
1888
+ {
1889
+ "epoch": 2.4589714285714286,
1890
+ "grad_norm": 2.5169051026523284,
1891
+ "learning_rate": 4.812160467963961e-07,
1892
+ "loss": 0.25467662811279296,
1893
+ "step": 2690
1894
+ },
1895
+ {
1896
+ "epoch": 2.468114285714286,
1897
+ "grad_norm": 3.150115641765334,
1898
+ "learning_rate": 4.656425968590048e-07,
1899
+ "loss": 0.26524691581726073,
1900
+ "step": 2700
1901
+ },
1902
+ {
1903
+ "epoch": 2.477257142857143,
1904
+ "grad_norm": 2.798567762503104,
1905
+ "learning_rate": 4.5029939499716845e-07,
1906
+ "loss": 0.2708770990371704,
1907
+ "step": 2710
1908
+ },
1909
+ {
1910
+ "epoch": 2.4864,
1911
+ "grad_norm": 2.779144429002268,
1912
+ "learning_rate": 4.3518817775073803e-07,
1913
+ "loss": 0.2831141948699951,
1914
+ "step": 2720
1915
+ },
1916
+ {
1917
+ "epoch": 2.495542857142857,
1918
+ "grad_norm": 2.9493120279424354,
1919
+ "learning_rate": 4.2031065540360324e-07,
1920
+ "loss": 0.2714195728302002,
1921
+ "step": 2730
1922
+ },
1923
+ {
1924
+ "epoch": 2.5046857142857144,
1925
+ "grad_norm": 3.114136833647926,
1926
+ "learning_rate": 4.056685117901199e-07,
1927
+ "loss": 0.2746497392654419,
1928
+ "step": 2740
1929
+ },
1930
+ {
1931
+ "epoch": 2.5138285714285713,
1932
+ "grad_norm": 3.8795836052599992,
1933
+ "learning_rate": 3.912634041045374e-07,
1934
+ "loss": 0.2960409164428711,
1935
+ "step": 2750
1936
+ },
1937
+ {
1938
+ "epoch": 2.5229714285714286,
1939
+ "grad_norm": 3.7611974062902402,
1940
+ "learning_rate": 3.770969627134363e-07,
1941
+ "loss": 0.2696434497833252,
1942
+ "step": 2760
1943
+ },
1944
+ {
1945
+ "epoch": 2.532114285714286,
1946
+ "grad_norm": 3.084236649645437,
1947
+ "learning_rate": 3.631707909712029e-07,
1948
+ "loss": 0.2951453447341919,
1949
+ "step": 2770
1950
+ },
1951
+ {
1952
+ "epoch": 2.541257142857143,
1953
+ "grad_norm": 2.7536418992296494,
1954
+ "learning_rate": 3.4948646503856597e-07,
1955
+ "loss": 0.26727540493011476,
1956
+ "step": 2780
1957
+ },
1958
+ {
1959
+ "epoch": 2.5504,
1960
+ "grad_norm": 2.4447069339756453,
1961
+ "learning_rate": 3.3604553370420153e-07,
1962
+ "loss": 0.26174561977386473,
1963
+ "step": 2790
1964
+ },
1965
+ {
1966
+ "epoch": 2.559542857142857,
1967
+ "grad_norm": 2.6204889030814917,
1968
+ "learning_rate": 3.228495182094457e-07,
1969
+ "loss": 0.25725569725036623,
1970
+ "step": 2800
1971
+ },
1972
+ {
1973
+ "epoch": 2.5686857142857145,
1974
+ "grad_norm": 2.854546748178268,
1975
+ "learning_rate": 3.09899912076119e-07,
1976
+ "loss": 0.26064653396606446,
1977
+ "step": 2810
1978
+ },
1979
+ {
1980
+ "epoch": 2.5778285714285714,
1981
+ "grad_norm": 3.071473221872306,
1982
+ "learning_rate": 2.9719818093748993e-07,
1983
+ "loss": 0.28105137348175047,
1984
+ "step": 2820
1985
+ },
1986
+ {
1987
+ "epoch": 2.5869714285714287,
1988
+ "grad_norm": 3.547166978357724,
1989
+ "learning_rate": 2.847457623723976e-07,
1990
+ "loss": 0.26943848133087156,
1991
+ "step": 2830
1992
+ },
1993
+ {
1994
+ "epoch": 2.5961142857142856,
1995
+ "grad_norm": 2.8077199918364992,
1996
+ "learning_rate": 2.725440657425424e-07,
1997
+ "loss": 0.271466064453125,
1998
+ "step": 2840
1999
+ },
2000
+ {
2001
+ "epoch": 2.605257142857143,
2002
+ "grad_norm": 3.3870796915867967,
2003
+ "learning_rate": 2.605944720329781e-07,
2004
+ "loss": 0.30047783851623533,
2005
+ "step": 2850
2006
+ },
2007
+ {
2008
+ "epoch": 2.6144,
2009
+ "grad_norm": 3.37481446466192,
2010
+ "learning_rate": 2.488983336958106e-07,
2011
+ "loss": 0.27461848258972166,
2012
+ "step": 2860
2013
+ },
2014
+ {
2015
+ "epoch": 2.623542857142857,
2016
+ "grad_norm": 3.3965631891349077,
2017
+ "learning_rate": 2.3745697449713e-07,
2018
+ "loss": 0.2756947040557861,
2019
+ "step": 2870
2020
+ },
2021
+ {
2022
+ "epoch": 2.6326857142857145,
2023
+ "grad_norm": 2.9333428705323916,
2024
+ "learning_rate": 2.262716893671846e-07,
2025
+ "loss": 0.2747671127319336,
2026
+ "step": 2880
2027
+ },
2028
+ {
2029
+ "epoch": 2.6418285714285714,
2030
+ "grad_norm": 2.6497732373612797,
2031
+ "learning_rate": 2.1534374425382144e-07,
2032
+ "loss": 0.25971531867980957,
2033
+ "step": 2890
2034
+ },
2035
+ {
2036
+ "epoch": 2.6509714285714283,
2037
+ "grad_norm": 4.272951017108124,
2038
+ "learning_rate": 2.0467437597920747e-07,
2039
+ "loss": 0.2755371332168579,
2040
+ "step": 2900
2041
+ },
2042
+ {
2043
+ "epoch": 2.6601142857142857,
2044
+ "grad_norm": 3.117894134867874,
2045
+ "learning_rate": 1.9426479209984722e-07,
2046
+ "loss": 0.28951458930969237,
2047
+ "step": 2910
2048
+ },
2049
+ {
2050
+ "epoch": 2.669257142857143,
2051
+ "grad_norm": 2.464439468735964,
2052
+ "learning_rate": 1.8411617076990878e-07,
2053
+ "loss": 0.2649653673171997,
2054
+ "step": 2920
2055
+ },
2056
+ {
2057
+ "epoch": 2.6784,
2058
+ "grad_norm": 2.72211328253953,
2059
+ "learning_rate": 1.742296606078836e-07,
2060
+ "loss": 0.29132938385009766,
2061
+ "step": 2930
2062
+ },
2063
+ {
2064
+ "epoch": 2.6875428571428572,
2065
+ "grad_norm": 4.113842251476894,
2066
+ "learning_rate": 1.646063805665843e-07,
2067
+ "loss": 0.2908849000930786,
2068
+ "step": 2940
2069
+ },
2070
+ {
2071
+ "epoch": 2.696685714285714,
2072
+ "grad_norm": 2.4174551461039124,
2073
+ "learning_rate": 1.552474198065032e-07,
2074
+ "loss": 0.27597498893737793,
2075
+ "step": 2950
2076
+ },
2077
+ {
2078
+ "epoch": 2.7058285714285715,
2079
+ "grad_norm": 2.6899463765584306,
2080
+ "learning_rate": 1.461538375725402e-07,
2081
+ "loss": 0.277122950553894,
2082
+ "step": 2960
2083
+ },
2084
+ {
2085
+ "epoch": 2.7149714285714284,
2086
+ "grad_norm": 2.8005053856013475,
2087
+ "learning_rate": 1.3732666307411823e-07,
2088
+ "loss": 0.25887160301208495,
2089
+ "step": 2970
2090
+ },
2091
+ {
2092
+ "epoch": 2.7241142857142857,
2093
+ "grad_norm": 2.703231559676717,
2094
+ "learning_rate": 1.2876689536869795e-07,
2095
+ "loss": 0.2687790632247925,
2096
+ "step": 2980
2097
+ },
2098
+ {
2099
+ "epoch": 2.733257142857143,
2100
+ "grad_norm": 2.9714387325356664,
2101
+ "learning_rate": 1.2047550324870454e-07,
2102
+ "loss": 0.2882379055023193,
2103
+ "step": 2990
2104
+ },
2105
+ {
2106
+ "epoch": 2.7424,
2107
+ "grad_norm": 2.975636524179059,
2108
+ "learning_rate": 1.1245342513187845e-07,
2109
+ "loss": 0.2735182285308838,
2110
+ "step": 3000
2111
+ },
2112
+ {
2113
+ "epoch": 2.7515428571428573,
2114
+ "grad_norm": 5.427438211860574,
2115
+ "learning_rate": 1.0470156895506816e-07,
2116
+ "loss": 0.28655252456665037,
2117
+ "step": 3010
2118
+ },
2119
+ {
2120
+ "epoch": 2.760685714285714,
2121
+ "grad_norm": 2.834836865933173,
2122
+ "learning_rate": 9.722081207146822e-08,
2123
+ "loss": 0.2843330383300781,
2124
+ "step": 3020
2125
+ },
2126
+ {
2127
+ "epoch": 2.7698285714285715,
2128
+ "grad_norm": 3.2508554170567745,
2129
+ "learning_rate": 9.00120011513217e-08,
2130
+ "loss": 0.3217320919036865,
2131
+ "step": 3030
2132
+ },
2133
+ {
2134
+ "epoch": 2.7789714285714284,
2135
+ "grad_norm": 2.662652904640414,
2136
+ "learning_rate": 8.307595208609242e-08,
2137
+ "loss": 0.2799499988555908,
2138
+ "step": 3040
2139
+ },
2140
+ {
2141
+ "epoch": 2.7881142857142858,
2142
+ "grad_norm": 3.313764988734726,
2143
+ "learning_rate": 7.641344989612553e-08,
2144
+ "loss": 0.2839944839477539,
2145
+ "step": 3050
2146
+ },
2147
+ {
2148
+ "epoch": 2.797257142857143,
2149
+ "grad_norm": 3.1722414488072572,
2150
+ "learning_rate": 7.002524864179655e-08,
2151
+ "loss": 0.2826042413711548,
2152
+ "step": 3060
2153
+ },
2154
+ {
2155
+ "epoch": 2.8064,
2156
+ "grad_norm": 2.4340202293962014,
2157
+ "learning_rate": 6.391207133816801e-08,
2158
+ "loss": 0.27430474758148193,
2159
+ "step": 3070
2160
+ },
2161
+ {
2162
+ "epoch": 2.815542857142857,
2163
+ "grad_norm": 3.8981338718366443,
2164
+ "learning_rate": 5.807460987315827e-08,
2165
+ "loss": 0.28628087043762207,
2166
+ "step": 3080
2167
+ },
2168
+ {
2169
+ "epoch": 2.8246857142857142,
2170
+ "grad_norm": 3.207003973875545,
2171
+ "learning_rate": 5.251352492923523e-08,
2172
+ "loss": 0.25586106777191164,
2173
+ "step": 3090
2174
+ },
2175
+ {
2176
+ "epoch": 2.8338285714285716,
2177
+ "grad_norm": 2.6863291011820767,
2178
+ "learning_rate": 4.7229445908638095e-08,
2179
+ "loss": 0.2681715726852417,
2180
+ "step": 3100
2181
+ },
2182
+ {
2183
+ "epoch": 2.8429714285714285,
2184
+ "grad_norm": 3.4170815541014594,
2185
+ "learning_rate": 4.222297086214494e-08,
2186
+ "loss": 0.2915987014770508,
2187
+ "step": 3110
2188
+ },
2189
+ {
2190
+ "epoch": 2.852114285714286,
2191
+ "grad_norm": 2.941305890011209,
2192
+ "learning_rate": 3.7494666421381274e-08,
2193
+ "loss": 0.2657483577728271,
2194
+ "step": 3120
2195
+ },
2196
+ {
2197
+ "epoch": 2.8612571428571427,
2198
+ "grad_norm": 3.526079056315177,
2199
+ "learning_rate": 3.304506773469329e-08,
2200
+ "loss": 0.25781662464141847,
2201
+ "step": 3130
2202
+ },
2203
+ {
2204
+ "epoch": 2.8704,
2205
+ "grad_norm": 2.609874604937171,
2206
+ "learning_rate": 2.8874678406576594e-08,
2207
+ "loss": 0.2730119228363037,
2208
+ "step": 3140
2209
+ },
2210
+ {
2211
+ "epoch": 2.879542857142857,
2212
+ "grad_norm": 3.0570740555603133,
2213
+ "learning_rate": 2.4983970440680128e-08,
2214
+ "loss": 0.2676541328430176,
2215
+ "step": 3150
2216
+ },
2217
+ {
2218
+ "epoch": 2.8886857142857143,
2219
+ "grad_norm": 2.976760544679315,
2220
+ "learning_rate": 2.1373384186383905e-08,
2221
+ "loss": 0.2622354507446289,
2222
+ "step": 3160
2223
+ },
2224
+ {
2225
+ "epoch": 2.8978285714285716,
2226
+ "grad_norm": 3.234328922862887,
2227
+ "learning_rate": 1.8043328288961105e-08,
2228
+ "loss": 0.2934865474700928,
2229
+ "step": 3170
2230
+ },
2231
+ {
2232
+ "epoch": 2.9069714285714285,
2233
+ "grad_norm": 3.1913825418895403,
2234
+ "learning_rate": 1.4994179643327555e-08,
2235
+ "loss": 0.28752024173736573,
2236
+ "step": 3180
2237
+ },
2238
+ {
2239
+ "epoch": 2.9161142857142854,
2240
+ "grad_norm": 3.135326939098938,
2241
+ "learning_rate": 1.2226283351384482e-08,
2242
+ "loss": 0.27213478088378906,
2243
+ "step": 3190
2244
+ },
2245
+ {
2246
+ "epoch": 2.925257142857143,
2247
+ "grad_norm": 2.4788183611689663,
2248
+ "learning_rate": 9.73995268296002e-09,
2249
+ "loss": 0.2616039037704468,
2250
+ "step": 3200
2251
+ },
2252
+ {
2253
+ "epoch": 2.9344,
2254
+ "grad_norm": 2.6512114328454897,
2255
+ "learning_rate": 7.535469040354516e-09,
2256
+ "loss": 0.27331559658050536,
2257
+ "step": 3210
2258
+ },
2259
+ {
2260
+ "epoch": 2.943542857142857,
2261
+ "grad_norm": 2.5254267778654653,
2262
+ "learning_rate": 5.613081926489073e-09,
2263
+ "loss": 0.276494574546814,
2264
+ "step": 3220
2265
+ },
2266
+ {
2267
+ "epoch": 2.9526857142857144,
2268
+ "grad_norm": 2.8166097166241686,
2269
+ "learning_rate": 3.973008916669519e-09,
2270
+ "loss": 0.26462578773498535,
2271
+ "step": 3230
2272
+ },
2273
+ {
2274
+ "epoch": 2.9618285714285717,
2275
+ "grad_norm": 3.292706227456575,
2276
+ "learning_rate": 2.6154356339599952e-09,
2277
+ "loss": 0.27637853622436526,
2278
+ "step": 3240
2279
+ },
2280
+ {
2281
+ "epoch": 2.9709714285714286,
2282
+ "grad_norm": 2.772394100009466,
2283
+ "learning_rate": 1.5405157281739303e-09,
2284
+ "loss": 0.26067826747894285,
2285
+ "step": 3250
2286
+ },
2287
+ {
2288
+ "epoch": 2.9801142857142855,
2289
+ "grad_norm": 3.1362183961360555,
2290
+ "learning_rate": 7.483708584843374e-10,
2291
+ "loss": 0.2749017238616943,
2292
+ "step": 3260
2293
+ },
2294
+ {
2295
+ "epoch": 2.989257142857143,
2296
+ "grad_norm": 2.5806364813100937,
2297
+ "learning_rate": 2.390906796548298e-10,
2298
+ "loss": 0.26424460411071776,
2299
+ "step": 3270
2300
+ },
2301
+ {
2302
+ "epoch": 2.9984,
2303
+ "grad_norm": 2.944409763435295,
2304
+ "learning_rate": 1.2732831892181553e-11,
2305
+ "loss": 0.26900973320007326,
2306
+ "step": 3280
2307
+ },
2308
+ {
2309
+ "epoch": 3.0,
2310
+ "step": 3282,
2311
+ "total_flos": 545049086656512.0,
2312
+ "train_loss": 0.4685640548112405,
2313
+ "train_runtime": 40125.0714,
2314
+ "train_samples_per_second": 5.234,
2315
+ "train_steps_per_second": 0.082
2316
+ }
2317
+ ],
2318
+ "logging_steps": 10,
2319
+ "max_steps": 3282,
2320
+ "num_input_tokens_seen": 0,
2321
+ "num_train_epochs": 3,
2322
+ "save_steps": 500,
2323
+ "stateful_callbacks": {
2324
+ "TrainerControl": {
2325
+ "args": {
2326
+ "should_epoch_stop": false,
2327
+ "should_evaluate": false,
2328
+ "should_log": false,
2329
+ "should_save": true,
2330
+ "should_training_stop": true
2331
+ },
2332
+ "attributes": {}
2333
+ }
2334
+ },
2335
+ "total_flos": 545049086656512.0,
2336
+ "train_batch_size": 1,
2337
+ "trial_name": null,
2338
+ "trial_params": null
2339
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4e5586e1c5c0491bb42b9664140bf29bb666bb2fa6c394dcca52d23053872a7
3
+ size 7761
training_loss.png ADDED