Training in progress, step 80, checkpoint

last-checkpoint/README.md

@@ -0,0 +1,202 @@
+---
+base_model: Qwen/Qwen2-0.5B
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.13.2

last-checkpoint/adapter_config.json

@@ -0,0 +1,34 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2-0.5B",
+  "bias": "none",
+  "fan_in_fan_out": null,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "o_proj",
+    "k_proj",
+    "q_proj",
+    "down_proj",
+    "up_proj",
+    "v_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

last-checkpoint/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5a91206a305d5d7d6ef1e9c952464d801b1d8f9e162a5dca23841af82853f788
+size 17640136

last-checkpoint/added_tokens.json

@@ -0,0 +1,5 @@
+{
+  "<|endoftext|>": 151643,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644
+}

last-checkpoint/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bea6fa14203deb33a8e39e2e76f43d4fabb54b912d3fe743fe54a93fbfee652b
+size 9568884

last-checkpoint/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5812e6c9c7cd96bdc640d12c2c22fceeddd7d33de9eeea4754d7ca0e58d38061
+size 14244

last-checkpoint/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a9f1391727449cdd7e0d2448ffc7fc8b9d6d2b7a44f882bf5d499ac1a852febb
+size 1064

last-checkpoint/special_tokens_map.json

@@ -0,0 +1,20 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

last-checkpoint/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bcfe42da0a4497e8b2b172c1f9f4ec423a46dc12907f4349c55025f670422ba9
+size 11418266

last-checkpoint/tokenizer_config.json

@@ -0,0 +1,43 @@
+{
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "bos_token": null,
+  "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{% if add_generation_prompt %}{{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "model_max_length": 32768,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

last-checkpoint/trainer_state.json

@@ -0,0 +1,609 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.2513747054202671,
+  "eval_steps": 80,
+  "global_step": 80,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.003142183817753339,
+      "grad_norm": 6.363121032714844,
+      "learning_rate": 2e-05,
+      "loss": 3.9332,
+      "step": 1
+    },
+    {
+      "epoch": 0.003142183817753339,
+      "eval_loss": 3.3246231079101562,
+      "eval_runtime": 3.1795,
+      "eval_samples_per_second": 42.145,
+      "eval_steps_per_second": 21.073,
+      "step": 1
+    },
+    {
+      "epoch": 0.006284367635506678,
+      "grad_norm": 4.884442329406738,
+      "learning_rate": 4e-05,
+      "loss": 2.8526,
+      "step": 2
+    },
+    {
+      "epoch": 0.009426551453260016,
+      "grad_norm": 3.985334873199463,
+      "learning_rate": 6e-05,
+      "loss": 3.2255,
+      "step": 3
+    },
+    {
+      "epoch": 0.012568735271013355,
+      "grad_norm": 6.034568786621094,
+      "learning_rate": 8e-05,
+      "loss": 3.5258,
+      "step": 4
+    },
+    {
+      "epoch": 0.015710919088766692,
+      "grad_norm": 4.2682061195373535,
+      "learning_rate": 0.0001,
+      "loss": 2.8997,
+      "step": 5
+    },
+    {
+      "epoch": 0.018853102906520033,
+      "grad_norm": 6.565602779388428,
+      "learning_rate": 0.00012,
+      "loss": 3.4334,
+      "step": 6
+    },
+    {
+      "epoch": 0.02199528672427337,
+      "grad_norm": 5.61314058303833,
+      "learning_rate": 0.00014,
+      "loss": 4.1331,
+      "step": 7
+    },
+    {
+      "epoch": 0.02513747054202671,
+      "grad_norm": 6.242368221282959,
+      "learning_rate": 0.00016,
+      "loss": 2.8306,
+      "step": 8
+    },
+    {
+      "epoch": 0.028279654359780047,
+      "grad_norm": 4.27402400970459,
+      "learning_rate": 0.00018,
+      "loss": 2.8574,
+      "step": 9
+    },
+    {
+      "epoch": 0.031421838177533384,
+      "grad_norm": 4.780200958251953,
+      "learning_rate": 0.0002,
+      "loss": 2.862,
+      "step": 10
+    },
+    {
+      "epoch": 0.03456402199528672,
+      "grad_norm": 3.1157400608062744,
+      "learning_rate": 0.00019999483168411242,
+      "loss": 2.2063,
+      "step": 11
+    },
+    {
+      "epoch": 0.037706205813040065,
+      "grad_norm": 5.149301528930664,
+      "learning_rate": 0.00019997932727067942,
+      "loss": 4.0438,
+      "step": 12
+    },
+    {
+      "epoch": 0.0408483896307934,
+      "grad_norm": 4.135054588317871,
+      "learning_rate": 0.00019995348836233516,
+      "loss": 2.0542,
+      "step": 13
+    },
+    {
+      "epoch": 0.04399057344854674,
+      "grad_norm": 4.026968002319336,
+      "learning_rate": 0.00019991731762995243,
+      "loss": 2.433,
+      "step": 14
+    },
+    {
+      "epoch": 0.04713275726630008,
+      "grad_norm": 4.476734161376953,
+      "learning_rate": 0.00019987081881236667,
+      "loss": 2.6396,
+      "step": 15
+    },
+    {
+      "epoch": 0.05027494108405342,
+      "grad_norm": 4.313846111297607,
+      "learning_rate": 0.00019981399671598939,
+      "loss": 2.4468,
+      "step": 16
+    },
+    {
+      "epoch": 0.05341712490180676,
+      "grad_norm": 4.3481597900390625,
+      "learning_rate": 0.0001997468572143115,
+      "loss": 2.0248,
+      "step": 17
+    },
+    {
+      "epoch": 0.056559308719560095,
+      "grad_norm": 4.479824066162109,
+      "learning_rate": 0.00019966940724729603,
+      "loss": 1.8349,
+      "step": 18
+    },
+    {
+      "epoch": 0.05970149253731343,
+      "grad_norm": 3.9508047103881836,
+      "learning_rate": 0.00019958165482066094,
+      "loss": 1.9087,
+      "step": 19
+    },
+    {
+      "epoch": 0.06284367635506677,
+      "grad_norm": 4.921350002288818,
+      "learning_rate": 0.00019948360900505139,
+      "loss": 1.9126,
+      "step": 20
+    },
+    {
+      "epoch": 0.06598586017282011,
+      "grad_norm": 6.273775577545166,
+      "learning_rate": 0.0001993752799351023,
+      "loss": 2.6166,
+      "step": 21
+    },
+    {
+      "epoch": 0.06912804399057344,
+      "grad_norm": 3.842134475708008,
+      "learning_rate": 0.0001992566788083908,
+      "loss": 1.8935,
+      "step": 22
+    },
+    {
+      "epoch": 0.07227022780832679,
+      "grad_norm": 4.88998556137085,
+      "learning_rate": 0.0001991278178842786,
+      "loss": 2.5942,
+      "step": 23
+    },
+    {
+      "epoch": 0.07541241162608013,
+      "grad_norm": 3.906719446182251,
+      "learning_rate": 0.0001989887104826449,
+      "loss": 1.6608,
+      "step": 24
+    },
+    {
+      "epoch": 0.07855459544383346,
+      "grad_norm": 3.4420666694641113,
+      "learning_rate": 0.00019883937098250963,
+      "loss": 1.3935,
+      "step": 25
+    },
+    {
+      "epoch": 0.0816967792615868,
+      "grad_norm": 4.214719295501709,
+      "learning_rate": 0.00019867981482054697,
+      "loss": 1.919,
+      "step": 26
+    },
+    {
+      "epoch": 0.08483896307934014,
+      "grad_norm": 3.18511962890625,
+      "learning_rate": 0.00019851005848948988,
+      "loss": 1.6292,
+      "step": 27
+    },
+    {
+      "epoch": 0.08798114689709348,
+      "grad_norm": 4.352863311767578,
+      "learning_rate": 0.00019833011953642525,
+      "loss": 1.7757,
+      "step": 28
+    },
+    {
+      "epoch": 0.09112333071484682,
+      "grad_norm": 5.203609943389893,
+      "learning_rate": 0.00019814001656098001,
+      "loss": 2.1664,
+      "step": 29
+    },
+    {
+      "epoch": 0.09426551453260015,
+      "grad_norm": 5.729132652282715,
+      "learning_rate": 0.0001979397692133988,
+      "loss": 1.8682,
+      "step": 30
+    },
+    {
+      "epoch": 0.0974076983503535,
+      "grad_norm": 4.504645347595215,
+      "learning_rate": 0.0001977293981925125,
+      "loss": 2.0425,
+      "step": 31
+    },
+    {
+      "epoch": 0.10054988216810684,
+      "grad_norm": 4.424794673919678,
+      "learning_rate": 0.00019750892524359896,
+      "loss": 1.7463,
+      "step": 32
+    },
+    {
+      "epoch": 0.10369206598586017,
+      "grad_norm": 4.2681732177734375,
+      "learning_rate": 0.00019727837315613504,
+      "loss": 1.8088,
+      "step": 33
+    },
+    {
+      "epoch": 0.10683424980361352,
+      "grad_norm": 4.222225189208984,
+      "learning_rate": 0.00019703776576144105,
+      "loss": 1.9744,
+      "step": 34
+    },
+    {
+      "epoch": 0.10997643362136685,
+      "grad_norm": 4.184460639953613,
+      "learning_rate": 0.0001967871279302175,
+      "loss": 1.8647,
+      "step": 35
+    },
+    {
+      "epoch": 0.11311861743912019,
+      "grad_norm": 3.9263622760772705,
+      "learning_rate": 0.000196526485569974,
+      "loss": 1.7795,
+      "step": 36
+    },
+    {
+      "epoch": 0.11626080125687353,
+      "grad_norm": 2.5162949562072754,
+      "learning_rate": 0.0001962558656223516,
+      "loss": 1.6098,
+      "step": 37
+    },
+    {
+      "epoch": 0.11940298507462686,
+      "grad_norm": 5.444307804107666,
+      "learning_rate": 0.00019597529606033782,
+      "loss": 2.9476,
+      "step": 38
+    },
+    {
+      "epoch": 0.12254516889238021,
+      "grad_norm": 4.51501989364624,
+      "learning_rate": 0.00019568480588537512,
+      "loss": 2.1029,
+      "step": 39
+    },
+    {
+      "epoch": 0.12568735271013354,
+      "grad_norm": 3.5365636348724365,
+      "learning_rate": 0.00019538442512436328,
+      "loss": 1.6352,
+      "step": 40
+    },
+    {
+      "epoch": 0.12882953652788687,
+      "grad_norm": 4.278099060058594,
+      "learning_rate": 0.00019507418482655545,
+      "loss": 1.8917,
+      "step": 41
+    },
+    {
+      "epoch": 0.13197172034564023,
+      "grad_norm": 3.2536511421203613,
+      "learning_rate": 0.00019475411706034883,
+      "loss": 1.4544,
+      "step": 42
+    },
+    {
+      "epoch": 0.13511390416339356,
+      "grad_norm": 3.517355442047119,
+      "learning_rate": 0.00019442425490996988,
+      "loss": 1.5405,
+      "step": 43
+    },
+    {
+      "epoch": 0.13825608798114689,
+      "grad_norm": 3.2878963947296143,
+      "learning_rate": 0.0001940846324720544,
+      "loss": 1.8725,
+      "step": 44
+    },
+    {
+      "epoch": 0.14139827179890024,
+      "grad_norm": 3.934913396835327,
+      "learning_rate": 0.00019373528485212325,
+      "loss": 1.7376,
+      "step": 45
+    },
+    {
+      "epoch": 0.14454045561665357,
+      "grad_norm": 2.8244900703430176,
+      "learning_rate": 0.00019337624816095358,
+      "loss": 1.4317,
+      "step": 46
+    },
+    {
+      "epoch": 0.1476826394344069,
+      "grad_norm": 3.8465495109558105,
+      "learning_rate": 0.00019300755951084594,
+      "loss": 2.0579,
+      "step": 47
+    },
+    {
+      "epoch": 0.15082482325216026,
+      "grad_norm": 2.7710604667663574,
+      "learning_rate": 0.00019262925701178866,
+      "loss": 1.2879,
+      "step": 48
+    },
+    {
+      "epoch": 0.1539670070699136,
+      "grad_norm": 3.3544390201568604,
+      "learning_rate": 0.00019224137976751795,
+      "loss": 1.935,
+      "step": 49
+    },
+    {
+      "epoch": 0.15710919088766692,
+      "grad_norm": 3.682419538497925,
+      "learning_rate": 0.00019184396787147632,
+      "loss": 1.7821,
+      "step": 50
+    },
+    {
+      "epoch": 0.16025137470542028,
+      "grad_norm": 4.398491859436035,
+      "learning_rate": 0.0001914370624026681,
+      "loss": 2.3979,
+      "step": 51
+    },
+    {
+      "epoch": 0.1633935585231736,
+      "grad_norm": 3.6515839099884033,
+      "learning_rate": 0.00019102070542141328,
+      "loss": 1.701,
+      "step": 52
+    },
+    {
+      "epoch": 0.16653574234092694,
+      "grad_norm": 4.598262310028076,
+      "learning_rate": 0.00019059493996499986,
+      "loss": 2.3888,
+      "step": 53
+    },
+    {
+      "epoch": 0.16967792615868027,
+      "grad_norm": 3.836564540863037,
+      "learning_rate": 0.00019015981004323536,
+      "loss": 1.6754,
+      "step": 54
+    },
+    {
+      "epoch": 0.17282010997643363,
+      "grad_norm": 3.4894602298736572,
+      "learning_rate": 0.00018971536063389744,
+      "loss": 1.9253,
+      "step": 55
+    },
+    {
+      "epoch": 0.17596229379418696,
+      "grad_norm": 2.8915672302246094,
+      "learning_rate": 0.00018926163767808503,
+      "loss": 1.3623,
+      "step": 56
+    },
+    {
+      "epoch": 0.1791044776119403,
+      "grad_norm": 2.8084566593170166,
+      "learning_rate": 0.00018879868807546935,
+      "loss": 1.6802,
+      "step": 57
+    },
+    {
+      "epoch": 0.18224666142969365,
+      "grad_norm": 4.654428005218506,
+      "learning_rate": 0.00018832655967944607,
+      "loss": 1.9732,
+      "step": 58
+    },
+    {
+      "epoch": 0.18538884524744698,
+      "grad_norm": 3.538031578063965,
+      "learning_rate": 0.0001878453012921891,
+      "loss": 1.7608,
+      "step": 59
+    },
+    {
+      "epoch": 0.1885310290652003,
+      "grad_norm": 7.985049724578857,
+      "learning_rate": 0.00018735496265960574,
+      "loss": 2.0565,
+      "step": 60
+    },
+    {
+      "epoch": 0.19167321288295366,
+      "grad_norm": 3.608008623123169,
+      "learning_rate": 0.0001868555944661949,
+      "loss": 1.7271,
+      "step": 61
+    },
+    {
+      "epoch": 0.194815396700707,
+      "grad_norm": 4.112086772918701,
+      "learning_rate": 0.00018634724832980793,
+      "loss": 1.5885,
+      "step": 62
+    },
+    {
+      "epoch": 0.19795758051846032,
+      "grad_norm": 2.906614065170288,
+      "learning_rate": 0.00018582997679631315,
+      "loss": 1.6899,
+      "step": 63
+    },
+    {
+      "epoch": 0.20109976433621368,
+      "grad_norm": 6.500161170959473,
+      "learning_rate": 0.00018530383333416418,
+      "loss": 2.3487,
+      "step": 64
+    },
+    {
+      "epoch": 0.204241948153967,
+      "grad_norm": 3.0283100605010986,
+      "learning_rate": 0.0001847688723288733,
+      "loss": 1.1601,
+      "step": 65
+    },
+    {
+      "epoch": 0.20738413197172034,
+      "grad_norm": 3.7165322303771973,
+      "learning_rate": 0.00018422514907738988,
+      "loss": 1.38,
+      "step": 66
+    },
+    {
+      "epoch": 0.21052631578947367,
+      "grad_norm": 3.9411511421203613,
+      "learning_rate": 0.0001836727197823842,
+      "loss": 1.6786,
+      "step": 67
+    },
+    {
+      "epoch": 0.21366849960722703,
+      "grad_norm": 3.546456813812256,
+      "learning_rate": 0.00018311164154643836,
+      "loss": 1.4133,
+      "step": 68
+    },
+    {
+      "epoch": 0.21681068342498036,
+      "grad_norm": 3.9866843223571777,
+      "learning_rate": 0.00018254197236614354,
+      "loss": 1.7876,
+      "step": 69
+    },
+    {
+      "epoch": 0.2199528672427337,
+      "grad_norm": 4.119327545166016,
+      "learning_rate": 0.00018196377112610526,
+      "loss": 1.8639,
+      "step": 70
+    },
+    {
+      "epoch": 0.22309505106048705,
+      "grad_norm": 2.856168031692505,
+      "learning_rate": 0.00018137709759285663,
+      "loss": 1.798,
+      "step": 71
+    },
+    {
+      "epoch": 0.22623723487824038,
+      "grad_norm": 4.225551605224609,
+      "learning_rate": 0.0001807820124086805,
+      "loss": 1.5513,
+      "step": 72
+    },
+    {
+      "epoch": 0.2293794186959937,
+      "grad_norm": 3.7681612968444824,
+      "learning_rate": 0.00018017857708534107,
+      "loss": 1.2283,
+      "step": 73
+    },
+    {
+      "epoch": 0.23252160251374707,
+      "grad_norm": 2.7943308353424072,
+      "learning_rate": 0.00017956685399772576,
+      "loss": 1.4152,
+      "step": 74
+    },
+    {
+      "epoch": 0.2356637863315004,
+      "grad_norm": 7.1395344734191895,
+      "learning_rate": 0.00017894690637739765,
+      "loss": 1.8666,
+      "step": 75
+    },
+    {
+      "epoch": 0.23880597014925373,
+      "grad_norm": 3.9814069271087646,
+      "learning_rate": 0.00017831879830605937,
+      "loss": 1.7041,
+      "step": 76
+    },
+    {
+      "epoch": 0.24194815396700706,
+      "grad_norm": 3.7089710235595703,
+      "learning_rate": 0.00017768259470892942,
+      "loss": 1.7016,
+      "step": 77
+    },
+    {
+      "epoch": 0.24509033778476041,
+      "grad_norm": 3.405512571334839,
+      "learning_rate": 0.00017703836134803105,
+      "loss": 1.8297,
+      "step": 78
+    },
+    {
+      "epoch": 0.24823252160251374,
+      "grad_norm": 3.8806557655334473,
+      "learning_rate": 0.0001763861648153945,
+      "loss": 1.6306,
+      "step": 79
+    },
+    {
+      "epoch": 0.2513747054202671,
+      "grad_norm": 3.021526336669922,
+      "learning_rate": 0.00017572607252617378,
+      "loss": 1.1181,
+      "step": 80
+    },
+    {
+      "epoch": 0.2513747054202671,
+      "eval_loss": 1.5871238708496094,
+      "eval_runtime": 2.7117,
+      "eval_samples_per_second": 49.416,
+      "eval_steps_per_second": 24.708,
+      "step": 80
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 319,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 80,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 712305310433280.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

last-checkpoint/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7ba324e7344c523e9f7951e49d5d27a627f624698c14e21500212af6c409a0d5
+size 6776