Upload chosen-sft checkpoint

.gitattributes

@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+checkpoint-1000/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1350/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-500/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,207 @@
+---
+base_model: Qwen/Qwen2.5-14B
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:Qwen/Qwen2.5-14B
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2.5-14B",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dee0de3bb476250e7de09dbf0dcdd981fc773ea1bd027a6c7f539a8b855885e0
+size 50357488

chat_template.jinja

@@ -0,0 +1,54 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- messages[0]['content'] }}
+    {%- else %}
+        {{- 'You are a helpful assistant.' }}
+    {%- endif %}
+    {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
+    {%- else %}
+        {{- '<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {{- '<|im_start|>' + message.role }}
+        {%- if message.content %}
+            {{- '\n' + message.content }}
+        {%- endif %}
+        {%- for tool_call in message.tool_calls %}
+            {%- if tool_call.function is defined %}
+                {%- set tool_call = tool_call.function %}
+            {%- endif %}
+            {{- '\n<tool_call>\n{"name": "' }}
+            {{- tool_call.name }}
+            {{- '", "arguments": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- '}\n</tool_call>' }}
+        {%- endfor %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+{%- endif %}

checkpoint-1000/README.md

@@ -0,0 +1,207 @@
+---
+base_model: Qwen/Qwen2.5-14B
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:Qwen/Qwen2.5-14B
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

checkpoint-1000/adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2.5-14B",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

checkpoint-1000/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dee0de3bb476250e7de09dbf0dcdd981fc773ea1bd027a6c7f539a8b855885e0
+size 50357488

checkpoint-1000/chat_template.jinja

@@ -0,0 +1,54 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- messages[0]['content'] }}
+    {%- else %}
+        {{- 'You are a helpful assistant.' }}
+    {%- endif %}
+    {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
+    {%- else %}
+        {{- '<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {{- '<|im_start|>' + message.role }}
+        {%- if message.content %}
+            {{- '\n' + message.content }}
+        {%- endif %}
+        {%- for tool_call in message.tool_calls %}
+            {%- if tool_call.function is defined %}
+                {%- set tool_call = tool_call.function %}
+            {%- endif %}
+            {{- '\n<tool_call>\n{"name": "' }}
+            {{- tool_call.name }}
+            {{- '", "arguments": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- '}\n</tool_call>' }}
+        {%- endfor %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+{%- endif %}

checkpoint-1000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7cf8b25cbb3be3be601a1cb3c34b6d5d4d053206c90d25ea0e2f6e094a8ad2b1
+size 1657

checkpoint-1000/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26927801984ce6503b6667bec4d536ee41cd94e1561527d7fd10537f9c52f94f
+size 14645

checkpoint-1000/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e66981ce87cdc7697b1273bc3525d280a5df7b341fbea0767296bee610ddc60
+size 1465

checkpoint-1000/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e2b7649a086fbb9771cd78ec5b7ffa7069e16a82424a382950fedfa1e057861
+size 11421991

checkpoint-1000/tokenizer_config.json

@@ -0,0 +1,29 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "extra_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "is_local": false,
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

checkpoint-1000/trainer_state.json

@@ -0,0 +1,384 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.7410838351088467,
+  "eval_steps": 500,
+  "global_step": 1000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.014821676702176934,
+      "grad_norm": 0.0,
+      "learning_rate": 1.971851851851852e-05,
+      "loss": 0.4899055004119873,
+      "step": 20
+    },
+    {
+      "epoch": 0.029643353404353867,
+      "grad_norm": 0.0,
+      "learning_rate": 1.9422222222222223e-05,
+      "loss": 0.5139500141143799,
+      "step": 40
+    },
+    {
+      "epoch": 0.0444650301065308,
+      "grad_norm": 0.0,
+      "learning_rate": 1.912592592592593e-05,
+      "loss": 0.5229451179504394,
+      "step": 60
+    },
+    {
+      "epoch": 0.059286706808707734,
+      "grad_norm": 0.0,
+      "learning_rate": 1.882962962962963e-05,
+      "loss": 0.5185572147369385,
+      "step": 80
+    },
+    {
+      "epoch": 0.07410838351088467,
+      "grad_norm": 0.0,
+      "learning_rate": 1.8533333333333334e-05,
+      "loss": 0.5250892639160156,
+      "step": 100
+    },
+    {
+      "epoch": 0.0889300602130616,
+      "grad_norm": 0.0,
+      "learning_rate": 1.8237037037037037e-05,
+      "loss": 0.5176488876342773,
+      "step": 120
+    },
+    {
+      "epoch": 0.10375173691523853,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7940740740740743e-05,
+      "loss": 0.5225274085998535,
+      "step": 140
+    },
+    {
+      "epoch": 0.11857341361741547,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7644444444444446e-05,
+      "loss": 0.5126307010650635,
+      "step": 160
+    },
+    {
+      "epoch": 0.1333950903195924,
+      "grad_norm": 0.0,
+      "learning_rate": 1.734814814814815e-05,
+      "loss": 0.49596052169799804,
+      "step": 180
+    },
+    {
+      "epoch": 0.14821676702176934,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7051851851851854e-05,
+      "loss": 0.48282203674316404,
+      "step": 200
+    },
+    {
+      "epoch": 0.16303844372394627,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6755555555555557e-05,
+      "loss": 0.47712411880493166,
+      "step": 220
+    },
+    {
+      "epoch": 0.1778601204261232,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6459259259259263e-05,
+      "loss": 0.543468427658081,
+      "step": 240
+    },
+    {
+      "epoch": 0.19268179712830014,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6162962962962966e-05,
+      "loss": 0.5191382884979248,
+      "step": 260
+    },
+    {
+      "epoch": 0.20750347383047707,
+      "grad_norm": 0.0,
+      "learning_rate": 1.586666666666667e-05,
+      "loss": 0.5149303913116455,
+      "step": 280
+    },
+    {
+      "epoch": 0.222325150532654,
+      "grad_norm": 0.0,
+      "learning_rate": 1.557037037037037e-05,
+      "loss": 0.45279850959777834,
+      "step": 300
+    },
+    {
+      "epoch": 0.23714682723483094,
+      "grad_norm": 0.0,
+      "learning_rate": 1.5274074074074074e-05,
+      "loss": 0.5343164920806884,
+      "step": 320
+    },
+    {
+      "epoch": 0.25196850393700787,
+      "grad_norm": 0.0,
+      "learning_rate": 1.497777777777778e-05,
+      "loss": 0.47828402519226076,
+      "step": 340
+    },
+    {
+      "epoch": 0.2667901806391848,
+      "grad_norm": 0.0,
+      "learning_rate": 1.4681481481481484e-05,
+      "loss": 0.5143001079559326,
+      "step": 360
+    },
+    {
+      "epoch": 0.28161185734136174,
+      "grad_norm": 0.0,
+      "learning_rate": 1.4385185185185187e-05,
+      "loss": 0.4801042556762695,
+      "step": 380
+    },
+    {
+      "epoch": 0.29643353404353867,
+      "grad_norm": 0.0,
+      "learning_rate": 1.408888888888889e-05,
+      "loss": 0.5391404151916503,
+      "step": 400
+    },
+    {
+      "epoch": 0.3112552107457156,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3792592592592594e-05,
+      "loss": 0.5449098587036133,
+      "step": 420
+    },
+    {
+      "epoch": 0.32607688744789254,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3496296296296298e-05,
+      "loss": 0.5099626541137695,
+      "step": 440
+    },
+    {
+      "epoch": 0.34089856415006947,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3200000000000002e-05,
+      "loss": 0.5027807235717774,
+      "step": 460
+    },
+    {
+      "epoch": 0.3557202408522464,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2903703703703705e-05,
+      "loss": 0.5257837772369385,
+      "step": 480
+    },
+    {
+      "epoch": 0.37054191755442334,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2607407407407408e-05,
+      "loss": 0.5272829532623291,
+      "step": 500
+    },
+    {
+      "epoch": 0.3853635942566003,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2311111111111112e-05,
+      "loss": 0.47138051986694335,
+      "step": 520
+    },
+    {
+      "epoch": 0.4001852709587772,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2014814814814815e-05,
+      "loss": 0.47753200531005857,
+      "step": 540
+    },
+    {
+      "epoch": 0.41500694766095414,
+      "grad_norm": 0.0,
+      "learning_rate": 1.171851851851852e-05,
+      "loss": 0.5022264957427979,
+      "step": 560
+    },
+    {
+      "epoch": 0.4298286243631311,
+      "grad_norm": 0.0,
+      "learning_rate": 1.1422222222222223e-05,
+      "loss": 0.5192673206329346,
+      "step": 580
+    },
+    {
+      "epoch": 0.444650301065308,
+      "grad_norm": 0.0,
+      "learning_rate": 1.1125925925925926e-05,
+      "loss": 0.5433578491210938,
+      "step": 600
+    },
+    {
+      "epoch": 0.45947197776748494,
+      "grad_norm": 0.0,
+      "learning_rate": 1.082962962962963e-05,
+      "loss": 0.5097993850708008,
+      "step": 620
+    },
+    {
+      "epoch": 0.4742936544696619,
+      "grad_norm": 0.0,
+      "learning_rate": 1.0533333333333333e-05,
+      "loss": 0.48088994026184084,
+      "step": 640
+    },
+    {
+      "epoch": 0.4891153311718388,
+      "grad_norm": 0.0,
+      "learning_rate": 1.0237037037037039e-05,
+      "loss": 0.5272709369659424,
+      "step": 660
+    },
+    {
+      "epoch": 0.5039370078740157,
+      "grad_norm": 0.0,
+      "learning_rate": 9.940740740740742e-06,
+      "loss": 0.5155187129974366,
+      "step": 680
+    },
+    {
+      "epoch": 0.5187586845761927,
+      "grad_norm": 0.0,
+      "learning_rate": 9.644444444444444e-06,
+      "loss": 0.513616943359375,
+      "step": 700
+    },
+    {
+      "epoch": 0.5335803612783696,
+      "grad_norm": 0.0,
+      "learning_rate": 9.348148148148149e-06,
+      "loss": 0.5366382598876953,
+      "step": 720
+    },
+    {
+      "epoch": 0.5484020379805465,
+      "grad_norm": 0.0,
+      "learning_rate": 9.051851851851853e-06,
+      "loss": 0.48917584419250487,
+      "step": 740
+    },
+    {
+      "epoch": 0.5632237146827235,
+      "grad_norm": 0.0,
+      "learning_rate": 8.755555555555556e-06,
+      "loss": 0.510042381286621,
+      "step": 760
+    },
+    {
+      "epoch": 0.5780453913849004,
+      "grad_norm": 0.0,
+      "learning_rate": 8.45925925925926e-06,
+      "loss": 0.5264229774475098,
+      "step": 780
+    },
+    {
+      "epoch": 0.5928670680870773,
+      "grad_norm": 0.0,
+      "learning_rate": 8.162962962962964e-06,
+      "loss": 0.543345308303833,
+      "step": 800
+    },
+    {
+      "epoch": 0.6076887447892543,
+      "grad_norm": 0.0,
+      "learning_rate": 7.866666666666667e-06,
+      "loss": 0.5195151329040527,
+      "step": 820
+    },
+    {
+      "epoch": 0.6225104214914312,
+      "grad_norm": 0.0,
+      "learning_rate": 7.570370370370371e-06,
+      "loss": 0.5005125045776367,
+      "step": 840
+    },
+    {
+      "epoch": 0.6373320981936081,
+      "grad_norm": 0.0,
+      "learning_rate": 7.274074074074075e-06,
+      "loss": 0.5076333045959472,
+      "step": 860
+    },
+    {
+      "epoch": 0.6521537748957851,
+      "grad_norm": 0.0,
+      "learning_rate": 6.977777777777779e-06,
+      "loss": 0.5086907863616943,
+      "step": 880
+    },
+    {
+      "epoch": 0.666975451597962,
+      "grad_norm": 0.0,
+      "learning_rate": 6.681481481481482e-06,
+      "loss": 0.5071919918060303,
+      "step": 900
+    },
+    {
+      "epoch": 0.6817971283001389,
+      "grad_norm": 0.0,
+      "learning_rate": 6.385185185185185e-06,
+      "loss": 0.4695600032806396,
+      "step": 920
+    },
+    {
+      "epoch": 0.6966188050023159,
+      "grad_norm": 0.0,
+      "learning_rate": 6.08888888888889e-06,
+      "loss": 0.5098789691925049,
+      "step": 940
+    },
+    {
+      "epoch": 0.7114404817044928,
+      "grad_norm": 0.0,
+      "learning_rate": 5.792592592592593e-06,
+      "loss": 0.5513834953308105,
+      "step": 960
+    },
+    {
+      "epoch": 0.7262621584066697,
+      "grad_norm": 0.0,
+      "learning_rate": 5.496296296296296e-06,
+      "loss": 0.5368476867675781,
+      "step": 980
+    },
+    {
+      "epoch": 0.7410838351088467,
+      "grad_norm": 0.0,
+      "learning_rate": 5.2e-06,
+      "loss": 0.48752031326293943,
+      "step": 1000
+    }
+  ],
+  "logging_steps": 20,
+  "max_steps": 1350,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 1.682337762946007e+17,
+  "train_batch_size": 1,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-1000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cc4d3ccbc6dd46df263fd0d62393a26dc134305545d04dbbe8339e95a3b389b
+size 5201

checkpoint-1350/README.md

@@ -0,0 +1,207 @@
+---
+base_model: Qwen/Qwen2.5-14B
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:Qwen/Qwen2.5-14B
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

checkpoint-1350/adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2.5-14B",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

checkpoint-1350/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dee0de3bb476250e7de09dbf0dcdd981fc773ea1bd027a6c7f539a8b855885e0
+size 50357488

checkpoint-1350/chat_template.jinja

@@ -0,0 +1,54 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- messages[0]['content'] }}
+    {%- else %}
+        {{- 'You are a helpful assistant.' }}
+    {%- endif %}
+    {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
+    {%- else %}
+        {{- '<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {{- '<|im_start|>' + message.role }}
+        {%- if message.content %}
+            {{- '\n' + message.content }}
+        {%- endif %}
+        {%- for tool_call in message.tool_calls %}
+            {%- if tool_call.function is defined %}
+                {%- set tool_call = tool_call.function %}
+            {%- endif %}
+            {{- '\n<tool_call>\n{"name": "' }}
+            {{- tool_call.name }}
+            {{- '", "arguments": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- '}\n</tool_call>' }}
+        {%- endfor %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+{%- endif %}

checkpoint-1350/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5257d6e010874c0527010c185a9d71749161e22da8912f6a7f175df466f432ea
+size 1657

checkpoint-1350/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd2a36f8738f0643a1780a5a73b7c5def1a68a43f2954053be8ba463d9297c13
+size 14645

checkpoint-1350/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:81a3d8813c352cbeddecb3110cc103676df3f785b3015cca6587393a4c17f518
+size 1465

checkpoint-1350/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e2b7649a086fbb9771cd78ec5b7ffa7069e16a82424a382950fedfa1e057861
+size 11421991

checkpoint-1350/tokenizer_config.json

@@ -0,0 +1,29 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "extra_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "is_local": false,
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

checkpoint-1350/trainer_state.json

@@ -0,0 +1,503 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.0,
+  "eval_steps": 500,
+  "global_step": 1350,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.014821676702176934,
+      "grad_norm": 0.0,
+      "learning_rate": 1.971851851851852e-05,
+      "loss": 0.4899055004119873,
+      "step": 20
+    },
+    {
+      "epoch": 0.029643353404353867,
+      "grad_norm": 0.0,
+      "learning_rate": 1.9422222222222223e-05,
+      "loss": 0.5139500141143799,
+      "step": 40
+    },
+    {
+      "epoch": 0.0444650301065308,
+      "grad_norm": 0.0,
+      "learning_rate": 1.912592592592593e-05,
+      "loss": 0.5229451179504394,
+      "step": 60
+    },
+    {
+      "epoch": 0.059286706808707734,
+      "grad_norm": 0.0,
+      "learning_rate": 1.882962962962963e-05,
+      "loss": 0.5185572147369385,
+      "step": 80
+    },
+    {
+      "epoch": 0.07410838351088467,
+      "grad_norm": 0.0,
+      "learning_rate": 1.8533333333333334e-05,
+      "loss": 0.5250892639160156,
+      "step": 100
+    },
+    {
+      "epoch": 0.0889300602130616,
+      "grad_norm": 0.0,
+      "learning_rate": 1.8237037037037037e-05,
+      "loss": 0.5176488876342773,
+      "step": 120
+    },
+    {
+      "epoch": 0.10375173691523853,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7940740740740743e-05,
+      "loss": 0.5225274085998535,
+      "step": 140
+    },
+    {
+      "epoch": 0.11857341361741547,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7644444444444446e-05,
+      "loss": 0.5126307010650635,
+      "step": 160
+    },
+    {
+      "epoch": 0.1333950903195924,
+      "grad_norm": 0.0,
+      "learning_rate": 1.734814814814815e-05,
+      "loss": 0.49596052169799804,
+      "step": 180
+    },
+    {
+      "epoch": 0.14821676702176934,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7051851851851854e-05,
+      "loss": 0.48282203674316404,
+      "step": 200
+    },
+    {
+      "epoch": 0.16303844372394627,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6755555555555557e-05,
+      "loss": 0.47712411880493166,
+      "step": 220
+    },
+    {
+      "epoch": 0.1778601204261232,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6459259259259263e-05,
+      "loss": 0.543468427658081,
+      "step": 240
+    },
+    {
+      "epoch": 0.19268179712830014,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6162962962962966e-05,
+      "loss": 0.5191382884979248,
+      "step": 260
+    },
+    {
+      "epoch": 0.20750347383047707,
+      "grad_norm": 0.0,
+      "learning_rate": 1.586666666666667e-05,
+      "loss": 0.5149303913116455,
+      "step": 280
+    },
+    {
+      "epoch": 0.222325150532654,
+      "grad_norm": 0.0,
+      "learning_rate": 1.557037037037037e-05,
+      "loss": 0.45279850959777834,
+      "step": 300
+    },
+    {
+      "epoch": 0.23714682723483094,
+      "grad_norm": 0.0,
+      "learning_rate": 1.5274074074074074e-05,
+      "loss": 0.5343164920806884,
+      "step": 320
+    },
+    {
+      "epoch": 0.25196850393700787,
+      "grad_norm": 0.0,
+      "learning_rate": 1.497777777777778e-05,
+      "loss": 0.47828402519226076,
+      "step": 340
+    },
+    {
+      "epoch": 0.2667901806391848,
+      "grad_norm": 0.0,
+      "learning_rate": 1.4681481481481484e-05,
+      "loss": 0.5143001079559326,
+      "step": 360
+    },
+    {
+      "epoch": 0.28161185734136174,
+      "grad_norm": 0.0,
+      "learning_rate": 1.4385185185185187e-05,
+      "loss": 0.4801042556762695,
+      "step": 380
+    },
+    {
+      "epoch": 0.29643353404353867,
+      "grad_norm": 0.0,
+      "learning_rate": 1.408888888888889e-05,
+      "loss": 0.5391404151916503,
+      "step": 400
+    },
+    {
+      "epoch": 0.3112552107457156,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3792592592592594e-05,
+      "loss": 0.5449098587036133,
+      "step": 420
+    },
+    {
+      "epoch": 0.32607688744789254,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3496296296296298e-05,
+      "loss": 0.5099626541137695,
+      "step": 440
+    },
+    {
+      "epoch": 0.34089856415006947,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3200000000000002e-05,
+      "loss": 0.5027807235717774,
+      "step": 460
+    },
+    {
+      "epoch": 0.3557202408522464,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2903703703703705e-05,
+      "loss": 0.5257837772369385,
+      "step": 480
+    },
+    {
+      "epoch": 0.37054191755442334,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2607407407407408e-05,
+      "loss": 0.5272829532623291,
+      "step": 500
+    },
+    {
+      "epoch": 0.3853635942566003,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2311111111111112e-05,
+      "loss": 0.47138051986694335,
+      "step": 520
+    },
+    {
+      "epoch": 0.4001852709587772,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2014814814814815e-05,
+      "loss": 0.47753200531005857,
+      "step": 540
+    },
+    {
+      "epoch": 0.41500694766095414,
+      "grad_norm": 0.0,
+      "learning_rate": 1.171851851851852e-05,
+      "loss": 0.5022264957427979,
+      "step": 560
+    },
+    {
+      "epoch": 0.4298286243631311,
+      "grad_norm": 0.0,
+      "learning_rate": 1.1422222222222223e-05,
+      "loss": 0.5192673206329346,
+      "step": 580
+    },
+    {
+      "epoch": 0.444650301065308,
+      "grad_norm": 0.0,
+      "learning_rate": 1.1125925925925926e-05,
+      "loss": 0.5433578491210938,
+      "step": 600
+    },
+    {
+      "epoch": 0.45947197776748494,
+      "grad_norm": 0.0,
+      "learning_rate": 1.082962962962963e-05,
+      "loss": 0.5097993850708008,
+      "step": 620
+    },
+    {
+      "epoch": 0.4742936544696619,
+      "grad_norm": 0.0,
+      "learning_rate": 1.0533333333333333e-05,
+      "loss": 0.48088994026184084,
+      "step": 640
+    },
+    {
+      "epoch": 0.4891153311718388,
+      "grad_norm": 0.0,
+      "learning_rate": 1.0237037037037039e-05,
+      "loss": 0.5272709369659424,
+      "step": 660
+    },
+    {
+      "epoch": 0.5039370078740157,
+      "grad_norm": 0.0,
+      "learning_rate": 9.940740740740742e-06,
+      "loss": 0.5155187129974366,
+      "step": 680
+    },
+    {
+      "epoch": 0.5187586845761927,
+      "grad_norm": 0.0,
+      "learning_rate": 9.644444444444444e-06,
+      "loss": 0.513616943359375,
+      "step": 700
+    },
+    {
+      "epoch": 0.5335803612783696,
+      "grad_norm": 0.0,
+      "learning_rate": 9.348148148148149e-06,
+      "loss": 0.5366382598876953,
+      "step": 720
+    },
+    {
+      "epoch": 0.5484020379805465,
+      "grad_norm": 0.0,
+      "learning_rate": 9.051851851851853e-06,
+      "loss": 0.48917584419250487,
+      "step": 740
+    },
+    {
+      "epoch": 0.5632237146827235,
+      "grad_norm": 0.0,
+      "learning_rate": 8.755555555555556e-06,
+      "loss": 0.510042381286621,
+      "step": 760
+    },
+    {
+      "epoch": 0.5780453913849004,
+      "grad_norm": 0.0,
+      "learning_rate": 8.45925925925926e-06,
+      "loss": 0.5264229774475098,
+      "step": 780
+    },
+    {
+      "epoch": 0.5928670680870773,
+      "grad_norm": 0.0,
+      "learning_rate": 8.162962962962964e-06,
+      "loss": 0.543345308303833,
+      "step": 800
+    },
+    {
+      "epoch": 0.6076887447892543,
+      "grad_norm": 0.0,
+      "learning_rate": 7.866666666666667e-06,
+      "loss": 0.5195151329040527,
+      "step": 820
+    },
+    {
+      "epoch": 0.6225104214914312,
+      "grad_norm": 0.0,
+      "learning_rate": 7.570370370370371e-06,
+      "loss": 0.5005125045776367,
+      "step": 840
+    },
+    {
+      "epoch": 0.6373320981936081,
+      "grad_norm": 0.0,
+      "learning_rate": 7.274074074074075e-06,
+      "loss": 0.5076333045959472,
+      "step": 860
+    },
+    {
+      "epoch": 0.6521537748957851,
+      "grad_norm": 0.0,
+      "learning_rate": 6.977777777777779e-06,
+      "loss": 0.5086907863616943,
+      "step": 880
+    },
+    {
+      "epoch": 0.666975451597962,
+      "grad_norm": 0.0,
+      "learning_rate": 6.681481481481482e-06,
+      "loss": 0.5071919918060303,
+      "step": 900
+    },
+    {
+      "epoch": 0.6817971283001389,
+      "grad_norm": 0.0,
+      "learning_rate": 6.385185185185185e-06,
+      "loss": 0.4695600032806396,
+      "step": 920
+    },
+    {
+      "epoch": 0.6966188050023159,
+      "grad_norm": 0.0,
+      "learning_rate": 6.08888888888889e-06,
+      "loss": 0.5098789691925049,
+      "step": 940
+    },
+    {
+      "epoch": 0.7114404817044928,
+      "grad_norm": 0.0,
+      "learning_rate": 5.792592592592593e-06,
+      "loss": 0.5513834953308105,
+      "step": 960
+    },
+    {
+      "epoch": 0.7262621584066697,
+      "grad_norm": 0.0,
+      "learning_rate": 5.496296296296296e-06,
+      "loss": 0.5368476867675781,
+      "step": 980
+    },
+    {
+      "epoch": 0.7410838351088467,
+      "grad_norm": 0.0,
+      "learning_rate": 5.2e-06,
+      "loss": 0.48752031326293943,
+      "step": 1000
+    },
+    {
+      "epoch": 0.7559055118110236,
+      "grad_norm": 0.0,
+      "learning_rate": 4.903703703703704e-06,
+      "loss": 0.5335604667663574,
+      "step": 1020
+    },
+    {
+      "epoch": 0.7707271885132005,
+      "grad_norm": 0.0,
+      "learning_rate": 4.607407407407408e-06,
+      "loss": 0.4965493202209473,
+      "step": 1040
+    },
+    {
+      "epoch": 0.7855488652153775,
+      "grad_norm": 0.0,
+      "learning_rate": 4.3111111111111115e-06,
+      "loss": 0.4886653900146484,
+      "step": 1060
+    },
+    {
+      "epoch": 0.8003705419175544,
+      "grad_norm": 0.0,
+      "learning_rate": 4.014814814814815e-06,
+      "loss": 0.49461803436279295,
+      "step": 1080
+    },
+    {
+      "epoch": 0.8151922186197313,
+      "grad_norm": 0.0,
+      "learning_rate": 3.718518518518519e-06,
+      "loss": 0.5084664821624756,
+      "step": 1100
+    },
+    {
+      "epoch": 0.8300138953219083,
+      "grad_norm": 0.0,
+      "learning_rate": 3.4222222222222224e-06,
+      "loss": 0.5635802745819092,
+      "step": 1120
+    },
+    {
+      "epoch": 0.8448355720240852,
+      "grad_norm": 0.0,
+      "learning_rate": 3.125925925925926e-06,
+      "loss": 0.5016401290893555,
+      "step": 1140
+    },
+    {
+      "epoch": 0.8596572487262621,
+      "grad_norm": 0.0,
+      "learning_rate": 2.82962962962963e-06,
+      "loss": 0.46094746589660646,
+      "step": 1160
+    },
+    {
+      "epoch": 0.8744789254284391,
+      "grad_norm": 0.0,
+      "learning_rate": 2.5333333333333338e-06,
+      "loss": 0.5131993770599366,
+      "step": 1180
+    },
+    {
+      "epoch": 0.889300602130616,
+      "grad_norm": 0.0,
+      "learning_rate": 2.2370370370370373e-06,
+      "loss": 0.5218451976776123,
+      "step": 1200
+    },
+    {
+      "epoch": 0.904122278832793,
+      "grad_norm": 0.0,
+      "learning_rate": 1.9407407407407408e-06,
+      "loss": 0.45912489891052244,
+      "step": 1220
+    },
+    {
+      "epoch": 0.9189439555349699,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6444444444444447e-06,
+      "loss": 0.499527645111084,
+      "step": 1240
+    },
+    {
+      "epoch": 0.9337656322371468,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3481481481481482e-06,
+      "loss": 0.4771925449371338,
+      "step": 1260
+    },
+    {
+      "epoch": 0.9485873089393237,
+      "grad_norm": 0.0,
+      "learning_rate": 1.051851851851852e-06,
+      "loss": 0.5050540447235108,
+      "step": 1280
+    },
+    {
+      "epoch": 0.9634089856415007,
+      "grad_norm": 0.0,
+      "learning_rate": 7.555555555555556e-07,
+      "loss": 0.49243617057800293,
+      "step": 1300
+    },
+    {
+      "epoch": 0.9782306623436776,
+      "grad_norm": 0.0,
+      "learning_rate": 4.5925925925925927e-07,
+      "loss": 0.49340081214904785,
+      "step": 1320
+    },
+    {
+      "epoch": 0.9930523390458545,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6296296296296295e-07,
+      "loss": 0.50099196434021,
+      "step": 1340
+    }
+  ],
+  "logging_steps": 20,
+  "max_steps": 1350,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 2.2826896586316595e+17,
+  "train_batch_size": 1,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-1350/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cc4d3ccbc6dd46df263fd0d62393a26dc134305545d04dbbe8339e95a3b389b
+size 5201

checkpoint-500/README.md

@@ -0,0 +1,207 @@
+---
+base_model: Qwen/Qwen2.5-14B
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:Qwen/Qwen2.5-14B
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.18.1

checkpoint-500/adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2.5-14B",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.18.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

checkpoint-500/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dee0de3bb476250e7de09dbf0dcdd981fc773ea1bd027a6c7f539a8b855885e0
+size 50357488

checkpoint-500/chat_template.jinja

@@ -0,0 +1,54 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- messages[0]['content'] }}
+    {%- else %}
+        {{- 'You are a helpful assistant.' }}
+    {%- endif %}
+    {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0]['role'] == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0]['content'] + '<|im_end|>\n' }}
+    {%- else %}
+        {{- '<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) or (message.role == "assistant" and not message.tool_calls) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {{- '<|im_start|>' + message.role }}
+        {%- if message.content %}
+            {{- '\n' + message.content }}
+        {%- endif %}
+        {%- for tool_call in message.tool_calls %}
+            {%- if tool_call.function is defined %}
+                {%- set tool_call = tool_call.function %}
+            {%- endif %}
+            {{- '\n<tool_call>\n{"name": "' }}
+            {{- tool_call.name }}
+            {{- '", "arguments": ' }}
+            {{- tool_call.arguments | tojson }}
+            {{- '}\n</tool_call>' }}
+        {%- endfor %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+{%- endif %}

checkpoint-500/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a52825d290193da64b6ddb8201a5e980037784bb16c8642f51b89d3931593fb0
+size 1657

checkpoint-500/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99df034704a32203929aa2832cef2b2a6c48c2a6b364376dec0961a348e4a31b
+size 14645

checkpoint-500/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea2a86ffb806d101c33076c27a45d3216d29190ce88a00b55fec5d42a3a8dc84
+size 1465

checkpoint-500/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e2b7649a086fbb9771cd78ec5b7ffa7069e16a82424a382950fedfa1e057861
+size 11421991

checkpoint-500/tokenizer_config.json

@@ -0,0 +1,29 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "extra_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "is_local": false,
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

checkpoint-500/trainer_state.json

@@ -0,0 +1,209 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.37054191755442334,
+  "eval_steps": 500,
+  "global_step": 500,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.014821676702176934,
+      "grad_norm": 0.0,
+      "learning_rate": 1.971851851851852e-05,
+      "loss": 0.4899055004119873,
+      "step": 20
+    },
+    {
+      "epoch": 0.029643353404353867,
+      "grad_norm": 0.0,
+      "learning_rate": 1.9422222222222223e-05,
+      "loss": 0.5139500141143799,
+      "step": 40
+    },
+    {
+      "epoch": 0.0444650301065308,
+      "grad_norm": 0.0,
+      "learning_rate": 1.912592592592593e-05,
+      "loss": 0.5229451179504394,
+      "step": 60
+    },
+    {
+      "epoch": 0.059286706808707734,
+      "grad_norm": 0.0,
+      "learning_rate": 1.882962962962963e-05,
+      "loss": 0.5185572147369385,
+      "step": 80
+    },
+    {
+      "epoch": 0.07410838351088467,
+      "grad_norm": 0.0,
+      "learning_rate": 1.8533333333333334e-05,
+      "loss": 0.5250892639160156,
+      "step": 100
+    },
+    {
+      "epoch": 0.0889300602130616,
+      "grad_norm": 0.0,
+      "learning_rate": 1.8237037037037037e-05,
+      "loss": 0.5176488876342773,
+      "step": 120
+    },
+    {
+      "epoch": 0.10375173691523853,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7940740740740743e-05,
+      "loss": 0.5225274085998535,
+      "step": 140
+    },
+    {
+      "epoch": 0.11857341361741547,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7644444444444446e-05,
+      "loss": 0.5126307010650635,
+      "step": 160
+    },
+    {
+      "epoch": 0.1333950903195924,
+      "grad_norm": 0.0,
+      "learning_rate": 1.734814814814815e-05,
+      "loss": 0.49596052169799804,
+      "step": 180
+    },
+    {
+      "epoch": 0.14821676702176934,
+      "grad_norm": 0.0,
+      "learning_rate": 1.7051851851851854e-05,
+      "loss": 0.48282203674316404,
+      "step": 200
+    },
+    {
+      "epoch": 0.16303844372394627,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6755555555555557e-05,
+      "loss": 0.47712411880493166,
+      "step": 220
+    },
+    {
+      "epoch": 0.1778601204261232,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6459259259259263e-05,
+      "loss": 0.543468427658081,
+      "step": 240
+    },
+    {
+      "epoch": 0.19268179712830014,
+      "grad_norm": 0.0,
+      "learning_rate": 1.6162962962962966e-05,
+      "loss": 0.5191382884979248,
+      "step": 260
+    },
+    {
+      "epoch": 0.20750347383047707,
+      "grad_norm": 0.0,
+      "learning_rate": 1.586666666666667e-05,
+      "loss": 0.5149303913116455,
+      "step": 280
+    },
+    {
+      "epoch": 0.222325150532654,
+      "grad_norm": 0.0,
+      "learning_rate": 1.557037037037037e-05,
+      "loss": 0.45279850959777834,
+      "step": 300
+    },
+    {
+      "epoch": 0.23714682723483094,
+      "grad_norm": 0.0,
+      "learning_rate": 1.5274074074074074e-05,
+      "loss": 0.5343164920806884,
+      "step": 320
+    },
+    {
+      "epoch": 0.25196850393700787,
+      "grad_norm": 0.0,
+      "learning_rate": 1.497777777777778e-05,
+      "loss": 0.47828402519226076,
+      "step": 340
+    },
+    {
+      "epoch": 0.2667901806391848,
+      "grad_norm": 0.0,
+      "learning_rate": 1.4681481481481484e-05,
+      "loss": 0.5143001079559326,
+      "step": 360
+    },
+    {
+      "epoch": 0.28161185734136174,
+      "grad_norm": 0.0,
+      "learning_rate": 1.4385185185185187e-05,
+      "loss": 0.4801042556762695,
+      "step": 380
+    },
+    {
+      "epoch": 0.29643353404353867,
+      "grad_norm": 0.0,
+      "learning_rate": 1.408888888888889e-05,
+      "loss": 0.5391404151916503,
+      "step": 400
+    },
+    {
+      "epoch": 0.3112552107457156,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3792592592592594e-05,
+      "loss": 0.5449098587036133,
+      "step": 420
+    },
+    {
+      "epoch": 0.32607688744789254,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3496296296296298e-05,
+      "loss": 0.5099626541137695,
+      "step": 440
+    },
+    {
+      "epoch": 0.34089856415006947,
+      "grad_norm": 0.0,
+      "learning_rate": 1.3200000000000002e-05,
+      "loss": 0.5027807235717774,
+      "step": 460
+    },
+    {
+      "epoch": 0.3557202408522464,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2903703703703705e-05,
+      "loss": 0.5257837772369385,
+      "step": 480
+    },
+    {
+      "epoch": 0.37054191755442334,
+      "grad_norm": 0.0,
+      "learning_rate": 1.2607407407407408e-05,
+      "loss": 0.5272829532623291,
+      "step": 500
+    }
+  ],
+  "logging_steps": 20,
+  "max_steps": 1350,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 8.406160016225894e+16,
+  "train_batch_size": 1,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-500/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cc4d3ccbc6dd46df263fd0d62393a26dc134305545d04dbbe8339e95a3b389b
+size 5201

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e2b7649a086fbb9771cd78ec5b7ffa7069e16a82424a382950fedfa1e057861
+size 11421991

tokenizer_config.json

@@ -0,0 +1,29 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "extra_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "is_local": false,
+  "model_max_length": 131072,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cc4d3ccbc6dd46df263fd0d62393a26dc134305545d04dbbe8339e95a3b389b
+size 5201