Upload folder using huggingface_hub

adapter/README.md

@@ -0,0 +1,206 @@
+---
+base_model: Qwen/Qwen3-VL-4B-Instruct
+library_name: peft
+tags:
+- base_model:adapter:Qwen/Qwen3-VL-4B-Instruct
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1

adapter/adapter_config.json

@@ -0,0 +1,42 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen3-VL-4B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": "gaussian",
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": [
+    "custom_text_proj"
+  ],
+  "peft_type": "LORA",
+  "peft_version": "0.19.1",
+  "qalora_group_size": 16,
+  "r": 32,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": "(.*(language_model).*(down_proj|gate_proj|up_proj|k_proj|q_proj|v_proj|o_proj).*$)",
+  "target_parameters": null,
+  "task_type": "FEATURE_EXTRACTION",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

adapter/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:841be022c53e591d0762b4d74c0f5d880c08956219cf589214f585c7597fd8d6
+size 265952696

adapter/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d51ae16241a9d399845ec0b6232d6479bcfa1ed533fe2a73ea2b0f13a2f3e7dd
+size 532188177

adapter/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c418b90b212432a41e5e55c42b8f23c9748fbeb1b5ba828b010a2b849429386
+size 14645

adapter/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c5f621fd4debd56c70e9bde485e7fdf9feb18ade96952c02c444cafd93e969c
+size 1465

adapter/trainer_state.json

@@ -0,0 +1,734 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.2954537060974259,
+  "eval_steps": 500,
+  "global_step": 1000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0029545370609742588,
+      "grad_norm": 2.833221197128296,
+      "learning_rate": 4.5e-05,
+      "loss": 0.6058326721191406,
+      "step": 10
+    },
+    {
+      "epoch": 0.0059090741219485175,
+      "grad_norm": 3.970088005065918,
+      "learning_rate": 4.986666666666667e-05,
+      "loss": 0.4907561779022217,
+      "step": 20
+    },
+    {
+      "epoch": 0.008863611182922776,
+      "grad_norm": 2.317507266998291,
+      "learning_rate": 4.971851851851852e-05,
+      "loss": 0.4133129596710205,
+      "step": 30
+    },
+    {
+      "epoch": 0.011818148243897035,
+      "grad_norm": 2.8210597038269043,
+      "learning_rate": 4.9570370370370374e-05,
+      "loss": 0.34064426422119143,
+      "step": 40
+    },
+    {
+      "epoch": 0.014772685304871294,
+      "grad_norm": 1.50558340549469,
+      "learning_rate": 4.942222222222223e-05,
+      "loss": 0.29927446842193606,
+      "step": 50
+    },
+    {
+      "epoch": 0.017727222365845553,
+      "grad_norm": 1.7299937009811401,
+      "learning_rate": 4.927407407407408e-05,
+      "loss": 0.27862727642059326,
+      "step": 60
+    },
+    {
+      "epoch": 0.02068175942681981,
+      "grad_norm": 1.3710973262786865,
+      "learning_rate": 4.912592592592593e-05,
+      "loss": 0.2401745080947876,
+      "step": 70
+    },
+    {
+      "epoch": 0.02363629648779407,
+      "grad_norm": 1.1095554828643799,
+      "learning_rate": 4.897777777777778e-05,
+      "loss": 0.2357936382293701,
+      "step": 80
+    },
+    {
+      "epoch": 0.026590833548768327,
+      "grad_norm": 2.0169742107391357,
+      "learning_rate": 4.882962962962963e-05,
+      "loss": 0.2158350706100464,
+      "step": 90
+    },
+    {
+      "epoch": 0.029545370609742588,
+      "grad_norm": 1.8902324438095093,
+      "learning_rate": 4.8681481481481485e-05,
+      "loss": 0.21283884048461915,
+      "step": 100
+    },
+    {
+      "epoch": 0.032499907670716845,
+      "grad_norm": 4.220162868499756,
+      "learning_rate": 4.853333333333334e-05,
+      "loss": 0.2145336627960205,
+      "step": 110
+    },
+    {
+      "epoch": 0.035454444731691105,
+      "grad_norm": 2.21907901763916,
+      "learning_rate": 4.838518518518519e-05,
+      "loss": 0.2089240312576294,
+      "step": 120
+    },
+    {
+      "epoch": 0.03840898179266536,
+      "grad_norm": 2.4063167572021484,
+      "learning_rate": 4.8237037037037045e-05,
+      "loss": 0.19337594509124756,
+      "step": 130
+    },
+    {
+      "epoch": 0.04136351885363962,
+      "grad_norm": 1.7236549854278564,
+      "learning_rate": 4.808888888888889e-05,
+      "loss": 0.19078925848007203,
+      "step": 140
+    },
+    {
+      "epoch": 0.04431805591461388,
+      "grad_norm": 1.5060020685195923,
+      "learning_rate": 4.7940740740740744e-05,
+      "loss": 0.19750164747238158,
+      "step": 150
+    },
+    {
+      "epoch": 0.04727259297558814,
+      "grad_norm": 1.5462108850479126,
+      "learning_rate": 4.77925925925926e-05,
+      "loss": 0.1754060983657837,
+      "step": 160
+    },
+    {
+      "epoch": 0.050227130036562394,
+      "grad_norm": 2.9146463871002197,
+      "learning_rate": 4.764444444444445e-05,
+      "loss": 0.17379658222198485,
+      "step": 170
+    },
+    {
+      "epoch": 0.053181667097536654,
+      "grad_norm": 1.205565094947815,
+      "learning_rate": 4.74962962962963e-05,
+      "loss": 0.17304102182388306,
+      "step": 180
+    },
+    {
+      "epoch": 0.056136204158510915,
+      "grad_norm": 1.3237217664718628,
+      "learning_rate": 4.7348148148148156e-05,
+      "loss": 0.19153650999069213,
+      "step": 190
+    },
+    {
+      "epoch": 0.059090741219485175,
+      "grad_norm": 1.7453283071517944,
+      "learning_rate": 4.72e-05,
+      "loss": 0.17861543893814086,
+      "step": 200
+    },
+    {
+      "epoch": 0.06204527828045943,
+      "grad_norm": 2.229522228240967,
+      "learning_rate": 4.7051851851851855e-05,
+      "loss": 0.1866261124610901,
+      "step": 210
+    },
+    {
+      "epoch": 0.06499981534143369,
+      "grad_norm": 1.2653534412384033,
+      "learning_rate": 4.690370370370371e-05,
+      "loss": 0.1543294072151184,
+      "step": 220
+    },
+    {
+      "epoch": 0.06795435240240795,
+      "grad_norm": 1.3780829906463623,
+      "learning_rate": 4.675555555555556e-05,
+      "loss": 0.169802463054657,
+      "step": 230
+    },
+    {
+      "epoch": 0.07090888946338221,
+      "grad_norm": 1.4371570348739624,
+      "learning_rate": 4.660740740740741e-05,
+      "loss": 0.1754474639892578,
+      "step": 240
+    },
+    {
+      "epoch": 0.07386342652435647,
+      "grad_norm": 18.6015625,
+      "learning_rate": 4.645925925925926e-05,
+      "loss": 0.1724642515182495,
+      "step": 250
+    },
+    {
+      "epoch": 0.07681796358533072,
+      "grad_norm": 2.5677523612976074,
+      "learning_rate": 4.6311111111111113e-05,
+      "loss": 0.16112465858459474,
+      "step": 260
+    },
+    {
+      "epoch": 0.07977250064630498,
+      "grad_norm": 1.9980823993682861,
+      "learning_rate": 4.6162962962962966e-05,
+      "loss": 0.18335959911346436,
+      "step": 270
+    },
+    {
+      "epoch": 0.08272703770727924,
+      "grad_norm": 1.2077431678771973,
+      "learning_rate": 4.601481481481482e-05,
+      "loss": 0.17765412330627442,
+      "step": 280
+    },
+    {
+      "epoch": 0.0856815747682535,
+      "grad_norm": 1.7410666942596436,
+      "learning_rate": 4.5866666666666666e-05,
+      "loss": 0.15704294443130493,
+      "step": 290
+    },
+    {
+      "epoch": 0.08863611182922776,
+      "grad_norm": 3.203758478164673,
+      "learning_rate": 4.571851851851852e-05,
+      "loss": 0.16737524271011353,
+      "step": 300
+    },
+    {
+      "epoch": 0.09159064889020202,
+      "grad_norm": 1.4441914558410645,
+      "learning_rate": 4.557037037037037e-05,
+      "loss": 0.16653298139572142,
+      "step": 310
+    },
+    {
+      "epoch": 0.09454518595117628,
+      "grad_norm": 2.038508892059326,
+      "learning_rate": 4.5422222222222225e-05,
+      "loss": 0.17271809577941893,
+      "step": 320
+    },
+    {
+      "epoch": 0.09749972301215053,
+      "grad_norm": 2.8530397415161133,
+      "learning_rate": 4.527407407407407e-05,
+      "loss": 0.174771511554718,
+      "step": 330
+    },
+    {
+      "epoch": 0.10045426007312479,
+      "grad_norm": 1.3839176893234253,
+      "learning_rate": 4.5125925925925924e-05,
+      "loss": 0.1588329553604126,
+      "step": 340
+    },
+    {
+      "epoch": 0.10340879713409905,
+      "grad_norm": 1.6686633825302124,
+      "learning_rate": 4.497777777777778e-05,
+      "loss": 0.1564006209373474,
+      "step": 350
+    },
+    {
+      "epoch": 0.10636333419507331,
+      "grad_norm": 1.8551031351089478,
+      "learning_rate": 4.482962962962963e-05,
+      "loss": 0.15350520610809326,
+      "step": 360
+    },
+    {
+      "epoch": 0.10931787125604757,
+      "grad_norm": 1.4116591215133667,
+      "learning_rate": 4.468148148148148e-05,
+      "loss": 0.14301124811172486,
+      "step": 370
+    },
+    {
+      "epoch": 0.11227240831702183,
+      "grad_norm": 1.3294757604599,
+      "learning_rate": 4.4533333333333336e-05,
+      "loss": 0.1581111431121826,
+      "step": 380
+    },
+    {
+      "epoch": 0.11522694537799609,
+      "grad_norm": 1.1157113313674927,
+      "learning_rate": 4.438518518518518e-05,
+      "loss": 0.15454559326171874,
+      "step": 390
+    },
+    {
+      "epoch": 0.11818148243897035,
+      "grad_norm": 1.9910318851470947,
+      "learning_rate": 4.4237037037037035e-05,
+      "loss": 0.16136586666107178,
+      "step": 400
+    },
+    {
+      "epoch": 0.1211360194999446,
+      "grad_norm": 3.034904718399048,
+      "learning_rate": 4.408888888888889e-05,
+      "loss": 0.13362436294555663,
+      "step": 410
+    },
+    {
+      "epoch": 0.12409055656091886,
+      "grad_norm": 1.259322166442871,
+      "learning_rate": 4.394074074074074e-05,
+      "loss": 0.14962050914764405,
+      "step": 420
+    },
+    {
+      "epoch": 0.12704509362189312,
+      "grad_norm": 1.715478539466858,
+      "learning_rate": 4.3792592592592594e-05,
+      "loss": 0.15777710676193238,
+      "step": 430
+    },
+    {
+      "epoch": 0.12999963068286738,
+      "grad_norm": 3.123663902282715,
+      "learning_rate": 4.364444444444445e-05,
+      "loss": 0.1729123115539551,
+      "step": 440
+    },
+    {
+      "epoch": 0.13295416774384164,
+      "grad_norm": 2.2047908306121826,
+      "learning_rate": 4.3496296296296294e-05,
+      "loss": 0.16192224025726318,
+      "step": 450
+    },
+    {
+      "epoch": 0.1359087048048159,
+      "grad_norm": 1.2984117269515991,
+      "learning_rate": 4.334814814814815e-05,
+      "loss": 0.16143107414245605,
+      "step": 460
+    },
+    {
+      "epoch": 0.13886324186579016,
+      "grad_norm": 2.490159511566162,
+      "learning_rate": 4.32e-05,
+      "loss": 0.16425319910049438,
+      "step": 470
+    },
+    {
+      "epoch": 0.14181777892676442,
+      "grad_norm": 1.2689216136932373,
+      "learning_rate": 4.305185185185185e-05,
+      "loss": 0.15182640552520751,
+      "step": 480
+    },
+    {
+      "epoch": 0.14477231598773868,
+      "grad_norm": 1.2135517597198486,
+      "learning_rate": 4.2903703703703706e-05,
+      "loss": 0.14787669181823732,
+      "step": 490
+    },
+    {
+      "epoch": 0.14772685304871294,
+      "grad_norm": 1.5820362567901611,
+      "learning_rate": 4.275555555555556e-05,
+      "loss": 0.14555797576904297,
+      "step": 500
+    },
+    {
+      "epoch": 0.1506813901096872,
+      "grad_norm": 1.2276184558868408,
+      "learning_rate": 4.2607407407407405e-05,
+      "loss": 0.16564297676086426,
+      "step": 510
+    },
+    {
+      "epoch": 0.15363592717066143,
+      "grad_norm": 1.8572674989700317,
+      "learning_rate": 4.245925925925926e-05,
+      "loss": 0.1854600191116333,
+      "step": 520
+    },
+    {
+      "epoch": 0.1565904642316357,
+      "grad_norm": 1.4520939588546753,
+      "learning_rate": 4.231111111111111e-05,
+      "loss": 0.14640001058578492,
+      "step": 530
+    },
+    {
+      "epoch": 0.15954500129260996,
+      "grad_norm": 1.5253207683563232,
+      "learning_rate": 4.2162962962962964e-05,
+      "loss": 0.15389859676361084,
+      "step": 540
+    },
+    {
+      "epoch": 0.16249953835358422,
+      "grad_norm": 1.3694510459899902,
+      "learning_rate": 4.201481481481482e-05,
+      "loss": 0.1426140546798706,
+      "step": 550
+    },
+    {
+      "epoch": 0.16545407541455848,
+      "grad_norm": 1.6946223974227905,
+      "learning_rate": 4.186666666666667e-05,
+      "loss": 0.15633541345596313,
+      "step": 560
+    },
+    {
+      "epoch": 0.16840861247553274,
+      "grad_norm": 1.165390133857727,
+      "learning_rate": 4.1718518518518516e-05,
+      "loss": 0.11482020616531372,
+      "step": 570
+    },
+    {
+      "epoch": 0.171363149536507,
+      "grad_norm": 3.4787509441375732,
+      "learning_rate": 4.157037037037037e-05,
+      "loss": 0.14850080013275146,
+      "step": 580
+    },
+    {
+      "epoch": 0.17431768659748126,
+      "grad_norm": 2.6960692405700684,
+      "learning_rate": 4.142222222222222e-05,
+      "loss": 0.142425799369812,
+      "step": 590
+    },
+    {
+      "epoch": 0.17727222365845552,
+      "grad_norm": 1.5532925128936768,
+      "learning_rate": 4.1274074074074075e-05,
+      "loss": 0.14471248388290406,
+      "step": 600
+    },
+    {
+      "epoch": 0.18022676071942978,
+      "grad_norm": 2.015765905380249,
+      "learning_rate": 4.112592592592593e-05,
+      "loss": 0.13730039596557617,
+      "step": 610
+    },
+    {
+      "epoch": 0.18318129778040404,
+      "grad_norm": 1.6330431699752808,
+      "learning_rate": 4.097777777777778e-05,
+      "loss": 0.12331445217132568,
+      "step": 620
+    },
+    {
+      "epoch": 0.1861358348413783,
+      "grad_norm": 1.678736686706543,
+      "learning_rate": 4.0829629629629634e-05,
+      "loss": 0.1559412360191345,
+      "step": 630
+    },
+    {
+      "epoch": 0.18909037190235256,
+      "grad_norm": 2.326524019241333,
+      "learning_rate": 4.068148148148148e-05,
+      "loss": 0.1342020869255066,
+      "step": 640
+    },
+    {
+      "epoch": 0.19204490896332682,
+      "grad_norm": 2.946491241455078,
+      "learning_rate": 4.0533333333333334e-05,
+      "loss": 0.14628241062164307,
+      "step": 650
+    },
+    {
+      "epoch": 0.19499944602430105,
+      "grad_norm": 1.5995780229568481,
+      "learning_rate": 4.038518518518519e-05,
+      "loss": 0.11631155014038086,
+      "step": 660
+    },
+    {
+      "epoch": 0.19795398308527531,
+      "grad_norm": 1.0670708417892456,
+      "learning_rate": 4.023703703703704e-05,
+      "loss": 0.1583050012588501,
+      "step": 670
+    },
+    {
+      "epoch": 0.20090852014624958,
+      "grad_norm": 0.865008533000946,
+      "learning_rate": 4.008888888888889e-05,
+      "loss": 0.11903636455535889,
+      "step": 680
+    },
+    {
+      "epoch": 0.20386305720722384,
+      "grad_norm": 6.1988844871521,
+      "learning_rate": 3.9940740740740746e-05,
+      "loss": 0.15114530324935913,
+      "step": 690
+    },
+    {
+      "epoch": 0.2068175942681981,
+      "grad_norm": 1.0600031614303589,
+      "learning_rate": 3.979259259259259e-05,
+      "loss": 0.14667139053344727,
+      "step": 700
+    },
+    {
+      "epoch": 0.20977213132917236,
+      "grad_norm": 1.4827007055282593,
+      "learning_rate": 3.9644444444444445e-05,
+      "loss": 0.14418727159500122,
+      "step": 710
+    },
+    {
+      "epoch": 0.21272666839014662,
+      "grad_norm": 1.216367483139038,
+      "learning_rate": 3.94962962962963e-05,
+      "loss": 0.16398065090179442,
+      "step": 720
+    },
+    {
+      "epoch": 0.21568120545112088,
+      "grad_norm": 1.939950704574585,
+      "learning_rate": 3.934814814814815e-05,
+      "loss": 0.15566943883895873,
+      "step": 730
+    },
+    {
+      "epoch": 0.21863574251209514,
+      "grad_norm": 1.0614118576049805,
+      "learning_rate": 3.9200000000000004e-05,
+      "loss": 0.14201202392578124,
+      "step": 740
+    },
+    {
+      "epoch": 0.2215902795730694,
+      "grad_norm": 1.284617304801941,
+      "learning_rate": 3.905185185185186e-05,
+      "loss": 0.15723674297332763,
+      "step": 750
+    },
+    {
+      "epoch": 0.22454481663404366,
+      "grad_norm": 1.0203224420547485,
+      "learning_rate": 3.8903703703703703e-05,
+      "loss": 0.15283368825912474,
+      "step": 760
+    },
+    {
+      "epoch": 0.22749935369501792,
+      "grad_norm": 2.668447494506836,
+      "learning_rate": 3.8755555555555556e-05,
+      "loss": 0.13261605501174928,
+      "step": 770
+    },
+    {
+      "epoch": 0.23045389075599218,
+      "grad_norm": 0.8986021280288696,
+      "learning_rate": 3.860740740740741e-05,
+      "loss": 0.1298680782318115,
+      "step": 780
+    },
+    {
+      "epoch": 0.23340842781696644,
+      "grad_norm": 0.9000882506370544,
+      "learning_rate": 3.845925925925926e-05,
+      "loss": 0.13043410778045655,
+      "step": 790
+    },
+    {
+      "epoch": 0.2363629648779407,
+      "grad_norm": 1.3062238693237305,
+      "learning_rate": 3.8311111111111115e-05,
+      "loss": 0.12488116025924682,
+      "step": 800
+    },
+    {
+      "epoch": 0.23931750193891493,
+      "grad_norm": 1.8721864223480225,
+      "learning_rate": 3.816296296296297e-05,
+      "loss": 0.16045504808425903,
+      "step": 810
+    },
+    {
+      "epoch": 0.2422720389998892,
+      "grad_norm": 1.8021628856658936,
+      "learning_rate": 3.8014814814814815e-05,
+      "loss": 0.1305558681488037,
+      "step": 820
+    },
+    {
+      "epoch": 0.24522657606086345,
+      "grad_norm": 1.973920226097107,
+      "learning_rate": 3.786666666666667e-05,
+      "loss": 0.17081881761550904,
+      "step": 830
+    },
+    {
+      "epoch": 0.24818111312183772,
+      "grad_norm": 1.8087708950042725,
+      "learning_rate": 3.771851851851852e-05,
+      "loss": 0.1436525821685791,
+      "step": 840
+    },
+    {
+      "epoch": 0.251135650182812,
+      "grad_norm": 1.2119991779327393,
+      "learning_rate": 3.7570370370370374e-05,
+      "loss": 0.13348952531814576,
+      "step": 850
+    },
+    {
+      "epoch": 0.25409018724378624,
+      "grad_norm": 3.290924549102783,
+      "learning_rate": 3.742222222222223e-05,
+      "loss": 0.14319207668304443,
+      "step": 860
+    },
+    {
+      "epoch": 0.2570447243047605,
+      "grad_norm": 2.480170965194702,
+      "learning_rate": 3.727407407407408e-05,
+      "loss": 0.13599660396575927,
+      "step": 870
+    },
+    {
+      "epoch": 0.25999926136573476,
+      "grad_norm": 1.5772013664245605,
+      "learning_rate": 3.7125925925925926e-05,
+      "loss": 0.14303747415542603,
+      "step": 880
+    },
+    {
+      "epoch": 0.262953798426709,
+      "grad_norm": 1.465206503868103,
+      "learning_rate": 3.697777777777778e-05,
+      "loss": 0.12858752012252808,
+      "step": 890
+    },
+    {
+      "epoch": 0.2659083354876833,
+      "grad_norm": 1.1226439476013184,
+      "learning_rate": 3.682962962962963e-05,
+      "loss": 0.13488395214080812,
+      "step": 900
+    },
+    {
+      "epoch": 0.26886287254865754,
+      "grad_norm": 1.6345360279083252,
+      "learning_rate": 3.6681481481481485e-05,
+      "loss": 0.13654342889785767,
+      "step": 910
+    },
+    {
+      "epoch": 0.2718174096096318,
+      "grad_norm": 1.3631547689437866,
+      "learning_rate": 3.653333333333334e-05,
+      "loss": 0.13675733804702758,
+      "step": 920
+    },
+    {
+      "epoch": 0.27477194667060606,
+      "grad_norm": 1.5883088111877441,
+      "learning_rate": 3.638518518518519e-05,
+      "loss": 0.15801552534103394,
+      "step": 930
+    },
+    {
+      "epoch": 0.2777264837315803,
+      "grad_norm": 0.7534575462341309,
+      "learning_rate": 3.623703703703704e-05,
+      "loss": 0.11741328239440918,
+      "step": 940
+    },
+    {
+      "epoch": 0.2806810207925546,
+      "grad_norm": 1.931433916091919,
+      "learning_rate": 3.608888888888889e-05,
+      "loss": 0.14444713592529296,
+      "step": 950
+    },
+    {
+      "epoch": 0.28363555785352884,
+      "grad_norm": 1.615752100944519,
+      "learning_rate": 3.5940740740740743e-05,
+      "loss": 0.17055082321166992,
+      "step": 960
+    },
+    {
+      "epoch": 0.2865900949145031,
+      "grad_norm": 1.5940306186676025,
+      "learning_rate": 3.5792592592592596e-05,
+      "loss": 0.14255964756011963,
+      "step": 970
+    },
+    {
+      "epoch": 0.28954463197547736,
+      "grad_norm": 2.5372769832611084,
+      "learning_rate": 3.564444444444445e-05,
+      "loss": 0.13338980674743653,
+      "step": 980
+    },
+    {
+      "epoch": 0.2924991690364516,
+      "grad_norm": 3.1546213626861572,
+      "learning_rate": 3.54962962962963e-05,
+      "loss": 0.128484046459198,
+      "step": 990
+    },
+    {
+      "epoch": 0.2954537060974259,
+      "grad_norm": 2.6247341632843018,
+      "learning_rate": 3.5348148148148156e-05,
+      "loss": 0.15008442401885985,
+      "step": 1000
+    }
+  ],
+  "logging_steps": 10,
+  "max_steps": 3385,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 250,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 5.971478765989939e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

adapter/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2f8909f5b320cd892e1bfe5a065a536c82a1d4eba942fa00c524bf1bbb016ef2
+size 5265