[2026-02-08 20:44:08,881] [WARNING] [huggingface_hub.utils._http._warn_on_warning_headers:779] [PID:10500] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
[2026-02-08 20:44:11,018] [WARNING] [py.warnings._showwarnmsg:110] [PID:10500] /root/axolotl/.venv/lib/python3.12/site-packages/torch/distributed/distributed_c10d.py:4807: UserWarning: No device id is provided via `init_process_group` or `barrier `. Using the current device set by the user. 
  warnings.warn(  # warn only once


Loading weights:   0%|                                                                                                                                                                    | 0/148 [00:00<?, ?it/s]
Loading weights:   1%|▋                                                                                                         | 1/148 [00:00<00:00, 16710.37it/s, Materializing param=model.embed_tokens.weight]
Loading weights:   1%|▋                                                                                                          | 1/148 [00:00<00:00, 4013.69it/s, Materializing param=model.embed_tokens.weight]
Loading weights:   1%|█▍                                                                                                       | 2/148 [00:00<00:00, 2439.26it/s, Materializing param=model.embedding_norm.weight]
Loading weights:   1%|█▍                                                                                                       | 2/148 [00:00<00:00, 2037.55it/s, Materializing param=model.embedding_norm.weight]
Loading weights:   2%|██                                                                                                   | 3/148 [00:00<00:00, 2390.37it/s, Materializing param=model.layers.0.conv.conv.weight]
Loading weights:   2%|██                                                                                                   | 3/148 [00:00<00:00, 2068.20it/s, Materializing param=model.layers.0.conv.conv.weight]
Loading weights:   3%|██▋                                                                                               | 4/148 [00:00<00:00, 2422.00it/s, Materializing param=model.layers.0.conv.in_proj.weight]
Loading weights:   3%|██▋                                                                                               | 4/148 [00:00<00:00, 2002.05it/s, Materializing param=model.layers.0.conv.in_proj.weight]
Loading weights:   3%|███▎                                                                                             | 5/148 [00:00<00:00, 2357.94it/s, Materializing param=model.layers.0.conv.out_proj.weight]
Loading weights:   3%|███▎                                                                                             | 5/148 [00:00<00:00, 2150.48it/s, Materializing param=model.layers.0.conv.out_proj.weight]
Loading weights:   4%|███▊                                                                                           | 6/148 [00:00<00:00, 2336.44it/s, Materializing param=model.layers.0.feed_forward.w1.weight]
Loading weights:   4%|███▊                                                                                           | 6/148 [00:00<00:00, 2190.24it/s, Materializing param=model.layers.0.feed_forward.w1.weight]
Loading weights:   5%|████▍                                                                                          | 7/148 [00:00<00:00, 2313.10it/s, Materializing param=model.layers.0.feed_forward.w2.weight]
Loading weights:   5%|████▍                                                                                          | 7/148 [00:00<00:00, 2248.96it/s, Materializing param=model.layers.0.feed_forward.w2.weight]
Loading weights:   5%|█████▏                                                                                         | 8/148 [00:00<00:00, 2446.37it/s, Materializing param=model.layers.0.feed_forward.w3.weight]
Loading weights:   5%|█████▏                                                                                         | 8/148 [00:00<00:00, 2383.97it/s, Materializing param=model.layers.0.feed_forward.w3.weight]
Loading weights:   6%|██████▏                                                                                               | 9/148 [00:00<00:00, 2570.04it/s, Materializing param=model.layers.0.ffn_norm.weight]
Loading weights:   6%|██████▏                                                                                               | 9/148 [00:00<00:00, 2439.34it/s, Materializing param=model.layers.0.ffn_norm.weight]
Loading weights:   7%|██████▍                                                                                         | 10/148 [00:00<00:00, 2623.57it/s, Materializing param=model.layers.0.operator_norm.weight]
Loading weights:   7%|██████▍                                                                                         | 10/148 [00:00<00:00, 2532.95it/s, Materializing param=model.layers.0.operator_norm.weight]
Loading weights:   7%|███████▍                                                                                            | 11/148 [00:00<00:00, 2681.00it/s, Materializing param=model.layers.1.conv.conv.weight]
Loading weights:   7%|███████▍                                                                                            | 11/148 [00:00<00:00, 2560.77it/s, Materializing param=model.layers.1.conv.conv.weight]
Loading weights:   8%|███████▊                                                                                         | 12/148 [00:00<00:00, 2640.97it/s, Materializing param=model.layers.1.conv.in_proj.weight]
Loading weights:   8%|███████▊                                                                                         | 12/148 [00:00<00:00, 2444.35it/s, Materializing param=model.layers.1.conv.in_proj.weight]
Loading weights:   9%|████████▍                                                                                       | 13/148 [00:00<00:00, 2515.50it/s, Materializing param=model.layers.1.conv.out_proj.weight]
Loading weights:   9%|████████▍                                                                                       | 13/148 [00:00<00:00, 2432.67it/s, Materializing param=model.layers.1.conv.out_proj.weight]
Loading weights:   9%|████████▉                                                                                     | 14/148 [00:00<00:00, 2538.16it/s, Materializing param=model.layers.1.feed_forward.w1.weight]
Loading weights:   9%|████████▉                                                                                     | 14/148 [00:00<00:00, 2477.54it/s, Materializing param=model.layers.1.feed_forward.w1.weight]
Loading weights:  10%|█████████▌                                                                                    | 15/148 [00:00<00:00, 2561.56it/s, Materializing param=model.layers.1.feed_forward.w2.weight]
Loading weights:  10%|█████████▌                                                                                    | 15/148 [00:00<00:00, 2525.88it/s, Materializing param=model.layers.1.feed_forward.w2.weight]
Loading weights:  11%|██████████▏                                                                                   | 16/148 [00:00<00:00, 2541.71it/s, Materializing param=model.layers.1.feed_forward.w3.weight]
Loading weights:  11%|██████████▏                                                                                   | 16/148 [00:00<00:00, 2428.05it/s, Materializing param=model.layers.1.feed_forward.w3.weight]
Loading weights:  11%|███████████▌                                                                                         | 17/148 [00:00<00:00, 2457.71it/s, Materializing param=model.layers.1.ffn_norm.weight]
Loading weights:  11%|███████████▌                                                                                         | 17/148 [00:00<00:00, 2428.50it/s, Materializing param=model.layers.1.ffn_norm.weight]
Loading weights:  12%|███████████▋                                                                                    | 18/148 [00:00<00:00, 2509.97it/s, Materializing param=model.layers.1.operator_norm.weight]
Loading weights:  12%|███████████▋                                                                                    | 18/148 [00:00<00:00, 2451.93it/s, Materializing param=model.layers.1.operator_norm.weight]
Loading weights:  13%|████████████                                                                                  | 19/148 [00:00<00:00, 2494.81it/s, Materializing param=model.layers.2.feed_forward.w1.weight]
Loading weights:  13%|████████████                                                                                  | 19/148 [00:00<00:00, 2466.86it/s, Materializing param=model.layers.2.feed_forward.w1.weight]
Loading weights:  14%|████████████▋                                                                                 | 20/148 [00:00<00:00, 2554.31it/s, Materializing param=model.layers.2.feed_forward.w2.weight]
Loading weights:  14%|████████████▋                                                                                 | 20/148 [00:00<00:00, 2491.05it/s, Materializing param=model.layers.2.feed_forward.w2.weight]
Loading weights:  14%|█████████████▎                                                                                | 21/148 [00:00<00:00, 2491.52it/s, Materializing param=model.layers.2.feed_forward.w3.weight]
Loading weights:  14%|█████████████▎                                                                                | 21/148 [00:00<00:00, 2466.48it/s, Materializing param=model.layers.2.feed_forward.w3.weight]
Loading weights:  15%|███████████████                                                                                      | 22/148 [00:00<00:00, 2531.47it/s, Materializing param=model.layers.2.ffn_norm.weight]
Loading weights:  15%|███████████████                                                                                      | 22/148 [00:00<00:00, 2485.98it/s, Materializing param=model.layers.2.ffn_norm.weight]
Loading weights:  16%|██████████████▉                                                                                 | 23/148 [00:00<00:00, 2546.77it/s, Materializing param=model.layers.2.operator_norm.weight]
Loading weights:  16%|██████████████▉                                                                                 | 23/148 [00:00<00:00, 2523.19it/s, Materializing param=model.layers.2.operator_norm.weight]
Loading weights:  16%|██████████████▎                                                                         | 24/148 [00:00<00:00, 2553.22it/s, Materializing param=model.layers.2.self_attn.k_layernorm.weight]
Loading weights:  16%|██████████████▎                                                                         | 24/148 [00:00<00:00, 2530.56it/s, Materializing param=model.layers.2.self_attn.k_layernorm.weight]
Loading weights:  17%|███████████████▋                                                                             | 25/148 [00:00<00:00, 2551.03it/s, Materializing param=model.layers.2.self_attn.k_proj.weight]
Loading weights:  17%|███████████████▋                                                                             | 25/148 [00:00<00:00, 2506.82it/s, Materializing param=model.layers.2.self_attn.k_proj.weight]
Loading weights:  18%|███████████████▉                                                                           | 26/148 [00:00<00:00, 2573.37it/s, Materializing param=model.layers.2.self_attn.out_proj.weight]
Loading weights:  18%|███████████████▉                                                                           | 26/148 [00:00<00:00, 2519.51it/s, Materializing param=model.layers.2.self_attn.out_proj.weight]
Loading weights:  18%|████████████████                                                                        | 27/148 [00:00<00:00, 2568.17it/s, Materializing param=model.layers.2.self_attn.q_layernorm.weight]
Loading weights:  18%|████████████████                                                                        | 27/148 [00:00<00:00, 2524.10it/s, Materializing param=model.layers.2.self_attn.q_layernorm.weight]
Loading weights:  19%|█████████████████▌                                                                           | 28/148 [00:00<00:00, 2577.20it/s, Materializing param=model.layers.2.self_attn.q_proj.weight]
Loading weights:  19%|█████████████████▌                                                                           | 28/148 [00:00<00:00, 2543.27it/s, Materializing param=model.layers.2.self_attn.q_proj.weight]
Loading weights:  20%|██████████████████▏                                                                          | 29/148 [00:00<00:00, 2593.38it/s, Materializing param=model.layers.2.self_attn.v_proj.weight]
Loading weights:  20%|██████████████████▏                                                                          | 29/148 [00:00<00:00, 2558.36it/s, Materializing param=model.layers.2.self_attn.v_proj.weight]
Loading weights:  20%|████████████████████▎                                                                               | 30/148 [00:00<00:00, 2580.95it/s, Materializing param=model.layers.3.conv.conv.weight]
Loading weights:  20%|████████████████████▎                                                                               | 30/148 [00:00<00:00, 2537.24it/s, Materializing param=model.layers.3.conv.conv.weight]
Loading weights:  21%|████████████████████▎                                                                            | 31/148 [00:00<00:00, 2560.88it/s, Materializing param=model.layers.3.conv.in_proj.weight]
Loading weights:  21%|████████████████████▎                                                                            | 31/148 [00:00<00:00, 2543.15it/s, Materializing param=model.layers.3.conv.in_proj.weight]
Loading weights:  22%|████████████████████▊                                                                           | 32/148 [00:00<00:00, 2569.94it/s, Materializing param=model.layers.3.conv.out_proj.weight]
Loading weights:  22%|████████████████████▊                                                                           | 32/148 [00:00<00:00, 2541.09it/s, Materializing param=model.layers.3.conv.out_proj.weight]
Loading weights:  22%|████████████████████▉                                                                         | 33/148 [00:00<00:00, 2583.13it/s, Materializing param=model.layers.3.feed_forward.w1.weight]
Loading weights:  22%|████████████████████▉                                                                         | 33/148 [00:00<00:00, 2562.81it/s, Materializing param=model.layers.3.feed_forward.w1.weight]
Loading weights:  23%|█████████████████████▌                                                                        | 34/148 [00:00<00:00, 2617.45it/s, Materializing param=model.layers.3.feed_forward.w2.weight]
Loading weights:  23%|█████████████████████▌                                                                        | 34/148 [00:00<00:00, 2600.27it/s, Materializing param=model.layers.3.feed_forward.w2.weight]
Loading weights:  24%|██████████████████████▏                                                                       | 35/148 [00:00<00:00, 2653.95it/s, Materializing param=model.layers.3.feed_forward.w3.weight]
Loading weights:  24%|██████████████████████▏                                                                       | 35/148 [00:00<00:00, 2637.69it/s, Materializing param=model.layers.3.feed_forward.w3.weight]
Loading weights:  24%|████████████████████████▌                                                                            | 36/148 [00:00<00:00, 2690.72it/s, Materializing param=model.layers.3.ffn_norm.weight]
Loading weights:  24%|████████████████████████▌                                                                            | 36/148 [00:00<00:00, 2674.75it/s, Materializing param=model.layers.3.ffn_norm.weight]
Loading weights:  25%|████████████████████████                                                                        | 37/148 [00:00<00:00, 2727.36it/s, Materializing param=model.layers.3.operator_norm.weight]
Loading weights:  25%|████████████████████████                                                                        | 37/148 [00:00<00:00, 2711.39it/s, Materializing param=model.layers.3.operator_norm.weight]
Loading weights:  26%|█████████████████████████▋                                                                          | 38/148 [00:00<00:00, 2763.19it/s, Materializing param=model.layers.4.conv.conv.weight]
Loading weights:  26%|█████████████████████████▋                                                                          | 38/148 [00:00<00:00, 2747.42it/s, Materializing param=model.layers.4.conv.conv.weight]
Loading weights:  26%|█████████████████████████▌                                                                       | 39/148 [00:00<00:00, 2797.88it/s, Materializing param=model.layers.4.conv.in_proj.weight]
Loading weights:  26%|█████████████████████████▌                                                                       | 39/148 [00:00<00:00, 2782.03it/s, Materializing param=model.layers.4.conv.in_proj.weight]
Loading weights:  27%|█████████████████████████▉                                                                      | 40/148 [00:00<00:00, 2831.93it/s, Materializing param=model.layers.4.conv.out_proj.weight]
Loading weights:  27%|█████████████████████████▉                                                                      | 40/148 [00:00<00:00, 2816.06it/s, Materializing param=model.layers.4.conv.out_proj.weight]
Loading weights:  28%|██████████████████████████                                                                    | 41/148 [00:00<00:00, 2864.96it/s, Materializing param=model.layers.4.feed_forward.w1.weight]
Loading weights:  28%|██████████████████████████                                                                    | 41/148 [00:00<00:00, 2849.16it/s, Materializing param=model.layers.4.feed_forward.w1.weight]
Loading weights:  28%|██████████████████████████▋                                                                   | 42/148 [00:00<00:00, 2896.81it/s, Materializing param=model.layers.4.feed_forward.w2.weight]
Loading weights:  28%|██████████████████████████▋                                                                   | 42/148 [00:00<00:00, 2880.14it/s, Materializing param=model.layers.4.feed_forward.w2.weight]
Loading weights:  29%|███████████████████████████▎                                                                  | 43/148 [00:00<00:00, 2926.70it/s, Materializing param=model.layers.4.feed_forward.w3.weight]
Loading weights:  29%|███████████████████████████▎                                                                  | 43/148 [00:00<00:00, 2910.78it/s, Materializing param=model.layers.4.feed_forward.w3.weight]
Loading weights:  30%|██████████████████████████████                                                                       | 44/148 [00:00<00:00, 2956.76it/s, Materializing param=model.layers.4.ffn_norm.weight]
Loading weights:  30%|██████████████████████████████                                                                       | 44/148 [00:00<00:00, 2941.07it/s, Materializing param=model.layers.4.ffn_norm.weight]
Loading weights:  30%|█████████████████████████████▏                                                                  | 45/148 [00:00<00:00, 2987.02it/s, Materializing param=model.layers.4.operator_norm.weight]
Loading weights:  30%|█████████████████████████████▏                                                                  | 45/148 [00:00<00:00, 2971.50it/s, Materializing param=model.layers.4.operator_norm.weight]
Loading weights:  31%|█████████████████████████████▏                                                                | 46/148 [00:00<00:00, 3016.54it/s, Materializing param=model.layers.5.feed_forward.w1.weight]
Loading weights:  31%|█████████████████████████████▏                                                                | 46/148 [00:00<00:00, 3000.87it/s, Materializing param=model.layers.5.feed_forward.w1.weight]
Loading weights:  32%|█████████████████████████████▊                                                                | 47/148 [00:00<00:00, 3044.70it/s, Materializing param=model.layers.5.feed_forward.w2.weight]
Loading weights:  32%|█████████████████████████████▊                                                                | 47/148 [00:00<00:00, 3029.08it/s, Materializing param=model.layers.5.feed_forward.w2.weight]
Loading weights:  32%|██████████████████████████████▍                                                               | 48/148 [00:00<00:00, 3072.23it/s, Materializing param=model.layers.5.feed_forward.w3.weight]
Loading weights:  32%|██████████████████████████████▍                                                               | 48/148 [00:00<00:00, 3056.66it/s, Materializing param=model.layers.5.feed_forward.w3.weight]
Loading weights:  33%|█████████████████████████████████▍                                                                   | 49/148 [00:00<00:00, 3099.21it/s, Materializing param=model.layers.5.ffn_norm.weight]
Loading weights:  33%|█████████████████████████████████▍                                                                   | 49/148 [00:00<00:00, 3083.68it/s, Materializing param=model.layers.5.ffn_norm.weight]
Loading weights:  34%|████████████████████████████████▍                                                               | 50/148 [00:00<00:00, 3124.95it/s, Materializing param=model.layers.5.operator_norm.weight]
Loading weights:  34%|████████████████████████████████▍                                                               | 50/148 [00:00<00:00, 3109.52it/s, Materializing param=model.layers.5.operator_norm.weight]
Loading weights:  34%|██████████████████████████████▎                                                         | 51/148 [00:00<00:00, 3150.78it/s, Materializing param=model.layers.5.self_attn.k_layernorm.weight]
Loading weights:  34%|██████████████████████████████▎                                                         | 51/148 [00:00<00:00, 3135.12it/s, Materializing param=model.layers.5.self_attn.k_layernorm.weight]
Loading weights:  35%|████████████████████████████████▋                                                            | 52/148 [00:00<00:00, 3173.85it/s, Materializing param=model.layers.5.self_attn.k_proj.weight]
Loading weights:  35%|████████████████████████████████▋                                                            | 52/148 [00:00<00:00, 3158.18it/s, Materializing param=model.layers.5.self_attn.k_proj.weight]
Loading weights:  36%|████████████████████████████████▌                                                          | 53/148 [00:00<00:00, 3198.07it/s, Materializing param=model.layers.5.self_attn.out_proj.weight]
Loading weights:  36%|████████████████████████████████▌                                                          | 53/148 [00:00<00:00, 3182.60it/s, Materializing param=model.layers.5.self_attn.out_proj.weight]
Loading weights:  36%|████████████████████████████████                                                        | 54/148 [00:00<00:00, 3221.52it/s, Materializing param=model.layers.5.self_attn.q_layernorm.weight]
Loading weights:  36%|████████████████████████████████                                                        | 54/148 [00:00<00:00, 3205.88it/s, Materializing param=model.layers.5.self_attn.q_layernorm.weight]
Loading weights:  37%|██████████████████████████████████▌                                                          | 55/148 [00:00<00:00, 3243.90it/s, Materializing param=model.layers.5.self_attn.q_proj.weight]
Loading weights:  37%|██████████████████████████████████▌                                                          | 55/148 [00:00<00:00, 3228.28it/s, Materializing param=model.layers.5.self_attn.q_proj.weight]
Loading weights:  38%|███████████████████████████████████▏                                                         | 56/148 [00:00<00:00, 3266.05it/s, Materializing param=model.layers.5.self_attn.v_proj.weight]
Loading weights:  38%|███████████████████████████████████▏                                                         | 56/148 [00:00<00:00, 3250.90it/s, Materializing param=model.layers.5.self_attn.v_proj.weight]
Loading weights:  39%|██████████████████████████████████████▌                                                             | 57/148 [00:00<00:00, 3288.07it/s, Materializing param=model.layers.6.conv.conv.weight]
Loading weights:  39%|██████████████████████████████████████▌                                                             | 57/148 [00:00<00:00, 3272.05it/s, Materializing param=model.layers.6.conv.conv.weight]
Loading weights:  39%|██████████████████████████████████████                                                           | 58/148 [00:00<00:00, 3308.26it/s, Materializing param=model.layers.6.conv.in_proj.weight]
Loading weights:  39%|██████████████████████████████████████                                                           | 58/148 [00:00<00:00, 3292.99it/s, Materializing param=model.layers.6.conv.in_proj.weight]
Loading weights:  40%|██████████████████████████████████████▎                                                         | 59/148 [00:00<00:00, 3329.13it/s, Materializing param=model.layers.6.conv.out_proj.weight]
Loading weights:  40%|██████████████████████████████████████▎                                                         | 59/148 [00:00<00:00, 3313.97it/s, Materializing param=model.layers.6.conv.out_proj.weight]
Loading weights:  41%|██████████████████████████████████████                                                        | 60/148 [00:00<00:00, 3349.59it/s, Materializing param=model.layers.6.feed_forward.w1.weight]
Loading weights:  41%|██████████████████████████████████████                                                        | 60/148 [00:00<00:00, 3334.68it/s, Materializing param=model.layers.6.feed_forward.w1.weight]
Loading weights:  41%|██████████████████████████████████████▋                                                       | 61/148 [00:00<00:00, 3369.76it/s, Materializing param=model.layers.6.feed_forward.w2.weight]
Loading weights:  41%|██████████████████████████████████████▋                                                       | 61/148 [00:00<00:00, 3354.61it/s, Materializing param=model.layers.6.feed_forward.w2.weight]
Loading weights:  42%|███████████████████████████████████████▍                                                      | 62/148 [00:00<00:00, 3389.03it/s, Materializing param=model.layers.6.feed_forward.w3.weight]
Loading weights:  42%|███████████████████████████████████████▍                                                      | 62/148 [00:00<00:00, 3374.25it/s, Materializing param=model.layers.6.feed_forward.w3.weight]
Loading weights:  43%|██████████████████████████████████████████▉                                                          | 63/148 [00:00<00:00, 3408.60it/s, Materializing param=model.layers.6.ffn_norm.weight]
Loading weights:  43%|██████████████████████████████████████████▉                                                          | 63/148 [00:00<00:00, 3393.97it/s, Materializing param=model.layers.6.ffn_norm.weight]
Loading weights:  43%|█████████████████████████████████████████▌                                                      | 64/148 [00:00<00:00, 3428.12it/s, Materializing param=model.layers.6.operator_norm.weight]
Loading weights:  43%|█████████████████████████████████████████▌                                                      | 64/148 [00:00<00:00, 3412.56it/s, Materializing param=model.layers.6.operator_norm.weight]
Loading weights:  44%|███████████████████████████████████████████▉                                                        | 65/148 [00:00<00:00, 3446.08it/s, Materializing param=model.layers.7.conv.conv.weight]
Loading weights:  44%|███████████████████████████████████████████▉                                                        | 65/148 [00:00<00:00, 3431.55it/s, Materializing param=model.layers.7.conv.conv.weight]
Loading weights:  45%|███████████████████████████████████████████▎                                                     | 66/148 [00:00<00:00, 3464.54it/s, Materializing param=model.layers.7.conv.in_proj.weight]
Loading weights:  45%|███████████████████████████████████████████▎                                                     | 66/148 [00:00<00:00, 3450.12it/s, Materializing param=model.layers.7.conv.in_proj.weight]
Loading weights:  45%|███████████████████████████████████████████▍                                                    | 67/148 [00:00<00:00, 3482.69it/s, Materializing param=model.layers.7.conv.out_proj.weight]
Loading weights:  45%|███████████████████████████████████████████▍                                                    | 67/148 [00:00<00:00, 3468.12it/s, Materializing param=model.layers.7.conv.out_proj.weight]
Loading weights:  46%|███████████████████████████████████████████▏                                                  | 68/148 [00:00<00:00, 3500.32it/s, Materializing param=model.layers.7.feed_forward.w1.weight]
Loading weights:  46%|███████████████████████████████████████████▏                                                  | 68/148 [00:00<00:00, 3486.07it/s, Materializing param=model.layers.7.feed_forward.w1.weight]
Loading weights:  47%|███████████████████████████████████████████▊                                                  | 69/148 [00:00<00:00, 3517.94it/s, Materializing param=model.layers.7.feed_forward.w2.weight]
Loading weights:  47%|███████████████████████████████████████████▊                                                  | 69/148 [00:00<00:00, 3503.67it/s, Materializing param=model.layers.7.feed_forward.w2.weight]
Loading weights:  47%|████████████████████████████████████████████▍                                                 | 70/148 [00:00<00:00, 3534.89it/s, Materializing param=model.layers.7.feed_forward.w3.weight]
Loading weights:  47%|████████████████████████████████████████████▍                                                 | 70/148 [00:00<00:00, 3520.65it/s, Materializing param=model.layers.7.feed_forward.w3.weight]
Loading weights:  48%|████████████████████████████████████████████████▍                                                    | 71/148 [00:00<00:00, 3551.82it/s, Materializing param=model.layers.7.ffn_norm.weight]
Loading weights:  48%|████████████████████████████████████████████████▍                                                    | 71/148 [00:00<00:00, 3536.89it/s, Materializing param=model.layers.7.ffn_norm.weight]
Loading weights:  49%|██████████████████████████████████████████████▋                                                 | 72/148 [00:00<00:00, 3567.34it/s, Materializing param=model.layers.7.operator_norm.weight]
Loading weights:  49%|██████████████████████████████████████████████▋                                                 | 72/148 [00:00<00:00, 3553.24it/s, Materializing param=model.layers.7.operator_norm.weight]
Loading weights:  49%|██████████████████████████████████████████████▎                                               | 73/148 [00:00<00:00, 3581.44it/s, Materializing param=model.layers.8.feed_forward.w1.weight]
Loading weights:  49%|██████████████████████████████████████████████▎                                               | 73/148 [00:00<00:00, 3567.17it/s, Materializing param=model.layers.8.feed_forward.w1.weight]
Loading weights:  50%|███████████████████████████████████████████████                                               | 74/148 [00:00<00:00, 3596.80it/s, Materializing param=model.layers.8.feed_forward.w2.weight]
Loading weights:  50%|███████████████████████████████████████████████                                               | 74/148 [00:00<00:00, 3583.01it/s, Materializing param=model.layers.8.feed_forward.w2.weight]
Loading weights:  51%|███████████████████████████████████████████████▋                                              | 75/148 [00:00<00:00, 3612.42it/s, Materializing param=model.layers.8.feed_forward.w3.weight]
Loading weights:  51%|███████████████████████████████████████████████▋                                              | 75/148 [00:00<00:00, 3598.45it/s, Materializing param=model.layers.8.feed_forward.w3.weight]
Loading weights:  51%|███████████████████████████████████████████████████▊                                                 | 76/148 [00:00<00:00, 3627.75it/s, Materializing param=model.layers.8.ffn_norm.weight]
Loading weights:  51%|███████████████████████████████████████████████████▊                                                 | 76/148 [00:00<00:00, 3613.93it/s, Materializing param=model.layers.8.ffn_norm.weight]
Loading weights:  52%|█████████████████████████████████████████████████▉                                              | 77/148 [00:00<00:00, 3642.86it/s, Materializing param=model.layers.8.operator_norm.weight]
Loading weights:  52%|█████████████████████████████████████████████████▉                                              | 77/148 [00:00<00:00, 3629.15it/s, Materializing param=model.layers.8.operator_norm.weight]
Loading weights:  53%|██████████████████████████████████████████████▍                                         | 78/148 [00:00<00:00, 3656.76it/s, Materializing param=model.layers.8.self_attn.k_layernorm.weight]
Loading weights:  53%|██████████████████████████████████████████████▍                                         | 78/148 [00:00<00:00, 3642.83it/s, Materializing param=model.layers.8.self_attn.k_layernorm.weight]
Loading weights:  53%|█████████████████████████████████████████████████▋                                           | 79/148 [00:00<00:00, 3670.82it/s, Materializing param=model.layers.8.self_attn.k_proj.weight]
Loading weights:  53%|█████████████████████████████████████████████████▋                                           | 79/148 [00:00<00:00, 3657.16it/s, Materializing param=model.layers.8.self_attn.k_proj.weight]
Loading weights:  54%|█████████████████████████████████████████████████▏                                         | 80/148 [00:00<00:00, 3685.07it/s, Materializing param=model.layers.8.self_attn.out_proj.weight]
Loading weights:  54%|█████████████████████████████████████████████████▏                                         | 80/148 [00:00<00:00, 3671.44it/s, Materializing param=model.layers.8.self_attn.out_proj.weight]
Loading weights:  55%|████████████████████████████████████████████████▏                                       | 81/148 [00:00<00:00, 3699.04it/s, Materializing param=model.layers.8.self_attn.q_layernorm.weight]
Loading weights:  55%|████████████████████████████████████████████████▏                                       | 81/148 [00:00<00:00, 3685.52it/s, Materializing param=model.layers.8.self_attn.q_layernorm.weight]
Loading weights:  55%|███████████████████████████████████████████████████▌                                         | 82/148 [00:00<00:00, 3712.74it/s, Materializing param=model.layers.8.self_attn.q_proj.weight]
Loading weights:  55%|███████████████████████████████████████████████████▌                                         | 82/148 [00:00<00:00, 3699.04it/s, Materializing param=model.layers.8.self_attn.q_proj.weight]
Loading weights:  56%|████████████████████████████████████████████████████▏                                        | 83/148 [00:00<00:00, 3725.84it/s, Materializing param=model.layers.8.self_attn.v_proj.weight]
Loading weights:  56%|████████████████████████████████████████████████████▏                                        | 83/148 [00:00<00:00, 3712.33it/s, Materializing param=model.layers.8.self_attn.v_proj.weight]
Loading weights:  57%|████████████████████████████████████████████████████████▊                                           | 84/148 [00:00<00:00, 3738.95it/s, Materializing param=model.layers.9.conv.conv.weight]
Loading weights:  57%|████████████████████████████████████████████████████████▊                                           | 84/148 [00:00<00:00, 3724.72it/s, Materializing param=model.layers.9.conv.conv.weight]
Loading weights:  57%|███████████████████████████████████████████████████████▋                                         | 85/148 [00:00<00:00, 3750.47it/s, Materializing param=model.layers.9.conv.in_proj.weight]
Loading weights:  57%|███████████████████████████████████████████████████████▋                                         | 85/148 [00:00<00:00, 3736.91it/s, Materializing param=model.layers.9.conv.in_proj.weight]
Loading weights:  58%|███████████████████████████████████████████████████████▊                                        | 86/148 [00:00<00:00, 3762.92it/s, Materializing param=model.layers.9.conv.out_proj.weight]
Loading weights:  58%|███████████████████████████████████████████████████████▊                                        | 86/148 [00:00<00:00, 3749.70it/s, Materializing param=model.layers.9.conv.out_proj.weight]
Loading weights:  59%|███████████████████████████████████████████████████████▎                                      | 87/148 [00:00<00:00, 3775.25it/s, Materializing param=model.layers.9.feed_forward.w1.weight]
Loading weights:  59%|███████████████████████████████████████████████████████▎                                      | 87/148 [00:00<00:00, 3762.10it/s, Materializing param=model.layers.9.feed_forward.w1.weight]
Loading weights:  59%|███████████████████████████████████████████████████████▉                                      | 88/148 [00:00<00:00, 3787.57it/s, Materializing param=model.layers.9.feed_forward.w2.weight]
Loading weights:  59%|███████████████████████████████████████████████████████▉                                      | 88/148 [00:00<00:00, 3774.56it/s, Materializing param=model.layers.9.feed_forward.w2.weight]
Loading weights:  60%|████████████████████████████████████████████████████████▌                                     | 89/148 [00:00<00:00, 3800.04it/s, Materializing param=model.layers.9.feed_forward.w3.weight]
Loading weights:  60%|████████████████████████████████████████████████████████▌                                     | 89/148 [00:00<00:00, 3787.16it/s, Materializing param=model.layers.9.feed_forward.w3.weight]
Loading weights:  61%|█████████████████████████████████████████████████████████████▍                                       | 90/148 [00:00<00:00, 3812.23it/s, Materializing param=model.layers.9.ffn_norm.weight]
Loading weights:  61%|█████████████████████████████████████████████████████████████▍                                       | 90/148 [00:00<00:00, 3799.46it/s, Materializing param=model.layers.9.ffn_norm.weight]
Loading weights:  61%|███████████████████████████████████████████████████████████                                     | 91/148 [00:00<00:00, 3823.20it/s, Materializing param=model.layers.9.operator_norm.weight]
Loading weights:  61%|███████████████████████████████████████████████████████████                                     | 91/148 [00:00<00:00, 3810.11it/s, Materializing param=model.layers.9.operator_norm.weight]
Loading weights:  62%|█████████████████████████████████████████████████████████▊                                   | 92/148 [00:00<00:00, 3834.79it/s, Materializing param=model.layers.10.feed_forward.w1.weight]
Loading weights:  62%|█████████████████████████████████████████████████████████▊                                   | 92/148 [00:00<00:00, 3822.11it/s, Materializing param=model.layers.10.feed_forward.w1.weight]
Loading weights:  63%|██████████████████████████████████████████████████████████▍                                  | 93/148 [00:00<00:00, 3846.28it/s, Materializing param=model.layers.10.feed_forward.w2.weight]
Loading weights:  63%|██████████████████████████████████████████████████████████▍                                  | 93/148 [00:00<00:00, 3833.58it/s, Materializing param=model.layers.10.feed_forward.w2.weight]
Loading weights:  64%|███████████████████████████████████████████████████████████                                  | 94/148 [00:00<00:00, 3855.13it/s, Materializing param=model.layers.10.feed_forward.w3.weight]
Loading weights:  64%|███████████████████████████████████████████████████████████                                  | 94/148 [00:00<00:00, 3841.99it/s, Materializing param=model.layers.10.feed_forward.w3.weight]
Loading weights:  64%|████████████████████████████████████████████████████████████████▏                                   | 95/148 [00:00<00:00, 3865.83it/s, Materializing param=model.layers.10.ffn_norm.weight]
Loading weights:  64%|████████████████████████████████████████████████████████████████▏                                   | 95/148 [00:00<00:00, 3853.31it/s, Materializing param=model.layers.10.ffn_norm.weight]
Loading weights:  65%|█████████████████████████████████████████████████████████████▌                                 | 96/148 [00:00<00:00, 3877.26it/s, Materializing param=model.layers.10.operator_norm.weight]
Loading weights:  65%|█████████████████████████████████████████████████████████████▌                                 | 96/148 [00:00<00:00, 3864.68it/s, Materializing param=model.layers.10.operator_norm.weight]
Loading weights:  66%|█████████████████████████████████████████████████████████                              | 97/148 [00:00<00:00, 3887.44it/s, Materializing param=model.layers.10.self_attn.k_layernorm.weight]
Loading weights:  66%|█████████████████████████████████████████████████████████                              | 97/148 [00:00<00:00, 3874.85it/s, Materializing param=model.layers.10.self_attn.k_layernorm.weight]
Loading weights:  66%|████████████████████████████████████████████████████████████▉                               | 98/148 [00:00<00:00, 3897.94it/s, Materializing param=model.layers.10.self_attn.k_proj.weight]
Loading weights:  66%|████████████████████████████████████████████████████████████▉                               | 98/148 [00:00<00:00, 3885.56it/s, Materializing param=model.layers.10.self_attn.k_proj.weight]
Loading weights:  67%|████████████████████████████████████████████████████████████▏                             | 99/148 [00:00<00:00, 3908.73it/s, Materializing param=model.layers.10.self_attn.out_proj.weight]
Loading weights:  67%|████████████████████████████████████████████████████████████▏                             | 99/148 [00:00<00:00, 3896.44it/s, Materializing param=model.layers.10.self_attn.out_proj.weight]
Loading weights:  68%|██████████████████████████████████████████████████████████                            | 100/148 [00:00<00:00, 3918.99it/s, Materializing param=model.layers.10.self_attn.q_layernorm.weight]
Loading weights:  68%|██████████████████████████████████████████████████████████                            | 100/148 [00:00<00:00, 3906.66it/s, Materializing param=model.layers.10.self_attn.q_layernorm.weight]
Loading weights:  68%|██████████████████████████████████████████████████████████████                             | 101/148 [00:00<00:00, 3929.22it/s, Materializing param=model.layers.10.self_attn.q_proj.weight]
Loading weights:  68%|██████████████████████████████████████████████████████████████                             | 101/148 [00:00<00:00, 3917.12it/s, Materializing param=model.layers.10.self_attn.q_proj.weight]
Loading weights:  69%|██████████████████████████████████████████████████████████████▋                            | 102/148 [00:00<00:00, 3939.37it/s, Materializing param=model.layers.10.self_attn.v_proj.weight]
Loading weights:  69%|██████████████████████████████████████████████████████████████▋                            | 102/148 [00:00<00:00, 3927.21it/s, Materializing param=model.layers.10.self_attn.v_proj.weight]
Loading weights:  70%|████████████████████████████████████████████████████████████████████▏                             | 103/148 [00:00<00:00, 3948.61it/s, Materializing param=model.layers.11.conv.conv.weight]
Loading weights:  70%|████████████████████████████████████████████████████████████████████▏                             | 103/148 [00:00<00:00, 3936.38it/s, Materializing param=model.layers.11.conv.conv.weight]
Loading weights:  70%|██████████████████████████████████████████████████████████████████▊                            | 104/148 [00:00<00:00, 3958.15it/s, Materializing param=model.layers.11.conv.in_proj.weight]
Loading weights:  70%|██████████████████████████████████████████████████████████████████▊                            | 104/148 [00:00<00:00, 3946.01it/s, Materializing param=model.layers.11.conv.in_proj.weight]
Loading weights:  71%|██████████████████████████████████████████████████████████████████▋                           | 105/148 [00:00<00:00, 3967.58it/s, Materializing param=model.layers.11.conv.out_proj.weight]
Loading weights:  71%|██████████████████████████████████████████████████████████████████▋                           | 105/148 [00:00<00:00, 3955.47it/s, Materializing param=model.layers.11.conv.out_proj.weight]
Loading weights:  72%|█████████████████████████████████████████████████████████████████▉                          | 106/148 [00:00<00:00, 3976.78it/s, Materializing param=model.layers.11.feed_forward.w1.weight]
Loading weights:  72%|█████████████████████████████████████████████████████████████████▉                          | 106/148 [00:00<00:00, 3964.83it/s, Materializing param=model.layers.11.feed_forward.w1.weight]
Loading weights:  72%|██████████████████████████████████████████████████████████████████▌                         | 107/148 [00:00<00:00, 3985.56it/s, Materializing param=model.layers.11.feed_forward.w2.weight]
Loading weights:  72%|██████████████████████████████████████████████████████████████████▌                         | 107/148 [00:00<00:00, 3973.64it/s, Materializing param=model.layers.11.feed_forward.w2.weight]
Loading weights:  73%|███████████████████████████████████████████████████████████████████▏                        | 108/148 [00:00<00:00, 3994.26it/s, Materializing param=model.layers.11.feed_forward.w3.weight]
Loading weights:  73%|███████████████████████████████████████████████████████████████████▏                        | 108/148 [00:00<00:00, 3982.32it/s, Materializing param=model.layers.11.feed_forward.w3.weight]
Loading weights:  74%|████████████████████████████████████████████████████████████████████████▉                          | 109/148 [00:00<00:00, 4002.41it/s, Materializing param=model.layers.11.ffn_norm.weight]
Loading weights:  74%|████████████████████████████████████████████████████████████████████████▉                          | 109/148 [00:00<00:00, 3990.50it/s, Materializing param=model.layers.11.ffn_norm.weight]
Loading weights:  74%|█████████████████████████████████████████████████████████████████████▊                        | 110/148 [00:00<00:00, 4011.49it/s, Materializing param=model.layers.11.operator_norm.weight]
Loading weights:  74%|█████████████████████████████████████████████████████████████████████▊                        | 110/148 [00:00<00:00, 3999.74it/s, Materializing param=model.layers.11.operator_norm.weight]
Loading weights:  75%|█████████████████████████████████████████████████████████████████████                       | 111/148 [00:00<00:00, 4020.66it/s, Materializing param=model.layers.12.feed_forward.w1.weight]
Loading weights:  75%|█████████████████████████████████████████████████████████████████████                       | 111/148 [00:00<00:00, 4009.09it/s, Materializing param=model.layers.12.feed_forward.w1.weight]
Loading weights:  76%|█████████████████████████████████████████████████████████████████████▌                      | 112/148 [00:00<00:00, 4029.53it/s, Materializing param=model.layers.12.feed_forward.w2.weight]
Loading weights:  76%|█████████████████████████████████████████████████████████████████████▌                      | 112/148 [00:00<00:00, 4017.91it/s, Materializing param=model.layers.12.feed_forward.w2.weight]
Loading weights:  76%|██████████████████████████████████████████████████████████████████████▏                     | 113/148 [00:00<00:00, 4038.28it/s, Materializing param=model.layers.12.feed_forward.w3.weight]
Loading weights:  76%|██████████████████████████████████████████████████████████████████████▏                     | 113/148 [00:00<00:00, 4026.68it/s, Materializing param=model.layers.12.feed_forward.w3.weight]
Loading weights:  77%|████████████████████████████████████████████████████████████████████████████▎                      | 114/148 [00:00<00:00, 4046.71it/s, Materializing param=model.layers.12.ffn_norm.weight]
Loading weights:  77%|████████████████████████████████████████████████████████████████████████████▎                      | 114/148 [00:00<00:00, 4035.30it/s, Materializing param=model.layers.12.ffn_norm.weight]
Loading weights:  78%|█████████████████████████████████████████████████████████████████████████                     | 115/148 [00:00<00:00, 4053.25it/s, Materializing param=model.layers.12.operator_norm.weight]
Loading weights:  78%|█████████████████████████████████████████████████████████████████████████                     | 115/148 [00:00<00:00, 4041.30it/s, Materializing param=model.layers.12.operator_norm.weight]
Loading weights:  78%|███████████████████████████████████████████████████████████████████▍                  | 116/148 [00:00<00:00, 4061.09it/s, Materializing param=model.layers.12.self_attn.k_layernorm.weight]
Loading weights:  78%|███████████████████████████████████████████████████████████████████▍                  | 116/148 [00:00<00:00, 4049.57it/s, Materializing param=model.layers.12.self_attn.k_layernorm.weight]
Loading weights:  79%|███████████████████████████████████████████████████████████████████████▉                   | 117/148 [00:00<00:00, 4068.97it/s, Materializing param=model.layers.12.self_attn.k_proj.weight]
Loading weights:  79%|███████████████████████████████████████████████████████████████████████▉                   | 117/148 [00:00<00:00, 4057.66it/s, Materializing param=model.layers.12.self_attn.k_proj.weight]
Loading weights:  80%|██████████████████████████████████████████████████████████████████████▉                  | 118/148 [00:00<00:00, 4076.77it/s, Materializing param=model.layers.12.self_attn.out_proj.weight]
Loading weights:  80%|██████████████████████████████████████████████████████████████████████▉                  | 118/148 [00:00<00:00, 4065.45it/s, Materializing param=model.layers.12.self_attn.out_proj.weight]
Loading weights:  80%|█████████████████████████████████████████████████████████████████████▏                | 119/148 [00:00<00:00, 4084.44it/s, Materializing param=model.layers.12.self_attn.q_layernorm.weight]
Loading weights:  80%|█████████████████████████████████████████████████████████████████████▏                | 119/148 [00:00<00:00, 4073.10it/s, Materializing param=model.layers.12.self_attn.q_layernorm.weight]
Loading weights:  81%|█████████████████████████████████████████████████████████████████████████▊                 | 120/148 [00:00<00:00, 4091.94it/s, Materializing param=model.layers.12.self_attn.q_proj.weight]
Loading weights:  81%|█████████████████████████████████████████████████████████████████████████▊                 | 120/148 [00:00<00:00, 4079.93it/s, Materializing param=model.layers.12.self_attn.q_proj.weight]
Loading weights:  82%|██████████████████████████████████████████████████████████████████████████▍                | 121/148 [00:00<00:00, 4098.41it/s, Materializing param=model.layers.12.self_attn.v_proj.weight]
Loading weights:  82%|██████████████████████████████████████████████████████████████████████████▍                | 121/148 [00:00<00:00, 4087.19it/s, Materializing param=model.layers.12.self_attn.v_proj.weight]
Loading weights:  82%|████████████████████████████████████████████████████████████████████████████████▊                 | 122/148 [00:00<00:00, 4105.63it/s, Materializing param=model.layers.13.conv.conv.weight]
Loading weights:  82%|████████████████████████████████████████████████████████████████████████████████▊                 | 122/148 [00:00<00:00, 4094.36it/s, Materializing param=model.layers.13.conv.conv.weight]
Loading weights:  83%|██████████████████████████████████████████████████████████████████████████████▉                | 123/148 [00:00<00:00, 4112.39it/s, Materializing param=model.layers.13.conv.in_proj.weight]
Loading weights:  83%|██████████████████████████████████████████████████████████████████████████████▉                | 123/148 [00:00<00:00, 4101.24it/s, Materializing param=model.layers.13.conv.in_proj.weight]
Loading weights:  84%|██████████████████████████████████████████████████████████████████████████████▊               | 124/148 [00:00<00:00, 4119.59it/s, Materializing param=model.layers.13.conv.out_proj.weight]
Loading weights:  84%|██████████████████████████████████████████████████████████████████████████████▊               | 124/148 [00:00<00:00, 4108.46it/s, Materializing param=model.layers.13.conv.out_proj.weight]
Loading weights:  84%|█████████████████████████████████████████████████████████████████████████████▋              | 125/148 [00:00<00:00, 4126.63it/s, Materializing param=model.layers.13.feed_forward.w1.weight]
Loading weights:  84%|█████████████████████████████████████████████████████████████████████████████▋              | 125/148 [00:00<00:00, 4115.78it/s, Materializing param=model.layers.13.feed_forward.w1.weight]
Loading weights:  85%|██████████████████████████████████████████████████████████████████████████████▎             | 126/148 [00:00<00:00, 4134.16it/s, Materializing param=model.layers.13.feed_forward.w2.weight]
Loading weights:  85%|██████████████████████████████████████████████████████████████████████████████▎             | 126/148 [00:00<00:00, 4122.68it/s, Materializing param=model.layers.13.feed_forward.w2.weight]
Loading weights:  86%|██████████████████████████████████████████████████████████████████████████████▉             | 127/148 [00:00<00:00, 4140.51it/s, Materializing param=model.layers.13.feed_forward.w3.weight]
Loading weights:  86%|██████████████████████████████████████████████████████████████████████████████▉             | 127/148 [00:00<00:00, 4129.76it/s, Materializing param=model.layers.13.feed_forward.w3.weight]
Loading weights:  86%|█████████████████████████████████████████████████████████████████████████████████████▌             | 128/148 [00:00<00:00, 4147.64it/s, Materializing param=model.layers.13.ffn_norm.weight]
Loading weights:  86%|█████████████████████████████████████████████████████████████████████████████████████▌             | 128/148 [00:00<00:00, 4136.90it/s, Materializing param=model.layers.13.ffn_norm.weight]
Loading weights:  87%|█████████████████████████████████████████████████████████████████████████████████▉            | 129/148 [00:00<00:00, 4154.85it/s, Materializing param=model.layers.13.operator_norm.weight]
Loading weights:  87%|█████████████████████████████████████████████████████████████████████████████████▉            | 129/148 [00:00<00:00, 4144.16it/s, Materializing param=model.layers.13.operator_norm.weight]
Loading weights:  88%|████████████████████████████████████████████████████████████████████████████████▊           | 130/148 [00:00<00:00, 4162.16it/s, Materializing param=model.layers.14.feed_forward.w1.weight]
Loading weights:  88%|████████████████████████████████████████████████████████████████████████████████▊           | 130/148 [00:00<00:00, 4151.42it/s, Materializing param=model.layers.14.feed_forward.w1.weight]
Loading weights:  89%|█████████████████████████████████████████████████████████████████████████████████▍          | 131/148 [00:00<00:00, 4169.00it/s, Materializing param=model.layers.14.feed_forward.w2.weight]
Loading weights:  89%|█████████████████████████████████████████████████████████████████████████████████▍          | 131/148 [00:00<00:00, 4157.80it/s, Materializing param=model.layers.14.feed_forward.w2.weight]
Loading weights:  89%|██████████████████████████████████████████████████████████████████████████████████          | 132/148 [00:00<00:00, 4174.88it/s, Materializing param=model.layers.14.feed_forward.w3.weight]
Loading weights:  89%|██████████████████████████████████████████████████████████████████████████████████          | 132/148 [00:00<00:00, 4164.33it/s, Materializing param=model.layers.14.feed_forward.w3.weight]
Loading weights:  90%|████████████████████████████████████████████████████████████████████████████████████████▉          | 133/148 [00:00<00:00, 4181.35it/s, Materializing param=model.layers.14.ffn_norm.weight]
Loading weights:  90%|████████████████████████████████████████████████████████████████████████████████████████▉          | 133/148 [00:00<00:00, 4170.82it/s, Materializing param=model.layers.14.ffn_norm.weight]
Loading weights:  91%|█████████████████████████████████████████████████████████████████████████████████████         | 134/148 [00:00<00:00, 4187.99it/s, Materializing param=model.layers.14.operator_norm.weight]
Loading weights:  91%|█████████████████████████████████████████████████████████████████████████████████████         | 134/148 [00:00<00:00, 4177.62it/s, Materializing param=model.layers.14.operator_norm.weight]
Loading weights:  91%|██████████████████████████████████████████████████████████████████████████████▍       | 135/148 [00:00<00:00, 4194.74it/s, Materializing param=model.layers.14.self_attn.k_layernorm.weight]
Loading weights:  91%|██████████████████████████████████████████████████████████████████████████████▍       | 135/148 [00:00<00:00, 4184.32it/s, Materializing param=model.layers.14.self_attn.k_layernorm.weight]
Loading weights:  92%|███████████████████████████████████████████████████████████████████████████████████▌       | 136/148 [00:00<00:00, 4199.80it/s, Materializing param=model.layers.14.self_attn.k_proj.weight]
Loading weights:  92%|███████████████████████████████████████████████████████████████████████████████████▌       | 136/148 [00:00<00:00, 4189.19it/s, Materializing param=model.layers.14.self_attn.k_proj.weight]
Loading weights:  93%|██████████████████████████████████████████████████████████████████████████████████▍      | 137/148 [00:00<00:00, 4205.23it/s, Materializing param=model.layers.14.self_attn.out_proj.weight]
Loading weights:  93%|██████████████████████████████████████████████████████████████████████████████████▍      | 137/148 [00:00<00:00, 4194.73it/s, Materializing param=model.layers.14.self_attn.out_proj.weight]
Loading weights:  93%|████████████████████████████████████████████████████████████████████████████████▏     | 138/148 [00:00<00:00, 4210.90it/s, Materializing param=model.layers.14.self_attn.q_layernorm.weight]
Loading weights:  93%|████████████████████████████████████████████████████████████████████████████████▏     | 138/148 [00:00<00:00, 4200.36it/s, Materializing param=model.layers.14.self_attn.q_layernorm.weight]
Loading weights:  94%|█████████████████████████████████████████████████████████████████████████████████████▍     | 139/148 [00:00<00:00, 4216.75it/s, Materializing param=model.layers.14.self_attn.q_proj.weight]
Loading weights:  94%|█████████████████████████████████████████████████████████████████████████████████████▍     | 139/148 [00:00<00:00, 4206.41it/s, Materializing param=model.layers.14.self_attn.q_proj.weight]
Loading weights:  95%|██████████████████████████████████████████████████████████████████████████████████████     | 140/148 [00:00<00:00, 4222.72it/s, Materializing param=model.layers.14.self_attn.v_proj.weight]
Loading weights:  95%|██████████████████████████████████████████████████████████████████████████████████████     | 140/148 [00:00<00:00, 4212.48it/s, Materializing param=model.layers.14.self_attn.v_proj.weight]
Loading weights:  95%|█████████████████████████████████████████████████████████████████████████████████████████████▎    | 141/148 [00:00<00:00, 4228.85it/s, Materializing param=model.layers.15.conv.conv.weight]
Loading weights:  95%|█████████████████████████████████████████████████████████████████████████████████████████████▎    | 141/148 [00:00<00:00, 4218.66it/s, Materializing param=model.layers.15.conv.conv.weight]
Loading weights:  96%|███████████████████████████████████████████████████████████████████████████████████████████▏   | 142/148 [00:00<00:00, 4234.80it/s, Materializing param=model.layers.15.conv.in_proj.weight]
Loading weights:  96%|███████████████████████████████████████████████████████████████████████████████████████████▏   | 142/148 [00:00<00:00, 4224.14it/s, Materializing param=model.layers.15.conv.in_proj.weight]
Loading weights:  97%|██████████████████████████████████████████████████████████████████████████████████████████▊   | 143/148 [00:00<00:00, 4240.09it/s, Materializing param=model.layers.15.conv.out_proj.weight]
Loading weights:  97%|██████████████████████████████████████████████████████████████████████████████████████████▊   | 143/148 [00:00<00:00, 4229.86it/s, Materializing param=model.layers.15.conv.out_proj.weight]
Loading weights:  97%|█████████████████████████████████████████████████████████████████████████████████████████▌  | 144/148 [00:00<00:00, 4245.96it/s, Materializing param=model.layers.15.feed_forward.w1.weight]
Loading weights:  97%|█████████████████████████████████████████████████████████████████████████████████████████▌  | 144/148 [00:00<00:00, 4235.99it/s, Materializing param=model.layers.15.feed_forward.w1.weight]
Loading weights:  98%|██████████████████████████████████████████████████████████████████████████████████████████▏ | 145/148 [00:00<00:00, 4251.92it/s, Materializing param=model.layers.15.feed_forward.w2.weight]
Loading weights:  98%|██████████████████████████████████████████████████████████████████████████████████████████▏ | 145/148 [00:00<00:00, 4241.90it/s, Materializing param=model.layers.15.feed_forward.w2.weight]
Loading weights:  99%|██████████████████████████████████████████████████████████████████████████████████████████▊ | 146/148 [00:00<00:00, 4257.58it/s, Materializing param=model.layers.15.feed_forward.w3.weight]
Loading weights:  99%|██████████████████████████████████████████████████████████████████████████████████████████▊ | 146/148 [00:00<00:00, 4247.46it/s, Materializing param=model.layers.15.feed_forward.w3.weight]
Loading weights:  99%|██████████████████████████████████████████████████████████████████████████████████████████████████▎| 147/148 [00:00<00:00, 4262.80it/s, Materializing param=model.layers.15.ffn_norm.weight]
Loading weights:  99%|██████████████████████████████████████████████████████████████████████████████████████████████████▎| 147/148 [00:00<00:00, 4252.30it/s, Materializing param=model.layers.15.ffn_norm.weight]
Loading weights: 100%|██████████████████████████████████████████████████████████████████████████████████████████████| 148/148 [00:00<00:00, 4267.72it/s, Materializing param=model.layers.15.operator_norm.weight]
Loading weights: 100%|██████████████████████████████████████████████████████████████████████████████████████████████| 148/148 [00:00<00:00, 4257.88it/s, Materializing param=model.layers.15.operator_norm.weight]
Loading weights: 100%|██████████████████████████████████████████████████████████████████████████████████████████████| 148/148 [00:00<00:00, 4241.10it/s, Materializing param=model.layers.15.operator_norm.weight]
[2026-02-08 20:44:36,298] [WARNING] [accelerate.utils.dataclasses.__post_init__:1962] [PID:10500] sync_module_states is obsolete in FSDP2, as it is not needed anymore.Setting sync_module_states to None.Multiple deprecation warnings due to FSDP2 conversion:
sharding_strategy is deprecated in favor of reshard_after_forward. This will be removed in a future version of Accelerate.
[2026-02-08 20:44:37,935] [WARNING] [py.warnings._showwarnmsg:110] [PID:10500] /root/axolotl/.venv/lib/python3.12/site-packages/torch/distributed/distributed_c10d.py:4807: UserWarning: No device id is provided via `init_process_group` or `barrier `. Using the current device set by the user. 
  warnings.warn(  # warn only once