Instructions to use WokeAI/Tankie-LFM2.5-1.2B-SFT-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use WokeAI/Tankie-LFM2.5-1.2B-SFT-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="WokeAI/Tankie-LFM2.5-1.2B-SFT-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("WokeAI/Tankie-LFM2.5-1.2B-SFT-v1")
model = AutoModelForCausalLM.from_pretrained("WokeAI/Tankie-LFM2.5-1.2B-SFT-v1", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use WokeAI/Tankie-LFM2.5-1.2B-SFT-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "WokeAI/Tankie-LFM2.5-1.2B-SFT-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "WokeAI/Tankie-LFM2.5-1.2B-SFT-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/WokeAI/Tankie-LFM2.5-1.2B-SFT-v1

SGLang

How to use WokeAI/Tankie-LFM2.5-1.2B-SFT-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "WokeAI/Tankie-LFM2.5-1.2B-SFT-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "WokeAI/Tankie-LFM2.5-1.2B-SFT-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "WokeAI/Tankie-LFM2.5-1.2B-SFT-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "WokeAI/Tankie-LFM2.5-1.2B-SFT-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use WokeAI/Tankie-LFM2.5-1.2B-SFT-v1 with Docker Model Runner:
```
docker model run hf.co/WokeAI/Tankie-LFM2.5-1.2B-SFT-v1
```

Tankie-LFM2.5-1.2B-SFT-v1 / debug.log

Fizzarolli

Upload folder using huggingface_hub

308417f verified 7 months ago

Raw

History Blame Contribute Delete

92.5 kB

	[2026-02-08 20:44:08,881] [WARNING] [huggingface_hub.utils._http._warn_on_warning_headers:779] [PID:10500] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
	[2026-02-08 20:44:11,018] [WARNING] [py.warnings._showwarnmsg:110] [PID:10500] /root/axolotl/.venv/lib/python3.12/site-packages/torch/distributed/distributed_c10d.py:4807: UserWarning: No device id is provided via `init_process_group` or `barrier `. Using the current device set by the user.
	warnings.warn( # warn only once

	Loading weights: 0%\| \| 0/148 [00:00<?, ?it/s] Loading weights: 1%\|▋ \| 1/148 [00:00<00:00, 16710.37it/s, Materializing param=model.embed_tokens.weight] Loading weights: 1%\|▋ \| 1/148 [00:00<00:00, 4013.69it/s, Materializing param=model.embed_tokens.weight] Loading weights: 1%\|█▍ \| 2/148 [00:00<00:00, 2439.26it/s, Materializing param=model.embedding_norm.weight] Loading weights: 1%\|█▍ \| 2/148 [00:00<00:00, 2037.55it/s, Materializing param=model.embedding_norm.weight] Loading weights: 2%\|██ \| 3/148 [00:00<00:00, 2390.37it/s, Materializing param=model.layers.0.conv.conv.weight] Loading weights: 2%\|██ \| 3/148 [00:00<00:00, 2068.20it/s, Materializing param=model.layers.0.conv.conv.weight] Loading weights: 3%\|██▋ \| 4/148 [00:00<00:00, 2422.00it/s, Materializing param=model.layers.0.conv.in_proj.weight] Loading weights: 3%\|██▋ \| 4/148 [00:00<00:00, 2002.05it/s, Materializing param=model.layers.0.conv.in_proj.weight] Loading weights: 3%\|███▎ \| 5/148 [00:00<00:00, 2357.94it/s, Materializing param=model.layers.0.conv.out_proj.weight] Loading weights: 3%\|███▎ \| 5/148 [00:00<00:00, 2150.48it/s, Materializing param=model.layers.0.conv.out_proj.weight] Loading weights: 4%\|███▊ \| 6/148 [00:00<00:00, 2336.44it/s, Materializing param=model.layers.0.feed_forward.w1.weight] Loading weights: 4%\|███▊ \| 6/148 [00:00<00:00, 2190.24it/s, Materializing param=model.layers.0.feed_forward.w1.weight] Loading weights: 5%\|████▍ \| 7/148 [00:00<00:00, 2313.10it/s, Materializing param=model.layers.0.feed_forward.w2.weight] Loading weights: 5%\|████▍ \| 7/148 [00:00<00:00, 2248.96it/s, Materializing param=model.layers.0.feed_forward.w2.weight] Loading weights: 5%\|█████▏ \| 8/148 [00:00<00:00, 2446.37it/s, Materializing param=model.layers.0.feed_forward.w3.weight] Loading weights: 5%\|█████▏ \| 8/148 [00:00<00:00, 2383.97it/s, Materializing param=model.layers.0.feed_forward.w3.weight] Loading weights: 6%\|██████▏ \| 9/148 [00:00<00:00, 2570.04it/s, Materializing param=model.layers.0.ffn_norm.weight] Loading weights: 6%\|██████▏ \| 9/148 [00:00<00:00, 2439.34it/s, Materializing param=model.layers.0.ffn_norm.weight] Loading weights: 7%\|██████▍ \| 10/148 [00:00<00:00, 2623.57it/s, Materializing param=model.layers.0.operator_norm.weight] Loading weights: 7%\|██████▍ \| 10/148 [00:00<00:00, 2532.95it/s, Materializing param=model.layers.0.operator_norm.weight] Loading weights: 7%\|███████▍ \| 11/148 [00:00<00:00, 2681.00it/s, Materializing param=model.layers.1.conv.conv.weight] Loading weights: 7%\|███████▍ \| 11/148 [00:00<00:00, 2560.77it/s, Materializing param=model.layers.1.conv.conv.weight] Loading weights: 8%\|███████▊ \| 12/148 [00:00<00:00, 2640.97it/s, Materializing param=model.layers.1.conv.in_proj.weight] Loading weights: 8%\|███████▊ \| 12/148 [00:00<00:00, 2444.35it/s, Materializing param=model.layers.1.conv.in_proj.weight] Loading weights: 9%\|████████▍ \| 13/148 [00:00<00:00, 2515.50it/s, Materializing param=model.layers.1.conv.out_proj.weight] Loading weights: 9%\|████████▍ \| 13/148 [00:00<00:00, 2432.67it/s, Materializing param=model.layers.1.conv.out_proj.weight] Loading weights: 9%\|████████▉ \| 14/148 [00:00<00:00, 2538.16it/s, Materializing param=model.layers.1.feed_forward.w1.weight] Loading weights: 9%\|████████▉ \| 14/148 [00:00<00:00, 2477.54it/s, Materializing param=model.layers.1.feed_forward.w1.weight] Loading weights: 10%\|█████████▌ \| 15/148 [00:00<00:00, 2561.56it/s, Materializing param=model.layers.1.feed_forward.w2.weight] Loading weights: 10%\|█████████▌ \| 15/148 [00:00<00:00, 2525.88it/s, Materializing param=model.layers.1.feed_forward.w2.weight] Loading weights: 11%\|██████████▏ \| 16/148 [00:00<00:00, 2541.71it/s, Materializing param=model.layers.1.feed_forward.w3.weight] Loading weights: 11%\|██████████▏ \| 16/148 [00:00<00:00, 2428.05it/s, Materializing param=model.layers.1.feed_forward.w3.weight] Loading weights: 11%\|███████████▌ \| 17/148 [00:00<00:00, 2457.71it/s, Materializing param=model.layers.1.ffn_norm.weight] Loading weights: 11%\|███████████▌ \| 17/148 [00:00<00:00, 2428.50it/s, Materializing param=model.layers.1.ffn_norm.weight] Loading weights: 12%\|███████████▋ \| 18/148 [00:00<00:00, 2509.97it/s, Materializing param=model.layers.1.operator_norm.weight] Loading weights: 12%\|███████████▋ \| 18/148 [00:00<00:00, 2451.93it/s, Materializing param=model.layers.1.operator_norm.weight] Loading weights: 13%\|████████████ \| 19/148 [00:00<00:00, 2494.81it/s, Materializing param=model.layers.2.feed_forward.w1.weight] Loading weights: 13%\|████████████ \| 19/148 [00:00<00:00, 2466.86it/s, Materializing param=model.layers.2.feed_forward.w1.weight] Loading weights: 14%\|████████████▋ \| 20/148 [00:00<00:00, 2554.31it/s, Materializing param=model.layers.2.feed_forward.w2.weight] Loading weights: 14%\|████████████▋ \| 20/148 [00:00<00:00, 2491.05it/s, Materializing param=model.layers.2.feed_forward.w2.weight] Loading weights: 14%\|█████████████▎ \| 21/148 [00:00<00:00, 2491.52it/s, Materializing param=model.layers.2.feed_forward.w3.weight] Loading weights: 14%\|█████████████▎ \| 21/148 [00:00<00:00, 2466.48it/s, Materializing param=model.layers.2.feed_forward.w3.weight] Loading weights: 15%\|███████████████ \| 22/148 [00:00<00:00, 2531.47it/s, Materializing param=model.layers.2.ffn_norm.weight] Loading weights: 15%\|███████████████ \| 22/148 [00:00<00:00, 2485.98it/s, Materializing param=model.layers.2.ffn_norm.weight] Loading weights: 16%\|██████████████▉ \| 23/148 [00:00<00:00, 2546.77it/s, Materializing param=model.layers.2.operator_norm.weight] Loading weights: 16%\|██████████████▉ \| 23/148 [00:00<00:00, 2523.19it/s, Materializing param=model.layers.2.operator_norm.weight] Loading weights: 16%\|██████████████▎ \| 24/148 [00:00<00:00, 2553.22it/s, Materializing param=model.layers.2.self_attn.k_layernorm.weight] Loading weights: 16%\|██████████████▎ \| 24/148 [00:00<00:00, 2530.56it/s, Materializing param=model.layers.2.self_attn.k_layernorm.weight] Loading weights: 17%\|███████████████▋ \| 25/148 [00:00<00:00, 2551.03it/s, Materializing param=model.layers.2.self_attn.k_proj.weight] Loading weights: 17%\|███████████████▋ \| 25/148 [00:00<00:00, 2506.82it/s, Materializing param=model.layers.2.self_attn.k_proj.weight] Loading weights: 18%\|███████████████▉ \| 26/148 [00:00<00:00, 2573.37it/s, Materializing param=model.layers.2.self_attn.out_proj.weight] Loading weights: 18%\|███████████████▉ \| 26/148 [00:00<00:00, 2519.51it/s, Materializing param=model.layers.2.self_attn.out_proj.weight] Loading weights: 18%\|████████████████ \| 27/148 [00:00<00:00, 2568.17it/s, Materializing param=model.layers.2.self_attn.q_layernorm.weight] Loading weights: 18%\|████████████████ \| 27/148 [00:00<00:00, 2524.10it/s, Materializing param=model.layers.2.self_attn.q_layernorm.weight] Loading weights: 19%\|█████████████████▌ \| 28/148 [00:00<00:00, 2577.20it/s, Materializing param=model.layers.2.self_attn.q_proj.weight] Loading weights: 19%\|█████████████████▌ \| 28/148 [00:00<00:00, 2543.27it/s, Materializing param=model.layers.2.self_attn.q_proj.weight] Loading weights: 20%\|██████████████████▏ \| 29/148 [00:00<00:00, 2593.38it/s, Materializing param=model.layers.2.self_attn.v_proj.weight] Loading weights: 20%\|██████████████████▏ \| 29/148 [00:00<00:00, 2558.36it/s, Materializing param=model.layers.2.self_attn.v_proj.weight] Loading weights: 20%\|████████████████████▎ \| 30/148 [00:00<00:00, 2580.95it/s, Materializing param=model.layers.3.conv.conv.weight] Loading weights: 20%\|████████████████████▎ \| 30/148 [00:00<00:00, 2537.24it/s, Materializing param=model.layers.3.conv.conv.weight] Loading weights: 21%\|████████████████████▎ \| 31/148 [00:00<00:00, 2560.88it/s, Materializing param=model.layers.3.conv.in_proj.weight] Loading weights: 21%\|████████████████████▎ \| 31/148 [00:00<00:00, 2543.15it/s, Materializing param=model.layers.3.conv.in_proj.weight] Loading weights: 22%\|████████████████████▊ \| 32/148 [00:00<00:00, 2569.94it/s, Materializing param=model.layers.3.conv.out_proj.weight] Loading weights: 22%\|████████████████████▊ \| 32/148 [00:00<00:00, 2541.09it/s, Materializing param=model.layers.3.conv.out_proj.weight] Loading weights: 22%\|████████████████████▉ \| 33/148 [00:00<00:00, 2583.13it/s, Materializing param=model.layers.3.feed_forward.w1.weight] Loading weights: 22%\|████████████████████▉ \| 33/148 [00:00<00:00, 2562.81it/s, Materializing param=model.layers.3.feed_forward.w1.weight] Loading weights: 23%\|█████████████████████▌ \| 34/148 [00:00<00:00, 2617.45it/s, Materializing param=model.layers.3.feed_forward.w2.weight] Loading weights: 23%\|█████████████████████▌ \| 34/148 [00:00<00:00, 2600.27it/s, Materializing param=model.layers.3.feed_forward.w2.weight] Loading weights: 24%\|██████████████████████▏ \| 35/148 [00:00<00:00, 2653.95it/s, Materializing param=model.layers.3.feed_forward.w3.weight] Loading weights: 24%\|██████████████████████▏ \| 35/148 [00:00<00:00, 2637.69it/s, Materializing param=model.layers.3.feed_forward.w3.weight] Loading weights: 24%\|████████████████████████▌ \| 36/148 [00:00<00:00, 2690.72it/s, Materializing param=model.layers.3.ffn_norm.weight] Loading weights: 24%\|████████████████████████▌ \| 36/148 [00:00<00:00, 2674.75it/s, Materializing param=model.layers.3.ffn_norm.weight] Loading weights: 25%\|████████████████████████ \| 37/148 [00:00<00:00, 2727.36it/s, Materializing param=model.layers.3.operator_norm.weight] Loading weights: 25%\|████████████████████████ \| 37/148 [00:00<00:00, 2711.39it/s, Materializing param=model.layers.3.operator_norm.weight] Loading weights: 26%\|█████████████████████████▋ \| 38/148 [00:00<00:00, 2763.19it/s, Materializing param=model.layers.4.conv.conv.weight] Loading weights: 26%\|█████████████████████████▋ \| 38/148 [00:00<00:00, 2747.42it/s, Materializing param=model.layers.4.conv.conv.weight] Loading weights: 26%\|█████████████████████████▌ \| 39/148 [00:00<00:00, 2797.88it/s, Materializing param=model.layers.4.conv.in_proj.weight] Loading weights: 26%\|█████████████████████████▌ \| 39/148 [00:00<00:00, 2782.03it/s, Materializing param=model.layers.4.conv.in_proj.weight] Loading weights: 27%\|█████████████████████████▉ \| 40/148 [00:00<00:00, 2831.93it/s, Materializing param=model.layers.4.conv.out_proj.weight] Loading weights: 27%\|█████████████████████████▉ \| 40/148 [00:00<00:00, 2816.06it/s, Materializing param=model.layers.4.conv.out_proj.weight] Loading weights: 28%\|██████████████████████████ \| 41/148 [00:00<00:00, 2864.96it/s, Materializing param=model.layers.4.feed_forward.w1.weight] Loading weights: 28%\|██████████████████████████ \| 41/148 [00:00<00:00, 2849.16it/s, Materializing param=model.layers.4.feed_forward.w1.weight] Loading weights: 28%\|██████████████████████████▋ \| 42/148 [00:00<00:00, 2896.81it/s, Materializing param=model.layers.4.feed_forward.w2.weight] Loading weights: 28%\|██████████████████████████▋ \| 42/148 [00:00<00:00, 2880.14it/s, Materializing param=model.layers.4.feed_forward.w2.weight] Loading weights: 29%\|███████████████████████████▎ \| 43/148 [00:00<00:00, 2926.70it/s, Materializing param=model.layers.4.feed_forward.w3.weight] Loading weights: 29%\|███████████████████████████▎ \| 43/148 [00:00<00:00, 2910.78it/s, Materializing param=model.layers.4.feed_forward.w3.weight] Loading weights: 30%\|██████████████████████████████ \| 44/148 [00:00<00:00, 2956.76it/s, Materializing param=model.layers.4.ffn_norm.weight] Loading weights: 30%\|██████████████████████████████ \| 44/148 [00:00<00:00, 2941.07it/s, Materializing param=model.layers.4.ffn_norm.weight] Loading weights: 30%\|█████████████████████████████▏ \| 45/148 [00:00<00:00, 2987.02it/s, Materializing param=model.layers.4.operator_norm.weight] Loading weights: 30%\|█████████████████████████████▏ \| 45/148 [00:00<00:00, 2971.50it/s, Materializing param=model.layers.4.operator_norm.weight] Loading weights: 31%\|█████████████████████████████▏ \| 46/148 [00:00<00:00, 3016.54it/s, Materializing param=model.layers.5.feed_forward.w1.weight] Loading weights: 31%\|█████████████████████████████▏ \| 46/148 [00:00<00:00, 3000.87it/s, Materializing param=model.layers.5.feed_forward.w1.weight] Loading weights: 32%\|█████████████████████████████▊ \| 47/148 [00:00<00:00, 3044.70it/s, Materializing param=model.layers.5.feed_forward.w2.weight] Loading weights: 32%\|█████████████████████████████▊ \| 47/148 [00:00<00:00, 3029.08it/s, Materializing param=model.layers.5.feed_forward.w2.weight] Loading weights: 32%\|██████████████████████████████▍ \| 48/148 [00:00<00:00, 3072.23it/s, Materializing param=model.layers.5.feed_forward.w3.weight] Loading weights: 32%\|██████████████████████████████▍ \| 48/148 [00:00<00:00, 3056.66it/s, Materializing param=model.layers.5.feed_forward.w3.weight] Loading weights: 33%\|█████████████████████████████████▍ \| 49/148 [00:00<00:00, 3099.21it/s, Materializing param=model.layers.5.ffn_norm.weight] Loading weights: 33%\|█████████████████████████████████▍ \| 49/148 [00:00<00:00, 3083.68it/s, Materializing param=model.layers.5.ffn_norm.weight] Loading weights: 34%\|████████████████████████████████▍ \| 50/148 [00:00<00:00, 3124.95it/s, Materializing param=model.layers.5.operator_norm.weight] Loading weights: 34%\|████████████████████████████████▍ \| 50/148 [00:00<00:00, 3109.52it/s, Materializing param=model.layers.5.operator_norm.weight] Loading weights: 34%\|██████████████████████████████▎ \| 51/148 [00:00<00:00, 3150.78it/s, Materializing param=model.layers.5.self_attn.k_layernorm.weight] Loading weights: 34%\|██████████████████████████████▎ \| 51/148 [00:00<00:00, 3135.12it/s, Materializing param=model.layers.5.self_attn.k_layernorm.weight] Loading weights: 35%\|████████████████████████████████▋ \| 52/148 [00:00<00:00, 3173.85it/s, Materializing param=model.layers.5.self_attn.k_proj.weight] Loading weights: 35%\|████████████████████████████████▋ \| 52/148 [00:00<00:00, 3158.18it/s, Materializing param=model.layers.5.self_attn.k_proj.weight] Loading weights: 36%\|████████████████████████████████▌ \| 53/148 [00:00<00:00, 3198.07it/s, Materializing param=model.layers.5.self_attn.out_proj.weight] Loading weights: 36%\|████████████████████████████████▌ \| 53/148 [00:00<00:00, 3182.60it/s, Materializing param=model.layers.5.self_attn.out_proj.weight] Loading weights: 36%\|████████████████████████████████ \| 54/148 [00:00<00:00, 3221.52it/s, Materializing param=model.layers.5.self_attn.q_layernorm.weight] Loading weights: 36%\|████████████████████████████████ \| 54/148 [00:00<00:00, 3205.88it/s, Materializing param=model.layers.5.self_attn.q_layernorm.weight] Loading weights: 37%\|██████████████████████████████████▌ \| 55/148 [00:00<00:00, 3243.90it/s, Materializing param=model.layers.5.self_attn.q_proj.weight] Loading weights: 37%\|██████████████████████████████████▌ \| 55/148 [00:00<00:00, 3228.28it/s, Materializing param=model.layers.5.self_attn.q_proj.weight] Loading weights: 38%\|███████████████████████████████████▏ \| 56/148 [00:00<00:00, 3266.05it/s, Materializing param=model.layers.5.self_attn.v_proj.weight] Loading weights: 38%\|███████████████████████████████████▏ \| 56/148 [00:00<00:00, 3250.90it/s, Materializing param=model.layers.5.self_attn.v_proj.weight] Loading weights: 39%\|██████████████████████████████████████▌ \| 57/148 [00:00<00:00, 3288.07it/s, Materializing param=model.layers.6.conv.conv.weight] Loading weights: 39%\|██████████████████████████████████████▌ \| 57/148 [00:00<00:00, 3272.05it/s, Materializing param=model.layers.6.conv.conv.weight] Loading weights: 39%\|██████████████████████████████████████ \| 58/148 [00:00<00:00, 3308.26it/s, Materializing param=model.layers.6.conv.in_proj.weight] Loading weights: 39%\|██████████████████████████████████████ \| 58/148 [00:00<00:00, 3292.99it/s, Materializing param=model.layers.6.conv.in_proj.weight] Loading weights: 40%\|██████████████████████████████████████▎ \| 59/148 [00:00<00:00, 3329.13it/s, Materializing param=model.layers.6.conv.out_proj.weight] Loading weights: 40%\|██████████████████████████████████████▎ \| 59/148 [00:00<00:00, 3313.97it/s, Materializing param=model.layers.6.conv.out_proj.weight] Loading weights: 41%\|██████████████████████████████████████ \| 60/148 [00:00<00:00, 3349.59it/s, Materializing param=model.layers.6.feed_forward.w1.weight] Loading weights: 41%\|██████████████████████████████████████ \| 60/148 [00:00<00:00, 3334.68it/s, Materializing param=model.layers.6.feed_forward.w1.weight] Loading weights: 41%\|██████████████████████████████████████▋ \| 61/148 [00:00<00:00, 3369.76it/s, Materializing param=model.layers.6.feed_forward.w2.weight] Loading weights: 41%\|██████████████████████████████████████▋ \| 61/148 [00:00<00:00, 3354.61it/s, Materializing param=model.layers.6.feed_forward.w2.weight] Loading weights: 42%\|███████████████████████████████████████▍ \| 62/148 [00:00<00:00, 3389.03it/s, Materializing param=model.layers.6.feed_forward.w3.weight] Loading weights: 42%\|███████████████████████████████████████▍ \| 62/148 [00:00<00:00, 3374.25it/s, Materializing param=model.layers.6.feed_forward.w3.weight] Loading weights: 43%\|██████████████████████████████████████████▉ \| 63/148 [00:00<00:00, 3408.60it/s, Materializing param=model.layers.6.ffn_norm.weight] Loading weights: 43%\|██████████████████████████████████████████▉ \| 63/148 [00:00<00:00, 3393.97it/s, Materializing param=model.layers.6.ffn_norm.weight] Loading weights: 43%\|█████████████████████████████████████████▌ \| 64/148 [00:00<00:00, 3428.12it/s, Materializing param=model.layers.6.operator_norm.weight] Loading weights: 43%\|█████████████████████████████████████████▌ \| 64/148 [00:00<00:00, 3412.56it/s, Materializing param=model.layers.6.operator_norm.weight] Loading weights: 44%\|███████████████████████████████████████████▉ \| 65/148 [00:00<00:00, 3446.08it/s, Materializing param=model.layers.7.conv.conv.weight] Loading weights: 44%\|███████████████████████████████████████████▉ \| 65/148 [00:00<00:00, 3431.55it/s, Materializing param=model.layers.7.conv.conv.weight] Loading weights: 45%\|███████████████████████████████████████████▎ \| 66/148 [00:00<00:00, 3464.54it/s, Materializing param=model.layers.7.conv.in_proj.weight] Loading weights: 45%\|███████████████████████████████████████████▎ \| 66/148 [00:00<00:00, 3450.12it/s, Materializing param=model.layers.7.conv.in_proj.weight] Loading weights: 45%\|███████████████████████████████████████████▍ \| 67/148 [00:00<00:00, 3482.69it/s, Materializing param=model.layers.7.conv.out_proj.weight] Loading weights: 45%\|███████████████████████████████████████████▍ \| 67/148 [00:00<00:00, 3468.12it/s, Materializing param=model.layers.7.conv.out_proj.weight] Loading weights: 46%\|███████████████████████████████████████████▏ \| 68/148 [00:00<00:00, 3500.32it/s, Materializing param=model.layers.7.feed_forward.w1.weight] Loading weights: 46%\|███████████████████████████████████████████▏ \| 68/148 [00:00<00:00, 3486.07it/s, Materializing param=model.layers.7.feed_forward.w1.weight] Loading weights: 47%\|███████████████████████████████████████████▊ \| 69/148 [00:00<00:00, 3517.94it/s, Materializing param=model.layers.7.feed_forward.w2.weight] Loading weights: 47%\|███████████████████████████████████████████▊ \| 69/148 [00:00<00:00, 3503.67it/s, Materializing param=model.layers.7.feed_forward.w2.weight] Loading weights: 47%\|████████████████████████████████████████████▍ \| 70/148 [00:00<00:00, 3534.89it/s, Materializing param=model.layers.7.feed_forward.w3.weight] Loading weights: 47%\|████████████████████████████████████████████▍ \| 70/148 [00:00<00:00, 3520.65it/s, Materializing param=model.layers.7.feed_forward.w3.weight] Loading weights: 48%\|████████████████████████████████████████████████▍ \| 71/148 [00:00<00:00, 3551.82it/s, Materializing param=model.layers.7.ffn_norm.weight] Loading weights: 48%\|████████████████████████████████████████████████▍ \| 71/148 [00:00<00:00, 3536.89it/s, Materializing param=model.layers.7.ffn_norm.weight] Loading weights: 49%\|██████████████████████████████████████████████▋ \| 72/148 [00:00<00:00, 3567.34it/s, Materializing param=model.layers.7.operator_norm.weight] Loading weights: 49%\|██████████████████████████████████████████████▋ \| 72/148 [00:00<00:00, 3553.24it/s, Materializing param=model.layers.7.operator_norm.weight] Loading weights: 49%\|██████████████████████████████████████████████▎ \| 73/148 [00:00<00:00, 3581.44it/s, Materializing param=model.layers.8.feed_forward.w1.weight] Loading weights: 49%\|██████████████████████████████████████████████▎ \| 73/148 [00:00<00:00, 3567.17it/s, Materializing param=model.layers.8.feed_forward.w1.weight] Loading weights: 50%\|███████████████████████████████████████████████ \| 74/148 [00:00<00:00, 3596.80it/s, Materializing param=model.layers.8.feed_forward.w2.weight] Loading weights: 50%\|███████████████████████████████████████████████ \| 74/148 [00:00<00:00, 3583.01it/s, Materializing param=model.layers.8.feed_forward.w2.weight] Loading weights: 51%\|███████████████████████████████████████████████▋ \| 75/148 [00:00<00:00, 3612.42it/s, Materializing param=model.layers.8.feed_forward.w3.weight] Loading weights: 51%\|███████████████████████████████████████████████▋ \| 75/148 [00:00<00:00, 3598.45it/s, Materializing param=model.layers.8.feed_forward.w3.weight] Loading weights: 51%\|███████████████████████████████████████████████████▊ \| 76/148 [00:00<00:00, 3627.75it/s, Materializing param=model.layers.8.ffn_norm.weight] Loading weights: 51%\|███████████████████████████████████████████████████▊ \| 76/148 [00:00<00:00, 3613.93it/s, Materializing param=model.layers.8.ffn_norm.weight] Loading weights: 52%\|█████████████████████████████████████████████████▉ \| 77/148 [00:00<00:00, 3642.86it/s, Materializing param=model.layers.8.operator_norm.weight] Loading weights: 52%\|█████████████████████████████████████████████████▉ \| 77/148 [00:00<00:00, 3629.15it/s, Materializing param=model.layers.8.operator_norm.weight] Loading weights: 53%\|██████████████████████████████████████████████▍ \| 78/148 [00:00<00:00, 3656.76it/s, Materializing param=model.layers.8.self_attn.k_layernorm.weight] Loading weights: 53%\|██████████████████████████████████████████████▍ \| 78/148 [00:00<00:00, 3642.83it/s, Materializing param=model.layers.8.self_attn.k_layernorm.weight] Loading weights: 53%\|█████████████████████████████████████████████████▋ \| 79/148 [00:00<00:00, 3670.82it/s, Materializing param=model.layers.8.self_attn.k_proj.weight] Loading weights: 53%\|█████████████████████████████████████████████████▋ \| 79/148 [00:00<00:00, 3657.16it/s, Materializing param=model.layers.8.self_attn.k_proj.weight] Loading weights: 54%\|█████████████████████████████████████████████████▏ \| 80/148 [00:00<00:00, 3685.07it/s, Materializing param=model.layers.8.self_attn.out_proj.weight] Loading weights: 54%\|█████████████████████████████████████████████████▏ \| 80/148 [00:00<00:00, 3671.44it/s, Materializing param=model.layers.8.self_attn.out_proj.weight] Loading weights: 55%\|████████████████████████████████████████████████▏ \| 81/148 [00:00<00:00, 3699.04it/s, Materializing param=model.layers.8.self_attn.q_layernorm.weight] Loading weights: 55%\|████████████████████████████████████████████████▏ \| 81/148 [00:00<00:00, 3685.52it/s, Materializing param=model.layers.8.self_attn.q_layernorm.weight] Loading weights: 55%\|███████████████████████████████████████████████████▌ \| 82/148 [00:00<00:00, 3712.74it/s, Materializing param=model.layers.8.self_attn.q_proj.weight] Loading weights: 55%\|███████████████████████████████████████████████████▌ \| 82/148 [00:00<00:00, 3699.04it/s, Materializing param=model.layers.8.self_attn.q_proj.weight] Loading weights: 56%\|████████████████████████████████████████████████████▏ \| 83/148 [00:00<00:00, 3725.84it/s, Materializing param=model.layers.8.self_attn.v_proj.weight] Loading weights: 56%\|████████████████████████████████████████████████████▏ \| 83/148 [00:00<00:00, 3712.33it/s, Materializing param=model.layers.8.self_attn.v_proj.weight] Loading weights: 57%\|████████████████████████████████████████████████████████▊ \| 84/148 [00:00<00:00, 3738.95it/s, Materializing param=model.layers.9.conv.conv.weight] Loading weights: 57%\|████████████████████████████████████████████████████████▊ \| 84/148 [00:00<00:00, 3724.72it/s, Materializing param=model.layers.9.conv.conv.weight] Loading weights: 57%\|███████████████████████████████████████████████████████▋ \| 85/148 [00:00<00:00, 3750.47it/s, Materializing param=model.layers.9.conv.in_proj.weight] Loading weights: 57%\|███████████████████████████████████████████████████████▋ \| 85/148 [00:00<00:00, 3736.91it/s, Materializing param=model.layers.9.conv.in_proj.weight] Loading weights: 58%\|███████████████████████████████████████████████████████▊ \| 86/148 [00:00<00:00, 3762.92it/s, Materializing param=model.layers.9.conv.out_proj.weight] Loading weights: 58%\|███████████████████████████████████████████████████████▊ \| 86/148 [00:00<00:00, 3749.70it/s, Materializing param=model.layers.9.conv.out_proj.weight] Loading weights: 59%\|███████████████████████████████████████████████████████▎ \| 87/148 [00:00<00:00, 3775.25it/s, Materializing param=model.layers.9.feed_forward.w1.weight] Loading weights: 59%\|███████████████████████████████████████████████████████▎ \| 87/148 [00:00<00:00, 3762.10it/s, Materializing param=model.layers.9.feed_forward.w1.weight] Loading weights: 59%\|███████████████████████████████████████████████████████▉ \| 88/148 [00:00<00:00, 3787.57it/s, Materializing param=model.layers.9.feed_forward.w2.weight] Loading weights: 59%\|███████████████████████████████████████████████████████▉ \| 88/148 [00:00<00:00, 3774.56it/s, Materializing param=model.layers.9.feed_forward.w2.weight] Loading weights: 60%\|████████████████████████████████████████████████████████▌ \| 89/148 [00:00<00:00, 3800.04it/s, Materializing param=model.layers.9.feed_forward.w3.weight] Loading weights: 60%\|████████████████████████████████████████████████████████▌ \| 89/148 [00:00<00:00, 3787.16it/s, Materializing param=model.layers.9.feed_forward.w3.weight] Loading weights: 61%\|█████████████████████████████████████████████████████████████▍ \| 90/148 [00:00<00:00, 3812.23it/s, Materializing param=model.layers.9.ffn_norm.weight] Loading weights: 61%\|█████████████████████████████████████████████████████████████▍ \| 90/148 [00:00<00:00, 3799.46it/s, Materializing param=model.layers.9.ffn_norm.weight] Loading weights: 61%\|███████████████████████████████████████████████████████████ \| 91/148 [00:00<00:00, 3823.20it/s, Materializing param=model.layers.9.operator_norm.weight] Loading weights: 61%\|███████████████████████████████████████████████████████████ \| 91/148 [00:00<00:00, 3810.11it/s, Materializing param=model.layers.9.operator_norm.weight] Loading weights: 62%\|█████████████████████████████████████████████████████████▊ \| 92/148 [00:00<00:00, 3834.79it/s, Materializing param=model.layers.10.feed_forward.w1.weight] Loading weights: 62%\|█████████████████████████████████████████████████████████▊ \| 92/148 [00:00<00:00, 3822.11it/s, Materializing param=model.layers.10.feed_forward.w1.weight] Loading weights: 63%\|██████████████████████████████████████████████████████████▍ \| 93/148 [00:00<00:00, 3846.28it/s, Materializing param=model.layers.10.feed_forward.w2.weight] Loading weights: 63%\|██████████████████████████████████████████████████████████▍ \| 93/148 [00:00<00:00, 3833.58it/s, Materializing param=model.layers.10.feed_forward.w2.weight] Loading weights: 64%\|███████████████████████████████████████████████████████████ \| 94/148 [00:00<00:00, 3855.13it/s, Materializing param=model.layers.10.feed_forward.w3.weight] Loading weights: 64%\|███████████████████████████████████████████████████████████ \| 94/148 [00:00<00:00, 3841.99it/s, Materializing param=model.layers.10.feed_forward.w3.weight] Loading weights: 64%\|████████████████████████████████████████████████████████████████▏ \| 95/148 [00:00<00:00, 3865.83it/s, Materializing param=model.layers.10.ffn_norm.weight] Loading weights: 64%\|████████████████████████████████████████████████████████████████▏ \| 95/148 [00:00<00:00, 3853.31it/s, Materializing param=model.layers.10.ffn_norm.weight] Loading weights: 65%\|█████████████████████████████████████████████████████████████▌ \| 96/148 [00:00<00:00, 3877.26it/s, Materializing param=model.layers.10.operator_norm.weight] Loading weights: 65%\|█████████████████████████████████████████████████████████████▌ \| 96/148 [00:00<00:00, 3864.68it/s, Materializing param=model.layers.10.operator_norm.weight] Loading weights: 66%\|█████████████████████████████████████████████████████████ \| 97/148 [00:00<00:00, 3887.44it/s, Materializing param=model.layers.10.self_attn.k_layernorm.weight] Loading weights: 66%\|█████████████████████████████████████████████████████████ \| 97/148 [00:00<00:00, 3874.85it/s, Materializing param=model.layers.10.self_attn.k_layernorm.weight] Loading weights: 66%\|████████████████████████████████████████████████████████████▉ \| 98/148 [00:00<00:00, 3897.94it/s, Materializing param=model.layers.10.self_attn.k_proj.weight] Loading weights: 66%\|████████████████████████████████████████████████████████████▉ \| 98/148 [00:00<00:00, 3885.56it/s, Materializing param=model.layers.10.self_attn.k_proj.weight] Loading weights: 67%\|████████████████████████████████████████████████████████████▏ \| 99/148 [00:00<00:00, 3908.73it/s, Materializing param=model.layers.10.self_attn.out_proj.weight] Loading weights: 67%\|████████████████████████████████████████████████████████████▏ \| 99/148 [00:00<00:00, 3896.44it/s, Materializing param=model.layers.10.self_attn.out_proj.weight] Loading weights: 68%\|██████████████████████████████████████████████████████████ \| 100/148 [00:00<00:00, 3918.99it/s, Materializing param=model.layers.10.self_attn.q_layernorm.weight] Loading weights: 68%\|██████████████████████████████████████████████████████████ \| 100/148 [00:00<00:00, 3906.66it/s, Materializing param=model.layers.10.self_attn.q_layernorm.weight] Loading weights: 68%\|██████████████████████████████████████████████████████████████ \| 101/148 [00:00<00:00, 3929.22it/s, Materializing param=model.layers.10.self_attn.q_proj.weight] Loading weights: 68%\|██████████████████████████████████████████████████████████████ \| 101/148 [00:00<00:00, 3917.12it/s, Materializing param=model.layers.10.self_attn.q_proj.weight] Loading weights: 69%\|██████████████████████████████████████████████████████████████▋ \| 102/148 [00:00<00:00, 3939.37it/s, Materializing param=model.layers.10.self_attn.v_proj.weight] Loading weights: 69%\|██████████████████████████████████████████████████████████████▋ \| 102/148 [00:00<00:00, 3927.21it/s, Materializing param=model.layers.10.self_attn.v_proj.weight] Loading weights: 70%\|████████████████████████████████████████████████████████████████████▏ \| 103/148 [00:00<00:00, 3948.61it/s, Materializing param=model.layers.11.conv.conv.weight] Loading weights: 70%\|████████████████████████████████████████████████████████████████████▏ \| 103/148 [00:00<00:00, 3936.38it/s, Materializing param=model.layers.11.conv.conv.weight] Loading weights: 70%\|██████████████████████████████████████████████████████████████████▊ \| 104/148 [00:00<00:00, 3958.15it/s, Materializing param=model.layers.11.conv.in_proj.weight] Loading weights: 70%\|██████████████████████████████████████████████████████████████████▊ \| 104/148 [00:00<00:00, 3946.01it/s, Materializing param=model.layers.11.conv.in_proj.weight] Loading weights: 71%\|██████████████████████████████████████████████████████████████████▋ \| 105/148 [00:00<00:00, 3967.58it/s, Materializing param=model.layers.11.conv.out_proj.weight] Loading weights: 71%\|██████████████████████████████████████████████████████████████████▋ \| 105/148 [00:00<00:00, 3955.47it/s, Materializing param=model.layers.11.conv.out_proj.weight] Loading weights: 72%\|█████████████████████████████████████████████████████████████████▉ \| 106/148 [00:00<00:00, 3976.78it/s, Materializing param=model.layers.11.feed_forward.w1.weight] Loading weights: 72%\|█████████████████████████████████████████████████████████████████▉ \| 106/148 [00:00<00:00, 3964.83it/s, Materializing param=model.layers.11.feed_forward.w1.weight] Loading weights: 72%\|██████████████████████████████████████████████████████████████████▌ \| 107/148 [00:00<00:00, 3985.56it/s, Materializing param=model.layers.11.feed_forward.w2.weight] Loading weights: 72%\|██████████████████████████████████████████████████████████████████▌ \| 107/148 [00:00<00:00, 3973.64it/s, Materializing param=model.layers.11.feed_forward.w2.weight] Loading weights: 73%\|███████████████████████████████████████████████████████████████████▏ \| 108/148 [00:00<00:00, 3994.26it/s, Materializing param=model.layers.11.feed_forward.w3.weight] Loading weights: 73%\|███████████████████████████████████████████████████████████████████▏ \| 108/148 [00:00<00:00, 3982.32it/s, Materializing param=model.layers.11.feed_forward.w3.weight] Loading weights: 74%\|████████████████████████████████████████████████████████████████████████▉ \| 109/148 [00:00<00:00, 4002.41it/s, Materializing param=model.layers.11.ffn_norm.weight] Loading weights: 74%\|████████████████████████████████████████████████████████████████████████▉ \| 109/148 [00:00<00:00, 3990.50it/s, Materializing param=model.layers.11.ffn_norm.weight] Loading weights: 74%\|█████████████████████████████████████████████████████████████████████▊ \| 110/148 [00:00<00:00, 4011.49it/s, Materializing param=model.layers.11.operator_norm.weight] Loading weights: 74%\|█████████████████████████████████████████████████████████████████████▊ \| 110/148 [00:00<00:00, 3999.74it/s, Materializing param=model.layers.11.operator_norm.weight] Loading weights: 75%\|█████████████████████████████████████████████████████████████████████ \| 111/148 [00:00<00:00, 4020.66it/s, Materializing param=model.layers.12.feed_forward.w1.weight] Loading weights: 75%\|█████████████████████████████████████████████████████████████████████ \| 111/148 [00:00<00:00, 4009.09it/s, Materializing param=model.layers.12.feed_forward.w1.weight] Loading weights: 76%\|█████████████████████████████████████████████████████████████████████▌ \| 112/148 [00:00<00:00, 4029.53it/s, Materializing param=model.layers.12.feed_forward.w2.weight] Loading weights: 76%\|█████████████████████████████████████████████████████████████████████▌ \| 112/148 [00:00<00:00, 4017.91it/s, Materializing param=model.layers.12.feed_forward.w2.weight] Loading weights: 76%\|██████████████████████████████████████████████████████████████████████▏ \| 113/148 [00:00<00:00, 4038.28it/s, Materializing param=model.layers.12.feed_forward.w3.weight] Loading weights: 76%\|██████████████████████████████████████████████████████████████████████▏ \| 113/148 [00:00<00:00, 4026.68it/s, Materializing param=model.layers.12.feed_forward.w3.weight] Loading weights: 77%\|████████████████████████████████████████████████████████████████████████████▎ \| 114/148 [00:00<00:00, 4046.71it/s, Materializing param=model.layers.12.ffn_norm.weight] Loading weights: 77%\|████████████████████████████████████████████████████████████████████████████▎ \| 114/148 [00:00<00:00, 4035.30it/s, Materializing param=model.layers.12.ffn_norm.weight] Loading weights: 78%\|█████████████████████████████████████████████████████████████████████████ \| 115/148 [00:00<00:00, 4053.25it/s, Materializing param=model.layers.12.operator_norm.weight] Loading weights: 78%\|█████████████████████████████████████████████████████████████████████████ \| 115/148 [00:00<00:00, 4041.30it/s, Materializing param=model.layers.12.operator_norm.weight] Loading weights: 78%\|███████████████████████████████████████████████████████████████████▍ \| 116/148 [00:00<00:00, 4061.09it/s, Materializing param=model.layers.12.self_attn.k_layernorm.weight] Loading weights: 78%\|███████████████████████████████████████████████████████████████████▍ \| 116/148 [00:00<00:00, 4049.57it/s, Materializing param=model.layers.12.self_attn.k_layernorm.weight] Loading weights: 79%\|███████████████████████████████████████████████████████████████████████▉ \| 117/148 [00:00<00:00, 4068.97it/s, Materializing param=model.layers.12.self_attn.k_proj.weight] Loading weights: 79%\|███████████████████████████████████████████████████████████████████████▉ \| 117/148 [00:00<00:00, 4057.66it/s, Materializing param=model.layers.12.self_attn.k_proj.weight] Loading weights: 80%\|██████████████████████████████████████████████████████████████████████▉ \| 118/148 [00:00<00:00, 4076.77it/s, Materializing param=model.layers.12.self_attn.out_proj.weight] Loading weights: 80%\|██████████████████████████████████████████████████████████████████████▉ \| 118/148 [00:00<00:00, 4065.45it/s, Materializing param=model.layers.12.self_attn.out_proj.weight] Loading weights: 80%\|█████████████████████████████████████████████████████████████████████▏ \| 119/148 [00:00<00:00, 4084.44it/s, Materializing param=model.layers.12.self_attn.q_layernorm.weight] Loading weights: 80%\|█████████████████████████████████████████████████████████████████████▏ \| 119/148 [00:00<00:00, 4073.10it/s, Materializing param=model.layers.12.self_attn.q_layernorm.weight] Loading weights: 81%\|█████████████████████████████████████████████████████████████████████████▊ \| 120/148 [00:00<00:00, 4091.94it/s, Materializing param=model.layers.12.self_attn.q_proj.weight] Loading weights: 81%\|█████████████████████████████████████████████████████████████████████████▊ \| 120/148 [00:00<00:00, 4079.93it/s, Materializing param=model.layers.12.self_attn.q_proj.weight] Loading weights: 82%\|██████████████████████████████████████████████████████████████████████████▍ \| 121/148 [00:00<00:00, 4098.41it/s, Materializing param=model.layers.12.self_attn.v_proj.weight] Loading weights: 82%\|██████████████████████████████████████████████████████████████████████████▍ \| 121/148 [00:00<00:00, 4087.19it/s, Materializing param=model.layers.12.self_attn.v_proj.weight] Loading weights: 82%\|████████████████████████████████████████████████████████████████████████████████▊ \| 122/148 [00:00<00:00, 4105.63it/s, Materializing param=model.layers.13.conv.conv.weight] Loading weights: 82%\|████████████████████████████████████████████████████████████████████████████████▊ \| 122/148 [00:00<00:00, 4094.36it/s, Materializing param=model.layers.13.conv.conv.weight] Loading weights: 83%\|██████████████████████████████████████████████████████████████████████████████▉ \| 123/148 [00:00<00:00, 4112.39it/s, Materializing param=model.layers.13.conv.in_proj.weight] Loading weights: 83%\|██████████████████████████████████████████████████████████████████████████████▉ \| 123/148 [00:00<00:00, 4101.24it/s, Materializing param=model.layers.13.conv.in_proj.weight] Loading weights: 84%\|██████████████████████████████████████████████████████████████████████████████▊ \| 124/148 [00:00<00:00, 4119.59it/s, Materializing param=model.layers.13.conv.out_proj.weight] Loading weights: 84%\|██████████████████████████████████████████████████████████████████████████████▊ \| 124/148 [00:00<00:00, 4108.46it/s, Materializing param=model.layers.13.conv.out_proj.weight] Loading weights: 84%\|█████████████████████████████████████████████████████████████████████████████▋ \| 125/148 [00:00<00:00, 4126.63it/s, Materializing param=model.layers.13.feed_forward.w1.weight] Loading weights: 84%\|█████████████████████████████████████████████████████████████████████████████▋ \| 125/148 [00:00<00:00, 4115.78it/s, Materializing param=model.layers.13.feed_forward.w1.weight] Loading weights: 85%\|██████████████████████████████████████████████████████████████████████████████▎ \| 126/148 [00:00<00:00, 4134.16it/s, Materializing param=model.layers.13.feed_forward.w2.weight] Loading weights: 85%\|██████████████████████████████████████████████████████████████████████████████▎ \| 126/148 [00:00<00:00, 4122.68it/s, Materializing param=model.layers.13.feed_forward.w2.weight] Loading weights: 86%\|██████████████████████████████████████████████████████████████████████████████▉ \| 127/148 [00:00<00:00, 4140.51it/s, Materializing param=model.layers.13.feed_forward.w3.weight] Loading weights: 86%\|██████████████████████████████████████████████████████████████████████████████▉ \| 127/148 [00:00<00:00, 4129.76it/s, Materializing param=model.layers.13.feed_forward.w3.weight] Loading weights: 86%\|█████████████████████████████████████████████████████████████████████████████████████▌ \| 128/148 [00:00<00:00, 4147.64it/s, Materializing param=model.layers.13.ffn_norm.weight] Loading weights: 86%\|█████████████████████████████████████████████████████████████████████████████████████▌ \| 128/148 [00:00<00:00, 4136.90it/s, Materializing param=model.layers.13.ffn_norm.weight] Loading weights: 87%\|█████████████████████████████████████████████████████████████████████████████████▉ \| 129/148 [00:00<00:00, 4154.85it/s, Materializing param=model.layers.13.operator_norm.weight] Loading weights: 87%\|█████████████████████████████████████████████████████████████████████████████████▉ \| 129/148 [00:00<00:00, 4144.16it/s, Materializing param=model.layers.13.operator_norm.weight] Loading weights: 88%\|████████████████████████████████████████████████████████████████████████████████▊ \| 130/148 [00:00<00:00, 4162.16it/s, Materializing param=model.layers.14.feed_forward.w1.weight] Loading weights: 88%\|████████████████████████████████████████████████████████████████████████████████▊ \| 130/148 [00:00<00:00, 4151.42it/s, Materializing param=model.layers.14.feed_forward.w1.weight] Loading weights: 89%\|█████████████████████████████████████████████████████████████████████████████████▍ \| 131/148 [00:00<00:00, 4169.00it/s, Materializing param=model.layers.14.feed_forward.w2.weight] Loading weights: 89%\|█████████████████████████████████████████████████████████████████████████████████▍ \| 131/148 [00:00<00:00, 4157.80it/s, Materializing param=model.layers.14.feed_forward.w2.weight] Loading weights: 89%\|██████████████████████████████████████████████████████████████████████████████████ \| 132/148 [00:00<00:00, 4174.88it/s, Materializing param=model.layers.14.feed_forward.w3.weight] Loading weights: 89%\|██████████████████████████████████████████████████████████████████████████████████ \| 132/148 [00:00<00:00, 4164.33it/s, Materializing param=model.layers.14.feed_forward.w3.weight] Loading weights: 90%\|████████████████████████████████████████████████████████████████████████████████████████▉ \| 133/148 [00:00<00:00, 4181.35it/s, Materializing param=model.layers.14.ffn_norm.weight] Loading weights: 90%\|████████████████████████████████████████████████████████████████████████████████████████▉ \| 133/148 [00:00<00:00, 4170.82it/s, Materializing param=model.layers.14.ffn_norm.weight] Loading weights: 91%\|█████████████████████████████████████████████████████████████████████████████████████ \| 134/148 [00:00<00:00, 4187.99it/s, Materializing param=model.layers.14.operator_norm.weight] Loading weights: 91%\|█████████████████████████████████████████████████████████████████████████████████████ \| 134/148 [00:00<00:00, 4177.62it/s, Materializing param=model.layers.14.operator_norm.weight] Loading weights: 91%\|██████████████████████████████████████████████████████████████████████████████▍ \| 135/148 [00:00<00:00, 4194.74it/s, Materializing param=model.layers.14.self_attn.k_layernorm.weight] Loading weights: 91%\|██████████████████████████████████████████████████████████████████████████████▍ \| 135/148 [00:00<00:00, 4184.32it/s, Materializing param=model.layers.14.self_attn.k_layernorm.weight] Loading weights: 92%\|███████████████████████████████████████████████████████████████████████████████████▌ \| 136/148 [00:00<00:00, 4199.80it/s, Materializing param=model.layers.14.self_attn.k_proj.weight] Loading weights: 92%\|███████████████████████████████████████████████████████████████████████████████████▌ \| 136/148 [00:00<00:00, 4189.19it/s, Materializing param=model.layers.14.self_attn.k_proj.weight] Loading weights: 93%\|██████████████████████████████████████████████████████████████████████████████████▍ \| 137/148 [00:00<00:00, 4205.23it/s, Materializing param=model.layers.14.self_attn.out_proj.weight] Loading weights: 93%\|██████████████████████████████████████████████████████████████████████████████████▍ \| 137/148 [00:00<00:00, 4194.73it/s, Materializing param=model.layers.14.self_attn.out_proj.weight] Loading weights: 93%\|████████████████████████████████████████████████████████████████████████████████▏ \| 138/148 [00:00<00:00, 4210.90it/s, Materializing param=model.layers.14.self_attn.q_layernorm.weight] Loading weights: 93%\|████████████████████████████████████████████████████████████████████████████████▏ \| 138/148 [00:00<00:00, 4200.36it/s, Materializing param=model.layers.14.self_attn.q_layernorm.weight] Loading weights: 94%\|█████████████████████████████████████████████████████████████████████████████████████▍ \| 139/148 [00:00<00:00, 4216.75it/s, Materializing param=model.layers.14.self_attn.q_proj.weight] Loading weights: 94%\|█████████████████████████████████████████████████████████████████████████████████████▍ \| 139/148 [00:00<00:00, 4206.41it/s, Materializing param=model.layers.14.self_attn.q_proj.weight] Loading weights: 95%\|██████████████████████████████████████████████████████████████████████████████████████ \| 140/148 [00:00<00:00, 4222.72it/s, Materializing param=model.layers.14.self_attn.v_proj.weight] Loading weights: 95%\|██████████████████████████████████████████████████████████████████████████████████████ \| 140/148 [00:00<00:00, 4212.48it/s, Materializing param=model.layers.14.self_attn.v_proj.weight] Loading weights: 95%\|█████████████████████████████████████████████████████████████████████████████████████████████▎ \| 141/148 [00:00<00:00, 4228.85it/s, Materializing param=model.layers.15.conv.conv.weight] Loading weights: 95%\|█████████████████████████████████████████████████████████████████████████████████████████████▎ \| 141/148 [00:00<00:00, 4218.66it/s, Materializing param=model.layers.15.conv.conv.weight] Loading weights: 96%\|███████████████████████████████████████████████████████████████████████████████████████████▏ \| 142/148 [00:00<00:00, 4234.80it/s, Materializing param=model.layers.15.conv.in_proj.weight] Loading weights: 96%\|███████████████████████████████████████████████████████████████████████████████████████████▏ \| 142/148 [00:00<00:00, 4224.14it/s, Materializing param=model.layers.15.conv.in_proj.weight] Loading weights: 97%\|██████████████████████████████████████████████████████████████████████████████████████████▊ \| 143/148 [00:00<00:00, 4240.09it/s, Materializing param=model.layers.15.conv.out_proj.weight] Loading weights: 97%\|██████████████████████████████████████████████████████████████████████████████████████████▊ \| 143/148 [00:00<00:00, 4229.86it/s, Materializing param=model.layers.15.conv.out_proj.weight] Loading weights: 97%\|█████████████████████████████████████████████████████████████████████████████████████████▌ \| 144/148 [00:00<00:00, 4245.96it/s, Materializing param=model.layers.15.feed_forward.w1.weight] Loading weights: 97%\|█████████████████████████████████████████████████████████████████████████████████████████▌ \| 144/148 [00:00<00:00, 4235.99it/s, Materializing param=model.layers.15.feed_forward.w1.weight] Loading weights: 98%\|██████████████████████████████████████████████████████████████████████████████████████████▏ \| 145/148 [00:00<00:00, 4251.92it/s, Materializing param=model.layers.15.feed_forward.w2.weight] Loading weights: 98%\|██████████████████████████████████████████████████████████████████████████████████████████▏ \| 145/148 [00:00<00:00, 4241.90it/s, Materializing param=model.layers.15.feed_forward.w2.weight] Loading weights: 99%\|██████████████████████████████████████████████████████████████████████████████████████████▊ \| 146/148 [00:00<00:00, 4257.58it/s, Materializing param=model.layers.15.feed_forward.w3.weight] Loading weights: 99%\|██████████████████████████████████████████████████████████████████████████████████████████▊ \| 146/148 [00:00<00:00, 4247.46it/s, Materializing param=model.layers.15.feed_forward.w3.weight] Loading weights: 99%\|██████████████████████████████████████████████████████████████████████████████████████████████████▎\| 147/148 [00:00<00:00, 4262.80it/s, Materializing param=model.layers.15.ffn_norm.weight] Loading weights: 99%\|██████████████████████████████████████████████████████████████████████████████████████████████████▎\| 147/148 [00:00<00:00, 4252.30it/s, Materializing param=model.layers.15.ffn_norm.weight] Loading weights: 100%\|██████████████████████████████████████████████████████████████████████████████████████████████\| 148/148 [00:00<00:00, 4267.72it/s, Materializing param=model.layers.15.operator_norm.weight] Loading weights: 100%\|██████████████████████████████████████████████████████████████████████████████████████████████\| 148/148 [00:00<00:00, 4257.88it/s, Materializing param=model.layers.15.operator_norm.weight] Loading weights: 100%\|██████████████████████████████████████████████████████████████████████████████████████████████\| 148/148 [00:00<00:00, 4241.10it/s, Materializing param=model.layers.15.operator_norm.weight]
	[2026-02-08 20:44:36,298] [WARNING] [accelerate.utils.dataclasses.__post_init__:1962] [PID:10500] sync_module_states is obsolete in FSDP2, as it is not needed anymore.Setting sync_module_states to None.Multiple deprecation warnings due to FSDP2 conversion:
	sharding_strategy is deprecated in favor of reshard_after_forward. This will be removed in a future version of Accelerate.
	[2026-02-08 20:44:37,935] [WARNING] [py.warnings._showwarnmsg:110] [PID:10500] /root/axolotl/.venv/lib/python3.12/site-packages/torch/distributed/distributed_c10d.py:4807: UserWarning: No device id is provided via `init_process_group` or `barrier `. Using the current device set by the user.
	warnings.warn( # warn only once

	[0m