2.6 GB

Ctrl+K

1 contributor

History: 1 commit

borkiss

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards

6f8979d verified about 1 month ago

lm_head_weight_part0.bin

63.8 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
lm_head_weight_part0_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
lm_head_weight_part1.bin

63.8 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
lm_head_weight_part1_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
lm_head_weight_part2.bin

63.8 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
lm_head_weight_part2_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
lm_head_weight_part3.bin

63.8 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
lm_head_weight_part3_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
manifest.json

94.1 kB
Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part0.bin

128 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part0_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part1.bin

128 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part1_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part2.bin

128 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part2_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part3.bin

128 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_embed_tokens_weight_part3_scales.bin

7.97 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_input_layernorm_weight.bin

6.14 kB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_mlp_down_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_mlp_down_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_mlp_gate_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_mlp_gate_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_mlp_up_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_mlp_up_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_post_attention_layernorm_weight.bin

6.14 kB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_self_attn_o_proj_weight.bin

9.44 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_self_attn_o_proj_weight_scales.bin

1.18 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_self_attn_qkv_proj_weight.bin

12.6 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_0_self_attn_qkv_proj_weight_scales.bin

1.57 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_input_layernorm_weight.bin

6.14 kB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_mlp_down_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_mlp_down_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_mlp_gate_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_mlp_gate_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_mlp_up_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_mlp_up_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_post_attention_layernorm_weight.bin

6.14 kB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_self_attn_o_proj_weight.bin

9.44 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_self_attn_o_proj_weight_scales.bin

1.18 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_self_attn_qkv_proj_weight.bin

12.6 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_10_self_attn_qkv_proj_weight_scales.bin

1.57 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_input_layernorm_weight.bin

6.14 kB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_mlp_down_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_mlp_down_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_mlp_gate_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_mlp_gate_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_mlp_up_proj_weight.bin

16.5 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_mlp_up_proj_weight_scales.bin

2.06 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_post_attention_layernorm_weight.bin

6.14 kB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago
model_layers_11_self_attn_o_proj_weight.bin

9.44 MB
xet

Q4 group32 with Q8 embeddings; shared physical layers, browser-native shards about 1 month ago