maximedb
/

twentle-gemma-4-merged-r256-from-pretrain-silver-bf16-2-q4

4-bit precision

Model card Files Files and versions

twentle-gemma-4-merged-r256-from-pretrain-silver-bf16-2-q4

19.2 GB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

maximedb's picture

Flatten quantized model to repo root for vLLM loading

449fd52 verified 3 months ago

.gitattributes

1.68 kB
Upload folder using huggingface_hub 3 months ago
chat_template.jinja

17 kB
Upload folder using huggingface_hub 3 months ago
config.json

5.1 kB
Flatten quantized model to repo root for vLLM loading 3 months ago
generation_config.json

204 Bytes
Flatten quantized model to repo root for vLLM loading 3 months ago
model-00001-of-00005.safetensors

4.29 GB
xet

Flatten quantized model to repo root for vLLM loading 3 months ago
model-00002-of-00005.safetensors

4.26 GB
xet

Flatten quantized model to repo root for vLLM loading 3 months ago
model-00003-of-00005.safetensors

4.26 GB
xet

Flatten quantized model to repo root for vLLM loading 3 months ago
model-00004-of-00005.safetensors

3.56 GB
xet

Flatten quantized model to repo root for vLLM loading 3 months ago
model-00005-of-00005.safetensors

2.83 GB
xet

Flatten quantized model to repo root for vLLM loading 3 months ago
model.safetensors.index.json

200 kB
Flatten quantized model to repo root for vLLM loading 3 months ago
quantization_config.json

260 Bytes
Flatten quantized model to repo root for vLLM loading 3 months ago
tokenizer.json

32.2 MB
xet

Flatten quantized model to repo root for vLLM loading 3 months ago
tokenizer_config.json

2.75 kB
Flatten quantized model to repo root for vLLM loading 3 months ago