apertus-electronics-hw-lora / adapter_config.json
clemsail's picture
upload eu-kiki LoRA adapter
423eed7 verified
Raw
History Blame Contribute Delete
268 Bytes
{
"fine_tune_type": "lora",
"lora_parameters": {
"rank": 16,
"alpha": 32,
"dropout": 0.05,
"scale": 2.0
},
"num_layers": 16,
"lora_layers": [
"self_attn.q_proj",
"self_attn.k_proj",
"self_attn.v_proj",
"self_attn.o_proj"
]
}