Nhoodie commited on
Commit
9cac33c
·
verified ·
1 Parent(s): 95ab771

Upload level_1/adapter_config.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. level_1/adapter_config.json +12 -0
level_1/adapter_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "rank": 16,
3
+ "alpha": 32,
4
+ "level": 1,
5
+ "target_modules": [
6
+ "att_proj",
7
+ "attn_out",
8
+ "ff_proj",
9
+ "ff_out"
10
+ ],
11
+ "in_dim_note": "level 0 = base.in_features, level 1+ = base.out_features"
12
+ }