jevon / runs /jevon-final /config.json
lewislululu's picture
Jevon: a 20M-parameter decision model for Maze and Snake
97f78c9
Raw History Blame Contribute Delete
396 Bytes
{
"vocab_size": 497,
"d_model": 384,
"n_heads": 6,
"prefix_layers": 6,
"candidate_layers": 2,
"set_layers": 2,
"ffn_mult": 4,
"dropout": 0.1,
"max_prefix_len": 320,
"max_candidate_len": 48,
"grid_channels": 8,
"planner_dim": 96,
"planner_blocks": 2,
"planner_grad_steps": 8,
"local_patch": 5,
"use_planner": true,
"expose_field": true,
"min_plus_field": true
}