Maggio33 commited on
Commit
468f977
·
verified ·
1 Parent(s): fd47592

Add GoLLeM-v5 32M and 16M (Fabryka AI)

Browse files

Add two GoLLeM-v5 byte-level models (Fabryka AI).

- GoLLeM-v5 32M: BLiMP 73.77, ARC-Easy 44.44, WikiText-2 byte_ppl 2.5386 (16B tokens)
- GoLLeM-v5 16M: BLiMP 70.53, ARC-Easy 40.91, WikiText-2 byte_ppl 2.6746 (16B tokens)

Eval protocol: full BLiMP (73k pairs), ARC-Easy, WikiText-2-raw-v1/test byte_ppl (token_ppl over non-overlapping 256-tok windows, converted to byte_ppl via n_tok/n_byte). Checkpoints + card + eval JSONs: https://huggingface.co/SlayerLab/gollem-v5-ckpts

Org tag 'Fabryka AI' (same as Pollock 1.5 Mini LM 128M already on the board).

Files changed (1) hide show
  1. index.html +0 -0
index.html CHANGED
The diff for this file is too large to render. See raw diff