open-sci
/

open-sci-ref-v0.02-1.7b-mixturevitae-noinstruct-300B-4096-longsft_16k

Model card Files Files and versions

open-sci-ref-v0.02-1.7b-mixturevitae-noinstruct-300B-4096-longsft_16k / config.json

Commit History

Fix max_position_embeddings: cast float artifact from YaRN scaling to int

4d5d195
verified

Harsh1729 commited on 7 days ago

Fix auto_map: use local modeling_opensci.py instead of cross-repo reference to base checkpoint

31b232e
verified

Harsh1729 commited on 8 days ago

Upload 16k long-context extension (NeurIPS rebuttal 2x2 grid, 300B base)

c95e8f7
verified

Harsh1729 commited on 16 days ago