---
license: apache-2.0
language:
- en
datasets:
- allenai/c4
tags:
- pytorch
- gpt
- yat-pn-alpha
- 261M
- chinchilla
- ablation
- seed1
library_name: transformers
---

# yat-pn+α 261M (d=12) — seed 1

Reproducibility seed for the [`yat-pn+α 261M`](https://huggingface.co/mlnomad/yatnmn-softplus-d12-chinchilla-261M-pytorch) ablation
(seed 0 is the canonical published checkpoint). Same architecture, same data, same
hyper-params — only the random seed differs. Useful for variance estimation
when comparing architectures.

```python
from transformers import AutoModelForCausalLM, AutoTokenizer
m = AutoModelForCausalLM.from_pretrained(
    "mlnomad/yatnmn-softplus-d12-chinchilla-261M-seed1-pytorch",
    trust_remote_code=True,
)
tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")
```

Apache 2.0.