Instructions to use taufeeque/TinyStories-1Layer-21M-Codebook with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use taufeeque/TinyStories-1Layer-21M-Codebook with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("taufeeque/TinyStories-1Layer-21M-Codebook", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "MSE": 0.0, | |
| "MSE/layer0": 0.0, | |
| "dead_code_fraction": 1.0, | |
| "dead_code_fraction/layer0": 1.0, | |
| "epoch": 10.43, | |
| "input_norm": 0.0, | |
| "input_norm/layer0": 0.0, | |
| "loss": 1.6774777018260956, | |
| "max_norm": 153.29054260253906, | |
| "max_norm/layer0": 153.29054260253906, | |
| "mean_norm": 75.17323780059814, | |
| "mean_norm/layer0": 75.17323780059814, | |
| "multicode_k": 1, | |
| "output_norm": 0.0, | |
| "output_norm/layer0": 0.0, | |
| "runtime": 132212.7109, | |
| "samples_per_second": 72.61, | |
| "steps_per_second": 0.756, | |
| "train_samples": 920563 | |
| } |