Add model card
Browse files
README.md
CHANGED
|
@@ -42,7 +42,12 @@ This model is pretrained on 30B tokens from HPLT pre-3.0 CD (per-crawl deduplica
|
|
| 42 |
|
| 43 |
## How to use
|
| 44 |
|
| 45 |
-
This repository contains
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
### Use with Transformers
|
| 48 |
|
|
|
|
| 42 |
|
| 43 |
## How to use
|
| 44 |
|
| 45 |
+
This repository contains the following intermediate checkpoints: `- `1B`
|
| 46 |
+
- `10B`
|
| 47 |
+
- `20B`
|
| 48 |
+
- `main``
|
| 49 |
+
|
| 50 |
+
The other checkpoints can be provided upon request.
|
| 51 |
|
| 52 |
### Use with Transformers
|
| 53 |
|