Add StartLux-Decision-35B-A3B to the sizes, the comparison table and the figures
Browse files- README.md +2 -1
- assets/di_chart.png +2 -2
- assets/hero.png +2 -2
- assets/latency.png +2 -2
README.md
CHANGED
|
@@ -16,7 +16,7 @@ StartLux-Decision-27B answers typed questions about a state: pick one of several
|
|
| 16 |
question comes back with a probability for each option. Requests and responses use the TypeSafe `/v1/systemone`
|
| 17 |
format, so clients written for Jev work unchanged.
|
| 18 |
|
| 19 |
-
Sizes: [0.8B](https://huggingface.co/startlux-models/StartLux-Decision-0.8B) 路 [2B](https://huggingface.co/startlux-models/StartLux-Decision-2B) 路 [4B](https://huggingface.co/startlux-models/StartLux-Decision-4B) 路 [9B](https://huggingface.co/startlux-models/StartLux-Decision-9B) 路 **27B**
|
| 20 |
|
| 21 |
## Results
|
| 22 |
|
|
@@ -47,6 +47,7 @@ Latency is end to end over HTTP on one H200 in bf16, one request at a time.
|
|
| 47 |
|
| 48 |
| Model | JevBench public, of 231 | Intern avg | DI 0.2 / 0.2.1 | Latency, 3 questions |
|
| 49 |
|:---:|:---:|:---:|:---:|:---:|
|
|
|
|
| 50 |
| **StartLux-Decision-27B** | 208 | 91.82 | 59.54 / 63.88 | 102.3 ms |
|
| 51 |
| StartLux-Decision-9B | 201 | 91.08 | 54.37 / 58.63 | 35.7 ms |
|
| 52 |
| StartLux-Decision-4B | 204 | 91.17 | 48.38 / 52.75 | 26.0 ms |
|
|
|
|
| 16 |
question comes back with a probability for each option. Requests and responses use the TypeSafe `/v1/systemone`
|
| 17 |
format, so clients written for Jev work unchanged.
|
| 18 |
|
| 19 |
+
Sizes: [0.8B](https://huggingface.co/startlux-models/StartLux-Decision-0.8B) 路 [2B](https://huggingface.co/startlux-models/StartLux-Decision-2B) 路 [4B](https://huggingface.co/startlux-models/StartLux-Decision-4B) 路 [9B](https://huggingface.co/startlux-models/StartLux-Decision-9B) 路 **27B** 路 [35B-A3B](https://huggingface.co/startlux-models/StartLux-Decision-35B-A3B)
|
| 20 |
|
| 21 |
## Results
|
| 22 |
|
|
|
|
| 47 |
|
| 48 |
| Model | JevBench public, of 231 | Intern avg | DI 0.2 / 0.2.1 | Latency, 3 questions |
|
| 49 |
|:---:|:---:|:---:|:---:|:---:|
|
| 50 |
+
| StartLux-Decision-35B-A3B | 210 | 92.29 | 57.24 / 61.55 | 52.5 ms |
|
| 51 |
| **StartLux-Decision-27B** | 208 | 91.82 | 59.54 / 63.88 | 102.3 ms |
|
| 52 |
| StartLux-Decision-9B | 201 | 91.08 | 54.37 / 58.63 | 35.7 ms |
|
| 53 |
| StartLux-Decision-4B | 204 | 91.17 | 48.38 / 52.75 | 26.0 ms |
|
assets/di_chart.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|
assets/hero.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|
assets/latency.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|