Create evaluation_reports/mixtral_eval.md
Browse files
evaluation_reports/mixtral_eval.md
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Mixtral 8x7B - Fallback Model Evaluation
|
| 2 |
+
|
| 3 |
+
**Status**: APPROVED (Fallback Only)
|
| 4 |
+
|
| 5 |
+
- Hallucination: 12% (acceptable for fallback)
|
| 6 |
+
- - Latency P95: 2200ms
|
| 7 |
+
- - Cost: $0.0000015 per 1K tokens
|
| 8 |
+
- - Use Case: Primary model unavailable
|
| 9 |
+
|
| 10 |
+
- **Recommendation**: Approved for automatic failover.
|