BDR-AI's picture
Initial commit for claims-gpt-model-registry
9fe93c4 verified
|
Raw History Blame Contribute Delete
573 Bytes
# Mixtral Model Evaluation Report
## Model
- **Name**: Mixtral 8x7B MoE
- **Version**: Instruct v0.1
- **Type**: Mixture of Experts
- **Parameters**: 47B (12B active)
## Evaluation Results
### Hallucination Testing
- **Score**: 12% hallucination rate
- **Result**: ⚠️ CONDITIONAL PASS (12% < 15%)
### Latency
- **P95**: 2200ms
- **Result**: ✅ PASS (< 2500ms)
### Cost
- **Cost per claim**: $0.018
- **Result**: ✅ PASS (< $0.02)
## Recommendation
**APPROVED FOR FAILOVER**
Status: Secondary model (when primary P95 > 2.5s)
Primary: Kimi 0905
Date: 2026-02-23