BDR-AI's picture
Initial commit for claims-gpt-model-registry
9fe93c4 verified
|
Raw History Blame Contribute Delete
573 Bytes

Mixtral Model Evaluation Report

Model

  • Name: Mixtral 8x7B MoE
  • Version: Instruct v0.1
  • Type: Mixture of Experts
  • Parameters: 47B (12B active)

Evaluation Results

Hallucination Testing

  • Score: 12% hallucination rate
  • Result: ⚠️ CONDITIONAL PASS (12% < 15%)

Latency

  • P95: 2200ms
  • Result: ✅ PASS (< 2500ms)

Cost

  • Cost per claim: $0.018
  • Result: ✅ PASS (< $0.02)

Recommendation

APPROVED FOR FAILOVER

Status: Secondary model (when primary P95 > 2.5s) Primary: Kimi 0905 Date: 2026-02-23