# Perplexity Benchmark Results ## Summary Total quantizations tested: 11 ## Results Table | Quantization | Perplexity | |--------------|------------| | IQ1_M | 6.9990 | | IQ2_XXS | 5.5370 | | IQ2_XS | 5.0865 | | IQ2_S | 4.9916 | | Q2_K | 4.7576 | | Q3_K_M | 4.0544 | | Q4_K_M | 3.8952 | | Q5_K_M | 3.8483 | | Q6_K | 3.8181 | | Q8_0 | 3.8140 | | F16 | 3.8197 | ## Analysis - **Best (lowest) perplexity**: Q8_0 with PPL = 3.8140 - **Worst (highest) perplexity**: IQ1_M with PPL = 6.9990 - **Perplexity range**: 3.8140 - 6.9990