Hemmingway-1 oMLX oQe Quantizations: Apple Silicon Evidence
Six Apple Silicon oMLX builds, corrected blind-preference v1, and separate BF16-to-oQ4e fidelity, KV, and oQ4e runtime evidence v2.
Text Generation • 27B • Updated • 9k • 805Note Upstream source model by Altworld. The local BF16 reference uses these source weights; the hosted deployment's exact checkpoint and runtime are not verified.
sixstringzen/hemmingway-1-omlx-quantization-benchmark-v1
Viewer • Updated • 184 • 118Note Corrected analysis revision 2: 15 prompts per quant, 11 hosted comparison prompts, descriptive counts, execution metadata, and the correction record. Raw responses remain local.
sixstringzen/hemmingway-1-omlx-quantization-evidence-v2
Viewer • Updated • 16 • 132Note Separate teacher-forced BF16-to-oQ4e distribution and KV-cache summaries, plus controlled oQ4e runtime telemetry on Apple Silicon. It complements the v1 blind-preference study.
sixstringzen/Hemmingway-1-oQ8e-mtp
Text Generation • 27B • Updated • 812 • 1Note oQ8e, 27.10 GiB. Corrected fixed-suite comparison with BF16: 27 wins, 22 losses, 41 ties from 90 ratings. Ties do not establish numerical equivalence.
sixstringzen/Hemmingway-1-oQ6e-mtp
Text Generation • 27B • Updated • 1.38k • 3Note oQ6e, 21.39 GiB. Corrected fixed-suite comparison with BF16: 34 wins, 19 losses, 37 ties from 90 ratings. Token-level fidelity remains unmeasured.
sixstringzen/Hemmingway-1-oQ4e-mtp
Text Generation • 27B • Updated • 1.26k • 1Note oQ4e, 15.21 GiB. Corrected fixed-suite comparison with BF16: 30 wins, 43 losses, 17 ties from 90 ratings. BF16 was preferred more often.
sixstringzen/Hemmingway-1-oQ3.5e-mtp
Text Generation • 27B • Updated • 769Note oQ3.5e, 13.19 GiB. Corrected fixed-suite comparison with BF16: 44 wins, 42 losses, four ties from 90 ratings. Near-even preference counts.
sixstringzen/Hemmingway-1-oQ3e-mtp
Text Generation • 27B • Updated • 728Note oQ3e, 12.22 GiB. Corrected fixed-suite comparison with BF16: 54 wins, 35 losses, one tie from 90 ratings. Highest observed quant win rate in this suite; no general superiority claim.
sixstringzen/Hemmingway-1-oQ2e-mtp
Text Generation • 27B • Updated • 676Note oQ2e, 10.14 GiB. Corrected fixed-suite comparison with BF16: 31 wins, 58 losses, one tie from 90 ratings. Smallest build; BF16 was preferred more often.