--- license: apache-2.0 base_model: aimeri/spoomplesmaxx-thrasher-24B library_name: gguf pipeline_tag: text-generation tags: - roleplay - creative-writing - chatml language: - en --- # spoomplesmaxx-thrasher-24B — GGUF (static) Static GGUF quants of [spoomplesmaxx-thrasher-24B](https://huggingface.co/aimeri/spoomplesmaxx-thrasher-24B) ("Thrash Metal", mimids 02). ChatML template embedded — llama.cpp picks it up without ceremony. See the main card for the full story: the token surgery that put ChatML on a Mistral base, the checkpoint-selection battery, and the measured sampler guidance. ``` spoomplesmaxx-thrasher-24B.Q5_K_M.gguf ~16.8 GB quality pick spoomplesmaxx-thrasher-24B.Q4_K_M.gguf ~14.3 GB the 24GB-card sweet spot spoomplesmaxx-thrasher-24B.Q3_K_M.gguf ~11.5 GB fits 12GB with room for ctx ``` Sampler (swept on the full-precision model): **temperature 1.0 · min_p 0.05**. A mild repetition_penalty 1.05 eliminated the verbatim-loop tail in our sweep at the cost of a rare unfinished turn — a reasonable opt-in here, unlike on mockingbird. imatrix quants: coming in a separate repo — prefer those at 3–4 bit once live. *For adults. Stays in character by design; bring your own moderation. Apache 2.0.*