Would this work on Kay coder dev?
#10
by datayoda - opened
Hi! I tried it on KAT, and surprisingly it did not seem to improve that one like it does for Qwen and Ornith. The best Sharp 35b-a3b I’ve run so far is TielCoder, which is based on ornith with a custom iMat and dynamic quant in addition to this template: https://huggingface.co/peculiar-ragdoll/Tiel-Coder-35B-A3B-GGUF