Excellent work on this, sir!
#2
by jreoka - opened
I love models like this!
Thanks @dillfrescott! :)
I agree, this model at Q6_K is just amazing!! I like it even more than Dolphin Mixtral 8x7B at Q4_K_M. Definitely punches WAYY above its weight, just like Alpha Monarch. My new favourite model already!
Fantastic, happy to get some feedback on where it performs well or not if you have time @siddhesh22!