Wow
#1
by qqeyes - opened
This thing rips, haven’t done extended testing yet but it performs great so far. Amazing work!
https://huggingface.co/madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid will be much better. It just ran 88.4 on GPQA Diamond
the v2 docker image is up with updated kernel and decode speed please use https://huggingface.co/madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid its the best tp4 GLM-5.2 I have been able to run
I’m going to try it right now thanks!