https://huggingface.co/Vortex5/G4-Dark-Soul-26B-A4B

#2727
by Vortex5 - opened

seems to be done, sorry for delay in response =)

https://hf.tst.eu/model#G4-Dark-Soul-26B-A4B-GGUF

Could you please try https://huggingface.co/Vortex5/Phoenix-X-26B-A4B again? It had a KeyError: 'global_head_dim' error, which seems like it may be on your end, as it quantized fine on my side.

It's queued! =)

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Phoenix-X-26B-A4B-GGUF for quants to appear.

Sign up or log in to comment