12B version?
#1
by serialhex - opened
Any plans to make a 12B version of this? I'm broke and only have 8GB of VRAM, so 24B would only work with extreme quants... le sigh. 12B GGUF would be perfect!
Thank you in advance!
Unfortunately that isn't possible because a 12B doesn't exist of all the merges that went into this. I would recommend ReadyArt/The-Omega-Directive-M-12B-v1.0