Hey, you ever thought about doing an EXL3 quant of this model? Specifically for 48gb vram? I'd do it myself, but the base model is gated.
· Sign up or log in to comment