qwenv2-7b-inst-imatrix-gguf / qwen7bv2inst_q4km_embedding4k_output8bit.gguf

very good quant for speed/perplexity, embedding is at q4k

3107dcd verified about 2 years ago

4.82 GB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.