donghyunli
/

Llama-2-13b-KronQ-W4A16

Text Generation

8-bit precision

Model card Files Files and versions

Llama-2-13b-KronQ-W4A16 / kronq_packed_config.json

donghyunli's picture

KronQ W4A16 packed int4 (L2-13B)

334bc10 verified 3 months ago

History Blame Contribute Delete

66 Bytes

	{
	"format": "kronq-packed",
	"bits": 4,
	"n_compressed": 280
	}