Llama-3.1-70B-Instruct-SWAN-5bit-MLX / generation_config.json

Commit History

SWAN adaptive mixed-precision quantization (5.51 avg bits, MAD bounds)
abf7841
verified

Trevor Kennedy commited on