generation_config.json · tellang/yeji-4b-rslora-v8-AWQ-fixed at main

yeji-4b-rslora-v8-AWQ-fixed / generation_config.json

tellang's picture

AWQ W4A16 symmetric - vLLM 0.13.0 compatible (Segfault fixed)

2e5f0ab verified 7 months ago

History Blame Contribute Delete

121 Bytes

	{
	"_from_model_config": true,
	"eos_token_id": 151645,
	"pad_token_id": 151654,
	"transformers_version": "4.57.3"
	}