torch
transformers>=4.36.2
gradio
accelerate>=0.26.0
safetensors
optimum
auto-gptq