flask
torch
transformers
accelerate
bitsandbytes
auto-gptq
einops
peft
optimum
sentencepiece
scipy
gradio
safetensors
unsloth
vllm