fastapi
uvicorn
torch
git+https://github.com/huggingface/transformers.git
pydantic
accelerate
bitsandbytes
protobuf
sentencepiece