Example PR: Using 2048 as example dim. DO NOT MERGE
#30
by michaelfeil - opened
Load with --revision refs/pr/30 to use this PR
e.g.
docker run \
--gpus "0" -p "7997":"7997" \
michaelf34/infinity:latest \
v2 --model-id dunzhang/stella_en_400M_v5 --revision "refs/pr/30" --dtype bfloat16 --batch-size 16 --device cuda --engine torch --port 7997 --no-bettertransformer
DO NOT MERGE
michaelfeil changed pull request title from Example PR: Using 2048 as to Example PR: Using 2048 as example dim. DO NOT MERGE
infgrad changed pull request status to merged