michael-qiu JustinTong commited on
Commit
554184d
·
1 Parent(s): ee0f7be

Trim SGLang launch command to the verified minimal recipe (#3)

Browse files

- Trim SGLang launch command to the verified minimal recipe (70b221c7331d9349645b83d52d39eab65921baf0)


Co-authored-by: Xinyuan Tong <JustinTong@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +0 -1
README.md CHANGED
@@ -70,7 +70,6 @@ docker run --rm --gpus all --ipc=host --shm-size 32g \
70
  --tp 4 \
71
  --context-length 262144 \
72
  --json-model-override-args '{"rope_scaling":{"rope_type":"yarn","factor":2.0,"rope_theta":6000000,"partial_rotary_factor":0.5,"original_max_position_embeddings":131072}}' \
73
- --mem-fraction-static 0.85 \
74
  --trust-remote-code \
75
  --reasoning-parser auto \
76
  --tool-call-parser auto \
 
70
  --tp 4 \
71
  --context-length 262144 \
72
  --json-model-override-args '{"rope_scaling":{"rope_type":"yarn","factor":2.0,"rope_theta":6000000,"partial_rotary_factor":0.5,"original_max_position_embeddings":131072}}' \
 
73
  --trust-remote-code \
74
  --reasoning-parser auto \
75
  --tool-call-parser auto \