Instructions to use inclusionAI/Ling-3.0-flash-VL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
- HuggingChat
- Notebooks
- Google Colab
- Kaggle
Commit ·
554184d
1
Parent(s): ee0f7be
Trim SGLang launch command to the verified minimal recipe (#3)
Browse files- Trim SGLang launch command to the verified minimal recipe (70b221c7331d9349645b83d52d39eab65921baf0)
Co-authored-by: Xinyuan Tong <JustinTong@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -70,7 +70,6 @@ docker run --rm --gpus all --ipc=host --shm-size 32g \
|
|
| 70 |
--tp 4 \
|
| 71 |
--context-length 262144 \
|
| 72 |
--json-model-override-args '{"rope_scaling":{"rope_type":"yarn","factor":2.0,"rope_theta":6000000,"partial_rotary_factor":0.5,"original_max_position_embeddings":131072}}' \
|
| 73 |
-
--mem-fraction-static 0.85 \
|
| 74 |
--trust-remote-code \
|
| 75 |
--reasoning-parser auto \
|
| 76 |
--tool-call-parser auto \
|
|
|
|
| 70 |
--tp 4 \
|
| 71 |
--context-length 262144 \
|
| 72 |
--json-model-override-args '{"rope_scaling":{"rope_type":"yarn","factor":2.0,"rope_theta":6000000,"partial_rotary_factor":0.5,"original_max_position_embeddings":131072}}' \
|
|
|
|
| 73 |
--trust-remote-code \
|
| 74 |
--reasoning-parser auto \
|
| 75 |
--tool-call-parser auto \
|