Instructions to use mlc-ai/Qwen1.5-1.8B-Chat-q4f16_1-MLC with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLC-LLM
How to use mlc-ai/Qwen1.5-1.8B-Chat-q4f16_1-MLC with MLC-LLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Update mlc-chat-config.json
Browse files- mlc-chat-config.json +1 -1
mlc-chat-config.json
CHANGED
|
@@ -43,7 +43,7 @@
|
|
| 43 |
},
|
| 44 |
"conv_template": {
|
| 45 |
"name": "chatml",
|
| 46 |
-
"system_template": "<|im_start|>system\n{system_message}",
|
| 47 |
"system_message": "A conversation between a user and an LLM-based AI assistant. The assistant gives helpful and honest answers.",
|
| 48 |
"system_prefix_token_ids": null,
|
| 49 |
"add_role_after_system_message": true,
|
|
|
|
| 43 |
},
|
| 44 |
"conv_template": {
|
| 45 |
"name": "chatml",
|
| 46 |
+
"system_template": "<|im_start|>system\n{system_message}<|im_end|>\n",
|
| 47 |
"system_message": "A conversation between a user and an LLM-based AI assistant. The assistant gives helpful and honest answers.",
|
| 48 |
"system_prefix_token_ids": null,
|
| 49 |
"add_role_after_system_message": true,
|