Instructions to use HanzoHuang/Qwen2.5-1.5B-Instruct-RKLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use HanzoHuang/Qwen2.5-1.5B-Instruct-RKLLM with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Upload folder using huggingface_hub
Browse files
.gitattributes
CHANGED
|
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
RK3576/Qwen2.5-1.5B-Instruct_w4a16_RK3576.rkllm filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
RK3576/Qwen2.5-1.5B-Instruct_w8a8_RK3576.rkllm filter=lfs diff=lfs merge=lfs -text
|
RK3576/Qwen2.5-1.5B-Instruct_w4a16_RK3576.rkllm
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:70b4b3c54221892cc403aa877612e0bfdc24abeda5e0011ee3a2e9a3c24e332c
|
| 3 |
+
size 1410933676
|
RK3576/Qwen2.5-1.5B-Instruct_w8a8_RK3576.rkllm
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2ab655ca7e6a3d3626a9a93e69a3a95660cedd7d4820ddf041371b45f4a6c94
|
| 3 |
+
size 2064864940
|