Instructions to use Felladrin/onnx-bloomz-560m-sft-chat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use Felladrin/onnx-bloomz-560m-sft-chat with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'Felladrin/onnx-bloomz-560m-sft-chat');
Transformers.js - Enable external data format in Node.js (#1)
Browse files- Transformers.js - Enable external data format in Node.js (c964adaa69c7feeff77d4ece5ed97c7d61ea683a)
Co-authored-by: Joshua <Xenova@users.noreply.huggingface.co>
- config.json +7 -2
config.json
CHANGED
|
@@ -27,5 +27,10 @@
|
|
| 27 |
"transformers_version": "4.35.2",
|
| 28 |
"unk_token_id": 0,
|
| 29 |
"use_cache": true,
|
| 30 |
-
"vocab_size": 250880
|
| 31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
"transformers_version": "4.35.2",
|
| 28 |
"unk_token_id": 0,
|
| 29 |
"use_cache": true,
|
| 30 |
+
"vocab_size": 250880,
|
| 31 |
+
"transformers.js_config": {
|
| 32 |
+
"use_external_data_format": {
|
| 33 |
+
"decoder_model_merged.onnx": true
|
| 34 |
+
}
|
| 35 |
+
}
|
| 36 |
+
}
|