How to use Felladrin/onnx-Llama-68M-Chat-v1 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'Felladrin/onnx-Llama-68M-Chat-v1');
INT8 ONNX version of Felladrin/Llama-68M-Chat-v1 to use with Transformers.js.
Base model
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'Felladrin/onnx-Llama-68M-Chat-v1');