Instructions to use TheBloke/vicuna-13B-v1.5-16K-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/vicuna-13B-v1.5-16K-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/vicuna-13B-v1.5-16K-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
can't load model with llama.cpp commit 519c981f8b65ee6c87c2965539685ced0a17223b
5
#6 opened about 3 years ago
by
md2
LLM just keep repating the same words
2
#5 opened about 3 years ago
by
leong99
Model answers blank and repeat words
4
#4 opened about 3 years ago
by
bazi88
Showing empty lines
#2 opened about 3 years ago
by
saradhipinapati
Model answer ends in repeating word
4
#1 opened about 3 years ago
by
mrichardt