| --- |
| language: |
| - pl |
| license: other |
| model_type: llama-2 |
| pipeline_tag: text-generation |
| tags: |
| - facebook |
| - meta |
| - pytorch |
| - llama |
| - llama-2 |
| - voicelab |
| --- |
| |
| #### Description |
|
|
| GGML Format model files for [This project](https://huggingface.co/Voicelab/trurl-2-13b). |
|
|
|
|
| ### inference |
|
|
| ```python |
| import ctransformers |
| from ctransformers import AutoModelForCausalLM |
| |
| model = AutoModelForCausalLM.from_pretrained("Aspik101/trurl-2-13b-GGML",model_type="llama") |
| |
| prompt = "Yesterday, when I was" |
| llm(prompt_input, |
| max_new_tokens=256, |
| temperature=0.9, |
| top_p= 0.7) |
| |
| ``` |
