Instructions to use TheBloke/Airoboros-65B-GPT4-2.0-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/Airoboros-65B-GPT4-2.0-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/Airoboros-65B-GPT4-2.0-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -123,6 +123,7 @@ Then extract the .zip archive. This will will expand both parts automatically. O
|
|
| 123 |
```
|
| 124 |
sudo apt update -y && sudo apt install 7zip
|
| 125 |
7zz x airoboros-65b-gpt4-2.0.ggmlv3.q6_K.zip
|
|
|
|
| 126 |
</details>
|
| 127 |
|
| 128 |
## How to run in `llama.cpp`
|
|
|
|
| 123 |
```
|
| 124 |
sudo apt update -y && sudo apt install 7zip
|
| 125 |
7zz x airoboros-65b-gpt4-2.0.ggmlv3.q6_K.zip
|
| 126 |
+
|
| 127 |
</details>
|
| 128 |
|
| 129 |
## How to run in `llama.cpp`
|