Instructions to use TheBloke/Airoboros-65B-GPT4-2.0-GGML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/Airoboros-65B-GPT4-2.0-GGML with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/Airoboros-65B-GPT4-2.0-GGML", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -100,6 +100,9 @@ Refer to the Provided Files table below to see what files use which methods, and
|
|
| 100 |
### q5_1, q6_K and q8_0 files require expansion from archive
|
| 101 |
|
| 102 |
**Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the q6_K and q8_0 files as multi-part ZIP files. They are not compressed, they are just for storing a .bin file in two parts.
|
|
|
|
|
|
|
|
|
|
| 103 |
|
| 104 |
### q5_1
|
| 105 |
Please download:
|
|
|
|
| 100 |
### q5_1, q6_K and q8_0 files require expansion from archive
|
| 101 |
|
| 102 |
**Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the q6_K and q8_0 files as multi-part ZIP files. They are not compressed, they are just for storing a .bin file in two parts.
|
| 103 |
+
|
| 104 |
+
<details>
|
| 105 |
+
<summary>Click for instructions regarding q5_1, q6_K and q8_0 files</summary>
|
| 106 |
|
| 107 |
### q5_1
|
| 108 |
Please download:
|