Instructions to use naver/cocom-v1-128-mistral-7b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use naver/cocom-v1-128-mistral-7b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="naver/cocom-v1-128-mistral-7b", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("naver/cocom-v1-128-mistral-7b", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -30,7 +30,7 @@ For batch processing, the model takes as input
|
|
| 30 |
The model compresses the questions into context embeddings and answers the question based on the provided context embeddings.
|
| 31 |
|
| 32 |
```python
|
| 33 |
-
from transformers import
|
| 34 |
|
| 35 |
model = AutoModel.from_pretrained('naver/cocom-v1-128-mistral-7b', trust_remote_code=True)
|
| 36 |
model = model.to('cuda')
|
|
|
|
| 30 |
The model compresses the questions into context embeddings and answers the question based on the provided context embeddings.
|
| 31 |
|
| 32 |
```python
|
| 33 |
+
from transformers import AutoModel
|
| 34 |
|
| 35 |
model = AutoModel.from_pretrained('naver/cocom-v1-128-mistral-7b', trust_remote_code=True)
|
| 36 |
model = model.to('cuda')
|