Transformers
Safetensors
English
text-generation-inference
unsloth
mistral
trl
Mistral-Nemo-Base-2407
Medical
Healthcare
Open-MedQA-Nexus
Instructions to use exafluence/EXF-Medistral-Nemo-12B-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use exafluence/EXF-Medistral-Nemo-12B-4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("exafluence/EXF-Medistral-Nemo-12B-4bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop