FreedomIntelligence/medical-o1-reasoning-SFT
Viewer • Updated • 90.1k • 21k • 1.19k
How to use vignesha7/DeepSeek-R1-Distill-Llama-8B-Medical-Expert with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("question-answering", model="vignesha7/DeepSeek-R1-Distill-Llama-8B-Medical-Expert") # Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("vignesha7/DeepSeek-R1-Distill-Llama-8B-Medical-Expert")
model = AutoModelForCausalLM.from_pretrained("vignesha7/DeepSeek-R1-Distill-Llama-8B-Medical-Expert", device_map="auto")# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("question-answering", model="vignesha7/DeepSeek-R1-Distill-Llama-8B-Medical-Expert")# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("vignesha7/DeepSeek-R1-Distill-Llama-8B-Medical-Expert")
model = AutoModelForCausalLM.from_pretrained("vignesha7/DeepSeek-R1-Distill-Llama-8B-Medical-Expert", device_map="auto")DeepSeek-R1-Distill-Llama-8B medical CoT model.
DeepSeek-R1-Distill-Llama-8B model fine tuned on the FreedomIntelligence/medical-o1-reasoning-SFT.
find the quantized models here: https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Llama-8B-Medical-Expert-GGUF
FreedomIntelligence/medical-o1-reasoning-SFT
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
# Gated model: Login with a HF token with gated access permission hf auth login