How to use from
Docker Model Runner
docker model run hf.co/abetlen/Phi-3.5-vision-instruct-gguf:F16
Quick Links

work-in-progress does not currently work with main branch of llama.cpp

Downloads last month
1,139
GGUF
Model size
4B params
Architecture
phi3
Hardware compatibility
Log In to add your hardware

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support