Local Models
Collection
16 items • Updated • 1
Overview
Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension.
Variants
| No | Variant | Cortex CLI command |
|---|---|---|
| 1 | Yi-1.5-34b | cortex run yi-1.5:34b |
Use it with Jan (UI)
- Install Jan using Quickstart
- Use in Jan model Hub:
cortexhub/yi-1.5
Use it with Cortex (CLI)
- Install Cortex using Quickstart
- Run the model with command:
cortex run yi-1.5
Credits
- Downloads last month
- 79
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Install from pip and serve model
# Install vLLM from pip: pip install vllm# Start the vLLM server: vllm serve "cortexso/yi-1.5"# Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "cortexso/yi-1.5", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'