Kite
🎉 You are looking at Kite 6(.)7, which was trained on over 3x the data!
Kite is a small, trained, 12 million parameter language model.
Training
It was trained on 250K selected passages of MS MARCO, using 1 epoch, 32 batch size, 1e-3 learning rate, and the MicroSupra tokenizer.
Limitations
Due to its size, the model is not suitable for production workloads.
- Downloads last month
- 429
Install from pip and serve model
# Install vLLM from pip: pip install vllm# Start the vLLM server: vllm serve "qikp/kite-67-12m"# Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "qikp/kite-67-12m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'