How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "aniruddh123464/allmodels"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "aniruddh123464/allmodels",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'
Use Docker
docker model run hf.co/aniruddh123464/allmodels
Quick Links

Qwen Multi-Model Repository Compilation

This public repository serves as an aggregated passive cloud storage mirror hosting a compilation of official large language checkpoints. All architecture elements are stored in isolated sub-directories.

Included Components & Credits:

  1. Qwen2.5-Coder-32B-Instruct: Original system by Qwen/Qwen2.5-Coder-32B-Instruct (Apache 2.0).
  2. Qwen2.5-32B-Instruct: Original system by Qwen/Qwen2.5-32B-Instruct (Apache 2.0).
  3. Qwen2-VL-72B-Instruct: Original vision-language system by Qwen/Qwen2-VL-72B-Instruct (Qwen Research License).

Compliance & Terms Notice:

  • Intended Use: Remote archival hosting and backup mirror.
  • Intellectual Property: Full authorship, training properties, and trademarks belong exclusively to the Qwen Team / Alibaba Cloud.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support