Instructions to use xverse/XVERSE-13B-Chat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use xverse/XVERSE-13B-Chat with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="xverse/XVERSE-13B-Chat", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("xverse/XVERSE-13B-Chat", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use xverse/XVERSE-13B-Chat with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "xverse/XVERSE-13B-Chat" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xverse/XVERSE-13B-Chat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/xverse/XVERSE-13B-Chat
- SGLang
How to use xverse/XVERSE-13B-Chat with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "xverse/XVERSE-13B-Chat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xverse/XVERSE-13B-Chat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "xverse/XVERSE-13B-Chat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xverse/XVERSE-13B-Chat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use xverse/XVERSE-13B-Chat with Docker Model Runner:
docker model run hf.co/xverse/XVERSE-13B-Chat
Commit ·
c78ddee
1
Parent(s): 33e5a3a
update open source license
Browse files
README.md
CHANGED
|
@@ -117,13 +117,12 @@ We strongly warn against the use of the XVERSE-13B-Chat model for producing or s
|
|
| 117 |
|
| 118 |
## 模型开源协议
|
| 119 |
|
| 120 |
-
使用本仓库的源码需要遵循 [Apache-2.0](https://github.com/xverse-ai/XVERSE-13B/blob/main/LICENSE) 开源协议,使用 XVERSE-13B-Chat 的模型权重则需要遵循[模型许可协议](MODEL_LICENSE.pdf)。
|
| 121 |
|
| 122 |
-
XVERSE-13B-Chat 模型权重对学术研究**完全开放**,并且支持**免费商用**
|
| 123 |
|
| 124 |
## Open Source License
|
| 125 |
|
| 126 |
-
The use of the source code in this repository must follow the [Apache-2.0](https://github.com/xverse-ai/XVERSE-13B/blob/main/LICENSE) open-source license, while the use of the model weights of XVERSE-13B-Chat needs to adhere to the [Model License Agreement](MODEL_LICENSE.pdf).
|
| 127 |
-
|
| 128 |
-
The XVERSE-13B-Chat model weights are **fully open** to academic research and support **free commercial use**. Commercial use requires an application for a commercial use license by sending an email to <opensource@xverse.cn>.
|
| 129 |
|
|
|
|
|
|
| 117 |
|
| 118 |
## 模型开源协议
|
| 119 |
|
| 120 |
+
使用本仓库的源码需要遵循 [Apache-2.0](https://github.com/xverse-ai/XVERSE-13B/blob/main/LICENSE) 开源协议,使用 XVERSE-13B-Chat 的模型权重则需要遵循[模型许可协议](https://github.com/xverse-ai/XVERSE-13B/blob/main/MODEL_LICENSE.pdf)。
|
| 121 |
|
| 122 |
+
XVERSE-13B-Chat 模型权重对学术研究**完全开放**,并且支持**免费商用**。如需申请商业许可证,请填写【[申请表](https://chat.xverse.cn/home/business.html)】,如有其他问题或合作,请联系 <opensource@xverse.cn>。
|
| 123 |
|
| 124 |
## Open Source License
|
| 125 |
|
| 126 |
+
The use of the source code in this repository must follow the [Apache-2.0](https://github.com/xverse-ai/XVERSE-13B/blob/main/LICENSE) open-source license, while the use of the model weights of XVERSE-13B-Chat needs to adhere to the [Model License Agreement](https://github.com/xverse-ai/XVERSE-13B/blob/main/MODEL_LICENSE.pdf).
|
|
|
|
|
|
|
| 127 |
|
| 128 |
+
The XVERSE-13B-Chat model weights are **fully open** to academic research and support **free commercial use**. To apply for a commercial license, please fill in the [application form](https://chat.xverse.cn/home/business.html). For other questions or collaborations, please contact <opensource@xverse.cn>.
|