Instructions to use meituan-longcat/LongCat-2.0-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use meituan-longcat/LongCat-2.0-FP8 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="meituan-longcat/LongCat-2.0-FP8")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import LongcatCausalLM
model = LongcatCausalLM.from_pretrained("meituan-longcat/LongCat-2.0-FP8", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use meituan-longcat/LongCat-2.0-FP8 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "meituan-longcat/LongCat-2.0-FP8"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meituan-longcat/LongCat-2.0-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/meituan-longcat/LongCat-2.0-FP8

SGLang

How to use meituan-longcat/LongCat-2.0-FP8 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "meituan-longcat/LongCat-2.0-FP8" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meituan-longcat/LongCat-2.0-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "meituan-longcat/LongCat-2.0-FP8" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "meituan-longcat/LongCat-2.0-FP8",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use meituan-longcat/LongCat-2.0-FP8 with Docker Model Runner:
```
docker model run hf.co/meituan-longcat/LongCat-2.0-FP8
```

BinbinWatermelon commited on Jul 3

Commit

7d07e27

verified ·

1 Parent(s): fc7d4f2

Add files using upload-large-folder tool

Browse files

Files changed (26) hide show

.gitattributes +2 -0
model-00119-of-00141.safetensors +3 -0
model-00120-of-00141.safetensors +3 -0
model-00121-of-00141.safetensors +3 -0
model-00122-of-00141.safetensors +3 -0
model-00123-of-00141.safetensors +3 -0
model-00124-of-00141.safetensors +3 -0
model-00125-of-00141.safetensors +3 -0
model-00126-of-00141.safetensors +3 -0
model-00127-of-00141.safetensors +3 -0
model-00128-of-00141.safetensors +3 -0
model-00129-of-00141.safetensors +3 -0
model-00130-of-00141.safetensors +3 -0
model-00131-of-00141.safetensors +3 -0
model-00132-of-00141.safetensors +3 -0
model-00133-of-00141.safetensors +3 -0
model-00134-of-00141.safetensors +3 -0
model-00135-of-00141.safetensors +3 -0
model-00136-of-00141.safetensors +3 -0
model-00137-of-00141.safetensors +3 -0
model-00138-of-00141.safetensors +3 -0
model-00139-of-00141.safetensors +3 -0
model-00140-of-00141.safetensors +3 -0
model-00141-of-00141.safetensors +3 -0
model.safetensors.index.json +3 -0
model.safetensors.index_fp8.json +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+model.safetensors.index.json filter=lfs diff=lfs merge=lfs -text
+model.safetensors.index_fp8.json filter=lfs diff=lfs merge=lfs -text

model-00119-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d1f5f777df6fac387182f1022df50b7331f13573dd024a54405a2b7288ed445e
+size 13988110928

model-00120-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa6681c35307530f62caecd31c85d721470cd13cb244b9f09ae056ba203a28cc
+size 13987624680

model-00121-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f0292fcf22974ee2660ae0257f7658d77ddb4509067030b4935beb5055418207
+size 13989156632

model-00122-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e30e5cf194c0d52aec3f0a1e7f3a37ae03595c2099f15ab2309adf2ca250f692
+size 13989157240

model-00123-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:44556e23764cf6574f578309435a20ced527d016e19ae702f3a94994c07af153
+size 13999120032

model-00124-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bcc4c20ef6196c16e0ea27881b089d9d80848cd42477c97f3cdc5d205a59b5ab
+size 13995435832

model-00125-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d82f01d3d9b22919d72905d25b7d3deb7fa22ce719adf5a903069730edf4d46b
+size 13994402128

model-00126-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0b77254de8f68a77a70ec7ad3498e5140db94576e433a9d8c3cf28a6e41d1139
+size 13994401536

model-00127-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2491b0740fa1d53621053d5334d5b09b5fdd976f72321c712f45b9dc2634f0bc
+size 13988636144

model-00128-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7ae8f3bd5bc6b66e4892230c422b612f582bfe3242d73bac35b2925a37b5d9ff
+size 13986014168

model-00129-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ef1188bde8879ad3edcde0c6eeb68867e622b1f2fcb034a30b5fd30941bb510a
+size 13996498640

model-00130-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0f39743a4c7af22e06cad653ac76e542ef74062191ea5783fe108075da8426c2
+size 13999993544

model-00131-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d5475059edc50334c7c996ae1c5df5f2a05c76c1ade93ff6ef764c466e06a010
+size 13993353912

model-00132-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ff35a1e3ff1c658fafc1048628c9c5c7903c0c820c94c28724252b5897544d0e
+size 13984441008

model-00133-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:11d3f40c03de7d9380c9c2bf6fc4d65ea9061556481d0d2cffd99412fce4c1af
+size 13993353096

model-00134-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b4847414c4d466ec6a9c43078ca91b2f1f3225e892e4f42f96a5160dd33c3c4d
+size 13992213976

model-00135-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:002692fbe68b8098c364627f2190e42a476835e283d0f296f2c866599adf7732
+size 13983915432

model-00136-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99e2941befe8bb9d228eeded382d3520bb2b15a499697b8e17ce53ff0bee0e1e
+size 13988109032

model-00137-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2b7e3df33f4ba64cbaf6a5e54ca849cb953b19d34ab5aaed6f3c451ec4751072
+size 13987626064

model-00138-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:02780d86ea46f965f16e7774c4706adcd9db975ebcfe41e3c2cb791ddaff7941
+size 13989157264

model-00139-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7aa8eabaf8c1cfbf6dd54bf9c46c7a8e03aa25a6a5845447b447297c228df6d2
+size 13989156664

model-00140-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:27c019a0df3388ddbea7ad0f521cdd4a7439c13fb873a41fd7a178c23f097f53
+size 13965564272

model-00141-of-00141.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:77eced882a9d88c14630513a1350139400baff3e86942b5faea03d68a516bfd6
+size 191365648

model.safetensors.index.json ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cc98aa2e5c3deef128510d1e37c2c3f29e09ea175ffa18321aaee0a83193c979
+size 16969139

model.safetensors.index_fp8.json ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cc98aa2e5c3deef128510d1e37c2c3f29e09ea175ffa18321aaee0a83193c979
+size 16969139