Instructions to use pipenetwork/LongCat-2.0-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use pipenetwork/LongCat-2.0-4bit with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("pipenetwork/LongCat-2.0-4bit")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use pipenetwork/LongCat-2.0-4bit with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "pipenetwork/LongCat-2.0-4bit"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "pipenetwork/LongCat-2.0-4bit"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

MLX LM

How to use pipenetwork/LongCat-2.0-4bit with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "pipenetwork/LongCat-2.0-4bit"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "pipenetwork/LongCat-2.0-4bit"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "pipenetwork/LongCat-2.0-4bit",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

Hermes Agent

How to use pipenetwork/LongCat-2.0-4bit with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "pipenetwork/LongCat-2.0-4bit"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default pipenetwork/LongCat-2.0-4bit

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use pipenetwork/LongCat-2.0-4bit with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "pipenetwork/LongCat-2.0-4bit"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "pipenetwork/LongCat-2.0-4bit" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

pipenetwork commited on Jul 5

Commit

966062b

verified ·

1 Parent(s): 53d8542

Add files using upload-large-folder tool

Browse files

Files changed (20) hide show

model-00013-of-00261.safetensors +3 -0
model-00021-of-00261.safetensors +3 -0
model-00024-of-00261.safetensors +3 -0
model-00052-of-00261.safetensors +3 -0
model-00057-of-00261.safetensors +3 -0
model-00065-of-00261.safetensors +3 -0
model-00096-of-00261.safetensors +3 -0
model-00099-of-00261.safetensors +3 -0
model-00100-of-00261.safetensors +3 -0
model-00105-of-00261.safetensors +3 -0
model-00132-of-00261.safetensors +3 -0
model-00144-of-00261.safetensors +3 -0
model-00173-of-00261.safetensors +3 -0
model-00179-of-00261.safetensors +3 -0
model-00180-of-00261.safetensors +3 -0
model-00212-of-00261.safetensors +3 -0
model-00220-of-00261.safetensors +3 -0
model-00225-of-00261.safetensors +3 -0
model-00253-of-00261.safetensors +3 -0
model-00259-of-00261.safetensors +3 -0

model-00013-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a4230ae86b66d2166f7000d11ad512f4db41eda0eca9c07765c6c8ccce8cee97
+size 527261327

model-00021-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:84e5431d6419783d2b29c17a8558672be4277172f8a2fe0c9ccb720dd0120f20
+size 527261583

model-00024-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1c357643a3bf67444326c428b7fdf5c1f85754d94aeeb5a432b150412b6e1d27
+size 4218091674

model-00052-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fbbbe3f5c4c51784871cb7bc68e65b21b6d6b26cdea4446c153f8bc385ae6edf
+size 6442451104

model-00057-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a050292641f4701f83c1182d2c799461534c332d881780838be0c11f2733921c
+size 1283314480

model-00065-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ce3ee0b95d0a8fc4b1a2bf465c2591e5a92edb056d57af70caccbf943cd0e5a4
+size 805306653

model-00096-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7c4d5cea86dfa2d4b8b852c4d9f8f23b210de31d9c017faddf0d72e64e9711e
+size 6442451103

model-00099-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a474c4998a02e12b238a13a8215a8311ea21b584bbfa57be04d071080573d9b4
+size 1283314564

model-00100-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8368afec9b484b8ca737c9d68e8c6ceff0e1a19db7c6072a6c3787fdab629c53
+size 6442451105

model-00105-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:25778d106c0f94a210b09254920c821e4e196964d917fbd077aece78b5a113ab
+size 1283314618

model-00132-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa429c6ef380c72abb0a9c22a554770c3a7e9776cfc6d6fb8bf0161cca030d3e
+size 6442451103

model-00144-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:de4477b3d98b96cd65fec924e77264eff271a858431ab4074259fe0f74393b55
+size 6442451103

model-00173-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b7b9a53db0e5020d45d8aabfb1af86beb344bebbe8f190bdfee11b58adcd37d
+size 805306655

model-00179-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7566642646390d853841dcf885419616e2be58ccf43a17bce89db442cbe1740
+size 805306655

model-00180-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c2a2df1eb3da206434c8d354218740fee832c2671934f8929040d2ddbf247442
+size 6442451103

model-00212-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8c67d2f73f805843beef807cbdf3fa4a773f2ec63829319bea4b2a6b5350879
+size 6442451104

model-00220-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ed1b76f465191a720d5f2a5606cdbd52a6e7a37c2ea59b0bd289bdea47db136a
+size 6442451105

model-00225-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4437ae9152b2d93bdebf8fa4b068fc96947273f7b2d6e44421a25a2676105a29
+size 1283314526

model-00253-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d68a079ef2c79d0ad8f9a06c154f95000a2e55224a8c3b45fb127634fecbcacc
+size 805306651

model-00259-of-00261.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:56144c42f0a01fb758a1a8b9108e96e4204ec3237848ac74bb0d251006fbd793
+size 805306651