Instructions to use unsloth/GLM-5.1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use unsloth/GLM-5.1-GGUF with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="unsloth/GLM-5.1-GGUF")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("unsloth/GLM-5.1-GGUF", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use unsloth/GLM-5.1-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M
# Run inference directly in the terminal:
llama cli -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M
# Run inference directly in the terminal:
llama cli -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Use Docker

docker model run hf.co/unsloth/GLM-5.1-GGUF:UD-Q4_K_M

LM Studio
Jan

vLLM

How to use unsloth/GLM-5.1-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "unsloth/GLM-5.1-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "unsloth/GLM-5.1-GGUF",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/unsloth/GLM-5.1-GGUF:UD-Q4_K_M

SGLang

How to use unsloth/GLM-5.1-GGUF with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "unsloth/GLM-5.1-GGUF" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "unsloth/GLM-5.1-GGUF",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "unsloth/GLM-5.1-GGUF" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "unsloth/GLM-5.1-GGUF",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Ollama
How to use unsloth/GLM-5.1-GGUF with Ollama:
```
ollama run hf.co/unsloth/GLM-5.1-GGUF:UD-Q4_K_M
```
Unsloth Desktop

How to use unsloth/GLM-5.1-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "unsloth/GLM-5.1-GGUF:UD-Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use unsloth/GLM-5.1-GGUF with Docker Model Runner:
```
docker model run hf.co/unsloth/GLM-5.1-GGUF:UD-Q4_K_M
```

Lemonade

How to use unsloth/GLM-5.1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Run and chat with the model

lemonade run user.GLM-5.1-GGUF-UD-Q4_K_M

List all available models

lemonade list

Hermes Agent

How to use unsloth/GLM-5.1-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use unsloth/GLM-5.1-GGUF with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf unsloth/GLM-5.1-GGUF:UD-Q4_K_M

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "unsloth/GLM-5.1-GGUF:UD-Q4_K_M" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

danielhanchen commited on Apr 7

Commit

8ecb443

verified ·

1 Parent(s): 8f91672

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +50 -0
BF16/GLM-5.1-BF16-00001-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00002-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00003-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00004-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00005-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00006-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00007-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00008-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00009-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00010-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00011-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00012-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00013-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00014-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00015-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00016-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00017-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00018-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00019-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00020-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00021-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00022-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00023-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00024-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00025-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00026-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00027-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00028-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00029-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00030-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00031-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00032-of-00033.gguf +3 -0
BF16/GLM-5.1-BF16-00033-of-00033.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00001-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00002-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00003-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00004-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00005-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00006-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00007-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00008-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00009-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00010-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00011-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00012-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00013-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00014-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00015-of-00017.gguf +3 -0
Q8_0/GLM-5.1-Q8_0-00016-of-00017.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -94,3 +94,53 @@ UD-Q5_K_XL/GLM-5.1-UD-Q5_K_XL-00010-of-00013.gguf filter=lfs diff=lfs merge=lfs
 UD-Q5_K_XL/GLM-5.1-UD-Q5_K_XL-00011-of-00013.gguf filter=lfs diff=lfs merge=lfs -text
 UD-Q5_K_XL/GLM-5.1-UD-Q5_K_XL-00012-of-00013.gguf filter=lfs diff=lfs merge=lfs -text
 UD-Q5_K_XL/GLM-5.1-UD-Q5_K_XL-00013-of-00013.gguf filter=lfs diff=lfs merge=lfs -text

 UD-Q5_K_XL/GLM-5.1-UD-Q5_K_XL-00011-of-00013.gguf filter=lfs diff=lfs merge=lfs -text
 UD-Q5_K_XL/GLM-5.1-UD-Q5_K_XL-00012-of-00013.gguf filter=lfs diff=lfs merge=lfs -text
 UD-Q5_K_XL/GLM-5.1-UD-Q5_K_XL-00013-of-00013.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00017-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00011-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00014-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00015-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00027-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00030-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00031-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00032-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00033-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00001-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00003-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00002-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00004-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00006-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00007-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00008-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00005-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00009-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00010-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00011-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00012-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00013-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00014-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00015-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+Q8_0/GLM-5.1-Q8_0-00016-of-00017.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00005-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00004-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00001-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00002-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00003-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00006-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00007-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00008-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00009-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00010-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00012-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00013-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00016-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00017-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00018-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00019-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00020-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00021-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00022-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00023-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00024-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00025-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00026-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00028-of-00033.gguf filter=lfs diff=lfs merge=lfs -text
+BF16/GLM-5.1-BF16-00029-of-00033.gguf filter=lfs diff=lfs merge=lfs -text

BF16/GLM-5.1-BF16-00001-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ab9b631a86b0ac383003c3594107b24391ae6fb442ada427eecbd75c6ff18472
+size 44935410592

BF16/GLM-5.1-BF16-00002-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5b32f0d74027602c43a36415cc84be44414d6469ded7ea44519ac61ac215d5c5
+size 45958425696

BF16/GLM-5.1-BF16-00003-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:09c0cc94fc9779726229979cebf3d37a5c1864745d3f0cba50592337a2edd5a7
+size 45958425696

BF16/GLM-5.1-BF16-00004-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:12ee0b9c0bae4bb57067b590bab5ebb76999021f21738774105596b5a35ce41c
+size 46389059936

BF16/GLM-5.1-BF16-00005-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:64dd328f2687a8dff1ffd7af970c1a8016811bda116e49c7eb25abe8914b5c86
+size 46760254656

BF16/GLM-5.1-BF16-00006-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:03cbf387a8addcb943b397037d3869a61efc96f2bfa79241b04ebe50bdb73c6f
+size 45958425696

BF16/GLM-5.1-BF16-00007-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a6534427eb7647351ab60a7769d1bae72099d0d0785557008d5d9da891a2003
+size 46389059936

BF16/GLM-5.1-BF16-00008-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7a7c993a1948a5679b934d4bfbb2043b69bc3893e7e9409f8933cc54324cbfa2
+size 45958425696

BF16/GLM-5.1-BF16-00009-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d1f573cb1d0c652b6fbb77826fb32e518d7208b4b87cac1d1172d94ece68e35a
+size 45958425696

BF16/GLM-5.1-BF16-00010-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0d9f1a09f0f078849a6d30277e33f0cc61d7d114324efa07fefbc3e67bd371af
+size 46389059904

BF16/GLM-5.1-BF16-00011-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6c0746c8638eee54dc9f181c8b1e87f9133e0989f5216a8a353162e291eeb3e9
+size 45958425696

BF16/GLM-5.1-BF16-00012-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e76965bbaf0df3521ce6a689a2a24d9f3871290550716d0997756a62bdae3c86
+size 45958425696

BF16/GLM-5.1-BF16-00013-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bc1378352373de07a892c932b0f0a990e4c2d112762a14bf6d5fdcac77d8d3de
+size 46389059936

BF16/GLM-5.1-BF16-00014-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b1547f0d9a16a63d75f690abe26fabe3af8447ecc9523211c2530ea5e1942dc2
+size 45958425696

BF16/GLM-5.1-BF16-00015-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:198b68c4a65e3c05a5401dfdc8bc206f83dabc9bdcb91fb069ef11da81885760
+size 45958425696

BF16/GLM-5.1-BF16-00016-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3d287566c71f7af44e9789a259cee091552efcbb331a03d264159a6d5c01a8ac
+size 46389059936

BF16/GLM-5.1-BF16-00017-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b53099e7beb8f8eeb929a7f9f2f2aee488e7bf2af9184be216d37dfc160181d2
+size 45958425696

BF16/GLM-5.1-BF16-00018-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:88298c9902bbd7b32ed34afe3c99884ccf56cd7eda78b999f663d3dfdddaa7cf
+size 45958425696

BF16/GLM-5.1-BF16-00019-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d1c4456bb44f4d33d55a97977c017d945c0244b97a899f543c47d5d6b0c3bf4d
+size 46389059904

BF16/GLM-5.1-BF16-00020-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:53f748d517f6c132ace89eaa9af94c1d36369f90277c81e50e0e4c4678946ee5
+size 45958425696

BF16/GLM-5.1-BF16-00021-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bd9f7c98d6b5020157dc0fafc03e45ab80f07404b70b650118940c53a67353e2
+size 45958425696

BF16/GLM-5.1-BF16-00022-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9a671d7bd2e91b965fe391fe6698426613aaf8f44c877a23378ab4acad4fccc5
+size 46389059936

BF16/GLM-5.1-BF16-00023-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0bd68bf9ba8962badc5df788127d4c7c56e92e8299c8099a50bfddac1ece556c
+size 45958425696

BF16/GLM-5.1-BF16-00024-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f3f196ea3f2e15b701e899e413d318670e6889d78da4ba6b9ab871167f91a3fd
+size 45958425696

BF16/GLM-5.1-BF16-00025-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7504e57723cb44f4f6428ccdf997c03676346b2322462b037e0f663529fc49c8
+size 46389059936

BF16/GLM-5.1-BF16-00026-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e6fc82045dad295c24f253414a82066403b972f8afdcb3e70b16ffcdd3d65afc
+size 45958425696

BF16/GLM-5.1-BF16-00027-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7e0479fe1df393780ae37c4102e0dc70a027616ee4f2157bfab116e02210e90d
+size 45958425696

BF16/GLM-5.1-BF16-00028-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c20ef481c77aaab306236509d67a5bed400265c4deef18a0aa65dd56cbb2a260
+size 46389059904

BF16/GLM-5.1-BF16-00029-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:82cbbfb489453b55fb9db076a6edb9584a282fbc202ba588f8b7ac25a09698ca
+size 45958425696

BF16/GLM-5.1-BF16-00030-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:45a80eb3f28d5034a0a469fa68523201fcb47f695e91829881809fec45ba9e90
+size 45958425696

BF16/GLM-5.1-BF16-00031-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4bc8fd178ad4f22e9e6ba570e9a8a833626118029b669b450b67e42c587ad82c
+size 46389059936

BF16/GLM-5.1-BF16-00032-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2063f60138fec81e7352f722e98b827079fa419c6c55c41bc0f9f1f91d3fb301
+size 46109494624

BF16/GLM-5.1-BF16-00033-of-00033.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:83e602df08b8aecc9164e48ab1b788f7109b9a5d4957464d5b577acc27514ed0
+size 33073523616

Q8_0/GLM-5.1-Q8_0-00001-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:571bfdcc08620c7a887400ac8d76e8ec0c6b3c10944e8b57aeb8e883975f54c2
+size 48303751040

Q8_0/GLM-5.1-Q8_0-00002-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e6726d5d5f292ec7eb6dbaa95d748c350d628ebbcc7ea65d26e1d6bf26a1c3de
+size 49074494816

Q8_0/GLM-5.1-Q8_0-00003-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:518eca1fa501a044eef6844d15dfb4847294ca994883b1c62106ef07ce2619c2
+size 49268742336

Q8_0/GLM-5.1-Q8_0-00004-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0ba6a1f4b66238195f320681b0cea162e385b90abf25e75181a25889a905bff1
+size 49074494816

Q8_0/GLM-5.1-Q8_0-00005-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:203fe0c58595bb0ac79e4057b1e3399824269ce252f4fdb902555b05111b5413
+size 49074494784

Q8_0/GLM-5.1-Q8_0-00006-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:825f9916654dc8b7a3e34c18b06ae0fa3a789539fb4f2aeec318025995daaf64
+size 48842741856

Q8_0/GLM-5.1-Q8_0-00007-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b8db8dde28e17709eef4a4112c91d51d0d0642bf131269b189eae43ee55bc606
+size 49074494784

Q8_0/GLM-5.1-Q8_0-00008-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2ba1cdd67d1251d12c4d56de5fa1dd139fd8cef40aa6aec7f430ef6d9f257e5e
+size 49074494816

Q8_0/GLM-5.1-Q8_0-00009-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b55bb3324f3bc3ba6ef40f3bef7589f66759dc46f053b481715f213396a137a6
+size 48842741856

Q8_0/GLM-5.1-Q8_0-00010-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a5afef87a2c0ad0d97a6078b793823418fbe970c6332b1ef597a999da79e8f0d
+size 49074494784

Q8_0/GLM-5.1-Q8_0-00011-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f505c8ade3092702aa23b0cad017c67bf258a0374e0f9c667085279ab46a03b9
+size 49074494816

Q8_0/GLM-5.1-Q8_0-00012-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4f748233662479568a083645250a0ef0c8e06c650fa954c9b1466a89c248d70a
+size 48842741824

Q8_0/GLM-5.1-Q8_0-00013-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3f905706bb0513d8eab7f909fed9767fcb511c889721da2e4ad321c22de8d5fc
+size 49074494816

Q8_0/GLM-5.1-Q8_0-00014-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:316a094f40ea15c3065d70b5029efe95eecb5386086e1d645fe2b9b1d60fe4d0
+size 49074494784

Q8_0/GLM-5.1-Q8_0-00015-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c6ca6011d410d3f70ad5a5ae3207b5e392be1a54f29433aafcc2c35d98a200fe
+size 48842741856

Q8_0/GLM-5.1-Q8_0-00016-of-00017.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e819ac3bfb736401c79279ebd2fef5887e92d2edf4c0d8f09c39bd96ec834fba
+size 49154784832