Instructions to use mradermacher/GLM-4.6-REAP-218B-A32B-Derestricted-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/GLM-4.6-REAP-218B-A32B-Derestricted-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/GLM-4.6-REAP-218B-A32B-Derestricted-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -66,3 +66,6 @@ GLM-4.6-REAP-218B-A32B-Derestricted.Q5_K_M.gguf.part1of4 filter=lfs diff=lfs mer
|
|
| 66 |
GLM-4.6-REAP-218B-A32B-Derestricted.Q5_K_M.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 67 |
GLM-4.6-REAP-218B-A32B-Derestricted.Q5_K_M.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 68 |
GLM-4.6-REAP-218B-A32B-Derestricted.Q5_K_M.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
| 66 |
GLM-4.6-REAP-218B-A32B-Derestricted.Q5_K_M.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 67 |
GLM-4.6-REAP-218B-A32B-Derestricted.Q5_K_M.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 68 |
GLM-4.6-REAP-218B-A32B-Derestricted.Q5_K_M.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
| 69 |
+
GLM-4.6-REAP-218B-A32B-Derestricted.IQ4_XS.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 70 |
+
GLM-4.6-REAP-218B-A32B-Derestricted.IQ4_XS.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 71 |
+
GLM-4.6-REAP-218B-A32B-Derestricted.IQ4_XS.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
GLM-4.6-REAP-218B-A32B-Derestricted.IQ4_XS.gguf.part1of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:730af270b2730974bc56d36cf09af159ba96ffd8f94a3aeb73cd561eeccad000
|
| 3 |
+
size 39728447488
|
GLM-4.6-REAP-218B-A32B-Derestricted.IQ4_XS.gguf.part2of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6cdbdf79548900cd4f42472c586dd251a7a3699d46aaeb4fc3da8720da28e348
|
| 3 |
+
size 39728447488
|
GLM-4.6-REAP-218B-A32B-Derestricted.IQ4_XS.gguf.part3of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d42d2496470c543f6dde308429221d64bec2ba3a3c58d62eb7f0268f800018f
|
| 3 |
+
size 38010991936
|