Instructions to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +8 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part1of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part2of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part3of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part4of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part5of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part6of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part7of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part8of8 +3 -0
.gitattributes
CHANGED
|
@@ -126,3 +126,11 @@ cogito-v2-preview-deepseek-671B-MoE.Q5_K_M.gguf.part07of10 filter=lfs diff=lfs m
|
|
| 126 |
cogito-v2-preview-deepseek-671B-MoE.Q5_K_M.gguf.part08of10 filter=lfs diff=lfs merge=lfs -text
|
| 127 |
cogito-v2-preview-deepseek-671B-MoE.Q5_K_M.gguf.part09of10 filter=lfs diff=lfs merge=lfs -text
|
| 128 |
cogito-v2-preview-deepseek-671B-MoE.Q5_K_M.gguf.part10of10 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 126 |
cogito-v2-preview-deepseek-671B-MoE.Q5_K_M.gguf.part08of10 filter=lfs diff=lfs merge=lfs -text
|
| 127 |
cogito-v2-preview-deepseek-671B-MoE.Q5_K_M.gguf.part09of10 filter=lfs diff=lfs merge=lfs -text
|
| 128 |
cogito-v2-preview-deepseek-671B-MoE.Q5_K_M.gguf.part10of10 filter=lfs diff=lfs merge=lfs -text
|
| 129 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part1of8 filter=lfs diff=lfs merge=lfs -text
|
| 130 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part2of8 filter=lfs diff=lfs merge=lfs -text
|
| 131 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part3of8 filter=lfs diff=lfs merge=lfs -text
|
| 132 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part4of8 filter=lfs diff=lfs merge=lfs -text
|
| 133 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part5of8 filter=lfs diff=lfs merge=lfs -text
|
| 134 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 135 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 136 |
+
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part1of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2d78b0ec55baf4f6cc3085aa57e83a00cf360564b4a3c00b1ed12c5defff54ba
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part2of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a854cf09764f7f96f8c2220c25739e31da7194538e8be35b8328beaa1fc12c87
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part3of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c91a2964cb40fa7c7c9d5a1ecc15abc77ffe5a77921969375b64175c63005650
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part4of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e97fe77cfe23ef9fecf8ff85c71efd5c2ffc535fd69b32c0fc51ac7edf87b507
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part5of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ae251b7f079570239be2394685515c60dfa22320f192419de8ac6ac8d9d10259
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part6of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2132e8bf720a998fdc0c6649ae67e3a75877f98a1215b3587743ea1c9ef6364b
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part7of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:59f86eedc95f4b9af06e1dc8b2f487fc0dc561867062d9fa6f28184c77362b4d
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.IQ4_XS.gguf.part8of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:40d578dc383a66b0842729c25c4c49967af093e8cf1303f936f5120c6b47b408
|
| 3 |
+
size 43879982720
|