Instructions to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +6 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part1of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part2of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part3of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part4of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part5of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part6of6 +3 -0
.gitattributes
CHANGED
|
@@ -83,3 +83,9 @@ cogito-v2-preview-deepseek-671B-MoE.Q3_K_M.gguf.part4of7 filter=lfs diff=lfs mer
|
|
| 83 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_M.gguf.part5of7 filter=lfs diff=lfs merge=lfs -text
|
| 84 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_M.gguf.part6of7 filter=lfs diff=lfs merge=lfs -text
|
| 85 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_M.gguf.part7of7 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 83 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_M.gguf.part5of7 filter=lfs diff=lfs merge=lfs -text
|
| 84 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_M.gguf.part6of7 filter=lfs diff=lfs merge=lfs -text
|
| 85 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_M.gguf.part7of7 filter=lfs diff=lfs merge=lfs -text
|
| 86 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part1of6 filter=lfs diff=lfs merge=lfs -text
|
| 87 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part2of6 filter=lfs diff=lfs merge=lfs -text
|
| 88 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part3of6 filter=lfs diff=lfs merge=lfs -text
|
| 89 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 90 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 91 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part1of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dc2a83560e0c62164aebfe3d946e4a308849c32bbe03152ce93eb9ce47c81dbe
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part2of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1183bc36b4087b8f65f5eb10584d13338b2a92914f7debf0887bbd61ac2869a1
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part3of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3cd8459492505dc154b2a68332cf60f54e90f1a489f027a3500b0736ded1a8aa
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part4of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8b1014478621698563cefd26d8522a829fe4d1e349c963b087b15792a9c94c6e
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part5of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b4a00933e2e6167de4b6b072d406614b3e7fad4d34382ad1687d5a4d405f3a23
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part6of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:482cc607510663dd3f60ae3ef6647ed93ce9e01e757730b62dcee87b7b3353b3
|
| 3 |
+
size 47554468576
|