Instructions to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +5 -0
- cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part1of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part2of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part3of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part4of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part5of5 +3 -0
.gitattributes
CHANGED
|
@@ -41,3 +41,8 @@ cogito-v2-preview-deepseek-671B-MoE.Q4_K_S.gguf.part5of8 filter=lfs diff=lfs mer
|
|
| 41 |
cogito-v2-preview-deepseek-671B-MoE.Q4_K_S.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 42 |
cogito-v2-preview-deepseek-671B-MoE.Q4_K_S.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 43 |
cogito-v2-preview-deepseek-671B-MoE.Q4_K_S.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
cogito-v2-preview-deepseek-671B-MoE.Q4_K_S.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 42 |
cogito-v2-preview-deepseek-671B-MoE.Q4_K_S.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 43 |
cogito-v2-preview-deepseek-671B-MoE.Q4_K_S.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part1of5 filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part2of5 filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part1of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:29e9664a54262f3e1ab27bc01de483cce5e2d9f74de8906ba2a805393c743f71
|
| 3 |
+
size 49392123904
|
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part2of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:10fc3e8e4a3043d5ec40c28008349e902df62477523bb74c4c384fee9815e820
|
| 3 |
+
size 49392123904
|
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part3of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:374c223c6f9df0b0f58f9255a060a8a1ee7ec7fbac7e2254580943fc2bdae634
|
| 3 |
+
size 49392123904
|
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part4of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6c6fab68ee5b7418c1425536384d67fffee1641321a0aacf69c55af7e6ea8188
|
| 3 |
+
size 49392123904
|
cogito-v2-preview-deepseek-671B-MoE.Q2_K.gguf.part5of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7f40f310978252afc285af86a16d5c2d89d7e531fa16d54ea517b76e88f3b4b0
|
| 3 |
+
size 46575947584
|