Instructions to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/cogito-v2-preview-deepseek-671B-MoE-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +8 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part1of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part2of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part3of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part4of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part5of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part6of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part7of8 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part8of8 +3 -0
.gitattributes
CHANGED
|
@@ -89,3 +89,11 @@ cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part3of6 filter=lfs diff=lfs mer
|
|
| 89 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 90 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 91 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 89 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 90 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 91 |
cogito-v2-preview-deepseek-671B-MoE.Q3_K_S.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
| 92 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part1of8 filter=lfs diff=lfs merge=lfs -text
|
| 93 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part2of8 filter=lfs diff=lfs merge=lfs -text
|
| 94 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part3of8 filter=lfs diff=lfs merge=lfs -text
|
| 95 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part4of8 filter=lfs diff=lfs merge=lfs -text
|
| 96 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part5of8 filter=lfs diff=lfs merge=lfs -text
|
| 97 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 98 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 99 |
+
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part1of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4f9fb3eb7613fdab7693a370845a2d1338f49c90152b0c75b2328c72336cc231
|
| 3 |
+
size 44023414784
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part2of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bdee250fae9ea07f39636a6abb6703ab9c63df037861ad64472bfc3b57b34db5
|
| 3 |
+
size 44023414784
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part3of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:44a156247f331b3d3a3978859171182203d23b0fb39cc8921585938b12123874
|
| 3 |
+
size 44023414784
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part4of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0a1a6f99b305c7deffc5c1b4ae14ce1f15d857972695e5e78e9870942d48a2b2
|
| 3 |
+
size 44023414784
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part5of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:93491c47bdf3f1bc36144946703da2e4b5fd18ad57f94005fe0628a2a01c333d
|
| 3 |
+
size 44023414784
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part6of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fb4c1e30cf43a7ac8b17bf5c8eb9c369204e068cea9d3bc07a9b138db5c03427
|
| 3 |
+
size 44023414784
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part7of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1ac5febca2195b6f749f656256b819f3b93ba51245b4d62993918641ebd45da
|
| 3 |
+
size 44023414784
|
cogito-v2-preview-deepseek-671B-MoE.Q3_K_L.gguf.part8of8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:18cf995fac892b3c32f333580bc1fc8a6f3a42bb853abebcfc2df30604580865
|
| 3 |
+
size 39346395872
|