Transformers
English
deepseek-v4
mixture-of-experts
abliterated
fp8
model-surgery
mechanistic-interpretability
Instructions to use mradermacher/DeepSeek-V4-Flash-0731-Abliterated-FP8-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/DeepSeek-V4-Flash-0731-Abliterated-FP8-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/DeepSeek-V4-Flash-0731-Abliterated-FP8-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from rich1
Browse files
.gitattributes
CHANGED
|
@@ -76,3 +76,7 @@ DeepSeek-V4-Flash-0731-Abliterated-FP8.Q5_K_M.gguf.part2of5 filter=lfs diff=lfs
|
|
| 76 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q5_K_M.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 77 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q5_K_M.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 78 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q5_K_M.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q5_K_M.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 77 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q5_K_M.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 78 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q5_K_M.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
| 79 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
| 80 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 81 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 82 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part1of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:11894dcc93e148c695e967307b5fd24cf63c24e2f5af68c5c87c8a9bae5a6b64
|
| 3 |
+
size 38654705664
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part2of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0147d8c006fb74b0a1116cf8b81b37cee3308ec9119b67fc4bbe093c6dbf8f62
|
| 3 |
+
size 38654705664
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part3of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b9c951bb6c462340f06d06a1aadacbbf530ce209ac7dd5b92a8cb3d8ec1f3f31
|
| 3 |
+
size 38654705664
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.IQ4_XS.gguf.part4of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:566afd4656a09b648cd85ae5200c02ade35aa4462c2aeea6fe31964b47409fb9
|
| 3 |
+
size 37007198176
|