Transformers
English
deepseek-v4
mixture-of-experts
abliterated
fp8
model-surgery
mechanistic-interpretability
Instructions to use mradermacher/DeepSeek-V4-Flash-0731-Abliterated-FP8-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/DeepSeek-V4-Flash-0731-Abliterated-FP8-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/DeepSeek-V4-Flash-0731-Abliterated-FP8-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from rich1
Browse files
.gitattributes
CHANGED
|
@@ -62,3 +62,7 @@ DeepSeek-V4-Flash-0731-Abliterated-FP8.Q3_K_L.gguf.part1of4 filter=lfs diff=lfs
|
|
| 62 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q3_K_L.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 63 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q3_K_L.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 64 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q3_K_L.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q3_K_L.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 63 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q3_K_L.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 64 |
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q3_K_L.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
| 65 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
| 66 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 67 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 68 |
+
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part1of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:16004b15528c43382a311922aa630c4a83f96d90b542ba3ea0b1afe007d0fbe1
|
| 3 |
+
size 44023414784
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part2of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a11cda1ad9d7b47ee02fb68f046f85f87ac13fc7dec8b24e8683d3043492f6a9
|
| 3 |
+
size 44023414784
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part3of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:40e063204b283bce9e73fcf6939d2de5e66c2ef7ae34eb15a62619e20b494699
|
| 3 |
+
size 44023414784
|
DeepSeek-V4-Flash-0731-Abliterated-FP8.Q4_K_M.gguf.part4of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:864d0291d9a35cb9857f684304036e6606c9a3e073bd10c70f9e68f74dc0d39b
|
| 3 |
+
size 39756233984
|