Update README.md
Browse files
README.md
CHANGED
|
@@ -25,6 +25,8 @@ tables, hyper-connections and sparse attention. It is not V4-Flash-0731.
|
|
| 25 |
How to build the engine, serve it, and the gotchas, plus the current status:
|
| 26 |
[https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41](https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41)
|
| 27 |
|
|
|
|
|
|
|
| 28 |
```
|
| 29 |
./llama-server \
|
| 30 |
--model ./DeepSeek-V4.1-Flash-Q2_K-00001-of-00007.gguf \
|
|
@@ -51,6 +53,7 @@ How to build the engine, serve it, and the gotchas, plus the current status:
|
|
| 51 |
--no-prefill-assistant
|
| 52 |
|
| 53 |
```
|
|
|
|
| 54 |
|
| 55 |
|
| 56 |
## Status
|
|
|
|
| 25 |
How to build the engine, serve it, and the gotchas, plus the current status:
|
| 26 |
[https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41](https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41)
|
| 27 |
|
| 28 |
+
New runtime binary was tested on 4xRTX4090(48Gb) + 2xRTX3090 with next config:
|
| 29 |
+
|
| 30 |
```
|
| 31 |
./llama-server \
|
| 32 |
--model ./DeepSeek-V4.1-Flash-Q2_K-00001-of-00007.gguf \
|
|
|
|
| 53 |
--no-prefill-assistant
|
| 54 |
|
| 55 |
```
|
| 56 |
+
Results: pp = 250 t/s; tg = 4.7t/s for prompt size=25k
|
| 57 |
|
| 58 |
|
| 59 |
## Status
|