smalinin commited on
Commit
1cce894
·
verified ·
1 Parent(s): 6eefbdc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -25,6 +25,8 @@ tables, hyper-connections and sparse attention. It is not V4-Flash-0731.
25
  How to build the engine, serve it, and the gotchas, plus the current status:
26
  [https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41](https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41)
27
 
 
 
28
  ```
29
  ./llama-server \
30
  --model ./DeepSeek-V4.1-Flash-Q2_K-00001-of-00007.gguf \
@@ -51,6 +53,7 @@ How to build the engine, serve it, and the gotchas, plus the current status:
51
  --no-prefill-assistant
52
 
53
  ```
 
54
 
55
 
56
  ## Status
 
25
  How to build the engine, serve it, and the gotchas, plus the current status:
26
  [https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41](https://github.com/smalinin/llama.cpp/tree/my_build_deepseek41)
27
 
28
+ New runtime binary was tested on 4xRTX4090(48Gb) + 2xRTX3090 with next config:
29
+
30
  ```
31
  ./llama-server \
32
  --model ./DeepSeek-V4.1-Flash-Q2_K-00001-of-00007.gguf \
 
53
  --no-prefill-assistant
54
 
55
  ```
56
+ Results: pp = 250 t/s; tg = 4.7t/s for prompt size=25k
57
 
58
 
59
  ## Status