sabafallah commited on
Commit
ad97da7
·
verified ·
1 Parent(s): 02441ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -4
README.md CHANGED
@@ -29,13 +29,32 @@ huggingface-cli download <this-repo> --include "mmproj-deepseek-ocr-2-bf16.gguf"
29
 
30
  ## 🚀 Run Example
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  Use the `llama-mtmd-cli` executable from the PR:
33
 
34
  ```bash
35
- build/bin/llama-mtmd-cli \
36
  -m gguf_models/deepseek-ai/deepseek-ocr-2-bf16.gguf \
37
  --mmproj gguf_models/deepseek-ai/mmproj-deepseek-ocr-2-bf16.gguf \
38
- --image tmp/mtmd_test_data/Deepseek-OCR-2510.18234v1_page1.png \
39
- -p "<|grounding|>Convert the document to markdown." \
40
- --chat-template deepseek-ocr --temp 0
 
 
 
 
 
41
  ```
 
 
29
 
30
  ## 🚀 Run Example
31
 
32
+ Use with `llama-server`
33
+ ```bash
34
+ build/bin/llama-server \
35
+ -hf sabafallah/DeepSeek-OCR-2-GGUF:bf16 \
36
+ --chat-template deepseek-ocr --no-jinja \
37
+ --temp 0 \
38
+ --flash-attn off \
39
+ --no-warmup \
40
+ -n 2048 \
41
+ --dry-multiplier 0.8 --dry-base 1.75 --dry-allowed-length 2 \
42
+ --dry-penalty-last-n -1 --dry-sequence-breaker none
43
+ ```
44
+
45
  Use the `llama-mtmd-cli` executable from the PR:
46
 
47
  ```bash
48
+ build/bin/llama-mtmd-cli \
49
  -m gguf_models/deepseek-ai/deepseek-ocr-2-bf16.gguf \
50
  --mmproj gguf_models/deepseek-ai/mmproj-deepseek-ocr-2-bf16.gguf \
51
+ --image tmp/mtmd_test_data/webpage_tall.png -p "Free OCR." \
52
+ --chat-template deepseek-ocr --no-jinja \
53
+ --temp 0 \
54
+ --flash-attn off \
55
+ --no-warmup \
56
+ -n 2048 \
57
+ --dry-multiplier 0.8 --dry-base 1.75 --dry-allowed-length 2 \
58
+ --dry-penalty-last-n -1 --dry-sequence-breaker none
59
  ```
60
+