sabafallah commited on
Commit
dd6b9e3
·
verified ·
1 Parent(s): 517a3ba

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - deepseek-ai/DeepSeek-OCR-2
4
+ ---
5
+
6
+
7
+ # DeepSeek-OCR-2 GGUF (for llama.cpp PR #20975)
8
+
9
+ This repository provides **GGUF model files** required for running the **DeepSeek-OCR-2 / MTMD** support introduced in the following llama.cpp pull request:
10
+
11
+ 👉 **llama.cpp PR #20975**
12
+ [https://github.com/ggml-org/llama.cpp/pull/20975](https://github.com/ggml-org/llama.cpp/pull/20975)
13
+
14
+ These models are **only compatible with the PR branch** and will not run on upstream llama.cpp `main`.
15
+
16
+ ---
17
+
18
+ ## 📥 Download
19
+
20
+ You can download the model files directly using:
21
+
22
+ ```bash
23
+ huggingface-cli download <this-repo> --include "deepseek-ocr-2-bf16.gguf" --local-dir gguf_models/deepseek-ai
24
+ huggingface-cli download <this-repo> --include "mmproj-deepseek-ocr-2-bf16.gguf" --local-dir gguf_models/deepseek-ai
25
+ ```
26
+
27
+ ---
28
+
29
+
30
+ ## 🚀 Run Example
31
+
32
+ Use the `llama-mtmd-cli` executable from the PR:
33
+
34
+ ```bash
35
+ build/bin/llama-mtmd-cli \
36
+ -m gguf_models/deepseek-ai/deepseek-ocr-2-bf16.gguf \
37
+ --mmproj gguf_models/deepseek-ai/mmproj-deepseek-ocr-2-bf16.gguf \
38
+ --image tmp/mtmd_test_data/Deepseek-OCR-2510.18234v1_page1.png \
39
+ -p "<|grounding|>Convert the document to markdown." \
40
+ --chat-template deepseek-ocr --temp 0
41
+ ```