Update README.md
Browse files
README.md
CHANGED
|
@@ -2,8 +2,10 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
# Notice
|
| 5 |
-
* Need RAM>=64 ,VRAM>8 if use bf16
|
|
|
|
| 6 |
|
| 7 |
* support gguf now.
|
| 8 |
# Example
|
| 9 |
-
|
|
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
# Notice
|
| 5 |
+
* Need RAM>=64 ,VRAM>8 if use bf16，RAM>50,VRAM>8 if Q8
|
| 6 |
+
|
| 7 |
|
| 8 |
* support gguf now.
|
| 9 |
# Example
|
| 10 |
+
|
| 11 |
+
|