Mellum2-12B-A2.5B-Thinking-ABLITERATED

Sleeping

usermma commited on May 12

Commit

f2d62d8

verified ·

1 Parent(s): 5d0d2c6

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -23,7 +23,9 @@ CMD ["--server", \
      "-m", "/app/MiniCPM-V-4.6-Abliterated-AND-Disinhibited-Q4_K_M.gguf", \
      "--host", "0.0.0.0", \
      "--port", "7860", \
-     "-t", "4", \
      "--mlock", \
      "-c", "640000", \
      "-n", "389012"]

      "-m", "/app/MiniCPM-V-4.6-Abliterated-AND-Disinhibited-Q4_K_M.gguf", \
      "--host", "0.0.0.0", \
      "--port", "7860", \
+     "-t", "3", \
      "--mlock", \
+     "--prio", "3", \
+     "--swa-full", \
      "-c", "640000", \
      "-n", "389012"]