--spec-type mtp?

#1
by Tsurukisan - opened

Which version of ik-llama.cpp are you using? If I run it according to the example command, it says that --spec-type mtp is not available. Naturally, if I run it with regular -md, I get the error 'unknown model architecture : 'gemma4_mtp''.

image
https://github.com/ikawrakow/ik_llama.cpp/blob/main/docs/parameters.md there is no --spec-type mtp here.

Tsurukisan changed discussion title from spec-type mtp? to --spec-type mtp?

Same errors here. I've built the ik-llama.cpp from today's git clone.
llama-server.exe --version
version: 4468 (9a26522a)
built with cc (GCC) 16.1.0 for x86_64-w64-mingw32

Sorry for not making it clear, these versions currently only work on the open PR 1744, so you'll need to build on top of them first.

Sign up or log in to comment