Describe the Issue
There is a new PR regarding MTP support in llama.cpp:
When searching in this repo I see this comment
// NextN/MTP tensors are currently ignored (reserved for future MTP support)
I am currently having some MTP preserved MLP NVFP4 gguf.
They can be loaded by kobold but I think MTP is being ignored due to no support.
Wonder what is the effort to support it in Koboldcpp once merging the upstream ggml/llama.cpp changes.
Additional Information:
The gguf I am using to test:
https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-NVFP4-GGUF
Thanks.
Describe the Issue
There is a new PR regarding MTP support in llama.cpp:
When searching in this repo I see this comment
I am currently having some MTP preserved MLP NVFP4 gguf.
They can be loaded by kobold but I think MTP is being ignored due to no support.
Wonder what is the effort to support it in Koboldcpp once merging the upstream ggml/llama.cpp changes.
Additional Information:
The gguf I am using to test:
https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-NVFP4-GGUF
Thanks.