Skip to content

[Feature Request] MTP support when loading corresponding gguf #2193

Description

@johnlabor

Describe the Issue

There is a new PR regarding MTP support in llama.cpp:

When searching in this repo I see this comment

// NextN/MTP tensors are currently ignored (reserved for future MTP support)

I am currently having some MTP preserved MLP NVFP4 gguf.
They can be loaded by kobold but I think MTP is being ignored due to no support.

Wonder what is the effort to support it in Koboldcpp once merging the upstream ggml/llama.cpp changes.

Additional Information:
The gguf I am using to test:
https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-NVFP4-GGUF

Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions