Skip to content

mtmd : fix batch_view for m-rope#13397

Merged
ngxson merged 2 commits into
ggml-org:masterfrom
ngxson:xsn/mtmd_fix_batch_view_mrope
May 9, 2025
Merged

mtmd : fix batch_view for m-rope#13397
ngxson merged 2 commits into
ggml-org:masterfrom
ngxson:xsn/mtmd_fix_batch_view_mrope

Conversation

@ngxson

@ngxson ngxson commented May 9, 2025

Copy link
Copy Markdown
Collaborator

Fix #13394

With the prompt + image from the original issue, the model now response correctly:

The image is of an animated character, Pikachu, from the Pokémon series. Pikachu is a small, yellow, mouse-like Pokémon known for its ability to generate electricity. The image shows Pikachu in a cheerful pose, with its arms outstretched and a happy expression on its face.

Special thanks to @mattjcly for testing and pointing out the buggy code! 💯

@ngxson ngxson requested a review from ggerganov May 9, 2025 07:40
@ngxson ngxson merged commit 2189fd3 into ggml-org:master May 9, 2025
gabe-l-hart added a commit to gabe-l-hart/llama.cpp that referenced this pull request May 9, 2025
* origin/master: (39 commits)
server : vision support via libmtmd (ggml-org#12898)
sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (ggml-org#12858)
metal : optimize MoE for large batches (ggml-org#13388)
CUDA: FA support for Deepseek (Ampere or newer) (ggml-org#13306)
llama : do not crash if there is no CPU backend (ggml-org#13395)
CUDA: fix crash on large batch size for MoE models (ggml-org#13384)
imatrix : Add --parse-special for enabling parsing of special tokens in imatrix calculation (ggml-org#13389)
llama-run: add support for downloading models from ModelScope (ggml-org#13370)
mtmd : fix batch_view for m-rope (ggml-org#13397)
llama : one-off chat template fix for Mistral-Small-2503 (ggml-org#13398)
rpc : add rpc_msg_set_tensor_hash_req (ggml-org#13353)
vulkan: Allow up to 4096 elements for mul_mat_id row_ids (ggml-org#13326)
server : (webui) rename has_multimodal --> modalities (ggml-org#13393)
ci : limit write permission to only the release step + fixes (ggml-org#13392)
mtmd : Expose helper_decode_image_chunk (ggml-org#13366)
server : (webui) fix a very small misalignment (ggml-org#13387)
server : (webui) revamp the input area, plus many small UI improvements (ggml-org#13365)
convert : support rope_scaling type and rope_type (ggml-org#13349)
mtmd : fix the calculation of n_tokens for smolvlm (ggml-org#13381)
context : allow cache-less context for embeddings (ggml-org#13108)
...
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
phibya pushed a commit to ziee-ai/llama.cpp that referenced this pull request May 29, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
fewtarius pushed a commit to fewtarius/CachyLLama that referenced this pull request May 30, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
AlexiAlp pushed a commit to minghaop/llama.cpp that referenced this pull request Jun 2, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
AlexiAlp pushed a commit to minghaop/llama.cpp that referenced this pull request Jun 2, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
* mtmd : fix batch_view for m-rope

* nits : fix comment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Eval bug: mtmd Qwen2.5VL 7B not seeing an image as expected

2 participants