Skip to content

Match mlx-vlm Gemma 4 prefill logits - #360

Closed
samir-lms wants to merge 1 commit into
mainfrom
bionic/mlx-vlm-0.6.11-compat
Closed

Match mlx-vlm Gemma 4 prefill logits#360
samir-lms wants to merge 1 commit into
mainfrom
bionic/mlx-vlm-0.6.11-compat

Conversation

@samir-lms

@samir-lms samir-lms commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Forward mlx-vlm's opt-in logits_to_keep=1 contract through batched VLM chunked prefill, final prefill, and decode
  • Preserve exact Gemma 4 generation parity with mlx-vlm 0.6.11 while avoiding full-sequence LM-head projection
  • Add focused prefill/decode forwarding coverage

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown


Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


You can retrigger this bot by commenting recheck in this Pull Request. Posted by the CLA Assistant Lite bot.

@samir-lms

Copy link
Copy Markdown
Contributor Author

Superseded by #361 after renaming the head branch to samir/gemma4-fix.

@samir-lms samir-lms closed this Aug 5, 2026
@github-actions github-actions Bot added the CLA signed Indicates that all contributors have signed label Aug 5, 2026
@github-actions github-actions Bot locked and limited conversation to collaborators Aug 5, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

CLA signed Indicates that all contributors have signed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant