I am currently getting a stutter during panning-shots with Minimax H3. It happens every 24 frames (So once per second) where it's like a frame is missing and a double-jump in temporal motion happens (Like it skips a frame, almost as if it was expecting 25 frames-per-second)
I don't know if it's possibly related to this issue (Where it was every 17th frame) in ComfyUI, or based on some similar mechanism perhaps:
A link to the issue-post on Comfy-org: Comfy-Org/ComfyUI#15426
When asking Google about it I got this reply (Probably related to the ComfyUI issue and not really the issue I'm seeing with every 24th frame stuttering) :
"The frame-boundary and panning stutter you are experiencing with MiniMax H3 is a known bug caused by a math mismatch in how the model handles masked rows and sigma values during generation.
This frequently causes noticeable frame stutters or periodic dark frames at exact 17-frame intervals, which becomes highly visible during continuous panning or tracking shots.
[1] (https://github.com/Comfy-Org/ComfyUI/issues/154[2](https://github.com/Comfy-Org/ComfyUI/issues/15978)6), [2] (Comfy-Org/ComfyUI#15978)
How to Fix the Panning Stutter1. Update ComfyUI (The Official Fix)
A regression fix was recently pushed to ComfyUI to fix this specific issue by properly scaling the returned video velocities by their corresponding denoise masks.
[1] (Comfy-Org/ComfyUI#15978: Update your ComfyUI to the latest master version (or at least v0.34.0+ with the patched math fixes).
[1] (https://huggingface.co/Kijai/MiniMax-H3_comfy/discussions/5), [2] (Comfy-Org/ComfyUI#15978)"
@deepbeepmeep : is this something you are aware of and can possibly fix?
Any tips and tricks to avoid the stutter are welcome.
Thanks, jacob.
I am currently getting a stutter during panning-shots with Minimax H3. It happens every 24 frames (So once per second) where it's like a frame is missing and a double-jump in temporal motion happens (Like it skips a frame, almost as if it was expecting 25 frames-per-second)
I don't know if it's possibly related to this issue (Where it was every 17th frame) in ComfyUI, or based on some similar mechanism perhaps:
A link to the issue-post on Comfy-org: Comfy-Org/ComfyUI#15426
When asking Google about it I got this reply (Probably related to the ComfyUI issue and not really the issue I'm seeing with every 24th frame stuttering) :
"The frame-boundary and panning stutter you are experiencing with MiniMax H3 is a known bug caused by a math mismatch in how the model handles masked rows and sigma values during generation.
This frequently causes noticeable frame stutters or periodic dark frames at exact 17-frame intervals, which becomes highly visible during continuous panning or tracking shots.
[1] (https://github.com/Comfy-Org/ComfyUI/issues/154[2](https://github.com/Comfy-Org/ComfyUI/issues/15978)6), [2] (Comfy-Org/ComfyUI#15978)
How to Fix the Panning Stutter1. Update ComfyUI (The Official Fix)
A regression fix was recently pushed to ComfyUI to fix this specific issue by properly scaling the returned video velocities by their corresponding denoise masks.
[1] (Comfy-Org/ComfyUI#15978: Update your ComfyUI to the latest master version (or at least v0.34.0+ with the patched math fixes).
[1] (https://huggingface.co/Kijai/MiniMax-H3_comfy/discussions/5), [2] (Comfy-Org/ComfyUI#15978)"
@deepbeepmeep : is this something you are aware of and can possibly fix?
Any tips and tricks to avoid the stutter are welcome.
Thanks, jacob.