ffmpeg crashed while trying to decode h264.

[ibashe]

I tried to decode h264 to yuv and ffmpeg crashed.
Here is the log and the ffmpeg command.
I've tried different h264 file and same result.

root@unassigned-hostname:~/vmedia# ffmpeg -codec:v h264_v4l2m2m -i space.h264 out.yuv ffmpeg -codec:v h264_v4l2m2m -i space.h264 out.yuv
ffmpeg version 5.1.6-0+deb12u1 Copyright (c) 2000-2024 the FFmpeg developers
built with gcc 12 (Debian 12.2.0-14)
configuration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared
libavutil 57. 28.100 / 57. 28.100
libavcodec 59. 37.100 / 59. 37.100
libavformat 59. 27.100 / 59. 27.100
libavdevice 59. 7.100 / 59. 7.100
libavfilter 8. 44.100 / 8. 44.100
libswscale 6. 7.100 / 6. 7.100
libswresample 4. 7.100 / 4. 7.100
libpostproc 56. 6.100 / 56. 6.100
[h264 @ 0x560f53f49d00] non-existing SPS 0 referenced in buffering period
Last message repeated 1 times
Input #0, h264, from 'space.h264':
Duration: N/A, bitrate: N/A
Stream #0:0: Video: h264 (Main), yuv420p(tv, progressive), 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 1200k tbn
[h264_v4l2m2m @ 0x560f53f4fb80] Using device /dev/video0
[h264_v4l2m2m @ 0x560f53f4fb80] driver 'virtio-media' on card 'ffmpeg decoder adapter' in mplane mode
[h264_v4l2m2m @ 0x560f53f4fb80] requesting formats: output=H264 capture=NV12
Stream mapping:
Stream #0:0 -> #[h264 @ 0x796b340038c0] non-existing SPS 0 referenced in buffering period
0:0 (h264 (h264_v4l2m2m) -> rawvideo (native))
Press [q] to stop, [?] for help
[2025-02-11T00:09:55.993939439+00:00 INFO devices::virtio::video::decoder::backend::ffmpeg] resolution changed to (1280, 720)
Output #0, rawvideo, to 'out.yuv':
Metadata:
encoder : Lavf59.27.100
Stream #0:0: Video: rawvideo (NV12 / 0x3231564E), nv12(progressive), 1280x720, q=2-31, 276480 kb/s, 25 fps, 25 tbn
Metadata:
encoder : Lavc59.37.100 rawvideo
[2025-02-11T00:09:58.652491037+00:00 ERROR devices::proxy] recv from pcivirtio-fs child device process failed: tube was disconnected
Segmentation fault

[Gnurou]

Hi,

Are you able to decode the streams mentioned in the TRY_IT_OUT.md document, or any other stream for that matter? Can you share one of the streams that fails?

[ibashe]

I used the file below and removed the container as follows, then passed it to play:

ffmpeg -i Big_Buck_Bunny_720_10s_2MB.mp4 -c:v copy -an -bsf:v h264_mp4toannexb Big_Buck_Bunny_720_10s_2MB.h264

You can download the file from: Big Buck Bunny Test Video.
https://test-videos.co.uk/vids/bigbuckbunny/mp4/h264/720/Big_Buck_Bunny_720_10s_2MB.mp4

With this clip, it did not crash, but it only created an output of 3 frames instead of decoding the entire file like the MP4 version.

Then I executed this command:

root@unassigned-hostname:~/vmedia# ffmpeg -v trace -codec:v h264_v4l2m2m -i Big_Buck_Bunny_720_10s_2MB.h264 out.yuv -y
ffmpeg version 5.1.6-0+deb12u1 Copyright (c) 2000-2024 the FFmpeg developers
built with gcc 12 (Debian 12.2.0-14)
configuration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared
libavutil 57. 28.100 / 57. 28.100
libavcodec 59. 37.100 / 59. 37.100
libavformat 59. 27.100 / 59. 27.100
libavdevice 59. 7.100 / 59. 7.100
libavfilter 8. 44.100 / 8. 44.100
libswscale 6. 7.100 / 6. 7.100
libswresample 4. 7.100 / 4. 7.100
libpostproc 56. 6.100 / 56. 6.100
Splitting the commandline.
Reading option '-v' ... matched as option 'v' (set logging level) with argument 'trace'.
Reading option '-codec:v' ... matched as option 'codec' (codec name) with argument 'h264_v4l2m2m'.
Reading option '-i' ... matched as input url with argument 'Big_Buck_Bunny_720_10s_2MB.h264'.
Reading option 'out.yuv' ... matched as output url.
Reading option '-y' ... matched as option 'y' (overwrite output files) with argument '1'.
Finished splitting the commandline.
Parsing a group of options: global .
Applying option v (set logging level) with argument trace.
Applying option y (overwrite output files) with argument 1.
Successfully parsed a group of options.
Parsing a group of options: input url Big_Buck_Bunny_720_10s_2MB.h264.
Applying option codec:v (codec name) with argument h264_v4l2m2m.
Successfully parsed a group of options.
Opening an input file: Big_Buck_Bunny_720_10s_2MB.h264.
[NULL @ 0x56257f0ee980] Opening 'Big_Buck_Bunny_720_10s_2MB.h264' for reading
[file @ 0x56257f0ef200] Setting default whitelist 'file,crypto,data'
Probing h264 score:51 size:2048
[h264 @ 0x56257f0ee980] Format h264 probed with size=2048 and score=51
[h264 @ 0x56257f0ee980] Before avformat_find_stream_info() pos: 0 bytes read:32768 seeks:0 nb_streams:1
[extract_extradata @ 0x56257f110740] nal_unit_type: 6(SEI), nal_ref_idc: 0
[extract_extradata @ 0x56257f110740] nal_unit_type: 7(SPS), nal_ref_idc: 3
[extract_extradata @ 0x56257f110740] nal_unit_type: 8(PPS), nal_ref_idc: 3
[extract_extradata @ 0x56257f110740] nal_unit_type: 5(IDR), nal_ref_idc: 3
[h264 @ 0x56257f0efcc0] nal_unit_type: 6(SEI), nal_ref_idc: 0
[h264 @ 0x56257f0efcc0] nal_unit_type: 7(SPS), nal_ref_idc: 3
[h264 @ 0x56257f0efcc0] nal_unit_type: 8(PPS), nal_ref_idc: 3
[h264 @ 0x56257f0efcc0] nal_unit_type: 5(IDR), nal_ref_idc: 3
[h264 @ 0x56257f0efcc0] Format yuv420p chosen by get_format().
[h264 @ 0x56257f0efcc0] Reinit context to 1280x720, pix_fmt: yuv420p
[h264 @ 0x56257f0efcc0] no picture
[h264 @ 0x56257f0ee980] max_analyze_duration 5000000 reached at 5000000 microseconds st:0
[h264 @ 0x56257f0ee980] stream 0: start_time: NOPTS duration: NOPTS
[h264 @ 0x56257f0ee980] format: start_time: NOPTS duration: NOPTS (estimate from bit rate) bitrate=0 kb/s
[h264 @ 0x56257f0ee980] After avformat_find_stream_info() pos: 983040 bytes read:983040 seeks:0 frames:152
Input #0, h264, from 'Big_Buck_Bunny_720_10s_2MB.h264':
Duration: N/A, bitrate: N/A
Stream #0:0, 152, 1/1200000: Video: h264 (High), 1 reference frame, yuv420p(progressive, left), 1280x720 [SAR 1:1 DAR 16:9], 0/1, 30 fps, 30 tbr, 1200k tbn
Successfully opened the file.
Parsing a group of options: output url out.yuv.
Successfully parsed a group of options.
Opening an output file: out.yuv.
[file @ 0x56257f10bdc0] Setting default whitelist 'file,crypto,data'
Successfully opened the file.
[h264_mp4toannexb @ 0x56257f10cb00] The input looks like it is Annex B already
[h264_v4l2m2m @ 0x56257f10ac80] probing device /dev/video0
[h264_v4l2m2m @ 0x56257f10ac80] driver 'virtio-media' on card 'ffmpeg decoder adapter' in mplane mode
[h264_v4l2m2m @ 0x56257f10ac80] Using device /dev/video0
[h264_v4l2m2m @ 0x56257f10ac80] driver 'virtio-media' on card 'ffmpeg decoder adapter' in mplane mode
[h264_v4l2m2m @ 0x56257f10ac80] requesting formats: output=H264 capture=NV12
[h264_v4l2m2m @ 0x56257f10ac80] output: H264 16 buffers initialized: 1280x0720, sizeimage 01048576, bytesperline 00000000
Stream mapping:
Stream #0:0 -> #0:0 (h264 (h264_v4l2m2m) -> rawvideo (native))
Press [q] to stop, [?] for help
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless if it occurs once at the start per stream)
[h264_v4l2m2m @ 0x56257f10ac80] capture: NV12 20 buffers initialized: 1280x0720, sizeimage 01382400, bytesperline 00001280
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless if it occurs once at the start per stream)
[2025-02-12T17:47:19.232674135+00:00 INFO devices::virtio::video::decoder::backend::ffmpeg] resolution changed to (1280, 720)
Last message repeated 2 times
detected 1 logical cores
[graph 0 input from stream 0:0 @ 0x56257f0f6280] Setting 'video_size' to value '1280x720'
[graph 0 input from stream 0:0 @ 0x56257f0f6280] Setting 'pix_fmt' to value '23'
[graph 0 input from stream 0:0 @ 0x56257f0f6280] Setting 'time_base' to value '1/1200000'
[graph 0 input from stream 0:0 @ 0x56257f0f6280] Setting 'pixel_aspect' to value '0/1'
[graph 0 input from stream 0:0 @ 0x56257f0f6280] Setting 'frame_rate' to value '30/1'
[graph 0 input from stream 0:0 @ 0x56257f0f6280] w:1280 h:720 pixfmt:nv12 tb:1/1200000 fr:30/1 sar:0/1
[AVFilterGraph @ 0x56257f10d300] query_formats: 3 queried, 2 merged, 0 already done, 0 delayed
Output #0, rawvideo, to 'out.yuv':
Metadata:
encoder : Lavf59.27.100
Stream #0:0, 0, 1/30: Video: rawvideo, 1 reference frame (NV12 / 0x3231564E), nv12(progressive), 1280x720 (0x0), 0/1, q=2-31, 331776 kb/s, 30 fps, 30 tbn
Metadata:
encoder : Lavc59.37.100 rawvideo
Clipping frame in rate conversion by 0.000008
*** dropping frame 3 from stream 0 at ts 0 time=00:00:00.06 bitrate=314571.2kbits/s speed= 3.1x
Last message repeated 171 times
*** dropping frame 3 from stream 0 at ts 0 time=00:00:00.10 bitrate=314572.8kbits/s dup=0 drop=172 speed=0.191x
Last message repeated 123 times
[out_0_0 @ 0x56257f0f7000] EOF on sink link out_0_0:default.
*** dropping frame 3 from stream 0 at ts 0
No more output streams to write to, finishing.
frame= 3 fps=0.0 q=-0.0 Lsize= 4050kB time=00:00:00.10 bitrate=331776.0kbits/s dup=0 drop=297 speed=0.113x
video:4050kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.000000%
Input file #0 (Big_Buck_Bunny_720_10s_2MB.h264):
Input stream #0:0 (video): 300 packets read (1974201 bytes); 300 frames decoded;
Total: 300 packets (1974201 bytes) demuxed
Output file #0 (out.yuv):
Output stream #0:0 (video): 3 frames encoded; 3 packets muxed (4147200 bytes);
Total: 3 packets (4147200 bytes) muxed
[AVIOContext @ 0x56257f10d5c0] Statistics: 4147200 bytes written, 0 seeks, 16 writeouts
300 frames successfully decoded, 0 decoding errors
[AVIOContext @ 0x56257f0f7600] Statistics: 1974201 bytes read, 0 seeks

root@unassigned-hostname:~/vmedia# ls -l out.yuv
-rw-r--r-- 1 root root 4147200 Feb 12 12:47 out.yuv