VAAPI fails to work on TrueNAS 'launch docker image' #584

highkick05 · 2023-05-02T03:26:08Z

highkick05
May 2, 2023

I've even tried the truecharts docker however same issues with VAAPI hardware failing.
Frigate seems to have no issues with utilising my intel quicksync (12th gen)
Using roflcoopter/viseron: latest
-- privaledged enabled

intel quicksync is set up correctly and working correctly with frigate

admin@truenas[~]$ sudo ls -l /dev/dri
total 0
drwxr-xr-x 2 root root        80 Apr 26 00:14 by-path
crw-rw---- 1 root video 226,   0 Apr 26 00:14 card0
crw-rw---- 1 root root  226, 128 Apr 26 00:14 renderD128

config.yaml

ffmpeg:
  camera:
    camera_2:
      name: Camera1
      protocol: rtsp
      host: 192.168.50.104
      port: 554
      username: admin
      password: admin
      path: /
      fps: 5
      stream_format: rtsp
      width: 1080
      height: 720
      codec: h264_qsv
      audio_codec: aac
darknet:
  object_detector:
    cameras:
      camera_2:
        fps: 5
        scan_on_motion_only: false
        labels:
          - label: person
            confidence: 0.75
            trigger_recorder: true
mog2:
  motion_detector:
    cameras:
      camera_2:
        fps: 5
nvr:
  camera_2:
logger:
  default_level: debug

Logs

2023-05-02T03:13:50.013840343Z �[0;32m****** Checking for hardware acceleration platforms ******�[0m
2023-05-02T03:13:50.021213122Z �[0;33mOpenCL cannot be used�[0m
2023-05-02T03:13:50.027788865Z �[0;33mVA-API cannot be used�[0m
2023-05-02T03:13:50.196291825Z �[0;33mCUDA cannot be used�[0m

2023-05-02T03:13:53.384273850Z �[31m[2023-05-02 03:13:53] [ERROR   ] [viseron.components.ffmpeg.stream.camera_2] - [AVHWDeviceContext @ 0x55f9cd369c80] libva: /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so init failed�[0m
2023-05-02T03:13:53.384352641Z �[31m[2023-05-02 03:13:53] [ERROR   ] [viseron.components.ffmpeg.stream.camera_2] - [AVHWDeviceContext @ 0x55f9cd369c80] Failed to initialise VAAPI connection: 1 (operation failed).�[0m
2023-05-02T03:13:53.384476722Z �[31m[2023-05-02 03:13:53] [ERROR   ] [viseron.components.ffmpeg.stream.camera_2] - [h264_qsv @ 0x55f9cd2451c0] Failed to create a VAAPI device.�[0m
2023-05-02T03:13:53.384488102Z �[31m[2023-05-02 03:13:53] [ERROR   ] [viseron.components.ffmpeg.stream.camera_2] - [h264_qsv @ 0x55f9cd2451c0] Error initializing an MFX session�[0m
2023-05-02T03:13:53.384551670Z �[31m[2023-05-02 03:13:53] [ERROR   ] [viseron.components.ffmpeg.stream.camera_2] - [h264_qsv @ 0x55f9cd2451c0] Error decoding header�[0m
2023-05-02T03:13:53.384605649Z �[31m[2023-05-02 03:13:53] [ERROR   ] [viseron.components.ffmpeg.stream.camera_2] - Error while decoding stream #0:0: Input/output error�[0m

viseron_viseron-ix-chart-68bc8cbc8f-p2qxf_ix-chart.log

vainfo in viseron container:

# vainfo
error: XDG_RUNTIME_DIR not set in the environment.
error: can't connect to X server!
libva info: VA-API version 1.7.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_7
libva error: /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so init failed
libva info: va_openDriver() returns 1
vaInitialize failed with error code 1 (operation failed),exit

I've been pulling my hair out but ready to give up.

roflcoopter · 2023-05-02T10:02:06Z

roflcoopter
May 2, 2023
Maintainer

Sorry you are having issues! Will investigate, probably some library that needs to be installed

0 replies

roflcoopter · 2023-05-02T10:27:20Z

roflcoopter
May 2, 2023
Maintainer

Two things you can try:

Set this env var in your docker run/docker-compose: LIBVA_DRIVER_NAME=i965

If that does not work, try to do the following:

Exec into the container docker exec -it viseron bash
Install i965-va-driver-shaders: apt-get update && apt-get install --no-install-recommends i965-va-driver-shaders

Whats the output of vainfo in the Frigate container?

2 replies

highkick05 May 2, 2023
Author

Hey there, yeah have narrowed it down to the i965 / iHD .. LIBVA_DRIVER_NAME=i965 is VAAPI yeah? does viseron support iHD ?
LIBVA_DRIVER_NAME=i965 in frigate setup spits out the same problems I'm having in viseron with vaapi libs. So I take it frigate uses the iHD driver:

Frigate vainfo (works with -c:v h264_qsv):

root@frigate-ix-chart-6d54f9cf97-qrglj:/opt/frigate# vainfo
error: XDG_RUNTIME_DIR is invalid or not set in the environment.
error: can't connect to X server!
libva info: VA-API version 1.17.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_17
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.17 (libva 2.10.0)
vainfo: Driver version: Intel iHD driver for Intel(R) Gen Graphics - 23.1.1 ()
vainfo: Supported profile and entrypoints
      VAProfileNone                   : VAEntrypointVideoProc
      VAProfileNone                   : VAEntrypointStats
      VAProfileMPEG2Simple            : VAEntrypointVLD
      VAProfileMPEG2Simple            : VAEntrypointEncSlice
      VAProfileMPEG2Main              : VAEntrypointVLD
      VAProfileMPEG2Main              : VAEntrypointEncSlice
      VAProfileH264Main               : VAEntrypointVLD
      VAProfileH264Main               : VAEntrypointEncSlice
      VAProfileH264Main               : VAEntrypointFEI
      VAProfileH264Main               : VAEntrypointEncSliceLP
      VAProfileH264High               : VAEntrypointVLD
      VAProfileH264High               : VAEntrypointEncSlice
      VAProfileH264High               : VAEntrypointFEI
      VAProfileH264High               : VAEntrypointEncSliceLP
      VAProfileVC1Simple              : VAEntrypointVLD
      VAProfileVC1Main                : VAEntrypointVLD
      VAProfileVC1Advanced            : VAEntrypointVLD
      VAProfileJPEGBaseline           : VAEntrypointVLD
      VAProfileJPEGBaseline           : VAEntrypointEncPicture
      VAProfileH264ConstrainedBaseline: VAEntrypointVLD
      VAProfileH264ConstrainedBaseline: VAEntrypointEncSlice
      VAProfileH264ConstrainedBaseline: VAEntrypointFEI
      VAProfileH264ConstrainedBaseline: VAEntrypointEncSliceLP
      VAProfileHEVCMain               : VAEntrypointVLD
      VAProfileHEVCMain               : VAEntrypointEncSlice
      VAProfileHEVCMain               : VAEntrypointFEI
      VAProfileHEVCMain               : VAEntrypointEncSliceLP
      VAProfileHEVCMain10             : VAEntrypointVLD
      VAProfileHEVCMain10             : VAEntrypointEncSlice
      VAProfileHEVCMain10             : VAEntrypointEncSliceLP
      VAProfileVP9Profile0            : VAEntrypointVLD
      VAProfileVP9Profile1            : VAEntrypointVLD
      VAProfileVP9Profile2            : VAEntrypointVLD
      VAProfileVP9Profile3            : VAEntrypointVLD
      VAProfileHEVCMain12             : VAEntrypointVLD
      VAProfileHEVCMain12             : VAEntrypointEncSlice
      VAProfileHEVCMain422_10         : VAEntrypointVLD
      VAProfileHEVCMain422_10         : VAEntrypointEncSlice
      VAProfileHEVCMain422_12         : VAEntrypointVLD
      VAProfileHEVCMain422_12         : VAEntrypointEncSlice
      VAProfileHEVCMain444            : VAEntrypointVLD
      VAProfileHEVCMain444            : VAEntrypointEncSliceLP
      VAProfileHEVCMain444_10         : VAEntrypointVLD
      VAProfileHEVCMain444_10         : VAEntrypointEncSliceLP
      VAProfileHEVCMain444_12         : VAEntrypointVLD
      VAProfileHEVCSccMain            : VAEntrypointVLD
      VAProfileHEVCSccMain            : VAEntrypointEncSliceLP
      VAProfileHEVCSccMain10          : VAEntrypointVLD
      VAProfileHEVCSccMain10          : VAEntrypointEncSliceLP
      VAProfileHEVCSccMain444         : VAEntrypointVLD
      VAProfileHEVCSccMain444         : VAEntrypointEncSliceLP
      VAProfileAV1Profile0            : VAEntrypointVLD
      VAProfileHEVCSccMain444_10      : VAEntrypointVLD
      VAProfileHEVCSccMain444_10      : VAEntrypointEncSliceLP
root@frigate-ix-chart-6d54f9cf97-qrglj:/opt/frigate#

LIBVA_DRIVER_NAME=iHD env set in Viseron:

root@viseron-ix-chart-77f6b8b88c-l8z29:/src# vainfo
error: XDG_RUNTIME_DIR not set in the environment.
error: can't connect to X server!
libva info: VA-API version 1.7.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_7
libva error: /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so init failed
libva info: va_openDriver() returns 1
vaInitialize failed with error code 1 (operation failed),exit
root@viseron-ix-chart-77f6b8b88c-l8z29:/src#

So it try's to open the iHD side obviously but fails

roflcoopter May 2, 2023
Maintainer

Yeah the same libraries are installed in Viseron, so iHD is supported (i run that on my server)
However Viseron containers run on Ubuntu and Frigate runs on Debian, and there seems to be a version difference.

In my container this is the output:

error: can't connect to X server!
libva info: VA-API version 1.7.0
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_7
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.7 (libva 2.6.0)
vainfo: Driver version: Intel iHD driver for Intel(R) Gen Graphics - 20.1.1 ()
vainfo: Supported profile and entrypoints
      VAProfileMPEG2Simple            : VAEntrypointVLD
      VAProfileMPEG2Main              : VAEntrypointVLD
      VAProfileH264Main               : VAEntrypointVLD
      VAProfileH264Main               : VAEntrypointEncSliceLP
      VAProfileH264High               : VAEntrypointVLD
      VAProfileH264High               : VAEntrypointEncSliceLP
      VAProfileJPEGBaseline           : VAEntrypointVLD
      VAProfileJPEGBaseline           : VAEntrypointEncPicture
      VAProfileH264ConstrainedBaseline: VAEntrypointVLD
      VAProfileH264ConstrainedBaseline: VAEntrypointEncSliceLP
      VAProfileVP8Version0_3          : VAEntrypointVLD
      VAProfileHEVCMain               : VAEntrypointVLD
      VAProfileHEVCMain10             : VAEntrypointVLD
      VAProfileVP9Profile0            : VAEntrypointVLD
      VAProfileVP9Profile2            : VAEntrypointVLD

The Debian packages are probably more updated than the Ubuntu ones.

highkick05 · 2023-05-02T10:59:29Z

highkick05
May 2, 2023
Author

Output of requested apt-get install (note: it removes the previous i965-va-driver package ok?)

admin@truenas[~]$ sudo docker exec -it 8c5f712324bd bash           
root@viseron-ix-chart-77f6b8b88c-l8z29:/src# ls -l
total 17
drwxr-xr-x 1 root root 7 May  2 10:53 viseron
root@viseron-ix-chart-77f6b8b88c-l8z29:/src# sudo apt-get update && apt-get install --no-install-recommends i965-va-driver-shaders
bash: sudo: command not found
root@viseron-ix-chart-77f6b8b88c-l8z29:/src# apt-get update && apt-get install --no-install-recommends i965-va-driver-shaders
Get:1 http://archive.ubuntu.com/ubuntu focal InRelease [265 kB]                                                              
Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB]                                                    
Get:3 https://packages.cloud.google.com/apt coral-edgetpu-stable InRelease [6332 B]                                          
Ign:4 https://packages.cloud.google.com/apt coral-edgetpu-stable/main amd64 Packages                
Get:4 https://packages.cloud.google.com/apt coral-edgetpu-stable/main amd64 Packages [2317 B]
Get:5 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1039 kB]
Get:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB]
Get:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB]
Get:8 http://archive.ubuntu.com/ubuntu focal/restricted amd64 Packages [33.4 kB]
Get:9 http://archive.ubuntu.com/ubuntu focal/multiverse amd64 Packages [177 kB]
Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 Packages [11.3 MB]        
Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2203 kB]
Get:12 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2668 kB]
Get:13 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [28.5 kB]   
Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 Packages [1275 kB]                     
Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3150 kB]                                                                                                                                              
Get:16 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [31.2 kB]                                                                                                                                        
Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2341 kB]                                                                                                                                        
Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1334 kB]                                                                                                                                          
Get:19 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [28.6 kB]                                                                                                                                        
Get:20 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [55.2 kB]                                                                                                                                            
Fetched 26.3 MB in 8s (3099 kB/s)                                                                                                                                                                                                
Reading package lists... Done
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following packages will be REMOVED:
  i965-va-driver
The following NEW packages will be installed:
  i965-va-driver-shaders
0 upgraded, 1 newly installed, 1 to remove and 12 not upgraded.
Need to get 924 kB of archives.
After this operation, 1024 B of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://archive.ubuntu.com/ubuntu focal/multiverse amd64 i965-va-driver-shaders amd64 2.4.0-1build1 [924 kB]
Fetched 924 kB in 2s (402 kB/s)                 
debconf: delaying package configuration, since apt-utils is not installed
(Reading database ... 37055 files and directories currently installed.)
Removing i965-va-driver:amd64 (2.4.0-0ubuntu1) ...
Selecting previously unselected package i965-va-driver-shaders:amd64.
(Reading database ... 37049 files and directories currently installed.)
Preparing to unpack .../i965-va-driver-shaders_2.4.0-1build1_amd64.deb ...
Unpacking i965-va-driver-shaders:amd64 (2.4.0-1build1) ...
Setting up i965-va-driver-shaders:amd64 (2.4.0-1build1) ...
root@viseron-ix-chart-77f6b8b88c-l8z29:/src#

0 replies

highkick05 · 2023-05-02T11:19:18Z

highkick05
May 2, 2023
Author

and after vainfo

LIBVA_DRIVER_NAME=i965:

root@viseron-ix-chart-7d94c974cf-vhjhn:/src# vainfo 
error: XDG_RUNTIME_DIR not set in the environment.
error: can't connect to X server!
libva info: VA-API version 1.7.0
libva info: User environment variable requested driver 'i965'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/i965_drv_video.so
libva info: Found init function __vaDriverInit_1_6
libva error: /usr/lib/x86_64-linux-gnu/dri/i965_drv_video.so init failed
libva info: va_openDriver() returns -1
vaInitialize failed with error code -1 (unknown libva error),exit

LIBVA_DRIVER_NAME=iHD:
root@viseron-ix-chart-c5b76cf7b-529w7:/src# vainfo

error: XDG_RUNTIME_DIR not set in the environment.
error: can't connect to X server!
libva info: VA-API version 1.7.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_7
libva error: /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so init failed
libva info: va_openDriver() returns 1
vaInitialize failed with error code 1 (operation failed),exit

0 replies

roflcoopter · 2023-05-02T12:12:05Z

roflcoopter
May 2, 2023
Maintainer

On another note, have you tried mounted /dev/dri:/dev/dri?

4 replies

highkick05 May 2, 2023
Author

tried a few things.. doesn't appear it wants to work with truenas container. perhaps the version needs updating?

actually from what you mentioned libva would need downgrading to 2.6.0 ? also the iHD driver looks older

roflcoopter May 3, 2023
Maintainer

I'll try to see if I can install it from source to get the latest version, will let you know when it's done

highkick05 May 3, 2023
Author

Thank you :)

roflcoopter May 5, 2023
Maintainer

I upgraded the VAAPI libraries as well as OpenCL and pushed to dev
You can try it out by pulling the dev docker tag.

I dont know if this will solve anything but at least it rules the version out if not

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

VAAPI fails to work on TrueNAS 'launch docker image' #584

{{title}}

Replies: 5 comments 6 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

VAAPI fails to work on TrueNAS 'launch docker image' #584

highkick05 May 2, 2023

Replies: 5 comments · 6 replies

roflcoopter May 2, 2023 Maintainer

roflcoopter May 2, 2023 Maintainer

highkick05 May 2, 2023 Author

roflcoopter May 2, 2023 Maintainer

highkick05 May 2, 2023 Author

highkick05 May 2, 2023 Author

roflcoopter May 2, 2023 Maintainer

highkick05 May 2, 2023 Author

roflcoopter May 3, 2023 Maintainer

highkick05 May 3, 2023 Author

roflcoopter May 5, 2023 Maintainer

highkick05
May 2, 2023

Replies: 5 comments 6 replies

roflcoopter
May 2, 2023
Maintainer

roflcoopter
May 2, 2023
Maintainer

highkick05 May 2, 2023
Author

roflcoopter May 2, 2023
Maintainer

highkick05
May 2, 2023
Author

highkick05
May 2, 2023
Author

roflcoopter
May 2, 2023
Maintainer

highkick05 May 2, 2023
Author

roflcoopter May 3, 2023
Maintainer

highkick05 May 3, 2023
Author

roflcoopter May 5, 2023
Maintainer