datatransferkit issue on Frontier when trilinos+rocm

[balos1]

==> Installing datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26 [85/99]
==> No binary for datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26 found: installing from source
==> No patches needed for datatransferkit
==> datatransferkit: Executing phase: 'cmake'
==> datatransferkit: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
    '/autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/gmake-4.4.1-7jqylueoixifhkb67bpv2bmvywxkgqix/bin/make' '-j16'

8 errors found in build log:
     260    /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/gmake-4.4.1-7jqylueoixifhkb67bpv2bmvywxkgqix/bin/make  -f packages/Utils/src/CMakeFiles/dtk_utils.dir/buil
            d.make packages/Utils/src/CMakeFiles/dtk_utils.dir/build
     261    make[2]: Entering directory '/tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-build-jbemmcc'
     262    [  5%] Building CXX object packages/Utils/src/CMakeFiles/dtk_utils.dir/DTK_Core.cpp.o
     263    [ 11%] Building CXX object packages/Utils/src/CMakeFiles/dtk_utils.dir/DTK_DBC.cpp.o
     264    cd /tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-build-jbemmcc/packages/Utils/src && /opt/cray/pe/mpich/8.1.23/ofi/gnu/9.1/bin/mpicxx -DKOKKOS_DEPENDENCE
             -Ddtk_utils_EXPORTS -I/tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-build-jbemmcc -I/tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2k
            kvvfsxxilg7gggfi7y26/spack-src/packages/Utils/src -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/trilinos-14.4.0-pzpmafs3fpe5r43pndzso34vcdtoy2p
            y/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/boost-1.83.0-3ezgrjnifq6cfgdrnxblog5hhbzlko73/include -isystem /autofs/nccs-svm1_proj/c
            sc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/kokkos-4.1.00-xpsa77z33v5gw67ifqqwq3zvadnuncwe/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack
            /linux-sles15-zen3/gcc-11.2.0/openblas-0.3.24-zcr3snp2lbobvdzlgcidjnk34jvfov3e/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/metis-5.1.
            0-m4tgtkwbffjj3x7aj7rpuphw5m6asnnf/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/hdf5-1.14.2-hpguvwvnko4p3jbfhrt5movfoa6x5x6q/include -
            isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/superlu-dist-8.2.0-73zev7w2dy2quhb3cap6ofkolzjkssc6/include -isystem /autofs/nccs-svm1_proj/csc326
            /balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/parmetis-4.0.3-gujq7heguwl6rokk2muo5nwvqvsc5uqz/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/lin
            ux-sles15-zen3/gcc-11.2.0/zlib-ng-2.1.4-r6bwlft36f5f3hgm2bgslcwrlf5kic7x/include -pedantic -Wall -Wno-long-long -Wwrite-strings -O3 -DNDEBUG -std=c++17 -fPIC -march=znver3 -mtune=znver3 -fno-gpu-rdc --o
            ffload-arch=gfx90a -MD -MT packages/Utils/src/CMakeFiles/dtk_utils.dir/DTK_Core.cpp.o -MF CMakeFiles/dtk_utils.dir/DTK_Core.cpp.o.d -o CMakeFiles/dtk_utils.dir/DTK_Core.cpp.o -c /tmp/balos1/spack-stage/
            spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-src/packages/Utils/src/DTK_Core.cpp
     265    cd /tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-build-jbemmcc/packages/Utils/src && /opt/cray/pe/mpich/8.1.23/ofi/gnu/9.1/bin/mpicxx -DKOKKOS_DEPENDENCE
             -Ddtk_utils_EXPORTS -I/tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-build-jbemmcc -I/tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2k
            kvvfsxxilg7gggfi7y26/spack-src/packages/Utils/src -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/trilinos-14.4.0-pzpmafs3fpe5r43pndzso34vcdtoy2p
            y/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/boost-1.83.0-3ezgrjnifq6cfgdrnxblog5hhbzlko73/include -isystem /autofs/nccs-svm1_proj/c
            sc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/kokkos-4.1.00-xpsa77z33v5gw67ifqqwq3zvadnuncwe/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack
            /linux-sles15-zen3/gcc-11.2.0/openblas-0.3.24-zcr3snp2lbobvdzlgcidjnk34jvfov3e/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/metis-5.1.
            0-m4tgtkwbffjj3x7aj7rpuphw5m6asnnf/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/hdf5-1.14.2-hpguvwvnko4p3jbfhrt5movfoa6x5x6q/include -
            isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/superlu-dist-8.2.0-73zev7w2dy2quhb3cap6ofkolzjkssc6/include -isystem /autofs/nccs-svm1_proj/csc326
            /balos1/frontier/spack-xsdk/opt/spack/linux-sles15-zen3/gcc-11.2.0/parmetis-4.0.3-gujq7heguwl6rokk2muo5nwvqvsc5uqz/include -isystem /autofs/nccs-svm1_proj/csc326/balos1/frontier/spack-xsdk/opt/spack/lin
            ux-sles15-zen3/gcc-11.2.0/zlib-ng-2.1.4-r6bwlft36f5f3hgm2bgslcwrlf5kic7x/include -pedantic -Wall -Wno-long-long -Wwrite-strings -O3 -DNDEBUG -std=c++17 -fPIC -march=znver3 -mtune=znver3 -fno-gpu-rdc --o
            ffload-arch=gfx90a -MD -MT packages/Utils/src/CMakeFiles/dtk_utils.dir/DTK_DBC.cpp.o -MF CMakeFiles/dtk_utils.dir/DTK_DBC.cpp.o.d -o CMakeFiles/dtk_utils.dir/DTK_DBC.cpp.o -c /tmp/balos1/spack-stage/spa
            ck-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-src/packages/Utils/src/DTK_DBC.cpp
  >> 266    g++: error: unrecognized command-line option '-fno-gpu-rdc'
  >> 267    g++: error: unrecognized command-line option '-fno-gpu-rdc'
  >> 268    g++: error: unrecognized command-line option '--offload-arch=gfx90a'
  >> 269    g++: error: unrecognized command-line option '--offload-arch=gfx90a'
  >> 270    make[2]: *** [packages/Utils/src/CMakeFiles/dtk_utils.dir/build.make:79: packages/Utils/src/CMakeFiles/dtk_utils.dir/DTK_Core.cpp.o] Error 1
     271    make[2]: *** Waiting for unfinished jobs....
  >> 272    make[2]: *** [packages/Utils/src/CMakeFiles/dtk_utils.dir/build.make:93: packages/Utils/src/CMakeFiles/dtk_utils.dir/DTK_DBC.cpp.o] Error 1
     273    make[2]: Leaving directory '/tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-build-jbemmcc'
  >> 274    make[1]: *** [CMakeFiles/Makefile2:1190: packages/Utils/src/CMakeFiles/dtk_utils.dir/all] Error 2
     275    make[1]: Leaving directory '/tmp/balos1/spack-stage/spack-stage-datatransferkit-3.2-jbemmcczcj2kkvvfsxxilg7gggfi7y26/spack-build-jbemmcc'
  >> 276    make: *** [Makefile:149: all] Error 2

[masterleinad]

You need to use hipcc when using Kokkos configured with HIP support. Besides that I'm not sure if DataTransferKit supports Kokkos build with HIP independently.