UCX 1.17.0 - installation

[rodrigofisico]

I am trying to install UCX 1.17.0, but I could not configurate RoCE.

May you help me?

This is my config.

./configure --prefix=/mypath/ucx-1.17.0/install
--with-verbs
--with-rdmacm
--without-cuda
make -j$(nproc)
make install

This is the error

[rodrigo@fend03 ucx-1.17.0]$ ucx_info -d
ucx_info: Symbol `ucs_memory_type_names' has different size in shared object, consider re-linking
#
# Memory domain: self
#     Component: self
#             register: unlimited, cost: 0 nsec
#           remote key: 0 bytes
#           rkey_ptr is supported
#         memory types: host (access,reg_nonblock,reg,cache)
#
#      Transport: self
#         Device: memory
#           Type: loopback
#  System device: <unknown>
#
#      capabilities:
#            bandwidth: 0.00/ppn + 19360.00 MB/sec
#              latency: 0 nsec
#             overhead: 10 nsec
#            put_short: <= 4294967295
#            put_bcopy: unlimited
#            get_bcopy: unlimited
#             am_short: <= 8K
#             am_bcopy: <= 8K
#               domain: cpu
#           atomic_add: 32, 64 bit
#           atomic_and: 32, 64 bit
#            atomic_or: 32, 64 bit
#           atomic_xor: 32, 64 bit
#          atomic_fadd: 32, 64 bit
#          atomic_fand: 32, 64 bit
#           atomic_for: 32, 64 bit
#          atomic_fxor: 32, 64 bit
#          atomic_swap: 32, 64 bit
#         atomic_cswap: 32, 64 bit
#           connection: to iface
#      device priority: 0
#     device num paths: 1
#              max eps: inf
#       device address: 0 bytes
#        iface address: 8 bytes
#       error handling: ep_check
#
free(): invalid pointer
Aborted (core dumped)

[rodrigo@fend03 ucx-1.17.0]$ ldd $(which ucx_info)
        linux-vdso.so.1 (0x00007fff0e35c000)
        libucp.so.0 => /lustre/hpc/software/kemi/openmpi/ucx-1.17.0/install/lib/libucp.so.0 (0x00007f2b1c13f000)
        libuct.so.0 => /lustre/hpc/software/kemi/openmpi/ucx-1.17.0/install/lib/libuct.so.0 (0x00007f2b1c0f4000)
        libucs.so.0 => /lustre/hpc/software/kemi/openmpi/ucx-1.17.0/install/lib/libucs.so.0 (0x00007f2b1c07f000)
        libc.so.6 => /lib64/libc.so.6 (0x00007f2b1be00000)
        libm.so.6 => /lib64/libm.so.6 (0x00007f2b1bd25000)
        libucm.so.0 => /lustre/hpc/software/kemi/openmpi/ucx-1.17.0/install/lib/libucm.so.0 (0x00007f2b1c044000)
        /lib64/ld-linux-x86-64.so.2 (0x00007f2b1c2cb000)
[rodrigo@fend03 ucx-1.17.0]$

[rakhmets]

It seems you are running an executable file of a different version. Please try to execute ucx_info from /lustre/hpc/software/kemi/openmpi/ucx-1.17.0/install/bin.