diff --git a/docs/tuning-apps/networking/ofi.rst b/docs/tuning-apps/networking/ofi.rst index 4c9ba56290c..8086e9d7aa3 100644 --- a/docs/tuning-apps/networking/ofi.rst +++ b/docs/tuning-apps/networking/ofi.rst @@ -18,6 +18,7 @@ including (but not limited to): * Cisco usNIC * Cray uGNI * Cornelius Networks Omni-Path +* HPE Slingshot 11 In general, the OFI-based components in Open MPI will auto-select themselves as appropriate at run time. @@ -43,8 +44,9 @@ communications: ``FI_EP_RDM`` endpoints, ``FI_TAGGED`` capabilities, and ``FI_ORDER_SAS`` ordering). -#. ``ofi`` BTL: Available since Open MPI v4.0.0, this component is - used for one-sided MPI communications (e.g., ``MPI_PUT``). The +#. ``ofi`` BTL: Available since Open MPI v4.0.0, this component is primarily + intended for one-sided MPI communications (e.g., ``MPI_PUT``). It + can also support BTL send/recv operations. ``ofi`` BTL requires that the Libfabric provider support reliable datagrams, RMA and atomic operations, and remote atomic completion notifications (specifically: ``FI_EP_RDM`` endpoints, ``FI_RMA`` @@ -76,6 +78,11 @@ list. For example: shell$ ompi_info --param mtl ofi --level 9 +.. important:: When using the HPE CXI provider and ``mpirun`` as the job launcher, + the PRTE ``ras_base_launch_orted_on_hn`` MCA parameter must be set to 1. + This can be done by adding ``--prtemca ras_base_launch_orted_on_hn 1`` to the job launch + command line. + For more information refer to the `Libfabric web site `_.