环境:
MPI: OpenMPI 2.1.1.
网卡: Mellanox ConnectX-4Lx
OFED: Mellanox_OFED 4.2
OS: Centos7.3
在服务器上有 Mellnaox, Qulogic, Broadcom 三种网卡, OpenMPI 运行在RDMA 时需要指定 mca 参数来避免使用了错误的网卡
命令:
mpirun --hostfile hosts -np 2 --bind-to core --display-map -mca pml ob1 -mca btl self,sm,openib --mca btl_openib_cpc_include rdmacm --map-by node -mca btl_openib_receive_queues P,65536,256,192,128 -mca mpi_add_procs_cutoff 4 /usr/mpi/gcc/openmpi-2.1.2a1/tests/imb/IMB-MPI1