| Requirements | DL Package | MVAPICH Library | Userguide |
| MCR-DL | MCR-DL v0.1 | MVAPICH-Plus MVAPICH2-GDR |
Userguide |
| ParaInfer-X | ParaInfer-X v1.0 | MVAPICH-Plus MVAPICH2-GDR |
Userguide |
| MPI-Driven DL Training (MPI4DL) | MPI4DL | MVAPICH-Plus MVAPICH2-GDR |
Userguide |
MPI-Driven DL Training (TensorFlow, Pytorch, MXNet)
|
Horovod (see userguide) |
MVAPICH-Plus MVAPICH2-GDR MVAPICH2-X |
Userguide |
| MPI-Driven ML Training (MPI4cuML) |
mpi4cuml-0.5 |
MVAPICH-Plus MVAPICH2-GDR |
Userguide |
| Data-Parallel Training with Caffe | OSU-Caffe |
MVAPICH-Plus MVAPICH2-GDR |
Userguide |
| High-Performance InfiniBand Support for TensorFlow | RDMA-TensorFlow |
MVAPICH-Plus MVAPICH2-GDR |
Userguide |
MCR-DL
- The MCR-DL v0.1 library is distributed under the Apache License.
- MCR-DL (12/22/2023).Total Clones: 669
- GitHub for MCR-DL.
- Please email us at hidl-discuss@lists.osu.edu if you encounter any issues. Also let us know if you experience any trouble installing the library on your system.
ParaInfer-X
- The ParaInfer-X v1.0 library includes Flover, which is distributed under the Apache License.
- ParaInfer-X 1.0 (11/09/2023).Total Clones: 602
- GitHub for ParaInfer-X.
- Please email us at hidl-discuss@lists.osu.edu if you encounter any issues. Also let us know if you experience any trouble installing the library on your system.
MPI4DL
- The MPI4DL library is distributed under the Apache License.
- MPI4DL 0.6 (11/09/2023).Total Clones: 1047
- GitHub for MPI4DL.
- Please email us at hidl-discuss@lists.osu.edu if you encounter any issues. Also let us know if you experience any trouble installing the library on your system.
MPI4cuML 0.5
- The MPI4cuML library is distributed under the BSD License.
- MPI4cuML 0.5 (11/10/2022).
- Userguide for MPI4cuML 0.5.
- Please email us at hidl-discuss@lists.osu.edu if you encounter any issues. Also let us know if you experience any trouble installing the library on your system.
OSU-Caffe 0.9
- The OSU-Caffe library is distributed under the BSD License.
- OSU-Caffe 0.9 (11/10/2016).
-
As an initial technology preview, we are providing RHEL6 and RHEL7
RPMs. These RPMs contain the OSU-Caffe software on the corresponding
distro. Please note that the RHEL RPMs are
compatible with CentOS as well. For Debian/Ubuntu users, please
follow the instructions in the
install section in the userguide.
RHEL/CENTOS 7 RPMs OFED GNU INTEL MLNX-OFED 3.2 [CUDA 7.5] [CUDA 7.5] RHEL/CENTOS 6 RPMs OFED GNU INTEL MLNX-OFED 3.2 [CUDA 7.5] [CUDA 7.5] -
Please note that all RPMs where built using the following version of the respective compilers:
- gcc (GCC) 4.9.3
- icc (ICC) 15.0.0 20140723
- For INSTALL and usage information please refer to the userguide
- Please email us at mvapich-help@cse.ohio-state.edu if you require a RPM built against a different version of CUDA or OFED. Also let us know if you experience any trouble installing the library on your system.
RDMA-TensorFlow 0.9.1
- The RDMA-TensorFlow library is distributed under the BSD License.
- RDMA-TensorFlow 0.9.1 (07/23/2018).
- Userguide
- Download rdma_tensorflow-0.9.1
-
Please note that the whl package were built using the following:
- gcc (GCC) 4.8.5
- glibc 2.17
- Python 2.7
- CUDA 8.0
- CUDNN 5.0
- Please email us at hidl-discuss@lists.osu.edu if you encounter any issues. Also let us know if you experience any trouble installing the library on your system.
MVAPICH2-GDR 2.3.7 Library
- The MVAPICH2-GDR library is distributed under the BSD License.
- OSU MVAPICH2-GDR 2.3.7 (5/27/2022), ABI compatible with MPICH-3.2.1.
- MVAPICH2-GDR User Guide: A detailed user guide with instructions to install MVAPICH2-GDR and execute MPI programs over GPU buffers is available.
- Installation using Spack: A detailed user guide with instructions to install MVAPICH2-GDR using Spack is available here.
- These RPMs contain the MVAPICH2-GDR software on the corresponding
distro. Please note that the RHEL RPMs are compatible
with CentOS as well. For Debian/Ubuntu users, please follow the instructions in
the install section in the userguide.
OpenPOWER RPMs OFED GNU 4.9.3 GNU 4.9.3 (w/ jsrun) GNU 7.3.1 GNU 7.3.1 (w/ jsrun) GNU 8.3.1 GNU 8.3.1 (w/ jsrun) XLC 16.01 XLC 16.01 (w/ jsrun) MLNX-OFED 4.7(Lassen/Sierra) [CUDA 10.2]
[CUDA 11.0]
[CUDA 11.2]
[CUDA 11.6]
[CUDA 10.1]
[CUDA 11.0]
[CUDA 11.1]
[CUDA 11.4]
[CUDA 11.6]
[CUDA 10.2]
[CUDA 11.0]
[CUDA 11.2]
[CUDA 11.6]
[CUDA 10.1]
[CUDA 11.0]
[CUDA 11.1]
[CUDA 11.4]
[CUDA 11.6]
[CUDA 10.2]
[CUDA 11.0]
[CUDA 11.2]
[CUDA 11.6]
[CUDA 10.1]
[CUDA 11.0]
[CUDA 11.1]
[CUDA 11.4]
[CUDA 11.6]
[CUDA 10.2]
[CUDA 11.0]
[CUDA 11.2]
[CUDA 11.6]
[CUDA 10.1]
[CUDA 11.0]
[CUDA 11.1]
[CUDA 11.4]
[CUDA 11.6]
OFED GNU 7.5.0 GNU 7.5.0 (w/jsrun) XLC 16.01 XLC 16.01 (w/jsrun) MLNX-OFED 4.9(Summit) [CUDA 10.2]
[CUDA 11.4]
[CUDA 10.2]
[CUDA 11.4]
[CUDA 10.2]
[CUDA 11.4]
[CUDA 10.2]
[CUDA 11.4]
x86 RPMs CUDA OFED GNU 4.8.5 (w/o SLURM) GNU 4.8.5 (w/ SLURM) GNU 7.3.0 (w/o SLURM) GNU 7.3.0 (w/ SLURM) MLNX-OFED 5.x [CUDA 11.0]
[CUDA 11.2]
[CUDA 11.0]
[CUDA 11.2]
[CUDA 11.0]
[CUDA 11.2]
[CUDA 11.0]
[CUDA 11.2]
OFED GNU 8.5.0 (w/o SLURM) GNU 8.5.0 (w/ SLURM) MLNX-OFED 5.5 [CUDA 11.6]
[CUDA 11.6]
OFED GNU 11.2.0 (w/o SLURM) GNU 11.2.0 (w/SLURM) Cray-OFED 5.1 (NERSC Perlmutter) [CUDA 11.5]
[CUDA 11.5]
OFED GNU 8.4.1 (w/o SLURM) Intel 19.0.5 (w/o SLURM) MLNX-OFED 5.6 - Optimized for NVIDIA A100 GPUs [CUDA 11.3]
[CUDA 11.3]
ROCM OFED GNU 10.3.1 (w/o SLURM) GNU 10.3.1 (w/ SLURM) Intel 19.0.4 (w/o SLURM) Intel 19.0.4 (w/ SLURM) MLNX-OFED 5.0 (Corona) [ROCM 5.1]
[ROCM 5.1]
[ROCM 5.1]
[ROCM 5.1]
*Note that the MOFED 5.x RPMs were built against MOFED 5.0 - However, these RPMs should work against the other MOFEDs with the same major MOFED version number
- e.g MOFED 5.0 RPMs should work if you have MOFED 5.0 & 5.1
- Please email mvapich-help@cse.ohio-state.edu if you encounter any issues
- Please note that, unless otherwise specified, all RPMs were built using the following version of the respective compilers:
- GNU (GCC) 4.8.5
- PGI 20.9 64-bit target on x86-64 Linux (CUDA 11.0)
- For INSTALL and usage information please refer to the userguide
- The RPMs contained in our libraries are relocatable and can be installed using a prefix other than the default of /opt/mvapich2/.
- Install library specifying custom prefix
$ rpm --prefix /custom/install/prefix -Uvh --nodeps mvapich2-gdr-mcast.cuda9.2.mofed4.3.pgi18.5.pbs-2.3-2.el7.x86_64.rpm
- If you do not have root permission or are on a system that does not use RPMs you can use rpm2cpio to extract the library.
$ rpm2cpio mvapich2-gdr-mcast.cuda9.2.mofed4.3.pgi18.5.pbs-2.3-2.el7.x86_64.rpm | cpio -id
When using the rpm2cpio method, you will need to update the MPI compiler scripts, such as mpicc, in order to point to the correct path of where you place the library. - Tip: If you are using a Debian based system such as Ubuntu you can convert the rpm to a deb using a tool such as alien or follow the rpm2cpio instructions above.
- Check the list below if your system configuration does not match any from the tables above.
- MOFED4.5
- mvapich2-gdr-cuda10.2.mofed4.5.gnu7.3.0-2.3.7-1.el7a.ppc64le.rpm
e16ca77bdd638fe9d25c090a5cb3bce7a34dcd67a8b772735d822198bd85187e
- mvapich2-gdr-cuda10.2.mofed4.5.nccl2.12.12.gnu7.3.0-2.3.7-1.el7a.ppc64le.rpm
d447790c0f002cccb0562ae482262fadd7c726d806aa9b77f2fca67b91ca44bd
- mvapich2-gdr-cuda10.2.mofed4.5.xlc16.01.0001.0003-2.3.7-1.el7a.ppc64le.rpm
6d2e5b0207d76949a3b71b998b7fc300897266bd74ae7105fcf6eb1cc64e986c
- mvapich2-gdr-cuda10.2.mofed4.5.gnu7.3.0-2.3.7-1.el7a.ppc64le.rpm
- MOFED4.7
- mvapich2-gdr-cuda10.2.mofed4.7.gnu4.9.3.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
978ccfdf647fd5c45c8c14e54ed7ce286d333594e94dc7b30c46e68a90905f2e
- mvapich2-gdr-cuda10.2.mofed4.7.gnu7.3.1.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
7b08d0f3da0841cab7398bb9adaabdfa77e7767576e0c1756951be76de5bdfb1
- mvapich2-gdr-cuda10.2.mofed4.7.gnu8.3.1.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
7812be0e0f56efd87475605b23cf0066f17b936a31a23938e2bb44f3db03361a
- mvapich2-gdr-cuda10.2.mofed4.7.xlc16.01.0001.0010.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
3ee5f8afe76ff2dbef3c51d3150c2db3d2ac7d11f425819abb2661c1442cd202
- mvapich2-gdr-cuda11.2.mofed4.7.gnu4.9.3.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
e3dc1710722f9a7d8efad11edc01070e074b4e2eff314db5c9d1b2116f6ae267
- mvapich2-gdr-cuda11.2.mofed4.7.gnu7.3.1.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
df8e8854feca151b3df716f6f4777171a8ffc7117a849d3318d6c98af0493a22
- mvapich2-gdr-cuda11.2.mofed4.7.gnu8.3.1.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
6024533cada1b32f29f1e7380ca855162352656b76b2af0c3d6f36b606c19f2c
- mvapich2-gdr-cuda11.2.mofed4.7.gnu9.3.0-2.3.7-1.el7.x86_64.rpm
7a124a49a17ede59c0001b0e21eaf864315b3c2ff0ccf5b65aced91b5f32ad82
- mvapich2-gdr-cuda11.2.mofed4.7.xlc16.01.0001.0010.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
9ea8dd262973e371a5251a0f49215c1dc2bb3c903f5f6d8380bf06ec7f0a50b0
- mvapich2-gdr-cuda10.2.mofed4.7.gnu4.9.3.jsrun-2.3.7-1.ch6_2.ppc64le.rpm
- MOFED4.9
- mvapich2-gdr-cuda10.2.mofed4.9.gnu8.5.0.slurm-2.3.7-1.el8.x86_64.rpm
1c8f8e4d509b084c201b3117fff0474a0bb24f05d88140803f2d5532f4536705
- mvapich2-gdr-cuda11.6.mofed4.9.gnu8.5.0.slurm-2.3.7-1.el8.x86_64.rpm
0fbb604229a311c73ee7ea7beb283e07d44282423dc630d2f5bfd41f6141fb5a
- mvapich2-gdr-cuda11.6.mofed4.9.intel19.0.5.281.slurm-2.3.7-1.el7_9.x86_64.rpm
82d0b6111f1f8f06cece462a9369cd21be423a6eeaebd7fde4876a44391df3a9
- mvapich2-gdr-cuda11.6.mofed4.9.intel2021.1.2.slurm-2.3.7-1.el7.x86_64.rpm
1201fd51be51983008124b4eb1f76726983c9b1e47b4870be50c77b488a1671e
- mvapich2-gdr-cuda11.6.mofed4.9.intel2021.1.2.slurm-2.3.7-1.el7.x86_64_nogpuarch.rpm
2383bc3fa32b0695d6fa6fa775faed546bdd56c1287728a26a4fd531c17ae197
- mvapich2-gdr-cuda11.6.mofed4.9.intel2021.1.2.slurm-2.3.7-1.el7.x86_64_pascal.rpm
ca3c4519fdc674a11295913e928b019860c3756df303612c7b17f6dd59672eac
- mvapich2-gdr-cuda10.2.mofed4.9.gnu8.5.0.slurm-2.3.7-1.el8.x86_64.rpm
- MOFED5.0
- mvapich2-gdr-cuda11.3.mofed5.0.gnu9.1.0-2.3.7-1.el7.x86_64.rpm
42578a5447188e49b427fa00c072d9d3411682271b65d171d18d7d8458833417
- mvapich2-gdr-cuda11.3.mofed5.0.intel19.1.1.217-2.3.7-1.el7.x86_64.rpm
1027f40f3f56de157b79e5a36b7c325ee688a583fec04087f13d59850092437f
- mvapich2-gdr-cuda11.3.mofed5.0.pgi20.7-2.3.7-1.el7.x86_64.rpm
8e48bb39dc9c8c347afd205534b8f7bc1b174d63bfe8b615ab3e56605ba55743
- mvapich2-gdr-cuda11.3.mofed5.0.gnu9.1.0-2.3.7-1.el7.x86_64.rpm
- MOFED5.1
- mvapich2-gdr-cuda11.2.mofed5.1.gnu9.3.0-2.3.7-1.el8.x86_64.rpm
164a45265976297d85f828cdefd4b19ee0fd9de8f348c8688598bc7910f52bc6
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0-2.3.7-1.el8.x86_64-ampere.rpm
926fe97e5e8bb3e7c9862418151878a4ad356362e9af653a81380234a76e7328
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0-2.3.7-1.el8.x86_64-pascal.rpm
7bae13fad3fd5b4a6e42af29e02afd14124a23e9b73792561d63ab476f46d20e
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0-2.3.7-1.el8.x86_64-turing.rpm
387d43e11760776be52602129069cb144bdedea50c00b6960c793a21156cdee9
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0-2.3.7-1.el8.x86_64-volta.rpm
a51122a4df340b995777c8fd0bfefa67b40b50e2cb74a6a46c88e959d795d452
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0.slurm-2.3.7-1.el8.x86_64-ampere.rpm
b721f688a5120fcc4de2d6185ed8166a49eb4324c9c970636eac3393e93f3311
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0.slurm-2.3.7-1.el8.x86_64-pascal.rpm
ab531dbda7461766fdb0b0f39038bc72fb9d7c235880a44b5043aaadcdebe096
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0.slurm-2.3.7-1.el8.x86_64-turing.rpm
ee7709d74b4f88c2495b33cda65d50c872ce4c26cc9559418301ce1a345cec23
- mvapich2-gdr-cuda11.7.mofed5.1.gnu10.3.0.slurm-2.3.7-1.el8.x86_64-volta.rpm
249453a48094dea097cb2ab0161d93644748ed280bf5652c02626a0371bd2cb9
- mvapich2-gdr-cuda11.7.mofed5.1.gnu8.5.0-2.3.7-1.el8.x86_64.rpm
72c3c7d3001652bc4368589c26f1cf5df3d08877596a4c260e64ff89ce74df09
- mvapich2-gdr-cuda11.2.mofed5.1.gnu9.3.0-2.3.7-1.el8.x86_64.rpm
- MOFED5.3
- mvapich2-gdr-cuda11.4.mofed5.3.gnu11.1.0-2.3.7-1.el7.x86_64.rpm
71f35ab936e500f1295a2e52d71460b8e20ccf960c87d66e6abbda6953a41694
- mvapich2-gdr-cuda11.4.mofed5.3.gnu11.1.0-2.3.7-1.el7.x86_64.rpm
- MOFED5.4
- mvapich2-gdr-cuda11.4.mofed5.4.gnu11.2.0-2.3.7-1.el8.x86_64.rpm
0823ec302a5100baf51300b8889a4ea7a4d55735d16ec254d080d4cca265dea2
- mvapich2-gdr-cuda11.4.mofed5.4.gnu9.3.0_2.3.7-2_amd64.deb
2c9a29ab7e7943f9cecdad0c2a9255408b09cef8244a11a5f285b1840a6a4577
- mvapich2-gdr-cuda11.4.mofed5.4.intel19.1.1.217-2.3.7-1.el8.x86_64.rpm
cae64a671b0d72db803988658a11013fb9a4230e2af1ef165eac5eb9ef89bc48
- mvapich2-gdr-cuda11.4.mofed5.4.gnu11.2.0-2.3.7-1.el8.x86_64.rpm
- MOFED5.6
- mvapich2-gdr-cuda11.4.mofed5.6.gnu11.1.0-2.3.7-1.el8.x86_64.rpm
bdcb41d219d20970fd16ee8fbd606a0731b72a9f5a6ef6b08f5598da22daf717
- mvapich2-gdr-cuda11.4.mofed5.6.gnu11.1.0.slurm-2.3.7-1.el8.x86_64.rpm
eec9ea404596b81fe28549cf3353cfa01797559a65ec5ac93a6fac508cac45b4
- mvapich2-gdr-cuda11.4.mofed5.6.gnu11.2.0-2.3.7-1.el8.x86_64.rpm
e81030a45eb819972d9170d781731acc9ad9306efa32d40740cb7ab41a3ff54d
- mvapich2-gdr-cuda11.4.mofed5.6.intel19.1.1.217-2.3.7-1.el8.x86_64.rpm
ebbb99038f5d27bd8c9248963e24ced2ea12bd28c3384b82ae8055a63b483786
- mvapich2-gdr-cuda11.6.mofed5.6.gnu11.1.0.slurm-2.3.7-1.el8.x86_64.rpm
7840c5144e8901b722d6712c74cc2e6fb92e3ac60ee8b7ab5d58606a28f2cfe5
- mvapich2-gdr-cuda11.6.mofed5.6.intel19.0.3.199.slurm-2.3.7-1.el7_9.x86_64_volta.rpm
7490b89781baecdbae59781aae01c5d02025cc53fe1a5b19f7291048fe4939e2
- mvapich2-gdr-cuda11.6.mofed5.6.intel2021.1.2.slurm-2.3.7-1.el7.x86_64.rpm
7f1ffbf2a2c42c4e8b61ef3575af5993ec39603d74482561ceef9f89d3f32c5d
- mvapich2-gdr-cuda11.6.mofed5.6.intel2021.1.2.slurm-2.3.7-1.el8.x86_64.rpm
e57450c6eadd82152a248a729663be82af66d2113b5e3bfc5166e9706afe07b5
- mvapich2-gdr-cuda11.6.mofed5.6.intel2021.3.0.slurm-2.3.7-1.el7_9.x86_64_pascal.rpm
c06dfcf5724da8ec349a4e4b429ee262482c24bb66baff68ad31521e3a853fa9
- mvapich2-gdr-cuda11.6.mofed5.6.intel2021.3.0.slurm-2.3.7-1.el7_9.x86_64_volta.rpm
7c30d0c069a448b02ec13adfbe847b397742458b1333c3b15e4315fa32b096e1
- mvapich2-gdr-cuda11.6.mofed5.6.intel2021.5.0.slurm-2.3.7-1.el8.x86_64.rpm
d6350511a3a16bba69cc1f37f0c35968d1082c27172158d6dce083f28bccbb27
- mvapich2-gdr-cuda11.7.mofed5.6.gnu11.1.0-2.3.7-1.el8.x86_64.rpm
218f9659372877f3bb70a62a8eebdb9901739ef3cc5ea6750b0e4cc61f46a17a
- mvapich2-gdr-cuda11.7.mofed5.6.gnu11.1.0.slurm-2.3.7-1.el8.x86_64.rpm
a72d11f8e4263e09ca801989b550269de2f03e88c9571196450afcd2796550f0
- mvapich2-gdr-cuda11.4.mofed5.6.gnu11.1.0-2.3.7-1.el8.x86_64.rpm
User Requested RPMs/DEBs
MVAPICH2-X 2.3 Library and User Guide
- The MVAPICH2-X 2.3 library is distributed under the BSD License.
- OSU MVAPICH2-X 2.3 (06/10/20), ABI compatible with MPICH-3.2.1.
- MVAPICH2-X User Guide: A detailed user guide with instructions to install MVAPICH2-X and execute MPI/UPC/UPC++/OpenSHMEM/CAF/Hybrid programs is available. (HTML, PDF)
- Installation using Spack: A detailed user guide with instructions to install MVAPICH2-X using Spack is available here.
- Installation Guide
- These tarballs contain the MVAPICH2-X software for Redhat and Debian based systems combined together in one combined package.
- Running the install.sh script in the tarball will install the libraries.
- These RPMs are relocatable and advanced users may skip the install.sh script to directly use alternate commands to install the desired RPMs.
- Which RPM should I Install?
-
InfiniBand / RoCE System
Features for InifiniBand (OFA-IB-CH3) and ROCE (OFA-RoCE-CH3) Basic Basic-XPMEM Advanced Advanced-XPMEM Architecture Specific Point-to-point and Collective Optimizations for x86, OpenPOWER, and ARM ✔ ✔ ✔ ✔ Optimized Support for PGAS models(UPC, UPC++, OpenSHMEM, CAF) and Hybrid MPI+PGAS models ✔ ✔ ✔ ✔ CMA-Aware Collectives ✔ ✔ ✔ ✔ Cooperative Rendezvous Protocols ✔ ✔ ✔ ✔ Optimized Asynchronous Progress* ✔ ✔ ✔ ✔ InfiniBand Hardware Multicast-based MPI_Bcast*+ ✔ ✔ ✔ ✔ OSU InfiniBand Network Analysis and Monitoring (INAM)*+$ ✔ ✔ ✔ ✔ XPMEM-based Point-to-Point and Collectives ✔ ✔ Direct Connected (DC) Transport Protocol*+ ✔ ✔ User mode Memory Registration (UMR)*+$ ✔ ✔ Core-direct based Collective Offload*+$ ✔ ✔ SHARP-based Collective Offload*+ ✔ ✔ * indicates disabled by default at runtime. Must use appropriate environment variable in MVAPICH2-X user guide to enable it.
+ indicates features only tested with InfiniBand network.
$ Advanced features available on request. -
Omni-Path System
Features for Omni-Path Basic Basic-XPMEM Architecture Specific Point-to-point and Collective Optimizations for x86, OpenPOWER, and ARM ✔ ✔ CMA-Aware Collectives ✔ ✔ Optimized Asynchronous Progress* ✔ ✔ XPMEM-based Collectives ✔ * indicates disabled by default at runtime. Must use appropriate environment variable in MVAPICH2-X user guide to enable it.
-
InfiniBand / RoCE System
- Advanced Install Options
- Install library using a prefix other than the default of /opt/mvapich2/.
$ rpm --prefix /custom/install/prefix -Uvh --nodeps mvapich2-x-basic-mofed3.4-gnu4.8.5-2.3-1.el7.centos.x86_64.rpm
- If you do not have root permission or are on a system that does not use RPMs you can use rpm2cpio to extract the library.
$ rpm2cpio mvapich2-x-basic-mofed3.4-gnu4.3-1.el7.centos.x86_64.rpm | cpio -id
When using the rpm2cpio method, you will need to update the MPI compiler scripts, such as mpicc, in order to point to the correct path of where you place the library. - Tip: If you are using a Debian based system such as Ubuntu you can convert the rpm to a deb using a tool such as alien or follow the rpm2cpio instructions above.
- Install library using a prefix other than the default of /opt/mvapich2/.
| Combined RPM Tarballs | |||
|---|---|---|---|
| OFED | Stock OFED | MOFED 4.X* | INTEL IFS 10.10 |
| x86_64 |
[GNU 4.8.5] |
[GNU 4.8.5] |
[GNU 4.8.5] |
*Note that the MOFED 4.X RPMs were built against MOFED 4.5
|
| OpenPOWER and ARM RPMs | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| OFED | GNU 4.9.3 | GNU 4.9.3 (w/ jsrun) | GNU 7.3.1 | GNU 7.3.1 (w/ jsrun) | GNU 8.3.1 | GNU 8.3.1 (w/ jsrun) | CLANG 8.0.1 | CLANG 8.0.1 (w/ jsrun) | XLC 16.01 | XLC 16.01 (w/ jsrun) |
| OpenPOWER |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
| OFED | GNU 4.8.5 | GNU 7.3.0 | GNU 8.3.0 | CLANG 7.0.1 | ||||||
| AARCH64 RPMs |
[BASIC] |
[BASIC] |
[BASIC] [ADV.] |
[BASIC] [ADV.] |
||||||
User Requested RPMs
- mvapich2-x-advanced-mofed4.5-clang9.0.0-2.3-1.ch6_2.ppc64le.rpm
290b565bf6c6e82fb46270c5ff8bbb82c17b4cfad97d262c930f2ec4ab3b10ee
- mvapich2-x-advanced-mofed4.5-clang9.0.0-jsrun-2.3-1.ch6_2.ppc64le.rpm
61059864a0dfe2aa9e97356bf4f74243378f5c96a682ba07893581dfec1a1c03
- mvapich2-x-basic-mofed4.5-clang9.0.0-2.3-1.ch6_2.ppc64le.rpm
eb614aa64561f6c1c00668cb6ad9d079e7be41d8e111f19b954ba8fae667bfdf
- mvapich2-x-basic-mofed4.5-clang9.0.0-jsrun-2.3-1.ch6_2.ppc64le.rpm
720163b2f927c7e5e14628c26940d62e16e503ce5de998a9ce594146b2b1c2c1
- mvapich2-x-basic-mofed4.5-gnu4.8.5-2.3-1.el7.x86_64.rpm
4fc7ecef423ca76ae633f21fdc8371c3202bf7433536af8d8a865d0a607a3336
- mvapich2-x-basic-mofed4.5-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm
c08f27e60154278aa06f85d2c8013eb39991ccd40a60f0ed00c3caa66db5ba43
- mvapich2-x-aws-mofed4.6-gnu7.3.1-2.3-1.amzn2.aarch64.rpm
7a5cd8ca0682462fc7b3fc6c5c5741f30221e089ec563a1e4ed8ab10dd837311
- mvapich2-x-aws-xpmem-mofed4.6-gnu7.3.1-2.3rc3XAWS-2.amzn2.x86_64.rpm
dcf5db3fd63377a64c45fe322de50d8b446f2533f669b3832e5bb94f4c737ef3
- mvapich2-x-aws-xpmem-mofed4.6-gnu7.3.1_2.3rc3XAWS-2.amzn2_amd64.deb
02151ee8396b9807a7f51a17200d7b7f951d0da697691c36e80dcf7f0051d8f1
- mvapich2-x-basic-mofed4.6-gnu4.8.5-2.3-1.el7.x86_64.rpm
951c570ef19cb428d51fc7fb98c4ad7d83793900228a14e6238a82a75ede8681
- mvapich2-x-basic-mofed4.6-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm
d240b8bcc4743c48101800f2d9a8d98b13b51fdc8a207df8e665609456b1ac07
- mvapich2-x-basic-mofed4.6-gnu5.4.0-slurm-2.3-1.el7.x86_64.rpm
2a818b4e8acbf9fda999885a01196720b6412711c5a522e19c9922f7b8cf9c13
- mvapich2-x-basic-mofed4.7-intel19.0.3.199-slurm-2.3-1.el7.x86_64.rpm
e84dde9e0f00a6334bba3cdc36f6f384cf07c91c6881725ca1039fc81225828b
- mvapich2-x-basic-mofed4.9-gnu8.5.0-2.3-1.el8.x86_64.rpm
5527ed8c35a5f7e9ca7f4aabf4307b81fecf57f1a1fa68e1cd92b5ab68e0b5a5
- mvapich2-x-advanced-mofed5.0-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm
861d513aa701573ccec4b5ac65be589cd6c5b9e8f83702fc10590182a865cfb8
- mvapich2-x-advanced-xpmem-mofed5.0-gnu8.5.0-2.3-1.el8.x86_64.rpm
9a45ca5853c3d948fdbf72facdc6053fcc5c1a6cd6638e2767d3eb3d3143ee91
- mvapich2-x-basic-mofed5.0-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm
e8d80f1abc9fdbb910d347516a3b7c64b8942c45e0ae460fdd1a15d465f6f0b6
- mvapich2-x-basic-mofed5.0-gnu7.3.1-2.3-1.el7.x86_64.rpm
ef872879015c77b656c7684a083011cd816ce2f945cfbd75037e9567761e0444
- mvapich2-x-azure-xpmem-mofed5.1-gnu4.8.5-v2.3xmofed5-1.el7.x86_64.rpm
9a9ec212ebeb2912b0fe38b38881ba6a9547b496006b7fe72ebacb91567e16a9
- mvapich2-x-azure-xpmem-mofed5.1-gnu9.2.0-v2.3xmofed5-1.el7.x86_64.rpm
cbccc85ebbcdea4769999a42a45d40c9a22bf000410f46de219d69a0ef0291b6
- mvapich2-x-advanced-xpmem-mofed5.6-gnu11.1.0-2.3-1.el8.x86_64.rpm
1383fb25244eabe81ba83fdcb41d0aefdf1693b87f4146154d46b5724898e73f
- mvapich2-x-advanced-xpmem-mofed5.6-gnu11.1.0-slurm-2.3-1.el8.x86_64.rpm
93fe38dee073fc2e4a51fd78b4af9dc1e80578a4f7447a879d820ad2a4099d58
Please email us at mvapich-help@cse.ohio-state.edu if your configuration does not appear on the list or if you experience any trouble installing the library on your system.
Please see the The HiDL Horovod Userguide for information on installing Horovod on CPU and GPU clusters.
MVAPICH-Plus 3.0b Library
- The MVAPICH-Plus library is distributed under the BSD License.
- OSU MVAPICH-Plus 3.0b (11/01/2023), ABI compatible with MPICH-3.4.3.
- These RPMs contain the MVAPICH-Plus software on the corresponding
distro. Please note that the RHEL RPMs are compatible
with Rocky as well. For Debian/Ubuntu users, please follow the instructions in
the install section in the README.
UCX OFI-Standard CUDA 11.X Ampere
Volta
Pascal
Ampere(Slurm)
Volta(Slurm)
Pascal(Slurm)
Ampere
Volta
Pascal
Ampere(Slurm)
Volta(Slurm)
Pascal(Slurm)
ROCM 5.6 Multiarch
Multiarch(Slurm)
Multiarch
Multiarch(Slurm)
- Please note that, unless otherwise specified, all RPMs were built using the following version of the respective compilers:
- GNU (GCC) 8.5.0
- For INSTALL and usage information please refer to the install section in the README
- The RPMs contained in our libraries are relocatable and can be installed using a prefix other than the default of /opt/mvapich/.
- Install library specifying custom prefix
$ rpm --prefix /custom/install/prefix -Uvh --nodeps mvapich-plus-mcast.cuda9.2.mofed4.3.pgi18.5.pbs-2.3-2.el7.x86_64.rpm - If you do not have root permission or are on a system that does not use RPMs you can use rpm2cpio to extract the library.
$ rpm2cpio mvapich-plus-mcast.cuda9.2.mofed4.3.pgi18.5.pbs-2.3-2.el7.x86_64.rpm | cpio -idWhen using the rpm2cpio method, you will need to update the MPI compiler scripts, such as mpicc, in order to point to the correct path of where you place the library. - Tip: If you are using a Debian based system such as Ubuntu you can convert the rpm to a deb using a tool such as alien or follow the rpm2cpio instructions above.
- Check the list below if your system configuration does not match any from the tables above.
User Requested RPMs/DEBs
Dept of Computer Science and Engineering
2001-2024 NBCL. All rights reserved.
2015 Neil Avenue
Columbus, OH 43210