Horovod Performance on CPUs with MVAPICH2
Machine Specifications
| CPU Model | CPU Core Info | Memory | IB Card | OS | OFED |
|---|---|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8280 | 2x28 @ 2.7Ghz | 192GB | Mellanox EDR (100 Gbps) | RHEL 7.7 | MOFED 5.4-1.0.3.0 |
TensorFlow Performance on Intel CPUs
Model: ResNet-50 Batch Size: 32 Benchmark: tensorflow2_synthetic_benchmark DL Framework: TensorFlow 2.11.0 ppn: 8
.png)
PyTorch Performance on Intel CPUs
Model: ResNet-50 Batch Size: 32 Benchmark: pytorch_synthetic_benchmark DL Framework: Pytorch 1.12.1 ppn: 8
.png)
Machine Specifications
| CPU Model | CPU Core Info | Memory | IB Card | OS | OFED |
|---|---|---|---|---|---|
| AMD EPYC 7713 | 2x64 @ 2Ghz | 256GB | Mellanox HDR (200 Gbps) | Rocky Linux 8.5 | MOFED 5.5-1.0.3.2 |
TensorFlow Performance with AMD CPUs
Model: ResNet-50 Batch Size: 32 Benchmark: tensorflow2_synthetic_benchmark DL Framework: TensorFlow v2.8 ppn: 8
.png)
PyTorch Performance with AMD CPUs
Model: ResNet-50 Batch Size: 32 Benchmark: pytroch_synthetic_benchmark DL Framework: PyTorch 1.12.1 ppn: 8
.png)
