BEAR Applications: Horovod 0.28.0-foss-2022a-CUDA-11.7.0-PyTorch-2.0.1 (for BlueBEAR, BEARCloud VMs, and CaStLeS VMs)

Horovod 0.28.0-foss-2022a-CUDA-11.7.0-PyTorch-2.0.1

Horovod is a distributed training framework

Accessing Horovod 0.28.0-foss-2022a-CUDA-11.7.0-PyTorch-2.0.1

To load the module for Horovod 0.28.0-foss-2022a-CUDA-11.7.0-PyTorch-2.0.1 please use this command on the BEAR systems (BlueBEAR, BEAR Cloud VMs, and CaStLeS VMs):

module load Horovod/0.28.0-foss-2022a-CUDA-11.7.0-PyTorch-2.0.1

BEAR Apps Version

2020b

Extensions

cloudpickle 2.2.1
horovod 0.28.0

More Information

For more information visit the Horovod website.

Dependencies

This version of Horovod has a direct dependency on: CUDA/11.7.0 foss/2022a NCCL/2.12.12-GCCcore-11.3.0-CUDA-11.7.0 Python/3.10.4-GCCcore-11.3.0 PyTorch/2.0.1-foss-2022a-CUDA-11.7.0 PyYAML/6.0-GCCcore-11.3.0

Other Versions

These versions of Horovod are available on the BEAR systems (BlueBEAR, BEAR Cloud VMs, and CaStLeS VMs). These will be retained in accordance with our Applications Support and Retention Policy.

Version	BEAR Apps Version
0.23.0-foss-2021a-CUDA-11.3.1-TensorFlow-2.6.0	2021a
0.23.0-foss-2021a-CUDA-11.3.1-PyTorch-1.10.0	2021a
0.21.1-fosscuda-2020b-TensorFlow-2.4.1	2020b
0.21.1-fosscuda-2020b-PyTorch-1.7.1	2020b
0.21.1-fosscuda-2020a-TensorFlow-2.3.1-Python-3.8.2	2020a
0.21.1-fosscuda-2019b-TensorFlow-2.2.0-Python-3.7.4	2019b
0.21.1-fosscuda-2019b-PyTorch-1.4.0-Python-3.7.4	2019b

Last modified on 2nd June 2023