Distributed Deep Learning with Horovod

Distributed Deep Learning with Horovod

Author Name : Dhara Bhadani, FNU Aayoush

ABSTRACT

The exponential growth of computing technology has undoubtedly resulted in generation of huge amount of data to be processed daily which is only possible with the help of computing fields like artificial intelligence along with its subset like machine learning, deep learning or deep structured learning. Advancement in deep learning can open plethora of opportunities and can act as a major pillar in this growth. Deep Learning model requires large amount of computation for training. In the paper, we will describe the current scenario of the amalgamation of deep learning with distributed computing and their possibilities called distributed deep learning with its recently developed framework named Horovod its advantages along with its impact on performance and efficiency.

Keywords- Horovod, Artificial Intelligence, Deep Learning, Distributed Deep Learning