Setup Github Actions workflow CI for horovod on CPU

🚀 Feature

Idea is to add run Horovod tests on CPU via Github Actions. We can either: 1) install horovod using pip or 2) otherwise compile horovod from source as it is done for Circle CI (without NCCL support). The goal is to be able to run CPU distributed tests with Horovod backend.

TODO:

• create new file hvd-tests.yml in .github/workflows like https://github.com/pytorch/ignite/blob/master/.github/workflows/tpu-tests.yml
• setup horovod (described above)
• run horovod tests like in circle ci yaml

Quick play around github actions can be done in a separate repository like https://github.com/vfdev-5/github-actions-playground

[ramesht007]

hey @sdesrozis , I am working on this. will give a PR in few days. 🙂

[vfdev-5]

Our goal is to run distributed tests for CPU, and the tests reffered to are in circleCI which use docker. So i have to use docker for the same?

@ramesht007 in circle ci we use docker env to easily have pytorch distribution without installing conda etc as it is done in github actions. For github actions, let’s follow the same setup as https://github.com/pytorch/ignite/blob/master/.github/workflows/unittests.yml#L29 , Setup Miniconda and Install dependencies steps. Let’s use python 3.7 and the latest pytorch version.