[FEATURE] Ray HPO Tune Integration

We’ve managed to run an axample ray cluster and HPO on kubenetes. Here are the steps:

1. Connect local kubectl to the eks cluster
2. Pip install ray locally: pip install ray
3. Clone ray repo: git clone https://github.com/ray-project/ray.git
4. Launch up a ray cluster by: ray up ray/python/ray/autoscaler/kubernetes/example-full.yaml
5. Check the cluster got launched by: kubectl -n ray get pods
6. To create a sample job: kubectl create -f ray/doc/kubernetes/job-example.yaml
   • You can modify the script got downloaded in the yaml file to run different script
7. To check result: kubectl -n ray logs <launched job pod>
8. To tear down the cluster: ray down ray/python/ray/autoscaler/kubernetes/example-full.yaml

[abaror]

nice, we can turn this into a plugin, make sure https://github.com/ray-project/ray/blob/master/python/ray/autoscaler/kubernetes/example-full.yaml is changed to use the <team namespace> and not introduce a new namespace “ray” . This will allow ray to launch containers within the team namespace.

[abaror]

Ray plugin has been added and will be available in the next release