[raysgd] How to set spot workers for an Azure cluster?

In Azure, we should be able to set a node as spot (preemptible) by setting properties.priority = ‘Spot’. However, I can’t understand how to translate this into my cluster configuration YAML, as there is no information on GitHub or the documentation that I’m aware of which indicates the spot parameter for Azure clusters.

For reference, in the automatic cluster setup documentation, while the Azure example mentions a setting of an on-demand head node and spot worker nodes, that’s not what actually happens, as I get all the workers as on-demand in Azure. In fact, I wouldn’t expect otherwise as, contrary to the GCP and AWS examples, there is no difference in the parameters between head_node and worker_nodes.

Is there any way to set spot workers in an Azure cluster? Or is this feature not yet implemented?

[gramhagen]

@AndreCNF not sure why that build failed?

But I found some time and added a PR (#8938) to address this. There’s a wheel built for python3.7 here: https://sdgraystorage.blob.core.windows.net/ray-wheels/ray-0.9.0.dev0-cp37-cp37m-manylinux1_x86_64.whl

Just install that and grab changes in the new example-full.yaml

• the main addition is under worker_nodes: azure_arm_parameters: priority: Spot
• make sure to change the wheel in the setup_commands section to match the one above

[eisber]

if that is a common ask, than I think it’s a good idea to make it accessible through the yaml config.

Maybe we should document how to copy and modify the templates to get full control over all aspects.