[kubernetes] Add ability to customize worker/scheduler pod names

In dask-kubernetes, you can use the kubernetes.worker_name value to add each user’s name to the worker pod names. Is that customization something that can be done in Dask-gateway? I haven’t figured that out yet - if it’s not possible, I think that would be a useful feature to add. Would be nice for more quickly filtering pods and diagnosing any issues a particular user may be having. Happy to work on that but wanted to check first and see that I wasn’t just missing some existing functionality somewhere

[cslovell]

Nevermind - seems the following works in the Helm chart values file:

dask-gateway: 
  gateway: 
    backend: ... [omitted for brevity]
    extraConfig:
      optionHandler: |
        from dask_gateway_server.options import Options, Integer, Float, String
        def cluster_options(user):  
            def option_handler(options):
                if ":" not in options.image:
                    raise ValueError("When specifying an image you must also provide a tag")
                extra_labels = {
                    "hub.jupyter.org/username": user.name
                }
                return {
                    "worker_cores": options.worker_cores,
                    "worker_memory": int(options.worker_memory * 2 ** 30),
                    "image": options.image,
                    "scheduler_extra_pod_labels": extra_labels,
                    "worker_extra_pod_labels": extra_labels,
                }
            return Options(
                Float("worker_cores", default=0.8, min=0.8, max=4.0, label="Worker Cores"),
                Float("worker_memory", default=3.3, min=1, max=8, label="Worker Memory (GiB)"),
                String("image", default="pangeo/base-notebook:2021.05.04", label="Image"),
                handler=option_handler,
            )
        c.Backend.cluster_options = cluster_options

[cslovell]

I know I’m late to the game - @droctothorpe I’m curious if you have a code snippet on how this is done. Also aiming to achieve some insight into per-user costs.