question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add `.get_client()` method to Cluster class

See original GitHub issue

I’m sitting with @costrouc and he’s typing cluster.get_client() based on his experience with Dask Gateway. Should we upstream this to dask.distributed.deploy.Cluster?

cc @jacobtomlinson @jcrist

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
jsignellcommented, Jul 20, 2022

I agree that the mulitple imports isn’t very elegant and would totally support an implementation like I outlined in https://github.com/dask/distributed/issues/6732#issuecomment-1187674320

0reactions
mrocklincommented, Jul 19, 2022

Mostly the concern that I feel is when writing basic materials I have to ask users to import different things from different libraries.

from dask_jobqueue import SLURMCluster
cluster = SLURMCluster()

from dask.distributed import Client
client = Client(cluster)

I remember reading Spark materials and getting confused about the Conf and Session and SQLSession objects that I had to create. The ceremony to get a basic example running felt odd.

Adding Cluster.get_client would let us rework our common basic example to the following:

from dask_jobqueue import SLURMCluster
client = SLURMCluster().get_client()

Not a big deal. My guess is that it’s less friction for early users. Not a big deal though.

Read more comments on GitHub >

github_iconTop Results From Across the Web

API — Dask.distributed 2022.12.1 documentation
The Client connects users to a Dask cluster. It provides an asynchronous user interface around functions and futures. This class resembles executors in ......
Read more >
How To Create an HTTP Client with Core HTTP in Node.js
You will begin by making a GET request, the standard HTTP request to receive data. You will then look at ways to customize...
Read more >
projects.zones.clusters.get | Google Kubernetes Engine (GKE)
Install the C# client library by adding a dependency on the relevant ... To execute asynchronously in an async method, replace `request.
Read more >
Client Libraries | Kubernetes
This page contains an overview of the client libraries for using the Kubernetes API from various programming languages.
Read more >
Cluster Sharding - Documentation - Akka
Shard a clustered compute process across the network with locationally transparent message routing using Akka Cluster Sharding.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found