dask-distributed client socks proxies
See original GitHub issueMy scheduler is not reachable by the public web, I actually use a SOCKS5 proxy to reach it. The reason is, i’m limited by the number of public IPs I can have at one time. To perform my task, I’m using dask.distributed.Client
.
- I used to use ngrok to poke more holes but now I’ve reached the limit of how many ngrok tunnels I can have at the same time too.
- Using
socks4
orsocks5
withdask.distributed.Client
context manager did not work, or maybe i’m doing something wrong?
Perhaps this is a dumb question, but I did not find information about this in the documentation. https://distributed.dask.org/en/latest/local-cluster.html and https://distributed.dask.org/en/latest/client.html
Is there a way to add a socks proxy?
Issue Analytics
- State:
- Created 4 years ago
- Comments:14 (7 by maintainers)
Top Results From Across the Web
API — Dask.distributed 2022.12.1 documentation
The client connects to and submits computation to a Dask cluster (such as a ... A Future is a local proxy to a...
Read more >Client — Dask.distributed 2022.12.1 documentation
The Client is the primary entry point for users of dask.distributed . After we setup a cluster, we initialize a Client by pointing...
Read more >Source code for distributed.client
[docs]class Future(WrappedKey): """A remotely running computation A Future is a local proxy to a result running on a remote worker.
Read more >How to run parallelized python jobs on yarn using Dask?
1 ) How do I connect Dask to Hadoop/YARN and parallelize a job? When I try using: from dask.distributed import Client client ......
Read more >SOCKS vs HTTP Proxy: What Is the Difference? - Oxylabs
When using SOCKS proxies, the internet traffic is routed through a proxy server via TCP connection on behalf of a client. Just like...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Hi @deepio , my apologies for the delay in response here.
cc’ing @jacobtomlinson , when you’re back from the holidays could you weigh in here?
What a great service (serveo), thank you for bringing this one to my attention. It’s too bad that it is currently disabled. Hopefully will see it in action in a few days though.
Dask has implemented many things I would need to program myself, I’m quite thankful that this exists! I’m not quite sure where to begin looking at the codebase but if I can help with implementing socks i’d be glad to help.