Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Dask Dashboard - Connection Refused
See original GitHub issueNot sure if this belongs here or dask distributed (or elsewhere?) - so please let me know if I should move this issue to another repo.
Issue
I am unable to access the dask dashboard when starting a cluster with dask jobqueue.
Setup
Port forwarding jupyterlab from HPC running slurm. Running a container (w/ Singularity): container info
Conda Environments
Base env (running JupyterLab)conda list
# packages in environment at /opt/conda:
#
# Name Version Build Channel
_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 0_gnu conda-forge
aiohttp 3.6.2 py37h516909a_0 conda-forge
alembic 1.4.2 pyh9f0ad1d_0 conda-forge
async-timeout 3.0.1 py_1000 conda-forge
async_generator 1.10 py_0 conda-forge
attrs 19.3.0 py_0 conda-forge
backcall 0.1.0 py_0 conda-forge
bleach 3.1.5 pyh9f0ad1d_0 conda-forge
blinker 1.4 py_1 conda-forge
bokeh 2.0.1 py37hc8dfbb8_0 conda-forge
brotlipy 0.7.0 py37h8f50634_1000 conda-forge
ca-certificates 2020.4.5.1 hecc5488_0 conda-forge
certifi 2020.4.5.1 py37hc8dfbb8_0 conda-forge
certipy 0.1.3 py_0 conda-forge
cffi 1.14.0 py37hd463f26_0 conda-forge
chardet 3.0.4 py37hc8dfbb8_1006 conda-forge
click 7.1.2 pyh9f0ad1d_0 conda-forge
cloudpickle 1.4.1 py_0 conda-forge
conda 4.8.2 py37_0 conda-forge
conda-package-handling 1.6.0 py37h8f50634_2 conda-forge
configurable-http-proxy 4.2.1 node13_he01fd0c_0 conda-forge
cryptography 2.9.2 py37hb09aad4_0 conda-forge
cytoolz 0.10.1 py37h516909a_0 conda-forge
dask-core 2.17.2 py_0 conda-forge
dask-labextension 2.0.2 py_0 conda-forge
decorator 4.4.2 py_0 conda-forge
defusedxml 0.6.0 py_0 conda-forge
distributed 2.17.0 py37hc8dfbb8_0 conda-forge
entrypoints 0.3 py37hc8dfbb8_1001 conda-forge
freetype 2.10.2 he06d7ca_0 conda-forge
heapdict 1.0.1 py_0 conda-forge
icu 64.2 he1b5a44_1 conda-forge
idna 2.9 py_1 conda-forge
importlib-metadata 1.6.0 py37hc8dfbb8_0 conda-forge
importlib_metadata 1.6.0 0 conda-forge
ipykernel 5.3.0 py37h43977f1_0 conda-forge
ipython 7.14.0 py37hc8dfbb8_0 conda-forge
ipython_genutils 0.2.0 py_1 conda-forge
jedi 0.17.0 py37hc8dfbb8_0 conda-forge
jinja2 2.11.2 pyh9f0ad1d_0 conda-forge
jpeg 9c h14c3975_1001 conda-forge
json5 0.9.0 py_0 conda-forge
jsonschema 3.2.0 py37hc8dfbb8_1 conda-forge
jupyter-archive 0.6.2 py_0 conda-forge
jupyter-panel-proxy 0.1.0 py_0 conda-forge
jupyter-rsession-proxy 1.2 py_0 conda-forge
jupyter-server-proxy 1.5.0 py_0 conda-forge
jupyter-vscode-proxy 0.1 py_0 conda-forge
jupyter_client 6.1.3 py_0 conda-forge
jupyter_core 4.6.3 py37hc8dfbb8_1 conda-forge
jupyter_telemetry 0.0.5 py_0 conda-forge
jupyterhub 1.1.0 py37_2 conda-forge
jupyterhub-base 1.1.0 py37_2 conda-forge
jupyterlab 2.1.3 py_0 conda-forge
jupyterlab_server 1.1.5 py_0 conda-forge
krb5 1.17.1 h2fd8d38_0 conda-forge
ld_impl_linux-64 2.34 h53a641e_0 conda-forge
libblas 3.8.0 14_openblas conda-forge
libcblas 3.8.0 14_openblas conda-forge
libcurl 7.69.1 hf7181ac_0 conda-forge
libedit 3.1.20170329 hf8c457e_1001 conda-forge
libffi 3.2.1 he1b5a44_1007 conda-forge
libgcc-ng 9.2.0 h24d8f2e_2 conda-forge
libgfortran-ng 7.5.0 hdf63c60_6 conda-forge
libgomp 9.2.0 h24d8f2e_2 conda-forge
liblapack 3.8.0 14_openblas conda-forge
libopenblas 0.3.7 h5ec1e0e_6 conda-forge
libpng 1.6.37 hed695b0_1 conda-forge
libsodium 1.0.17 h516909a_0 conda-forge
libssh2 1.9.0 hab1572f_2 conda-forge
libstdcxx-ng 9.2.0 hdf63c60_2 conda-forge
libtiff 4.1.0 hc7e4089_6 conda-forge
libuv 1.34.0 h516909a_0 conda-forge
libwebp-base 1.1.0 h516909a_3 conda-forge
lz4-c 1.9.2 he1b5a44_1 conda-forge
mako 1.1.0 py_0 conda-forge
markdown 3.2.2 py_0 conda-forge
markupsafe 1.1.1 py37h8f50634_1 conda-forge
mistune 0.8.4 py37h8f50634_1001 conda-forge
msgpack-python 1.0.0 py37h99015e2_1 conda-forge
multidict 4.7.5 py37h8f50634_1 conda-forge
nb_conda_kernels 2.2.3 py37_0 conda-forge
nbconvert 5.6.1 py37hc8dfbb8_1 conda-forge
nbformat 5.0.6 py_0 conda-forge
ncurses 6.1 hf484d3e_1002 conda-forge
nodejs 13.13.0 hf5d1a2b_0 conda-forge
notebook 6.0.3 py37hc8dfbb8_0 conda-forge
numpy 1.18.4 py37h8960a57_0 conda-forge
oauthlib 3.0.1 py_0 conda-forge
olefile 0.46 py_0 conda-forge
openssl 1.1.1g h516909a_0 conda-forge
packaging 20.4 pyh9f0ad1d_0 conda-forge
pamela 1.0.0 py_0 conda-forge
pandoc 2.9.2.1 0 conda-forge
pandocfilters 1.4.2 py_1 conda-forge
panel 0.9.5 py_1 conda-forge
param 1.9.3 py_0 conda-forge
parso 0.7.0 pyh9f0ad1d_0 conda-forge
pexpect 4.8.0 py37hc8dfbb8_1 conda-forge
pickleshare 0.7.5 py37hc8dfbb8_1001 conda-forge
pillow 7.1.2 py37h718be6c_0 conda-forge
pip 20.1 pyh9f0ad1d_0 conda-forge
prometheus_client 0.8.0 pyh9f0ad1d_0 conda-forge
prompt-toolkit 3.0.5 py_0 conda-forge
psutil 5.7.0 py37h8f50634_1 conda-forge
ptyprocess 0.6.0 py_1001 conda-forge
pycosat 0.6.3 py37h8f50634_1004 conda-forge
pycparser 2.20 py_0 conda-forge
pyct 0.4.6 py_0 conda-forge
pyct-core 0.4.6 py_0 conda-forge
pycurl 7.43.0.5 py37h16ce93b_0 conda-forge
pygments 2.6.1 py_0 conda-forge
pyjwt 1.7.1 py_0 conda-forge
pyopenssl 19.1.0 py_1 conda-forge
pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge
pyrsistent 0.16.0 py37h8f50634_0 conda-forge
pysocks 1.7.1 py37hc8dfbb8_1 conda-forge
python 3.7.6 h8356626_5_cpython conda-forge
python-dateutil 2.8.1 py_0 conda-forge
python-editor 1.0.4 py_0 conda-forge
python-json-logger 0.1.11 py_0 conda-forge
python_abi 3.7 1_cp37m conda-forge
pyviz_comms 0.7.4 pyh8c360ce_0 conda-forge
pyyaml 5.3.1 py37h8f50634_0 conda-forge
pyzmq 19.0.1 py37hac76be4_0 conda-forge
readline 8.0 hf8c457e_0 conda-forge
requests 2.23.0 pyh8c360ce_2 conda-forge
ruamel.yaml 0.16.6 py37h8f50634_1 conda-forge
ruamel.yaml.clib 0.2.0 py37h8f50634_1 conda-forge
ruamel_yaml 0.15.80 py37h8f50634_1001 conda-forge
send2trash 1.5.0 py_0 conda-forge
setuptools 46.1.3 py37hc8dfbb8_0 conda-forge
simpervisor 0.3 py_1 conda-forge
six 1.14.0 py_1 conda-forge
sortedcontainers 2.1.0 py_0 conda-forge
sqlalchemy 1.3.17 py37h8f50634_0 conda-forge
sqlite 3.30.1 hcee41ef_0 conda-forge
tblib 1.6.0 py_0 conda-forge
terminado 0.8.3 py37hc8dfbb8_1 conda-forge
testpath 0.4.4 py_0 conda-forge
tini 0.18.0 h14c3975_1001 conda-forge
tk 8.6.10 hed695b0_0 conda-forge
toolz 0.10.0 py_0 conda-forge
tornado 5.1.1 py37h14c3975_1000 conda-forge
tqdm 4.45.0 pyh9f0ad1d_1 conda-forge
traitlets 4.3.3 py37hc8dfbb8_1 conda-forge
typing_extensions 3.7.4.2 py_0 conda-forge
urllib3 1.25.9 py_0 conda-forge
wcwidth 0.1.9 pyh9f0ad1d_0 conda-forge
webencodings 0.5.1 py_1 conda-forge
wheel 0.34.2 py_1 conda-forge
widgetsnbextension 3.5.1 py37_0 conda-forge
xz 5.2.5 h516909a_0 conda-forge
yaml 0.2.4 h516909a_0 conda-forge
yarl 1.3.0 py37h516909a_1000 conda-forge
zeromq 4.3.2 he1b5a44_2 conda-forge
zict 2.0.0 py_0 conda-forge
zipp 3.1.0 py_0 conda-forge
zlib 1.2.11 h516909a_1006 conda-forge
zstd 1.4.4 h6597ccf_3 conda-forge
py_geo env (kernel used in JupyterLab)conda list
# packages in environment at /opt/conda/envs/py_geo:
#
# Name Version Build Channel
_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 1_llvm conda-forge
_py-xgboost-mutex 2.0 cpu_0 conda-forge
abseil-cpp 20200225.2 he1b5a44_0 conda-forge
affine 2.3.0 py_0 conda-forge
aiohttp 3.6.2 py37h516909a_0 conda-forge
appdirs 1.4.3 py_1 conda-forge
arrow-cpp 0.17.1 py37h1234567_3_cpu conda-forge
asciitree 0.3.3 py_2 conda-forge
async-timeout 3.0.1 py_1000 conda-forge
at-spi2-atk 2.32.0 h1369247_0 conda-forge
at-spi2-core 2.35.1 h1369247_0 conda-forge
atk 2.36.0 0 conda-forge
atk-1.0 2.36.0 haf93ef1_0 conda-forge
attrs 19.3.0 py_0 conda-forge
aws-sdk-cpp 1.7.164 hc831370_1 conda-forge
backcall 0.1.0 py_0 conda-forge
beautifulsoup4 4.9.1 py37hc8dfbb8_0 conda-forge
bleach 3.1.5 pyh9f0ad1d_0 conda-forge
blinker 1.4 py_1 conda-forge
blosc 1.18.1 he1b5a44_0 conda-forge
bokeh 2.0.1 py37hc8dfbb8_0 conda-forge
boost-cpp 1.72.0 h8e57a91_0 conda-forge
boto3 1.13.18 pyh9f0ad1d_0 conda-forge
botocore 1.16.18 pyh9f0ad1d_0 conda-forge
brotli 1.0.7 he1b5a44_1002 conda-forge
bzip2 1.0.8 h516909a_2 conda-forge
c-ares 1.15.0 h516909a_1001 conda-forge
ca-certificates 2020.4.5.1 hecc5488_0 conda-forge
cachetools 4.1.0 py_1 conda-forge
cairo 1.16.0 hcf35c78_1003 conda-forge
cartopy 0.18.0 py37h4b180d9_0 conda-forge
certifi 2020.4.5.1 py37hc8dfbb8_0 conda-forge
cffi 1.14.0 py37hd463f26_0 conda-forge
cfitsio 3.470 h3eac812_5 conda-forge
cftime 1.1.3 py37h03ebfcd_0 conda-forge
chardet 3.0.4 py37hc8dfbb8_1006 conda-forge
click 7.1.2 pyh9f0ad1d_0 conda-forge
click-plugins 1.1.1 py_0 conda-forge
cligj 0.5.0 py_0 conda-forge
cloudpickle 1.4.1 py_0 conda-forge
colorcet 2.0.1 py_0 conda-forge
cryptography 2.9.2 py37hb09aad4_0 conda-forge
curl 7.69.1 h33f0ec9_0 conda-forge
cycler 0.10.0 py_2 conda-forge
cytoolz 0.10.1 py37h516909a_0 conda-forge
dask 2.17.2 py_0 conda-forge
dask-core 2.17.2 py_0 conda-forge
dask-glm 0.2.0 py_1 conda-forge
dask-jobqueue 0.7.1 py_0 conda-forge
dask-labextension 2.0.2 py_0 conda-forge
dask-ml 1.5.0 py_0 conda-forge
dask-xgboost 0.1.10 py_0 conda-forge
datashader 0.11.0 pyh9f0ad1d_0 conda-forge
datashape 0.5.4 py_1 conda-forge
dbus 1.13.6 he372182_0 conda-forge
decorator 4.4.2 py_0 conda-forge
defusedxml 0.6.0 py_0 conda-forge
deprecated 1.2.10 pyh9f0ad1d_0 conda-forge
distributed 2.17.0 py37hc8dfbb8_0 conda-forge
docopt 0.6.2 py_1 conda-forge
docutils 0.15.2 py37_0 conda-forge
earthengine-api 0.1.223 pyh9f0ad1d_0 conda-forge
entrypoints 0.3 py37hc8dfbb8_1001 conda-forge
epoxy 1.5.4 h516909a_1 conda-forge
esda 2.2.1 py_0 conda-forge
et_xmlfile 1.0.1 py_1001 conda-forge
expat 2.2.9 he1b5a44_2 conda-forge
fastcache 1.1.0 py37h8f50634_1 conda-forge
fasteners 0.14.1 py_3 conda-forge
fastparquet 0.4.0 py37h03ebfcd_0 conda-forge
fastprogress 0.2.3 py_0 conda-forge
fiona 1.8.13 py37h0492a4a_1 conda-forge
firefox 76.0 he1b5a44_0 conda-forge
fontconfig 2.13.1 h86ecdb6_1001 conda-forge
freetype 2.10.2 he06d7ca_0 conda-forge
freexl 1.0.5 h14c3975_1002 conda-forge
fribidi 1.0.9 h516909a_0 conda-forge
fsspec 0.7.4 py_0 conda-forge
future 0.18.2 py37hc8dfbb8_1 conda-forge
gcsfs 0.6.2 py_0 conda-forge
gdal 3.0.4 py37h4b180d9_6 conda-forge
gdb 8.3.1 py37h497da48_1 conda-forge
gdk-pixbuf 2.38.2 h3f25603_3 conda-forge
geckodriver 0.26.0 he1b5a44_0 conda-forge
geopandas 0.7.0 py_1 conda-forge
geos 3.8.1 he1b5a44_0 conda-forge
geotiff 1.5.1 h05acad5_10 conda-forge
geoviews 1.8.1 py_0 conda-forge
geoviews-core 1.8.1 py_0 conda-forge
gettext 0.19.8.1 hc5be6a0_1002 conda-forge
gflags 2.2.2 he1b5a44_1002 conda-forge
giddy 2.3.0 py_0 conda-forge
giflib 5.2.1 h516909a_2 conda-forge
glib 2.64.3 h6f030ca_0 conda-forge
glog 0.4.0 h49b9bf7_3 conda-forge
gmp 6.2.0 he1b5a44_2 conda-forge
gmpy2 2.1.0b1 py37h04dde30_0 conda-forge
gobject-introspection 1.58.2 py37h619baee_1004 conda-forge
google-api-core 1.17.0 py37hc8dfbb8_0 conda-forge
google-api-python-client 1.8.4 pyh9f0ad1d_0 conda-forge
google-auth 1.14.3 pyh9f0ad1d_0 conda-forge
google-auth-httplib2 0.0.3 py_3 conda-forge
google-auth-oauthlib 0.4.1 py_2 conda-forge
google-cloud-core 1.3.0 py_0 conda-forge
google-cloud-storage 1.28.1 pyh9f0ad1d_0 conda-forge
google-resumable-media 0.5.0 py_1 conda-forge
googleapis-common-protos 1.51.0 py37hc8dfbb8_2 conda-forge
graphite2 1.3.13 he1b5a44_1001 conda-forge
graphviz 2.42.3 h0511662_0 conda-forge
grpc-cpp 1.29.0 h8e748ff_0 conda-forge
gtk3 3.24.14 h45fd312_2 conda-forge
h5netcdf 0.8.0 py_0 conda-forge
h5py 2.10.0 nompi_py37h513d04c_102 conda-forge
harfbuzz 2.4.0 h9f30f68_3 conda-forge
hdf4 4.2.13 hf30be14_1003 conda-forge
hdf5 1.10.5 nompi_h3c11f04_1104 conda-forge
heapdict 1.0.1 py_0 conda-forge
holoviews 1.13.2 pyh9f0ad1d_0 conda-forge
httplib2 0.18.1 pyh9f0ad1d_0 conda-forge
hvplot 0.5.2 py_0 conda-forge
icu 64.2 he1b5a44_1 conda-forge
idna 2.9 py_1 conda-forge
importlib-metadata 1.6.0 py37hc8dfbb8_0 conda-forge
importlib_metadata 1.6.0 0 conda-forge
inequality 1.0.0 py_0 conda-forge
intake 0.5.5 py_0 conda-forge
intake-esm 2020.5.21 py_0 conda-forge
intake-parquet 0.2.3 py_0 conda-forge
intake-sql 0.2.0 py_0 conda-forge
intake-stac 0.2.3 py_0 conda-forge
intake-xarray 0.3.1 py_0 conda-forge
ipykernel 5.3.0 py37h43977f1_0 conda-forge
ipython 7.14.0 py37hc8dfbb8_0 conda-forge
ipython_genutils 0.2.0 py_1 conda-forge
ipywidgets 7.5.1 py_0 conda-forge
jdcal 1.4.1 py_0 conda-forge
jedi 0.17.0 py37hc8dfbb8_0 conda-forge
jinja2 2.11.2 pyh9f0ad1d_0 conda-forge
jmespath 0.10.0 pyh9f0ad1d_0 conda-forge
joblib 0.15.1 py_0 conda-forge
jpeg 9c h14c3975_1001 conda-forge
json-c 0.13.1 hbfbb72e_1002 conda-forge
jsonschema 3.2.0 py37hc8dfbb8_1 conda-forge
jupyter-server-proxy 1.5.0 py_0 conda-forge
jupyter_client 6.1.3 py_0 conda-forge
jupyter_core 4.6.3 py37hc8dfbb8_1 conda-forge
kealib 1.4.13 hec59c27_0 conda-forge
kiwisolver 1.2.0 py37h99015e2_0 conda-forge
krb5 1.17.1 h2fd8d38_0 conda-forge
ld_impl_linux-64 2.34 h53a641e_4 conda-forge
libblas 3.8.0 16_openblas conda-forge
libcblas 3.8.0 16_openblas conda-forge
libcups 2.2.12 hf10b501_1 conda-forge
libcurl 7.69.1 hf7181ac_0 conda-forge
libdap4 3.20.6 h1d1bd15_0 conda-forge
libedit 3.1.20170329 hf8c457e_1001 conda-forge
libevent 2.1.10 h72c5cf5_0 conda-forge
libffi 3.2.1 he1b5a44_1007 conda-forge
libgcc-ng 9.2.0 h24d8f2e_2 conda-forge
libgdal 3.0.4 h3dfc09a_6 conda-forge
libgfortran-ng 7.5.0 hdf63c60_6 conda-forge
libiconv 1.15 h516909a_1006 conda-forge
libkml 1.3.0 hb574062_1011 conda-forge
liblapack 3.8.0 16_openblas conda-forge
libllvm8 8.0.1 hc9558a2_0 conda-forge
libnetcdf 4.7.4 nompi_h9f9fd6a_101 conda-forge
libopenblas 0.3.9 h5ec1e0e_0 conda-forge
libpng 1.6.37 hed695b0_1 conda-forge
libpq 12.2 h5513abc_1 conda-forge
libprotobuf 3.11.4 h8b12597_0 conda-forge
libpysal 4.2.2 py_0 conda-forge
libsodium 1.0.17 h516909a_0 conda-forge
libspatialindex 1.9.3 he1b5a44_3 conda-forge
libspatialite 4.3.0a h2482549_1038 conda-forge
libssh2 1.9.0 hab1572f_2 conda-forge
libstdcxx-ng 9.2.0 hdf63c60_2 conda-forge
libtiff 4.1.0 hc7e4089_6 conda-forge
libtool 2.4.6 h14c3975_1002 conda-forge
libuuid 2.32.1 h14c3975_1000 conda-forge
libwebp-base 1.1.0 h516909a_3 conda-forge
libxcb 1.13 h14c3975_1002 conda-forge
libxgboost 1.0.2 he1b5a44_1 conda-forge
libxml2 2.9.10 hee79883_0 conda-forge
libxslt 1.1.33 h31b3aaa_0 conda-forge
llvm-openmp 10.0.0 hc9558a2_0 conda-forge
llvmlite 0.31.0 py37h5202443_1 conda-forge
locket 0.2.0 py_2 conda-forge
lxml 4.5.1 py37he3881c9_0 conda-forge
lz4-c 1.9.2 he1b5a44_1 conda-forge
lzo 2.10 h14c3975_1000 conda-forge
mapclassify 2.2.0 py_0 conda-forge
markdown 3.2.2 py_0 conda-forge
markupsafe 1.1.1 py37h8f50634_1 conda-forge
matplotlib-base 3.2.1 py37h30547a4_0 conda-forge
mechanicalsoup 0.12.0 py_0 conda-forge
metpy 0.12.1 py_0 conda-forge
mgwr 2.1.1 py_0 conda-forge
mistune 0.8.4 py37h8f50634_1001 conda-forge
mock 4.0.2 py37hc8dfbb8_0 conda-forge
monotonic 1.5 py_0 conda-forge
more-itertools 8.3.0 py_0 conda-forge
mpc 1.1.0 h04dde30_1007 conda-forge
mpfr 4.0.2 he80fd80_1 conda-forge
mpi 1.0 openmpi conda-forge
mpi4py 3.0.3 py37hbfacf26_1 conda-forge
mpmath 1.1.0 py_0 conda-forge
msgpack-python 1.0.0 py37h99015e2_1 conda-forge
multidict 4.7.5 py37h8f50634_1 conda-forge
multipledispatch 0.6.0 py_0 conda-forge
munch 2.5.0 py_0 conda-forge
nbconvert 5.6.1 py37hc8dfbb8_1 conda-forge
nbformat 5.0.6 py_0 conda-forge
ncurses 6.1 hf484d3e_1002 conda-forge
netcdf4 1.5.3 nompi_py37hec16513_103 conda-forge
nose 1.3.7 py37hc8dfbb8_1004 conda-forge
notebook 6.0.3 py37hc8dfbb8_0 conda-forge
numba 0.48.0 py37hb3f55d8_0 conda-forge
numcodecs 0.6.4 py37he1b5a44_0 conda-forge
numexpr 2.7.1 py37h0da4684_1 conda-forge
numpy 1.18.4 py37h8960a57_0 conda-forge
oauth2client 4.1.3 py_0 conda-forge
oauthlib 3.0.1 py_0 conda-forge
olefile 0.46 py_0 conda-forge
openjpeg 2.3.1 h981e76c_3 conda-forge
openmpi 4.0.3 hdf1f1ad_1 conda-forge
openpyxl 3.0.3 py_0 conda-forge
openssl 1.1.1g h516909a_0 conda-forge
owslib 0.19.2 py_1 conda-forge
packaging 20.4 pyh9f0ad1d_0 conda-forge
pandas 1.0.3 py37h0da4684_1 conda-forge
pandoc 2.9.2.1 0 conda-forge
pandocfilters 1.4.2 py_1 conda-forge
panel 0.9.5 py_1 conda-forge
pango 1.42.4 h7062337_4 conda-forge
param 1.9.3 py_0 conda-forge
parquet-cpp 1.5.1 2 conda-forge
parso 0.7.0 pyh9f0ad1d_0 conda-forge
partd 1.1.0 py_0 conda-forge
patsy 0.5.1 py_0 conda-forge
pcre 8.44 he1b5a44_0 conda-forge
pexpect 4.8.0 py37hc8dfbb8_1 conda-forge
phantomjs 2.1.1 1 conda-forge
pickleshare 0.7.5 py37hc8dfbb8_1001 conda-forge
pillow 7.1.2 py37h718be6c_0 conda-forge
pint 0.11 py_1 conda-forge
pip 20.1.1 py_1 conda-forge
pixman 0.38.0 h516909a_1003 conda-forge
pluggy 0.13.1 py37hc8dfbb8_1 conda-forge
pointpats 2.1.0 py_1 conda-forge
pooch 1.1.1 py_0 conda-forge
poppler 0.67.0 h14e79db_8 conda-forge
poppler-data 0.4.9 1 conda-forge
postgresql 12.2 h8573dbc_1 conda-forge
proj 7.0.0 h966b41f_4 conda-forge
prometheus_client 0.8.0 pyh9f0ad1d_0 conda-forge
prompt-toolkit 3.0.5 py_0 conda-forge
protobuf 3.11.4 py37h3340039_1 conda-forge
psutil 5.7.0 py37h8f50634_1 conda-forge
psycopg2 2.8.5 py37hb09aad4_1 conda-forge
pthread-stubs 0.4 h14c3975_1001 conda-forge
ptyprocess 0.6.0 py_1001 conda-forge
py 1.8.1 py_0 conda-forge
py-xgboost 1.0.2 py37hc8dfbb8_1 conda-forge
pyarrow 0.17.1 py37h1234567_3_cpu conda-forge
pyasn1 0.4.8 py_0 conda-forge
pyasn1-modules 0.2.7 py_0 conda-forge
pycparser 2.20 py_0 conda-forge
pyct 0.4.6 py_0 conda-forge
pyct-core 0.4.6 py_0 conda-forge
pydap 3.2.2 py37_1000 conda-forge
pydrive 1.3.1 py_1 conda-forge
pyepsg 0.4.0 py_0 conda-forge
pygments 2.6.1 py_0 conda-forge
pyjwt 1.7.1 py_0 conda-forge
pyopenssl 19.1.0 py_1 conda-forge
pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge
pyproj 2.6.1.post1 py37h34dd122_0 conda-forge
pyrsistent 0.16.0 py37h8f50634_0 conda-forge
pysal 2.2.0 py_0 conda-forge
pyshp 2.1.0 py_0 conda-forge
pysocks 1.7.1 py37hc8dfbb8_1 conda-forge
pytables 3.6.1 py37h9f153d1_1 conda-forge
pytest 5.4.2 py37hc8dfbb8_0 conda-forge
python 3.7.6 h8356626_5_cpython conda-forge
python-dateutil 2.7.5 py_0 conda-forge
python_abi 3.7 1_cp37m conda-forge
pytz 2020.1 pyh9f0ad1d_0 conda-forge
pyviz_comms 0.7.4 pyh8c360ce_0 conda-forge
pyyaml 5.3.1 py37h8f50634_0 conda-forge
pyzmq 19.0.1 py37hac76be4_0 conda-forge
quantecon 0.4.7 py37hc8dfbb8_0 conda-forge
rasterio 1.1.4 py37h0492a4a_0 conda-forge
rasterstats 0.14.0 py_0 conda-forge
re2 2020.05.01 he1b5a44_1 conda-forge
readline 8.0 hf8c457e_0 conda-forge
requests 2.23.0 pyh8c360ce_2 conda-forge
requests-oauthlib 1.2.0 py_0 conda-forge
rioxarray 0.0.26 py_0 conda-forge
rsa 4.0 py_0 conda-forge
rtree 0.9.4 py37h8526d28_1 conda-forge
s3fs 0.4.2 py_0 conda-forge
s3transfer 0.3.3 py37hc8dfbb8_1 conda-forge
sat-stac 0.3.3 py_0 conda-forge
scikit-learn 0.23.1 py37h8a51577_0 conda-forge
scipy 1.4.1 py37ha3d9a3c_3 conda-forge
seaborn 0.10.1 py_0 conda-forge
segregation 1.2.0 py_1 conda-forge
selenium 3.141.0 py37h8f50634_1001 conda-forge
send2trash 1.5.0 py_0 conda-forge
setuptools 47.1.0 py37hc8dfbb8_0 conda-forge
shapely 1.7.0 py37hc88ce51_3 conda-forge
simpervisor 0.3 py_1 conda-forge
simplejson 3.17.0 py37h8f50634_1 conda-forge
six 1.15.0 pyh9f0ad1d_0 conda-forge
snappy 1.1.8 he1b5a44_1 conda-forge
snuggs 1.4.7 py_0 conda-forge
sortedcontainers 2.1.0 py_0 conda-forge
soupsieve 2.0.1 py37hc8dfbb8_0 conda-forge
spaghetti 1.5.0 py_0 conda-forge
spectral 0.21 pyh9f0ad1d_1 conda-forge
spglm 1.0.7 py_0 conda-forge
spint 1.0.6 py_0 conda-forge
splot 1.1.3 py_0 conda-forge
spreg 1.1.1 py_0 conda-forge
spvcm 0.3.0 py_0 conda-forge
sqlalchemy 1.3.17 py37h8f50634_0 conda-forge
sqlite 3.30.1 hcee41ef_0 conda-forge
statsmodels 0.11.1 py37h8f50634_1 conda-forge
streamz 0.5.3 pyh9f0ad1d_0 conda-forge
sympy 1.6 py37hc8dfbb8_0 conda-forge
tbb 2020.1 hc9558a2_0 conda-forge
tblib 1.6.0 py_0 conda-forge
terminado 0.8.3 py37hc8dfbb8_1 conda-forge
testpath 0.4.4 py_0 conda-forge
threadpoolctl 2.0.0 pyh5ca1d4c_0 conda-forge
threddsclient 0.4.2 py_0 conda-forge
thrift 0.11.0 py37he1b5a44_1001 conda-forge
thrift-cpp 0.13.0 h62aa4f2_2 conda-forge
tiledb 1.7.7 h8efa9f0_3 conda-forge
tk 8.6.10 hed695b0_0 conda-forge
tobler 0.3.0 py_0 conda-forge
toolz 0.10.0 py_0 conda-forge
tornado 5.1.1 py37h14c3975_1000 conda-forge
tqdm 4.46.0 pyh9f0ad1d_0 conda-forge
traitlets 4.3.3 py37hc8dfbb8_1 conda-forge
typing_extensions 3.7.4.2 py_0 conda-forge
tzcode 2020a h516909a_0 conda-forge
uritemplate 3.0.1 py_0 conda-forge
urllib3 1.24.3 py37_0 conda-forge
wcwidth 0.1.9 pyh9f0ad1d_0 conda-forge
webencodings 0.5.1 py_1 conda-forge
webob 1.8.6 py_0 conda-forge
wheel 0.34.2 py_1 conda-forge
widgetsnbextension 3.5.1 py37_0 conda-forge
wrapt 1.12.1 py37h8f50634_1 conda-forge
xarray 0.15.1 py_0 conda-forge
xerces-c 3.2.2 h8412b87_1004 conda-forge
xgboost 1.0.2 py37h3340039_1 conda-forge
xgeo 1.0 py_0 conda-forge
xorg-kbproto 1.0.7 h14c3975_1002 conda-forge
xorg-libice 1.0.10 h516909a_0 conda-forge
xorg-libsm 1.2.3 h84519dc_1000 conda-forge
xorg-libx11 1.6.9 h516909a_0 conda-forge
xorg-libxau 1.0.9 h14c3975_0 conda-forge
xorg-libxdmcp 1.1.3 h516909a_0 conda-forge
xorg-libxext 1.3.4 h516909a_0 conda-forge
xorg-libxpm 3.5.13 h516909a_0 conda-forge
xorg-libxrender 0.9.10 h516909a_1002 conda-forge
xorg-libxt 1.1.5 h516909a_1003 conda-forge
xorg-renderproto 0.11.1 h14c3975_1002 conda-forge
xorg-xextproto 7.3.0 h14c3975_1002 conda-forge
xorg-xproto 7.0.31 h14c3975_1007 conda-forge
xrviz 0.1.4 py_1 conda-forge
xz 5.2.5 h516909a_0 conda-forge
yaml 0.2.4 h516909a_0 conda-forge
yarl 1.3.0 py37h516909a_1000 conda-forge
zarr 2.4.0 py_0 conda-forge
zeromq 4.3.2 he1b5a44_2 conda-forge
zict 2.0.0 py_0 conda-forge
zipp 3.1.0 py_0 conda-forge
zlib 1.2.11 h516909a_1006 conda-forge
zstd 1.4.4 h6597ccf_3 conda-forge
Example
Working Example
I am able to access the dashboard with /proxy/8787/status in the dask labextension and at: http://localhost:9999/proxy/8787/status
from dask.distributed import Client, LocalCluster
cluster = LocalCluster()
client = Client(cluster)
client
Failing Example
I am unable to access the dashboard with /proxy/8787/status in the dask labextension. When I try and go to http://localhost:9999/proxy/8787/status I get: [Errno 111] Connection refused
import dask_jobqueue as jq
from dask.distributed import Client
from tqdm.notebook import tqdm
partition='short,brief-low'
num_processes = 2
num_threads_per_processes = 6
mem = 3.2*num_processes*num_threads_per_processes*1.25
n_cores_per_job = num_processes*num_threads_per_processes
container = 'docker://rowangaffney/data_science_im_rs:latest'
env = 'py_geo'
clust = jq.SLURMCluster(queue=partition,
processes=num_processes,
cores=n_cores_per_job,
memory=str(mem)+'GB',
interface='ib0',
local_directory='$TMPDIR',
death_timeout=30,
python="singularity -vv exec {} /opt/conda/envs/{}/bin/python".format(container,env),
walltime='02:00:00',
job_extra=["--output=/dev/null","--error=/dev/null"])
cl=Client(clust)
clust.scale(n=2*num_processes)
with tqdm(total=2*num_processes) as pbar:
while (((cl.status == "running") and (len(cl.scheduler_info()["workers"]) < .9*2*num_processes))):
pbar.update(len(cl.scheduler_info()["workers"])-pbar.n)
pbar.update(len(cl.scheduler_info()["workers"])-pbar.n)
cl
Tagging @ynanyam as he can provide more details about HPC setup if needed.
Thanks!
Issue Analytics
- State:
- Created 3 years ago
- Comments:18 (16 by maintainers)
Top Results From Across the Web
Diagnostics (distributed) - Dask documentation
Diagnostics (distributed)¶. The Dask distributed scheduler provides live feedback in two forms: An interactive dashboard containing many plots and tables ...
Read more >"404 Not found" when trying to connect to dask dashboard
I'm using dask.distributed on a remote machine accessible via SSH, and attempting to connect to the Dask dashboard.
Read more >Ray Dashboard — Ray 2.2.0 - the Ray documentation
Ray's built-in dashboard provides metrics, charts, and other features that help Ray users ... You can access the dashboard through a URL printed...
Read more >Troubleshooting App Deployment Errors - Dash Python
This troubleshooting guide describes errors that you may encounter when deploying apps to Dash Enterprise as well as steps to resolve them.
Read more >adv_viz.ipynb - Colaboratory - Google Colab
The diagram below describes the steps Dask takes to manipulate data. The operation is broken down into a sequence of ... Click here...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
It should be fixed with dask 2.20, do reopen if that’s not the case.
@rmg55, I recently ran into a similar issue and I tried different bokeh+dask+distributed combination and I couldn’t get it to work until I pinned dask, distributed, and bokeh to the following versions: