question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Batchspawner spawning / keep-alive is instable

See original GitHub issue

Hi, I often end up in the following situation:

  • JupyterHub spawns new worker
  • Worker starts:
+ which jupyterhub-singleuser
/opt/anaconda/3-2019.10/bin/jupyterhub-singleuser
+ batchspawner-singleuser jupyterhub-singleuser --ip=0.0.0.0 --NotebookApp.default_url=/lab
[I 2020-03-29 18:18:43.199 SingleUserNotebookApp manager:48] [nb_conda_kernels] enabled, 84 kernels found
[I 2020-03-29 18:18:44.331 SingleUserNotebookApp extension:157] JupyterLab extension loaded from /opt/anaconda/3-2019.10/lib/python3.7/site-packages/jupyterlab
[I 2020-03-29 18:18:44.331 SingleUserNotebookApp extension:158] JupyterLab application directory is /opt/anaconda/3-2019.10/share/jupyter/lab
[I 2020-03-29 18:18:44.784 SingleUserNotebookApp __init__:31] [Jupytext Server Extension] Deriving a JupytextContentsManager from LargeFileManager
[I 2020-03-29 18:18:44.788 SingleUserNotebookApp singleuser:561] Starting jupyterhub-singleuser server version 1.1.0
[I 2020-03-29 18:18:44.800 SingleUserNotebookApp notebookapp:1924] Serving notebooks from local directory: /data/nasif12/home_if12/the_user
[I 2020-03-29 18:18:44.800 SingleUserNotebookApp notebookapp:1924] The Jupyter Notebook is running at:
[I 2020-03-29 18:18:44.800 SingleUserNotebookApp notebookapp:1924] http://lab-desk12:38375/jupyter/user/the_user/
[I 2020-03-29 18:18:44.800 SingleUserNotebookApp notebookapp:1925] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[I 2020-03-29 18:18:44.820 SingleUserNotebookApp singleuser:542] Updating Hub with activity every 300 seconds

Also, after ~ 24h the jupyterlab-singleuser worker looses connection to the JupyterHub. However, depending on the configuration I would like to have the jupyter instances running for more than one day.

Does somebody know why the connection between JupyterHub and the worker is so instable? Could https://github.com/jupyterhub/jupyterhub/pull/2727 be the solution?

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:6 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
consideRatiocommented, Jan 29, 2021

Closed by #187

1reaction
linhbngocommented, Oct 9, 2020

@Hoeze We ran into the same issue at our cluster (OpenPBS). Since PR #187 has not been merged yet, we side-stepped by set the JupyterHub Spawner’s poll_interval configuration to 1800 seconds (default is 30 seconds), and it seemed to help.

Read more comments on GitHub >

github_iconTop Results From Across the Web

jupyterhub - Bountysource
I run jupyterhub as webservice for our cluster users, each jupyter notebook is spawned onto a PBS node using batchspawner and its PBSSpawner, ......
Read more >
JupyterHub Documentation
JupyterHub, a multi-user Hub, spawns, manages, and proxies multiple instances of the single-user Jupyter notebook server.
Read more >
Developer Manual - NVIDIA Bright Cluster Manager Support
Description: WLM cluster that is associated with this batch spawner. Parameter: startupPollInterval. Type: unsigned integer.
Read more >
Jupyterhub: Multi-user Server for Jupyter Notebooks With Python
With JupyterHub you can create a multi-user Hub that spawns, manages, ... batchspawner, Designed for clusters using batch scheduling software.
Read more >
Simple Index - Alibaba Cloud
acycling-digraph-problem ... async-keepalive-httpc · async-keycloak · async-kinesis · async-kinesis-client ... aws-pcluster-slurm-spawner
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found