question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Activation and execution of cells is slower when using Conda Run

See original GitHub issue

Conda run seems to be very slow

  • Possibly because conda run is slow
  • Or we have python extension running conda run for all conda environments and we’re running as well
  • Or other

@rchiodo @IanMatthewHuff You might recall, that running conda activate on CI can cause issues specially when run in parallel. And we have code that retries the activation (basically conda isn’t designed to activate multiple environments at the same time, due to some file locking issue).

Hence I believe using conda run in parallel (in python extension & then also running in jupyter) could be causing issues.

This is all hypothetical.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:10 (10 by maintainers)

github_iconTop GitHub Comments

1reaction
rchiodocommented, Jan 11, 2022

Note to self. this command was super useful for debugging this stuff:

image

It clears the memento storage, forcing all the environment caching to rerun.

0reactions
rchiodocommented, Jan 12, 2022

I did find a typo that may be causing the caching to be skipped for somethings (this line here should read await Promise.race([cacheInfo.promise, latestInfo])).

Effectively that race always returns immediately but then the cacheInfo isn’t completed so we always wait for the latestInfo promise. That should be cached on the python side though, so not sure it makes much of a difference.

I’m going to try moving all of the kernel warmup code into a single execution to see if I can speed that up a little.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Bash script with multiple commands stops when entering new ...
I want a command that I can add to my ~/.bashrc which does the following in this order: cd to a directory; activate...
Read more >
Release notes — conda 22.11.1.post16+ce4e810c9 ...
Users will still need to run conda activate base to put the base environment on PATH and gain access to the executables in...
Read more >
Introduction to Python for Data Science - GitHub Pages
Create and run Python cells in a notebook. Activate the Conda environment. At the end of the previous episode we deactivated our Conda...
Read more >
Frequently Asked Questions — Spyder 4 documentation
Q: How do I run Spyder installed in a conda environment using the command line? ... Then, type spyder to launch the version...
Read more >
Installation — climada 2.2.0 documentation - Read the Docs
If the installation has been successful, an OK will appear at the end (the execution should last less than 2min). Run tutorials: Install...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found