question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Evaluate alternatives to storing executed notebooks in git

See original GitHub issue

Doing widget state cleanup today:

$ git diff --stat
 docs/source/examples/Analyzing the Parker Solar Probe flybys.ipynb                  |  4295 ------------------------
 docs/source/examples/Catch that asteroid!.ipynb                                     |  2655 ---------------
 docs/source/examples/Exploring the New Horizons launch.ipynb                        |  1446 --------
 docs/source/examples/Going to Jupiter with Python using Jupyter and poliastro.ipynb | 11647 ----------------------------------------------------------------
 docs/source/examples/Using NEOS package.ipynb                                       |  6689 +------------------------------------
 docs/source/examples/Visualizing the SpaceX Tesla Roadster trip to Mars.ipynb       |   141 +-
 6 files changed, 106 insertions(+), 26767 deletions(-)

This was just the last straw, but storing executed notebooks takes a lot of space and makes code review more difficult. We should evaluate whether things like jupytext are better suited for this.

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:6 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
jorgepilotocommented, Jun 17, 2020

When implementing #828 and after #976 it is clear that some notebooks do not seem to be updated even if a make clean && make html is executed. In ddition to that, reviewing modifications is difficult when it comes to *.ipynb as @astrojuanlu claimed.

I did a small ship locally from *.ipynb to *.py using Jupytext and found these advantages apart from previously ones:

  • Notebooks are forced to run always, no matter if they do not raise API changes related errors.
  • The recently implemented nbsphinx-gallery works without problem together with 3D plotting utilities.
  • Syntax is easy and it is possible to re-convert to notebooks whenever it is desired.
0reactions
astrojuanlucommented, Jun 19, 2020

@GorgiAstro if you notice weird things with the TOC extension, please let us know!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Jupyter Notebooks in a Git Repository - Read the Docs
Executing Notebooks in a Separate Branch§. In this scenario, you and your collaborators mainly work on the dev branch (never committing cell outputs),...
Read more >
Save a notebook to GitHub | Vertex AI Workbench
Configure your user-managed notebooks instance with your GitHub user ... In JupyterLab, select Git > Open Git Repository in Terminal to open a...
Read more >
On the Myths and Problems of Jupyter Notebooks - Ploomber
If we are thinking of testing notebooks as a whole, we can use papermill to execute them programmatically and evaluate their results.
Read more >
Use Git Repositories in a Notebook Instance
Use Git Repositories in a Notebook Instance ... To open any of the additional repositories, navigate up one folder. The additional repositories are...
Read more >
Exploring an Alternative to Jupyter Notebooks for Python ...
Introduction. Jupyter notebooks are an amazing tool for evaluating and exploring data. I have been using them as an integral part of my...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found