question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Allow for display of pipeline | canvas widget properties in the Visual Pipeline Editor

See original GitHub issue

As the creator of a notebook pipeline I would like to embed human-readable information in my [notebook] flow that enables other users to quickly determine what the purpose of (1) the pipeline and (2) the included notebooks is. For illustrative purposes let’s look at this pipeline, courtesy of https://github.com/CODAIT/covid-notebooks

image

Assuming user A has created this pipeline and shared it with user B (through whatever means), there’s currently a potential information loss risk unless additional information is shared through other means (email, slack message, verbal communication, etc). This information could entail:

  • what’s the origin of the pipeline
  • what’s the purpose of the pipeline
  • what’s the purpose of a pipeline component (this information is likely embedded in the notebook but requires the user to open it to find out)

Even if a creator currently chooses descriptive notebook names(like it was done here, e.g. etl_us_data), user B wouldn’t know what us_data is referring to unless he/she opens the notebook or, in case of generic notebooks, inspects input parameter values or is aware of the pipeline origins. As of today, a pipeline creator would have to embed information about the origin and purpose of the pipeline in one of the notebooks (to make the pipeline “self-explaining”), which doesn’t seem to be the appropriate place to convey the information, since a notebook might be part of many pipelines.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:12 (12 by maintainers)

github_iconTop GitHub Comments

1reaction
bourdakos1commented, Apr 23, 2021

I would opt for a dedicated PIPELINE PROPERTIES tab instead maybe?

This would also be a good place to potentially add a global defaults system

1reaction
ptitzlercommented, Jun 4, 2020

Yes, they could be used but this approach unfortunately does not define context information. For example, is a comment describing the pipeline, a notebook or something else? While a human can infer this if comments are properly positioned (or by interpreting the content), it cannot be done automatically. As a result the information could not be easily externalized outside the editor.

For example, let’s say sometime in the future we want to enable a pipeline “preview” in a navigator that would display the pipeline comment, if one was defined and the user hovers over the pipeline name

image

Read more comments on GitHub >

github_iconTop Results From Across the Web

Clipping for UMG Widgets in Unreal Engine
An overview of using the Clipping properties within the UMG UI Designer. ... The Image Widget (left) has been placed at the edge...
Read more >
Review test results - Azure Pipelines | Microsoft Learn
Test reports provide an effective and consistent way to view the tests results executed using different test frameworks, in order to measure ...
Read more >
Custom Editors - Unity - Manual
Making a Custom Editor. The above demonstrates how you can get simple scripts running during edit-time, however this alone does not allow you...
Read more >
Displaying Pipelines — scikit-learn 1.2.0 documentation
The default configuration for displaying a pipeline in a Jupyter Notebook is'diagram' where ... LogisticRegression , and displays its visual representation.
Read more >
4. Displaying data - ParaView Documentation
Views provide the canvas on which to display such visual representations, ... The role of the visualization pipeline is often to transform the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found