question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

clarify pipeline stages vs experiments

See original GitHub issue

Some features often underused/misunderstood/unknown could be helped by better docs/messaging/onboarding clarity.

  • Should there be a page clearly describing the difference between stages and experiements?

Nothing in use-cases/experiment-tracking nor user-guide/experiment-management seems to tell existing dvc repro users why they should bother with/what are the use cases of dvc exp.

It doesn’t seem clear to users what’s the difference between stage/repro (i.e. pipelines) and exp (i.e. experiments).

  • A feature comparison table would be epic.

Issue Analytics

  • State:open
  • Created a year ago
  • Reactions:2
  • Comments:7 (6 by maintainers)

github_iconTop GitHub Comments

4reactions
drozzycommented, Sep 6, 2022

These two clarification points I’ve found in various places (the latter one from @SoyGema) have been very useful for me as a user:

  1. Experiments commands exp produce a git ref, that is how it stores its state.
  2. “If you use dvc repro, each time you execute it will overwrite everything without going back unless you commit in between each execution.” “dvc exp run allows to run different experiments, for example hyper parameter changes without having to create a commit for each one”
2reactions
jorgeorpinelcommented, Jun 11, 2022

Nothing in use-cases/experiment-tracking nor user-guide/experiment-management seems to tell existing dvc repro users why they should bother with/what are the use cases of dvc exp.

We do mention exp run vs. repro specifically in several places like https://dvc.org/doc/user-guide/experiment-management/experiments-overview#basic-workflow, https://dvc.org/doc/user-guide/experiment-management/running-experiments#running-the-pipelines, and https://dvc.org/doc/command-reference/exp/run.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Pipeline architecture - GitLab Docs
Pipelines are the fundamental building blocks for CI/CD in GitLab. This page documents some of the important concepts related to them.
Read more >
pipelines: clarify whether it's possible to have more than one ...
I am assuming that it's not possible to re-use certain stages or that it's possible to use some sort of composition. Let's say...
Read more >
Working with Pipelines - MLOps Guide
Let's also consider that we have three stages in this experiment: Preprocessing your data(extract features...) Train the model; Evaluate the model. Here you ......
Read more >
Running Experiments | Data Version Control - DVC
These files codify pipelines that specify one or more stagesstages of the experiment workflow (code, dependenciesdependencies, outputsoutputs, etc.). See Get ...
Read more >
GitLab: understanding pipelines, stages, jobs and organising ...
Each job belongs to a single stage. Stage can contain zero, one or more jobs to execute. All jobs in a single stage...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found