question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. ItΒ collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

exp show: --show-md for experiment tables

See original GitHub issue

We want to be able to display tables of our experiments in markdown documents similar to how we can do it with dvc params and metrics.

Our use case is that we are conducting hyperparameter tuning jobs in CML, and would like to easily format a table of the results in PR comments.

I appreciate that just doing a dvc exp show --show-md could by default be an overwhelming table but the conversion would be extremely handy along with the filtering flags to get a summary that is much more manageable.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:3
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
dberenbaumcommented, Sep 17, 2021

Also, no need to close the ticket. This is at least a pattern we should explicitly support for cml and other ci needs.

0reactions
daavoocommented, Oct 13, 2021

Raw markdown would be more likely to benefit from some features of the platform where the table is being rendered (i.e. in Jupyter you would get rows highlighted on hover).

Taking Github example below, I kind of like the --show-md format better.

Example β€œcode block workaround” (this renders awful on VSCode markdown extension preview, btw):

┏━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Experiment ┃ Created      ┃    loss ┃ accuracy ┃ train.batch_size ┃ train.hidden_units ┃ train.dropout ┃ train.num_epochs ┃ train.lr ┃ train.conv_activation ┃
┑━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━┩
β”‚ workspace  β”‚ -            β”‚ 0.26484 β”‚   0.9038 β”‚ 128              β”‚ 64                 β”‚ 0.4           β”‚ 10               β”‚ 0.001    β”‚ relu                  β”‚
β”‚ main       β”‚ Sep 14, 2021 β”‚ 0.26484 β”‚   0.9038 β”‚ 128              β”‚ 64                 β”‚ 0.4           β”‚ 10               β”‚ 0.001    β”‚ relu                  β”‚
β”‚ 5bcd44f    β”‚ Sep 01, 2021 β”‚ 0.25026 β”‚   0.9095 β”‚ 128              β”‚ 64                 β”‚ 0.4           β”‚ 10               β”‚ 0.001    β”‚ relu                  β”‚
β”‚ b06a6ba    β”‚ Aug 31, 2021 β”‚ 0.25026 β”‚   0.9095 β”‚ 128              β”‚ 64                 β”‚ 0.4           β”‚ 10               β”‚ 0.001    β”‚ relu                  β”‚
β”‚ d34fd8c    β”‚ Aug 30, 2021 β”‚ 0.30741 β”‚   0.8929 β”‚ 128              β”‚ 64                 β”‚ 0.4           β”‚ 10               β”‚ 0.01     β”‚ relu                  β”‚
β”‚ 02b68b7    β”‚ Aug 29, 2021 β”‚ 0.44604 β”‚   0.8483 β”‚ 128              β”‚ 64                 β”‚ 0.4           β”‚ 10               β”‚ 0.01     β”‚ relu                  β”‚
β”‚ 5337519    β”‚ Aug 28, 2021 β”‚       - β”‚        - β”‚ -                β”‚ -                  β”‚ -             β”‚ -                β”‚ -        β”‚ -                     β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Pure markdown:

Experiment Created loss accuracy train.batch_size train.hidden_units train.dropout train.num_epochs train.lr train.conv_activation
workspace - 0.26484 0.9038 128 64 0.4 10 0.001 relu
main Sep 14, 2021 0.26484 0.9038 128 64 0.4 10 0.001 relu
5bcd44f Sep 01, 2021 0.25026 0.9095 128 64 0.4 10 0.001 relu
b06a6ba Aug 31, 2021 0.25026 0.9095 128 64 0.4 10 0.001 relu
d34fd8c Aug 30, 2021 0.30741 0.8929 128 64 0.4 10 0.01 relu
02b68b7 Aug 29, 2021 0.44604 0.8483 128 64 0.4 10 0.01 relu
5337519 Aug 28, 2021 - - - - - - - -
Read more comments on GitHub >

github_iconTop Results From Across the Web

metrics diff | Data Version Control - DVC
Provides a quick way to compare metrics among experiments in the repository history. The differences shown by this command include the new value,Β ......
Read more >
CHEM 109 Exp. 5 - See the Light Week 1 - StuDocu
Chem 109 completed Lab manual. Dr. Yesselman experiment see the light week total points: 52 name: lab section: report your report should include...
Read more >
Expert Healthcare for Riders | ShowMD | United States
Certified Physician. Our team of certified physicians, nurses, physician assistants & medics are present throughout the show day to provide all aspects ofΒ ......
Read more >
digital health - SAGE Journals
Demonstration experiment of telemedicine using ultrasonography and ... in their daily work to operate the probe (also shown in Figure 1).
Read more >
DVC: Data Version Control - Git for Data & Models - Zenodo
... use ui.table for --show-md (#5887) @skshetry refactor exp show: use new abstractions (#5880) @skshetry refactor diff and show to use newΒ ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found