question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[App] custom charts (eg. Confusion Matrix and ROC) show "no data available"

See original GitHub issue

Describe the bug As of 2 days ago before making this issue, the custom charts I used no longer display data using wandb.log() in the web client.

To Reproduce

The following calls are used from following the docs:

  • wandb.log({"roc" : wandb.plot.roc_curve(ground_truth, predictions, labels=["a", "b"])})
  • wandb.log({"conf_mat" : wandb.plot.confusion_matrix( probs=None, y_true=ground_truth, preds=predictions, class_names=["a", "b"]})

Using wandb with PyTorch Lightning, but with direct calls from wandb package.

Tables under the ‘Media’ tab are created with values for each custom chart, but not recognized as data to be displayed in ‘Custom Charts’. Instead, custom charts show “no data available”.

This also occurred after logging to a different wandb project ID.

Expected behavior Values to be plotted in the respective custom chart formats, updated after every custom chart log call for the same run.

wandb_custom_charts

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:21 (8 by maintainers)

github_iconTop GitHub Comments

2reactions
KyleGoyettecommented, Apr 23, 2021

@IgorHoholko We’ll have a fix in an upcoming release to resolve this issue so you can log automatically again.

2reactions
KyleGoyettecommented, Apr 23, 2021

@IgorHoholko If you click the edit modal, then modify your query to look as follows: image For your ROC chart in this workspace: https://wandb.ai/ihoholko/masks_attributs?workspace=user-ihoholko

It should work.

Read more comments on GitHub >

github_iconTop Results From Across the Web

[App] custom charts (eg. Confusion Matrix and ROC) show ...
Tables under the 'Media' tab are created with values for each custom chart, but not recognized as data to be displayed in 'Custom...
Read more >
ROC Curve tools: DataRobot docs
The ROC Curve tools help you explore classification, performance, and statistics related to a selected model at any point on the probability scale....
Read more >
MATLAB confusionchart - Classification
This MATLAB function creates a confusion matrix chart from true labels trueLabels and predicted labels predictedLabels and returns a ConfusionMatrixChart ...
Read more >
Demystifying 'Confusion Matrix' Confusion | by SalRite
Understanding the Data. The Dataset contains properties of the wavelet transformed image of 400x400 pixels of a BankNote, and can be found here....
Read more >
Keras Metrics: Everything You Need to Know
Sometimes the performance cannot be represented as one number but rather as a performance chart. Examples of such charts are ROC curve or...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found