[App] custom charts (eg. Confusion Matrix and ROC) show "no data available"
See original GitHub issueDescribe the bug As of 2 days ago before making this issue, the custom charts I used no longer display data using wandb.log() in the web client.
To Reproduce
The following calls are used from following the docs:
wandb.log({"roc" : wandb.plot.roc_curve(ground_truth, predictions, labels=["a", "b"])})
wandb.log({"conf_mat" : wandb.plot.confusion_matrix( probs=None, y_true=ground_truth, preds=predictions, class_names=["a", "b"]})
Using wandb with PyTorch Lightning, but with direct calls from wandb package.
Tables under the ‘Media’ tab are created with values for each custom chart, but not recognized as data to be displayed in ‘Custom Charts’. Instead, custom charts show “no data available”.
This also occurred after logging to a different wandb project ID.
Expected behavior Values to be plotted in the respective custom chart formats, updated after every custom chart log call for the same run.
Issue Analytics
- State:
- Created 2 years ago
- Comments:21 (8 by maintainers)
Top Results From Across the Web
[App] custom charts (eg. Confusion Matrix and ROC) show ...
Tables under the 'Media' tab are created with values for each custom chart, but not recognized as data to be displayed in 'Custom...
Read more >ROC Curve tools: DataRobot docs
The ROC Curve tools help you explore classification, performance, and statistics related to a selected model at any point on the probability scale....
Read more >MATLAB confusionchart - Classification
This MATLAB function creates a confusion matrix chart from true labels trueLabels and predicted labels predictedLabels and returns a ConfusionMatrixChart ...
Read more >Demystifying 'Confusion Matrix' Confusion | by SalRite
Understanding the Data. The Dataset contains properties of the wavelet transformed image of 400x400 pixels of a BankNote, and can be found here....
Read more >Keras Metrics: Everything You Need to Know
Sometimes the performance cannot be represented as one number but rather as a performance chart. Examples of such charts are ROC curve or...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@IgorHoholko We’ll have a fix in an upcoming release to resolve this issue so you can log automatically again.
@IgorHoholko If you click the edit modal, then modify your query to look as follows:
For your ROC chart in this workspace:
https://wandb.ai/ihoholko/masks_attributs?workspace=user-ihoholko
It should work.