System metrics: customize logging frequency
See original GitHub issuewandb --version && python --version && uname
- Weights and Biases version: version 0.9.1
- Python version: Python 3.7.4
- Operating System: MAC OS
Description
Hi there! From the documentation, I find that default metrics will be averaged every 30 seconds. I want to ask if we have any approach to change the time interval. I hope that users can have the option to choose by themselves. For example, if I have a program that runs for about 3 minutes, we might want to record system metrics every 5 or 10 seconds. If not, is there any way to add some code to make a control outside of wandb
package. Thank you!
Issue Analytics
- State:
- Created 3 years ago
- Comments:8 (3 by maintainers)
Top Results From Across the Web
System metrics: customize logging frequency #1133 - GitHub
Hi there! From the documentation, I find that default metrics will be averaged every 30 seconds. I want to ask if we have...
Read more >Generate Metrics From Your Logs to View Historical Trends ...
You can create a log-based metric from your log analytics queries by selecting the Generate new Metric option from your graph. Generate a...
Read more >Log-based metrics overview - Google Cloud
You can create user-defined log-based metrics to track other metrics that are important for your project. For example, you might create a log-based...
Read more >Chapter 7. Logging performance data with pmlogger Red Hat ...
Record metrics which are not listed in the automatic configuration. Choose custom logging frequencies. Add PMDA with the application metrics. Prerequisites.
Read more >Logging — PyTorch Lightning 1.8.5.post0 documentation
Track your parameters, metrics, source code and more using Comet. ... You can also pass a custom Logger to the Trainer . ......
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@loodvn if you’re using PyTorch, using the profiler is probably your best bet for debugging GPU memory issues but I can file a ticket for adding some of these more basic tools to the UI
Hey @coolalexzb we’re currently not exposing these dynamic settings in the UI. The relevant code is here: https://github.com/wandb/client/blob/master/wandb/stats.py#L81 As a quick workaround you could override this method. In the next release of our python library we plan to expose this in the UI, this release is planned for late July.