Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Support for latest PyTorch profiler

See original GitHub issue

🚀 Feature

Support for the “new” PyTorch profiler.

Motivation

Per the PyTorch docs, the torch.autograd profiler used in Lightning is legacy code and will be deprecated. The torch.profiler is much nicer and has been supported for over a year.

Pitch

Rename PyTorchProfiler to PyTorchAutogradProfiler and implement PyTorchProfiler as the new default profiler.

Alternatives

Keep PyTorchProfiler as the legacy profiler and implement PyTorchProfiler2 (or something) as an alternative profiler.

Additional context

N/A

cc @carmocca @kaushikb11 @ninginthecloud @rohitgr7

Issue Analytics

State:
Created 2 years ago
Comments:6 (3 by maintainers)

Top GitHub Comments

5reactions

ananthsubcommented, Mar 17, 2022

The integration with the latest pytorch profiler is already available here: https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pytorch_lightning/profiler/pytorch.py

Specifically: https://github.com/PyTorchLightning/pytorch-lightning/blob/bc812077c41896c93205fe6e9e3d18485d83a2e5/pytorch_lightning/profiler/pytorch.py#L477-L479

@kaushikb11 the profiling docs should be updated to reflect this: https://pytorch-lightning.readthedocs.io/en/latest/advanced/profiler.html#pytorch-profiler

0reactions

carmoccacommented, Apr 7, 2022

Sure!

Top Results From Across the Web

torch.profiler — PyTorch 1.13 documentation

PyTorch Profiler is a tool that allows the collection of performance metrics during training and inference. Profiler's context manager API can be used...

Support for latest PyTorch profiler · Issue #12358 - GitHub

Per the PyTorch docs, the torch.autograd profiler used in Lightning is legacy code and will be deprecated. The torch.profiler is much nicer and ......

PROFILING AND OPTIMIZING PYTORCH APPLICATIONS ...

... Microsoft) shares the most recent updates to PyTorch Profiler, a demo and tips for leveraging the Profiler API to help you quickly ......

PyTorch Profiler and Designing Evolutionary Data Systems

This is a recording of a live meetup we ran on November 17th. PyTorch Proflier updates and a chat about Designing Evolutionary Data...

What is the new PyTorch profiler? - eduCBA

A PyTorch Profiler is an open-source tool for analyzing and troubleshooting large-scale deep learning models with accuracy and efficiency. This new tool, which ......