Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Test summary with previous PyTorch/TensorFlow versions

See original GitHub issue

Initialized by @LysandreJik, we ran the tests with previous PyTorch/TensorFlow versions. The goal is to determine if we should drop (some) earlier PyTorch/TensorFlow versions.

This is not exactly the same as the scheduled daily CI (torch-scatter, accelerate not installed, etc.)
Currently we only have the global summary (i.e. there is no number of test failures per model)

Here is the results (running on ~June 20, 2022):

PyTorch testing has ~27100 tests
TensorFlow testing has ~15700 tests

Framework	No. Failures
PyTorch 1.10	50
PyTorch 1.9	710
PyTorch 1.8	1301
PyTorch 1.7	1567
PyTorch 1.6	2342
PyTorch 1.5	3315
PyTorch 1.4	3949
TensorFlow 2.8	118
TensorFlow 2.7	122
TensorFlow 2.6	122
TensorFlow 2.5	128
TensorFlow 2.4	167

It looks like the number of failures in TensorFlow testing doesn’t increase much.

So far my thoughts:

All TF >= 2.4 should be (still) kept in the list of supported versions

Questions

What’s you opinion regarding which versions to drop support?
Would you like to see the number of test failures per model?
TensorFlow 2.3 needs CUDA 10.1 and requires the build of a special docker image. Do you think we should make the effort on it to have the results for TF 2.3?

Issue Analytics

State:
Created a year ago
Comments:11 (6 by maintainers)

Top GitHub Comments

2reactions

Rocketknight1commented, Jul 18, 2022

TF 2.3 is quite old by now, and I wouldn’t make a special effort to support it. Several nice TF features (like the Numpy-like API) only arrived in TF 2.4, and we’re likely to use those a lot in future.

2reactions

ydshiehcommented, Jul 18, 2022

cc @LysandreJik @sgugger @patrickvonplaten @Rocketknight1 @gante @anton-l @NielsRogge @amyeroberts @alaradirik @stas00 @hollance to have your comments

Top Results From Across the Web

Guide to Conda for TensorFlow and PyTorch

Guide to Conda for TensorFlow and PyTorch. Learn how to set up anaconda environments for different versions of CUDA, TensorFlow, and PyTorch.

Pytorch vs Tensorflow: A Head-to-Head Comparison - viso.ai

TensorFlow and PyTorch are two widely-used machine learning frameworks that support artificial neural network models. This article describes the effectiveness ...

How to Check PyTorch Version {3 Methods} | phoenixNAP KB

Using Python Code. To check the PyTorch version using Python code: 1. Open the terminal or command prompt and run Python: python3.

tf.test.is_gpu_available | TensorFlow v2.11.0

Returns whether TensorFlow can access a GPU. (deprecated)

torch.utils.tensorboard — PyTorch 1.13 documentation

For example, “Loss/train” and “Loss/test” will be grouped together, ... from torch.utils.tensorboard import SummaryWriter # create a summary writer with ...