Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

add: start having ERROR: unexpected error - 'Tqdm' object has no attribute 'desc' when upgrade from 2.10.2 to 2.11.0

See original GitHub issue

Bug Report

Description

Running dvc add ./data shows error ERROR: unexpected error - 'Tqdm' object has no attribute 'desc' on version 2.11.0. In my case, one interesting thing is that if the data folder is generated using dev data with the folder size ~55MB, both 2.10.2 and 2.11.0 work, but if I use prod data with the folder size ~2.59GB, only 2.10.2 works.

Reproduce

dvc remote default prod
dvc add ./data

Expected

2.11.0 should work on both dev and prod data like how 2.10.2 does. It should not depend on the data size.

Environment information

dvc doctor

DVC version: 2.11.0 (pip)
---------------------------------
Platform: Python 3.8.10 on Linux-5.10.104-linuxkit-x86_64-with-glibc2.29
Supports:
        webhdfs (fsspec = 2022.5.0),
        http (aiohttp = 3.8.1, aiohttp-retry = 2.4.6),
        https (aiohttp = 3.8.1, aiohttp-retry = 2.4.6),
        s3 (s3fs = 2022.5.0, boto3 = 1.21.21)

Issue Analytics

State:
Created a year ago
Reactions:1
Comments:16 (9 by maintainers)

Top GitHub Comments

6reactions

sjawharcommented, Jul 7, 2022

OK, guys, I’ve found the issue! See this chunk of code in tqdm. When being run in a non-interactive environment (isatty() is False), the tqdm constructor hits this early return and doesn’t set the desc property.

So, should I submit a patch to tqdm or should dvc_objects stop relying on existence of the desc attribute?

Update I also opened https://github.com/iterative/dvc-objects/pull/92. Let’s solve this!

1reaction

casperdclcommented, Jul 8, 2022

Ah srry for not seeing this earlier.

Thanks @sjawhar & @daavoo for the debugging efforts!

A few points:

https://github.com/iterative/dvc-objects/blob/b469fb63c4479c85f064c33696ef4f18ed92f65c/src/dvc_objects/hash.py#L133-L155 doesn’t seem to be in current main anymore, so can’t be it…
ergo https://github.com/iterative/dvc-objects/pull/92 won’t fix the above issue
I’d rather not merge https://github.com/tqdm/tqdm/pull/1341 (for various reasons… TL;DR it likely encourages bad practice, see below for alternative)
as per this comment the root cause looks moved to dvc-data instead? I’ve opened https://github.com/iterative/dvc-data/pull/92 😃

Top Results From Across the Web

AttributeError: type object 'tqdm_asyncio' has no attribute 'auto'

I am trying to use tqdm in order to show a progress bar. My code looks like this: > def create_data_lists(fnames): > for...

Package List — Spack 0.17.2 documentation

This is a list of things you can install using Spack. ... This allows legacy applications to start taking advantage of libFLAME with...

All Modules 18.04 - Life Sciences Software

It can be used to error correct barcodes, collapse UMIs, produce gene count or transcript compatibility count matrices, and is useful for many...

pkg_desc_index « metadata - repo/sync/gentoo.git

Sync-friendly git mirror of repo/gentoo with caches and metadata ... 0.79.5: Tool for creating error correction data (ecc) for optical media (DVD, CD, ......

docs/softwarelist.txt · master · hpc-public / spartan-hpc-docs

The repository contains the Abseil C++ library code. Abseil is an ... probabilities that describe how much sequence from each genome is.