question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Error downloading mini-imagenet data

See original GitHub issue

Somehow I get the following error:

Downloading: /home/miranda9/data/l2l_data/mini-imagenet-cache-test.pkl
Traceback (most recent call last):
  File "/home/miranda9/miniconda3/envs/meta_learning_a100/lib/python3.9/site-packages/learn2learn/vision/datasets/mini_imagenet.py", line 102, in __init__
    self.data = pickle.load(f)
_pickle.UnpicklingError: invalid load key, '<'.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/miranda9/ultimate-utils/ultimate-utils-proj-src/uutils/torch_uu/dataloaders/meta_learning/l2l_mini_imagenet_mi.py", line 268, in <module>
    mi_test()
  File "/home/miranda9/ultimate-utils/ultimate-utils-proj-src/uutils/torch_uu/dataloaders/meta_learning/l2l_mini_imagenet_mi.py", line 255, in mi_test
    args.tasksets: BenchmarkTasksets = get_tasksets(
  File "/home/miranda9/ultimate-utils/ultimate-utils-proj-src/uutils/torch_uu/dataloaders/meta_learning/l2l_mini_imagenet_mi.py", line 212, in get_tasksets
    datasets, transforms = _TASKSETS[name](train_ways=train_ways,
  File "/home/miranda9/ultimate-utils/ultimate-utils-proj-src/uutils/torch_uu/dataloaders/meta_learning/l2l_mini_imagenet_mi.py", line 78, in mini_imagenet_tasksets
    test_dataset = l2l.vision.datasets.MiniImagenet(
  File "/home/miranda9/miniconda3/envs/meta_learning_a100/lib/python3.9/site-packages/learn2learn/vision/datasets/mini_imagenet.py", line 108, in __init__
    self.data = pickle.load(f)
_pickle.UnpicklingError: invalid load key, '<'.

but I only get it in the dgx machine not locally…has anyone had this error before?

cross: https://stackoverflow.com/questions/71094907/how-does-one-download-data-for-a-dgx-a100-machine-that-returns-a-invalid-load-ke

Issue Analytics

  • State:open
  • Created 2 years ago
  • Comments:21 (3 by maintainers)

github_iconTop GitHub Comments

11reactions
nazagocommented, Feb 25, 2022

A temporal solution I found is the following:

1 Go to /learn2learn/vision/datasets and choose your <dataset>.py (for example, mini_imagenet.py). 2 Look through the code comments, there are the link from which the script download the test. 3 Click the links and download them with your web browser. 4 Move them to the folder the algorithm look for the dataset (by default ~/data).

This is how I have solved 😃

1reaction
woreomcommented, Sep 27, 2022

Just use gdown to download your data from google drive

Read more comments on GitHub >

github_iconTop Results From Across the Web

miniImageNet - Kaggle
Pre-processed miniImageNet dataset for few-shot learning research. ... arrow_drop_up 3. file_downloadDownload (7 GB) ... An error occurred: Failed to fetch.
Read more >
Download Few-Shot Datasets
Download Few-Shot Datasets. All these datasets are only allowed to be downloaded by researchers for non-commercial research and educational purposes.
Read more >
The visualization results of feature map on mini-ImageNet ...
Download scientific diagram | The visualization results of feature map on mini-ImageNet dataset test samples. from publication: Feature Transformation ...
Read more >
Datasets - Torchmeta - Tristan Deleu
The dataset is downloaded from the original Omniglot repository. ... Root directory where the dataset folder miniimagenet exists. num_classes_per_task: int
Read more >
ImageNet
ImageNet is an image database organized according to the WordNet hierarchy (currently only the nouns), in which each node of the hierarchy is...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found