Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

How to use a custom dataset?

See original GitHub issue

I’ve changed the default_config.py to a custom folder with images: folder/path |----/image001.jpg |----/image002.jpg …

But it returned me ValueError: num_samples should be a positive integer value, but got num_samples=0

Issue Analytics

State:
Created 3 years ago
Comments:11 (3 by maintainers)

Top GitHub Comments

4reactions

june1819commented, Dec 5, 2020

I get this error. But I try to make “val” folder for “validation” folder. The error disappears. I get new error : “out of memory” although I try to make “batch_size = 2” and “crop_size = 64”. Could you post your default_config.py if you can run train.py.

0reactions

yifeipetcommented, Feb 11, 2022

Yes, writing own dataloader solve this issue.

Top Results From Across the Web

Writing Custom Datasets, DataLoaders and Transforms

In this tutorial, we will see how to load and preprocess/augment data from a non trivial dataset. To run this tutorial, please make...

Custom dataset in Pytorch —Part 1. Images | by Utkarsh Garg

So, we'll be learning about how to use it in our custom dataset pipeline. You can install it using : pip install -U...

Use Custom Datasets — detectron2 0.6 documentation

Use Custom Datasets ¶ · Register your dataset (i.e., tell detectron2 how to obtain your dataset). · Optionally, register metadata for your dataset....

Writing custom datasets - TensorFlow

To use the new dataset with tfds.load('my_dataset') : tfds.load will automatically detect and load the dataset generated in ~/tensorflow_datasets/my_dataset/ ...

Creating a custom Dataset and Dataloader in Pytorch - Medium

The dataset class of torch can be used like any other class in python, and have any number of sub functions in it,...