question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

COCO-style DataLoader

See original GitHub issue

I would love to start training with this! I helped to write a Dataloader for the “COCO” format i.e. images and text files containing line separated captions. They are matched in the data loader via the unique basename of each file.

https://github.com/lucidrains/DALLE-pytorch/blob/main/dalle_pytorch/loader.py

Would it be possible to port that data loader to this project? It is perhaps of interest to some folks I know with some spare compute. Also personally useful to me, because I have converted a good deal of my collected datasets to this format already.

Thanks!

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
Zasder3commented, May 23, 2021

@afiaka87 Oh sorry I didn’t mean to mess with your Dropbox usage abilities! I’m currently downloading one of them but that will conclude in 30 minutes. If you are interested in having these remain public I could help work out a solution? Personally, I know archive.org is a good place for larger files for free.

1reaction
Zasder3commented, May 21, 2021

I’ve written up a DataModule based on the file you linked and made sure to attribute the original repo. Feel free to message me if you would like any updates to the citation!

Read more comments on GitHub >

github_iconTop Results From Across the Web

AFLW2COCO: convert AFLW annotation into COCO format
In this repo, we provide a script for converting annotations into a COCO-style json file, which can be used by the provided PyTorch...
Read more >
How to work with object detection datasets in COCO format
Microsoft's Common Objects in Context dataset (COCO) is the most popular object detection dataset at the moment. It is widely used to benchmark ......
Read more >
How do I re-train Torchvision's keypoint R-CNN with a custom ...
I've created a custom COCO keypoints style dataset using COCO annotator and want to retrain Torchvision's Keypoint R-CNN on it.
Read more >
Custom Dataset — OpenPifPaf Guide DEV
A Coco Data loader is already available, or a custom one can be created and ... your own dataloader, or you can transform...
Read more >
TorchVision Object Detection Finetuning Tutorial - PyTorch
DataLoader ( dataset, batch_size=2, shuffle=True, num_workers=4, ... So after one epoch of training, we obtain a COCO-style mAP of 60.6, and a mask...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found