question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Feature proposal: TorchIO hub - A system to store and fetch transform objects for reproducibility

See original GitHub issue

🚀 Feature

Introducing a public TorchIO hub where researchers can save the transform object used to randomly sample and augment their data during training with one line of code - transform = tio.from_hub("cool_recent_paper")

Motivation

DL researchers and practitioners hoping to reproduce other people’s work can easily fetch model weights and architectural definitions (e.g Torch Hub or MONAI Bundle), training parameters (e.g AutoModel from HuggingFace) and preprocessing strategies (e.g AutoFeatureExtractor from HuggingFace) however, one thing which is still an obstacle in reproducing someone’s setup in a few lines of code is data augmentation. Libraries like Albumentations and TorchIO provide a variety of common data augmentation strategies - but they lack the Hub features of HF or Pytorch to easily store and fetch strategies.

Pitch

Not sure how you would implement this. As an MVP you could have a separate repo where users submit model transforms as code and a big dictionary lookup between some chosen string and their transforms.

Issue Analytics

  • State:open
  • Created a year ago
  • Reactions:3
  • Comments:6 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
fepegarcommented, Oct 9, 2022

You mean something like this?

@classmethod
def from_hub(cls, *args, **kwargs):
    return torch.hub.load(*args, **kwargs)
1reaction
tomvarscommented, Oct 9, 2022

I really like this API! You could maybe create a new repo like fepegar/torchiohub:main and have a single hubconf.py file as the access point to different preprocessing functions. In the repo users could append their transform functions to a large transforms.py file and the hubconf.py would have lines such as from transforms import ronneberger_unet_2015_transform

Read more comments on GitHub >

github_iconTop Results From Across the Web

Issues · fepegar/torchio - GitHub
Feature proposal : TorchIO hub - A system to store and fetch transform objects for reproducibility enhancement New feature or request.
Read more >
Feature proposal: TorchIO hub - A system to store and fetch ...
Feature. Introducing a public TorchIO hub where researchers can save the transform object used to randomly sample and augment their data during training...
Read more >
Fepegar Torchio Issues - IssueHint
Feature proposal : TorchIO hub - A system to store and fetch transform objects for reproducibility, open, 5, 2022-09-28, 2022-10-16.
Read more >
torchio - bytemeta
Feature proposal : TorchIO hub - A system to store and fetch transform objects for reproducibility. Previous Next. Make software development more efficient, ......
Read more >
Untitled
A data object describing a heterogeneous graph, holding multiple node and/or edge …. These release notes describe the key features, software enhancements ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found