Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[RFC] Implement transforms primitives for Segmentation Masks

See original GitHub issue

Related tracker issue: #5754

Functional transforms for segmentation masks

The idea is to implement the following low-level functional transforms for segmentation masks: https://github.com/pytorch/vision/blob/main/torchvision/prototype/transforms/functional/_geometry.py

affine_segmentation_mask (@vfdev-5) #5613
rotate_segmentation_mask (@vfdev-5) #5692
perspective_segmentation_mask (@vfdev-5) #5888
center_crop_segmentation_mask (@federicopozzi33) #5961
crop_segmentation_mask (@vfdev-5) #5851
resized_crop_segmentation_mask (@vfdev-5) #5855
pad_segmentation_mask (@federicopozzi33) #5866, need more tests: https://github.com/pytorch/vision/pull/5866/files#r859158083 -> https://github.com/pytorch/vision/pull/6104
vertical_flip_segmentation_mask (@federicopozzi33) #5860, #5633

How to test the implementation ?

Put tests into test/test_prototype_transforms_functional.py:

correctness test
eager vs scripted
scriptable
check on cpu and cuda

cc @vfdev-5 @datumbox @bjuncek

Issue Analytics

State:
Created a year ago
Comments:9 (3 by maintainers)

Top GitHub Comments

1reaction

vfdev-5commented, May 30, 2022

I’m closing this tracker as done

1reaction

federicopozzi33commented, May 2, 2022

I’d like to complete this issue doing center_crop_segmentation_mask.

Top Results From Across the Web

MaskFormer - Hugging Face

MaskFormer addresses semantic segmentation with a mask classification paradigm instead of performing classic pixel-level classification.

FocalClick: Towards Practical Interactive Image Segmentation

Interactive segmentation allows users to extract target masks by making positive/negative clicks. Although ex- plored by many previous works, there is still ...

Extending TorchVision's Transforms to Object Detection ...

You can use new functional transforms for transforming Videos, Bounding Boxes and Segmentation Masks. The interface remains the same to ...

Mask augmentation for segmentation - Albumentations

Pass image and masks to the augmentation pipeline and receive augmented images and masks.¶. If the image has one associated mask, you need...

Learning Segmentation Masks with the Independence Prior

Training with adversarial loss and penalty for mask area, each provider learns a mask that is as small as possible but enough to...