Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Using masks as preprocessing for classification [FR]

See original GitHub issue

Maybe it’s a little bit too early to ask for this but could it be possible to specify regions within an image for ViT to perfom the prediction? I was thinking on a binary mask, for example, which could be used for the tiling step in order to obtain different images sequences.

I am thinking on a pipeline where, in order to increase resolution, you could specify the regions to perform the training based on whatever reason you find it suitable (previous attention maps for example 😄).

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:8 (5 by maintainers)

Top GitHub Comments

1reaction

lucidrainscommented, Oct 7, 2020

https://github.com/lucidrains/vit-pytorch/releases/tag/0.0.4 done!

1reaction

lucidrainscommented, Oct 7, 2020

@Tato14 Ok, I’ll add the mask later today 😃

Top Results From Across the Web

Facial Mask Detection Using Depthwise Separable ... - Frontiers

We describe an effective face mask-based facial image classification system using a MobileNet-based deep learning model with a Depthwise separable convolution ...

Fine-tuning a masked language model - Hugging Face Course

When training models for masked language modeling, one technique that can be used is to mask whole words together, not just individual tokens....

3.4.3. Preprocessing

Preprocessing ¶. The tab Preprocessing provides several tools for data manipulation which are useful before the actual classification process. 3.4.3.1. ASTER.

Identifying Facemask-Wearing Condition Using Image Super ...

The proposed algorithm contains four main steps: Image pre-processing, facial detection and cropping, image super-resolution, and facemask-wearing condition ...

Masked Face Recognition Using Deep Learning: A Review

Image Preprocessing. The performance of FR systems, with or without masks, is largely influenced by the nature of face images used in the...