question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

FFCV Imagenet Image Quality vs. Native Imagenet Image Quality

See original GitHub issue

Hello! I see that FFCV offers alot of options for the quality of the dataset - e.g. in the imagenet example:

# - 50% JPEG encoded, 90% raw pixel values
# - quality=90 JPEGs
./write_dataset.sh 500 0.50 90

One thing I’m curious is the effects of these quality options on the training results of the dataset, as I’m interested in reproducing Imagenet results but faster using FFCV. What would also be recommended settings to use if you would like to produce Native Imagenet Quality precisely (barring the crop size).

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:11 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
andrewilyascommented, Jan 19, 2022

Just to add: for our ImageNet results (the speed/accuracy tradeoff scatterplot and table), we use:

Max image size: 500
Random compression with 50% probability
JPEG Quality 90
0reactions
GuillaumeLeclerccommented, Jan 22, 2022

I think this thread has been dealt with. @YassineYousfi Feel free to start a new conversation about these specific topics.

Read more comments on GitHub >

github_iconTop Results From Across the Web

ImageNet Benchmarks — FFCV documentation
We benchmark our system using the ImageNet dataset, covering dataset size (storage), ... Image Format. Quality. Size @ 256px. Size @ 384px. Size...
Read more >
Train ImageNet *fast* in 500 lines of code with FFCV - GitHub
Train ImageNet *fast* in 500 lines of code with FFCV - GitHub ... images with: # - 500px side length maximum # -...
Read more >
[P] FFCV: Accelerated Model Training via Fast Data Loading
Train an ImageNet model (ResNet-50) to 75.6% accuracy *on one AWS machine* ... with other libraries, do you use the same image resolution?...
Read more >
Composer + FFCV: Faster Together - MosaicML
It uses a collection of techniques such as compiling image processing pipeline to native code, intelligent memory allocation, better scheduling ...
Read more >
FFCV: FAST TRAINING VIA FAST DATA LOADING
Using FFCV, we train ResNet-18 and ResNet-50 on the ImageNet dataset ... fixed-width information) about a given sample, such as e.g. the image...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found