Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add Imagenet using the new Benchmark API

See original GitHub issue

Create Imagenet (split) as a module in avalanche/benchmarks/new_cdata_loaders.

You should use the generic functions made available in:

avalanche/benchmarks/scenarios/new_instances/scenario_creation.py if you want to create an NI scenario.
avalanche/benchmarks/scenarios/new_classes/scenario_creation.py if you want to create a NC scenario.
avalanche/benchmarks/scenarios/generic_scenario_creation.py if you want to create a scenario based on filelists.

Please also add a test in the tests directory using unittest.

Issue Analytics

State:
Created 3 years ago
Comments:6 (4 by maintainers)

Top GitHub Comments

1reaction

imprashrcommented, Jul 14, 2020

okay i’ll follow it

0reactions

vlomonacocommented, Oct 21, 2020

Completed in https://github.com/vlomonaco/avalanche/commit/76fc9e9c3d6d2ebf55624d1c1155344360cb1769

Top Results From Across the Web

ImageNet Benchmarks — FFCV documentation

We benchmark our system using the ImageNet dataset, covering dataset size (storage), data loading, and end-to-end training. As we demonstrate below, FFCV ...

Benchmark task: Full finetuning on Imagenet 1% , 10% subsets

Users can run the benchmark on 10% ImageNet subsets from SimCLR with the following command: python tools/run_distributed_engines.py ...

The ImageNet-CoG Benchmark - GitHub

ImageNet -CoG is a benchmark for concept generalization. It provides a full evaluation framework for pre-trained visual representations which ...

Welcome to the API docs of the ShiftHappens benchmark!

We aim to create a community-built benchmark suite for ImageNet models comprised of new datasets for OOD robustness and detection, as well as...

ImageNet Benchmark (Image Classification) | Papers With Code

Rank Model Top 1 Accuracy Number of params Year 1 CoCa (finetuned) 91.0% 2100M 2022 2 Model soups (BASIC‑L) 90.98% 2440M 2022 3 Model soups (ViT‑G/14)...