Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Eval Interval without a Validation Dataloader

See original GitHub issue

I am using multiple datasets, some with validation dataloaders and some without.

When I pass None for a validation dataloader but keep the rest of my Trainer the same I get the error:

Specifying `eval_interval` without an `eval_dataloader` has no effect.

I have tried setting eval_dataloader to 0, None but nothing seems to work…

Thanks, Trenton

Issue Analytics

State:
Created 9 months ago
Comments:11 (6 by maintainers)

Top GitHub Comments

1reaction

mvpatel2000commented, Dec 13, 2022

great! glad its working. Feel free to reach out if you hit any other issues

1reaction

TrentBrickcommented, Dec 13, 2022

Ok in making a minimal repro I figured out that my tester script (rather than parallelized runner) hadn’t updated with the entry of “1”. Now things work. Sorry for the confusion.

Top Results From Across the Web

Logging Intervals and Evaluation Intervals #3466 - GitHub

Before initializing the trainer, I've used the dataloader/dataset to calculate the number of batches per epoch, and then used ...

LightningModule - PyTorch Lightning - Read the Docs

Implement one or multiple PyTorch DataLoaders for validation. The dataloader you return will not be reloaded unless you set reload_dataloaders_every_n_epochs to ...

How to split dataset into test and validation sets

I have a dataset in which the different images are classified into different folders. I want to split the data to test, train,...

Training & evaluation with the built-in methods - Keras

This guide covers training, evaluation, and prediction (inference) models when using built-in APIs for training & validation (such as ...

Evaluation Settings — RecBole 1.1.1 documentation

Evaluation settings are designed to set parameters about model evaluation. ... the ratio of training set, validation set and testing set respectively.