How to use the test function from the trainer?
See original GitHub issue❓ Questions and Help
What is your question?
So when I test
my model with trainer.test()
I get as output this:
----------------------------------------------------------------------------------------------------
TEST RESULTS
{}
----------------------------------------------------------------------------------------------------
I suppose in the empty bracket can stand sth. But I dont know what can stand there and where to do it. I can’t seem to find it in the docs not under trainer nor under test set stands for what this is. If I am right and it doesn’T stand anywhere maybe add to the docs.
Code
trainer.test()
What have you tried?
Searching the docs and google it.
What’s your environment?
- Windows 10
- conda
- lighning 0.7.1
Issue Analytics
- State:
- Created 4 years ago
- Reactions:9
- Comments:18 (1 by maintainers)
Top Results From Across the Web
How to use the test function from the trainer? · Issue #1088
It seems one needs to use predict_step (and trainer.predict ) in order to explicitly return something (without using "tricks" like logging). For ...
Read more >Trainer - Hugging Face
The Trainer class provides an API for feature-complete training in PyTorch for most standard use cases. It's used in most of the example...
Read more >Validate and test a model (intermediate) - PyTorch Lightning
Testing is performed using the Trainer object's .test() method. Trainer.test(model=None, dataloaders=None, ckpt_path=None, verbose=True, ...
Read more >Understanding Train Test Split - Built In
Train test split is a model validation procedure that reveals how your model performs on new data. Here's how to apply it.
Read more >Python Machine Learning Train/Test - W3Schools
Train/Test is a method to measure the accuracy of your model. It is called Train/Test because you split the the data set into...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
I would like to vote for reopening this issue, the solution is too dark right now. I think pytorch lightning has a lot of potential. A better solution is needed
I would like to vote for reopening this issue, in particular because the Introduction Guide suggests that any value returned in the dictionary in
test_epoch_end
will be displayed in the summary. I assume that this was the case in the past, and that the Introduction Guide is simply outdated in this regard. Nevertheless, having to wrap it in a key calledprogress_bar
seems counter-intuitive.More generally speaking, it would help if there was a centralised documentation on what keys to return in the dictionary in each of these functions 😃.
And of course, thanks so much for the work on this library. I’m just exploring it right now, but it looks really nice to use 😃. I’m quite excited!