Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Cannot reproduce model results

See original GitHub issue

After running all of the steps in the README.md verbatim, the prediction_scores.txt contains:

Model MSE: 0.201040
Previous Frame MSE: 0.021246

and all of the generated plots contain only two colours (pink and blue), for example, here are the first five: plot_0 plot_3 plot_4 plot_5 plot_7

I am using Python 2.7 and Theano==0.9.0 (GPU with pygpu==0.6.2) and Keras==1.0.8 (it seems higher versions are incompatible [see #18]). I am not using cuDNN.

Issue Analytics

State:
Created 6 years ago
Comments:14 (4 by maintainers)

Top GitHub Comments

1reaction

wongjoelcommented, Jan 17, 2018

I wasn’t getting the strange colourisation of output, but I was getting some poorer quality output before the latest commit (9f6482e). Compare the results from before and after:

plot_69 plot_69

So just wanted to say thanks to bill-lotter for fixing the issue, and to encourage anyone with issues to try again with the latest commit.

1reaction

bill-lottercommented, Apr 11, 2017

Hmmm yeah not sure about the cuDNN issue, but if you can get that working on your machine, it should speed up training a lot. If you end up trying to train again, I would run model.fit_generator with verbose=1 and then you should at least be able to see if it’s getting anywhere as it starts training.

Top Results From Across the Web

Why Can't I Reproduce Their Results?

Perhaps your data isn't clean in the first place? Perhaps it has outliers or invalid entries? Perhaps there is a bug in your...

Help! I can't reproduce a machine learning project! - Medium

In order to make machine learning results reproducible, you need to make sure that the random elements are the same every time you...

can't reproduce results even set all random seeds #7068

My environment： python2.7, cuda8.0, cudnn, pytorch 0.3.1 I set all random seeds but I still can't reproduce results.

Cannot reproduce results with Keras - python - Stack Overflow

Model weights are initialized randomly. Sometime a model starts with better luck than another. Since you're using "relu" and just a few neurons ......

Why can't I reproduce my results in keras using random seed?

To confirm this point, you can try to use TensorFlow with CPU only, or disable Cuda DNN but the model will be twice...