question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

HER model don't learn again after load previously learned model.

See original GitHub issue

It seems HER model don’t learn again after load previously learned model.

model = HER.load('her_bit_env', env=env)
model.learn(1000)
model.save("her_bit_env")

I got exactly the same effect after test. Stable baselines v.2.6

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:5

github_iconTop GitHub Comments

1reaction
araffincommented, Aug 8, 2019

as it is using off-policy algorithms, it does not by default. the most important thing missing would be the replay buffer, that you can save easily by yourself.

0reactions
rlancommented, Aug 8, 2019

@araffin In light of your comment in https://github.com/hill-a/stable-baselines/issues/301#issuecomment-489308597, does HER have a perfect recovery or no?

Read more comments on GitHub >

github_iconTop Results From Across the Web

Why Loading a Previously Saved Keras Model Gives ...
Some models take weeks to months to train. This makes it so important to be able to store our models locally and retrieve...
Read more >
My machine learning model does not learn. What should I ...
Your training process is not too slow. If your training set is too large, you can extract a smaller sample for training; For...
Read more >
How to Save and Load Your Keras Deep Learning Model
In this post, you will discover how to save your Keras models to files and load them up again to make predictions. After...
Read more >
Loading a trained Keras model and continue training
The reason for this is that I will have more training data in the future and I do not want to retrain the...
Read more >
What should I do when my neural network doesn't learn?
This Medium post, "How to unit test machine learning code," by ... This is because your model should start out close to randomly...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found