HER+SAC on Robotic Environment

Hi I am getting this error while running this code:

python train.py --algo her --env FetchPickAndPlace-v1 --tensorboard-log "C:\Users\pei-seng.tan\Desktop\Deep_RL\rl-baselines-zoo\USM_RL\SAC+HER" --eval-freq 10000 --eval-episodes 10 --save-freq 100000

It happens when the time-steps=10000

May I know how do i solve it?

[araffin]

You forgot to give the complete traceback… it is due to the eval env which is not properly wrapped. See the warning:

stable_baselines/common/callbacks.py:277: UserWarning: Training and eval env are not of the same type<stable_baselines.her.utils.HERGoalEnvWrapper object at 0x7f68c48c09e8> != <stable_baselines.common.vec_env.dummy_vec_env.DummyVecEnv object at 0x7f68b00f7908>
  "{} != {}".format(self.training_env, self.eval_env))

I would appreciate a PR that solves this issue.

[PierreExeter]

Ok I’ll give it a try. But I will need to create a PR for Stable Baselines as well since I’m changing HERGoalWrapper