[Question] Tensorboard logging doesnt work

Important Note: We do not do technical support, nor consulting and don’t answer personal questions per email. Please post your question on the RL Discord, Reddit or Stack Overflow in that case.

Question

I am running my learning algorithm on a custom environment created using Robosuite. I followed the documentation and try to use the tensorboard but the file used by tensorboard doesnt get created.

model = PPO('MlpPolicy', env, verbose=1, n_steps=4, batch_size=4, tensorboard_log="./ppo_tensorboard/") model.learn(total_timesteps=8, tb_log_name='learning') #

I run it just for few steps to see if file used by tensorboard gets created but it doesnt. Any suggestions?

Checklist

• I have read the documentation (required)
• I have checked that there is no similar issue in the repo (required)

[stwerner97]

Sure, I will open a PR later today 😃

[Miffyli]

@stwerner97 I understand the issue, but on the other side there is not much to log after few steps in the environment: only a poor sample of the FPS of the environment, time ran and number of steps done. The episode stats only appear once episodes are completed (i.e. not updated every step), and there are no training metrics until first training rollout is done after n_steps. I recommend looking at, say, SAC or TD3 if you have a very low FPS environment (they are more sample efficient).