Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

The Atari breakout platform doesn't move and just sticks to right side.

See original GitHub issue

Hello, I was working on my atari breakout model and the project is finally completed but doesn’t work nicely as shown in the tutorial. Here are two pics of how its like: 2022-07-30 2022-07-30 (1)

Here is my code:

#Import Dependencies
import gym
from stable_baselines3 import A2C
from stable_baselines3.common.vec_env import VecFrameStack
from stable_baselines3.common.evaluation import evaluate_policy
from stable_baselines3.common.env_util import make_atari_env
from stable_baselines3.common.env_util import make_vec_env

import os
from gym.utils import play
from stable_baselines3.ddpg.policies import CnnPolicy

from ale_py import ALEInterface
from ale_py.roms import Breakout

ale = ALEInterface()


ale.loadROM(Breakout)
env = make_atari_env('Breakout-v0', seed=0)
log_path = os.path.join('Training', 'Logs')
model = A2C('CnnPolicy', env, verbose=1, tensorboard_log=log_path)
a2c_path = os.path.join('Training','Logs', 'A2C_300k_model')
model.save(a2c_path)

env.observation_space
del model
model = A2C.load(a2c_path, env)
evaluate_policy(model, env, n_eval_episodes=100, render=True)

I am also only getting the average score of 1 or something unlike in the video in which the code gives him 4-5 point average. Please help. The tutorial I am following: https://www.youtube.com/watch?v=Mut_u40Sqz4&t=7103s&ab_channel=NicholasRenotte. Thanks