question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Agent Continuous Action

See original GitHub issue

I’d like to inquire if the continuous action is deprecated in some latest versions (i.e. ai2thor=2.4.22 from conda forge). I tried the command mentioned in this issue #40 : controller = Controller() controller.reset('FloorPlan1') event = controller.step(dict(action='Initialize', continuous=True)) print(event.metadata['agent']) event = controller.step(action='RotateLeft', degrees=45.0) print(event.metadata['agent']) exit() However, the returned robot position still snapped to the grid (default grid size 0.25). I’m wondering if my code leads to this problem or the continuous functionality is deprecated.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:8 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
XiaoLiSeancommented, Apr 17, 2021

Sure. I just updated to the lastest version and everything works just fine. Thanks!

1reaction
mattdeitkecommented, Apr 16, 2021

Hi @XiaoLiSean,

The following minimal example should allow the agent to navigate such that it is not snapped to the grid:

from ai2thor.controller import Controller
controller = Controller(snapToGrid=False, gridSize=0.25)
print(controller.last_event.metadata["agent"}["position"])

controller.step(action="MoveAhead", moveMagnitude=0.15)
print(controller.last_event.metadata["agent"}["position"])
Read more comments on GitHub >

github_iconTop Results From Across the Web

How does ML decide value for continuous action space?
Basically, ML-Agents will randomly select actions, and gradually encourage the actions that result in a higher reward more. The rate of this ...
Read more >
Creating Continuous Action Bot using Deep Reinforcement ...
In this article we will learn about creating our first continuous action bot using deep reinforcement learning.
Read more >
How can I apply reinforcement learning to continuous ...
I'm trying to get an agent to learn the mouse movements necessary to best perform some task in a reinforcement learning setting (i.e....
Read more >
Multi Agent Deep Reinforcement Learning for continuous ...
I am looking to have a cooperative multi agent reinforcement learning framework where one agent has a discrete action space and another agent...
Read more >
Safe Deep Reinforcement Learning for Multi-Agent ...
Multi-agent control problems constitute an interesting area of application for deep reinforcement learning models with continuous action spaces.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found