Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[Examples] RL example implementation

See original GitHub issue

I’m trying to port actor-critic example to ignite. Here is ported code. The logic is not that straight forward but if user understands how ignite.engine works it can be implemented without problems.

Some term correspondences:

episode <-> epoch
timestep <-> iteration

However, ignite lacks of an option that maybe typical for RL, that when episode is finished when agent is failed for example, we need to stop our “batch” iterations, execute handlers and go on the next epoch. On the other hand ignite.engine provides should_terminate flag that can stops the training and it is not what we would like to do.

Any thoughts?

Issue Analytics

State:
Created 5 years ago
Comments:7 (4 by maintainers)

Top GitHub Comments

1reaction

vfdev-5commented, Jul 11, 2018

@alykhantejani yes, exactly. Will send a PR today with actor-critic example

1reaction

alykhantejanicommented, Jul 6, 2018

We should be able to do this with a normal handler attached to the ITERATION_COMPLETE event. we just need another terminate flag that terminates the epoch but not the whole trainer.

Now I understand your original message 😃

Top Results From Across the Web

Best Reinforcement Learning Tutorials, Examples, Projects ...

1. RL with Mario Bros · 2. Machine Learning for Humans: Reinforcement Learning · 3. An introduction to Reinforcement Learning · 4. Reinforcement...

Beginner's guide to Reinforcement Learning & its ...

Learn problem formulation, Q learning and RL examples. ... Reinforcement learning problems; An implementation of Reinforcement Learning ...

A Beginner's Guide to Reinforcement Learning and its Basic ...

A Reinforcement Learning (RL) task is about training an agent that interacts with its environment. The agent transitions between different scenarios of the ......

Reinforcement Learning Real-world examples - Data Analytics

In this blog post, we'll learn about some real-world / real-life examples of Reinforcement learning, one of the different approaches to ...

Reinforcement Learning: What is, Algorithms, Types & Examples

Example of Reinforcement Learning · Your cat is an agent that is exposed to the environment. · Our agent reacts by performing an...