question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Airsim crashes during training for reinforcement learning

See original GitHub issue

I am using reinforcement learning to train my model. But the AirSim engine crashes after a few hundreds of episodes. Before crashing its gives the following error multiple times:

error while optimizing with nlopt: This likely means the optimization aborted early.
error while optimizing with nlopt: This likely means the optimization aborted early.
error while optimizing with nlopt: This likely means the optimization aborted early.
error while optimizing with nlopt: This likely means the optimization aborted early.
error while optimizing with nlopt: This likely means the optimization aborted early.

and finally I have this error:

Signal 11 caught.
Malloc Size=65538 LargeMemoryPoolOffset=65554 
CommonUnixCrashHandler: Signal=11
Malloc Size=65535 LargeMemoryPoolOffset=131119 
Malloc Size=86336 LargeMemoryPoolOffset=217472 
terminating with uncaught exception of type std::__1::bad_weak_ptr: bad_weak_ptr
Signal 6 caught.
Failed to find symbol file, expected location:
"/home/kaveh/AirSim/AirSim_Training/AirSimExe/Binaries/Linux/AirSimExe.sym"
terminating with uncaught exception of type std::__1::bad_weak_ptr: bad_weak_ptr
Signal 6 caught.
Malloc Size=44187 LargeMemoryPoolOffset=261675 
Engine crash handling finished; re-raising signal 11 for the default handler. Good bye.
Segmentation fault (core dumped)

Issue Analytics

  • State:open
  • Created 4 years ago
  • Comments:17

github_iconTop GitHub Comments

1reaction
ghostcommented, Nov 14, 2019

Thank you for the update, I will try this.

1reaction
madratmancommented, Nov 13, 2019

Alright, you just need to sleep a bit after the call to simResetRace() and before the call to simStartRace. See updated gist here https://gist.github.com/madratman/e617b53ec20c5f38a7d10633ba3a42c9 When reset is called, the drones lie on top of each other at world origin, then when simResetRace() is called, the drone meshes are teleported to the center of the cages. Now, due to gravity the meshes fall down for a fraction of second before settling down at the bottom. If you call simStartRace before they settle down, I think the spline fitter is perhaps something weird as current position (I need to look a bit more to see why exactly this happened), but sleeping for 0.5 seconds (could be less) b/w reset and simStartRace is not crashing the sim. You can see the diff in the gist from the previous comment to this comment here https://gist.github.com/madratman/e617b53ec20c5f38a7d10633ba3a42c9/revisions

Read more comments on GitHub >

github_iconTop Results From Across the Web

Counter a Drone in a Complex Neighborhood Area by Deep ...
In this study, a deep reinforcement learning (DRL) architecture ... Transfer learning also shows that the number of crashes during training ...
Read more >
Autonomous Drone Racing with Deep Reinforcement Learning
Fig. 1: A quadrotor navigates at high speed through three different race tracks: AlphaPilot (left), Split-S (middle), and AirSim. (right).
Read more >
Countering a Drone in a 3D Space: Analyzing Deep ... - MDPI
training Reinforcement Learning agents can deflect a drone equipped with ... crash positions and the action distribution during training and ...
Read more >
Project Don't Crash - GitHub Pages
We want to build on AirSim's framework by employing. Computer Vision algorithms for perception and training Imitation Learning and Reinforcement.
Read more >
Exploring Deep Reinforcement Learning for Autonomous ...
This work uses realtime simulations based on AirSim to test several state-of-the-art DRL ... Elements from imitation learning are used to speed up...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found