Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Support training restorage

See original GitHub issue

Subject of the feature

Currently, we are using model.load_weights to start the supervised training from non-random weights. However, if the intention is to resume a stopped run, this will not be perfect as the status of optimizer is not saved in the checkpoint.

The following piece of code can be helpful:

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5 (2 by maintainers)

github_iconTop GitHub Comments

mathpluscodecommented, Oct 22, 2020

what the status of optimizer is useful for resuming?


If you do not have the optimizer status, beta, gamma in Adam for example. After reloading the checkpoint, the first gradient update might give a big harmful update which leads to inferior performance.

With optimizer status, you can continue the training as you never stopped it. This piece of code has been tested in other projects, so it’s verified already.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Restore Training - Training Christian Women
Restore Training is an online, self-paced training program for Anabaptist women interested in engaging in anti-trafficking and restoration efforts.
Read more >
Core Restore - Back Support & Core Training Tool |
Soothe your tired back with the Teeter Core Restore, a multi-functional lumbar support and core training tool designed to help relieve back pain....
Read more >
Restoration Training & Education
Restoration Technical Institute Offers the Following Comprehensive Courses: Water Damage Technician, Applied Structural Drying, Media Blasting, & so Much ...
Read more >
IICRC: Welcome
Customer ServiceThe IICRC customer service team can assist you with all your needs. Certified FirmsExamsRenewalsReinstatementsRetestsStandards ...
Read more >
Facilitator training & support - Restore Small Groups
Join A Group Coaching & Speaking Facilitator training & support ... Over Restore's 20-year history, small group facilitators have been at the heart...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found