question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Unable to recover from UPDATE_ROLLBACK_COMPLETE

See original GitHub issue

CloudFormation is able to update stacks that are in UPDATE_ROLLBACK_COMPLETE but the CDK CLI blocks these with the error:

The stack named XXX is in a failed state: UPDATE_ROLLBACK_COMPLETE

Environment

  • CLI Version : 0.24.1
  • Framework Version: 0.24.1
  • OS :
  • Language :

Other


This is 🐛 Bug Report

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:21
  • Comments:20 (9 by maintainers)

github_iconTop GitHub Comments

6reactions
NewtrinoPiGuicommented, May 29, 2020

I agree with @neg3ntropy this seems like a really severe issue. I am currently running into this in my multi-stack project. There are some references between the resources of the stacks, and it doesn’t seem smart enough to understand how to update the stacks on subsequent deployments. Here’s the call-stack I get in the console:

eboozer-app-data-storage
eboozer-app-data-storage: deploying...
eboozer-app-data-storage: creating CloudFormation changeset...
 0/1 | 1:17:56 PM | UPDATE_ROLLBACK_IN_P | AWS::CloudFormation::Stack | eboozer-app-data-storage Export eboozer-app-data-storage:ExportsOutputFnGetAttAppDataBucket857FA106ArnDA77A1F5 cannot be deleted as it is in use by eboozer-formulary-management
 0/1 | 1:18:16 PM | UPDATE_ROLLBACK_COMP | AWS::CloudFormation::Stack | eboozer-app-data-storage 
 1/1 | 1:18:17 PM | UPDATE_ROLLBACK_COMP | AWS::CloudFormation::Stack | eboozer-app-data-storage 

 ❌  eboozer-app-data-storage failed: Error: The stack named eboozer-app-data-storage is in a failed state: UPDATE_ROLLBACK_COMPLETE
    at /Users/eboozer/Workspaces/next-backend/node_modules/aws-cdk/lib/api/util/cloudformation.ts:247:13
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at waitFor (/Users/eboozer/Workspaces/next-backend/node_modules/aws-cdk/lib/api/util/cloudformation.ts:157:20)
    at Object.deployStack (/Users/eboozer/Workspaces/next-backend/node_modules/aws-cdk/lib/api/deploy-stack.ts:248:26)
    at CdkToolkit.deploy (/Users/eboozer/Workspaces/next-backend/node_modules/aws-cdk/lib/cdk-toolkit.ts:181:24)
    at main (/Users/eboozer/Workspaces/next-backend/node_modules/aws-cdk/bin/cdk.ts:237:16)
    at initCommandLine (/Users/eboozer/Workspaces/next-backend/node_modules/aws-cdk/bin/cdk.ts:170:9)
The stack named eboozer-app-data-storage is in a failed state: UPDATE_ROLLBACK_COMPLETE

I don’t think UPDATE_ROLLBACK_COMPLETE should be treated as a “failed” state. And if I manually hack the CDK code to not treat rollbacks as unsuccessful, then I can get past this error, or if I manually tweak the template. Otherwise, I have to delete the stacks in the AWS console and start over (which is not always an option).

1reaction
nimra2022skipqcommented, Feb 3, 2022

I am facing the same error, have to manually delete the stack for the changes to reflect back again.

Read more comments on GitHub >

github_iconTop Results From Across the Web

How do I update a CloudFormation stack with state ...
If the stack is in UPDATE_ROLLBACK_COMPLETE state you should be able to update the stack again. If the rollback failed you may need...
Read more >
ContinueUpdateRollback - AWS CloudFormation
A stack goes into the UPDATE_ROLLBACK_FAILED state when AWS CloudFormation can't roll back all changes after a failed stack update. For example, you...
Read more >
Continue rolling back an update - Amazon CloudFormation
A stack goes into the UPDATE_ROLLBACK_FAILED state when Amazon CloudFormation can't roll back all changes during an update. For example, you might have...
Read more >
AWS CloudFormation -Update Rollback Failed -How to Rectify ...
Steps for “update rollback complete”: 1. Open the AWS CloudFormation console. 2. From the navigation pane, choose Stacks. 3. From the Stack name ......
Read more >
UPDATE_ROLLBACK_COMPLE...
If your stack is in UPDATE_ROLLBACK_COMPLETE , that just means that your last stack failed to deploy but should still be updatable.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found