Cloudformation script fails on creating lambda due to missing IAM role
See original GitHub issueDescribe the bug We (@npalm and @joostwestra have created the MLOps framwork via the stack published on AWS (ttps://solutions-reference.s3.amazonaws.com/aws-mlops-framework/latest/aws-mlops-single-account-framework.template). All worked fine till today. As of today we got an error during creation of the stack. Creating a lamba fails with an error that the required role not exists. However the specific role was created before. See log below.
To Reproduce
- Create cloud formation stack based on: ttps://solutions-reference.s3.amazonaws.com/aws-mlops-framework/latest/aws-mlops-single-account-framework.template (used region eu-west-1)
- Just wait, after a few mintues the stack will rollback.
Expected behavior Should succeed (as before)
Please complete the following information about the solution:
- latest
To get the version of the solution, you can look at the description of the created CloudFormation stack. For example, “(SO0136) - AWS MLOps Framework. Version v1.0.0”.
- Region: eu-west-1
- Were there any errors in the CloudWatch Logs?
Screenshots
Additional context Log from cloudformation:
2021-08-26 16:41:39 UTC+0200 | niek2-mlops | ROLLBACK_IN_PROGRESS | The following resource(s) failed to create: [accessLogs751B1465, PipelineOrchestrationLambdaRestApiAccountB62D7499, SolutionHelperC369AAA8]. Rollback requested by user.
-- | -- | -- | --
2021-08-26 16:41:38 UTC+0200 | PipelineOrchestrationLambdaRestApiAccountB62D7499 | CREATE_FAILED | Template error: IAM role niek2-mlops-PipelineOrchestrationLambdaRestApiClou-L6QKNJREWOOG doesn't exist
2021-08-26 16:41:37 UTC+0200 | accessLogs751B1465 | CREATE_FAILED | Resource creation cancelled
2021-08-26 16:41:37 UTC+0200 | SolutionHelperC369AAA8 | CREATE_FAILED | Template error: IAM role niek2-mlops-SolutionHelperServiceRoleB95702BC-QBXJKZ5M45T3 doesn't exist
2021-08-26 16:41:36 UTC+0200 | PipelineOrchestrationLambdaFunctionServiceRoleE64D6F74 | CREATE_COMPLETE | -
2021-08-26 16:41:36 UTC+0200 | PipelineOrchestrationLambdaRestApiCloudWatchRole6F4B9723 | CREATE_COMPLETE | -
2021-08-26 16:41:35 UTC+0200 | mlopscloudformationrole867810B0 | CREATE_COMPLETE | -
2021-08-26 16:41:35 UTC+0200 | CustomResourceLambdaServiceRole757E6AFA | CREATE_COMPLETE | -
2021-08-26 16:41:34 UTC+0200 | SolutionHelperServiceRoleB95702BC | CREATE_COMPLETE
Issue Analytics
- State:
- Created 2 years ago
- Comments:5 (3 by maintainers)
Top GitHub Comments
Hi @npalm, Thank you for reporting the issue. I was able to reproduce the issue, and we are investigating the root cause. I’ll get back to you ASAP.
Thanks for the quick response