(ApplicationLoadBalancedFargateService): Auto scaling won't scale-in after update service with force new deployment option
See original GitHub issueThe ECS(Fargate) auto scaling out is working as expect, but if I update the ECS service with force new deployment option in the AWS web UI, after the deployment process done, the ECS service CPU/MEN usage decreased and the CloudWatch Alarm which named with ‘AlarmLow’ triggered but the Desired count not decreasing.
Reproduction Steps
- Deploy a ECS service with ApplicationLoadBalancedFargateService as following.
- Trigger auto-scale out with some test traffic
- Click update in ECS service panel in AWS UI
- Check ‘force new deployment’ box, don’t touch anything else and update the ECS service
- waiting for new deployment done and the CPU/MEN usage should below the auto scale alert count.
- Check the CloudWatch and the alarm named with ‘AlarmLow’ should in alarm status but ECS Desired Count not decrease
What did you expect to happen?
the CPU/MEN usage is below the alert setting and the ‘AlarmLow’ in alarm status, the desired count should be decreased.
What actually happened?
‘AlarmLow’ in alarm status but the ECS desired count not decreased.
Environment
- CDK CLI Version : @aws-cdk/core@1.88.0, @aws-cdk/aws-ecs-patterns@1.88.0
- Framework Version:
- Node.js Version:
- OS :
- Language (Version):
Other
This is 🐛 Bug Report
Issue Analytics
- State:
- Created 3 years ago
- Comments:8
Top Results From Across the Web
Troubleshoot service auto scaling issues in Amazon ECS
Service auto scaling might not be able to add or remove tasks as expected due to one or more of the following reasons:...
Read more >Lab 2: Deploy Cluster
This is what we'll have after the deployment is complete: Frontend Application Load Balancer; Rails frontend service with auto-scaling; 3 frontend application ...
Read more >How do I deploy updated Docker images to Amazon ECS ...
Actually, since/if you have enabled auto scaling on your ECS service, a simple way to do it is to just force a new...
Read more >Deploy Your Django Apps in AWS With CDK (v2)
It comes with a toolkit that allows creating a new CDK project, synthesizing the code, and deploying it using a chosen account and...
Read more >ECS Service Auto-Scaling with the CDK - Idan Lupinsky
This is known as a scale-in event. This behavior is achieved by creating a target tracking scaling policy with the Application Auto Scaling...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Oh, I don’t have permission to close. Who can?
I’m not sure if this is related, but I’m having a problem with deleting a stack with an ASG for ECS.
There’s a message in the ASG configuration (activity tab) saying
Could not scale to desired capacity because all remaining instances are protected from scale-in.
. I go disable scale-in protection on the instance, and it continues deleting the stack almost immediately.I’m guessing the following should default
newInstancesProtectedFromScaleIn
to false in the properties???e.g.
Should I file a separate issue, or is this related?
To be clear, I think it’s really bizarre for AWS to be putting anything in a “protected” mode without it being explicitly requested.