EC2 Snapshots gets lots of stuff, takes very long
See original GitHub issueI’m trying Cartography on an AWS account that is practically empty (just a few users), and noticed that it takes a while to run. What really stands out is that it takes over 9 minutes to get EBS snapshot data. And this account does not have (and never had) any EBS volumes in any regions.
Yet, when I debug get_snapshots()
in snapshots.py
, I see that client.get_paginator('describe_snapshots')
returns many thousands of records despite the fact that there is no snapshot data in any region visible in the AWS Console.
So, what is describe_snapshots returning exactly, and do we need all that?
Issue Analytics
- State:
- Created a year ago
- Reactions:1
- Comments:5
Top Results From Across the Web
Why is my EC2 AMI or EBS snapshot creation slow? - AWS
The creation of EBS-backed AMIs or EBS snapshots might be slow because of the large amount of data that must be copied to...
Read more >create ebs snapshot takes a long time? : r/aws - Reddit
The initial snapshot will always take a relatively long time - any additional snapshots will be much faster if a lot of data...
Read more >How to know the snapshot completion time in AWS EC2?
It can take several hours, but it generally doesn't matter how long it takes. If you need a completely consistent snapshot you shut...
Read more >EBS Snapshot Pitfalls: Does your backup withstand reality?
A restored EBS volume requires initialization ... Restoring a volume based on an EBS snapshot typically takes a few seconds only. However, the ......
Read more >Amazon EBS and Snapshot Optimization Strategies for Better ...
Many organizations rely on Amazon Elastic Block Store ( EBS ) to run ... EC2 and EBS for optimal cost and performance *Deep-dive...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@danielsaporo There’s public EBS snapshots for public datasets, and there’s a lot of them. This is similar to public AMIs. See, for example, how I changed that to only pull AMIs from owned accounts, but then introspected the graph to find other images that should be fetched: https://github.com/lyft/cartography/blob/master/cartography/intel/aws/ec2/images.py#L17-L59
Thanks for fixing this. What is the process to upgrade to a newer version of Cartography that includes this fix? Do I need to wait for some kind of release to happen first?