question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

EC2 Snapshots gets lots of stuff, takes very long

See original GitHub issue

I’m trying Cartography on an AWS account that is practically empty (just a few users), and noticed that it takes a while to run. What really stands out is that it takes over 9 minutes to get EBS snapshot data. And this account does not have (and never had) any EBS volumes in any regions.

Yet, when I debug get_snapshots() in snapshots.py, I see that client.get_paginator('describe_snapshots') returns many thousands of records despite the fact that there is no snapshot data in any region visible in the AWS Console.

So, what is describe_snapshots returning exactly, and do we need all that?

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:5

github_iconTop GitHub Comments

1reaction
ryan-lanecommented, Apr 14, 2022

@danielsaporo There’s public EBS snapshots for public datasets, and there’s a lot of them. This is similar to public AMIs. See, for example, how I changed that to only pull AMIs from owned accounts, but then introspected the graph to find other images that should be fetched: https://github.com/lyft/cartography/blob/master/cartography/intel/aws/ec2/images.py#L17-L59

0reactions
danielsaporocommented, Apr 19, 2022

Thanks for fixing this. What is the process to upgrade to a newer version of Cartography that includes this fix? Do I need to wait for some kind of release to happen first?

Read more comments on GitHub >

github_iconTop Results From Across the Web

Why is my EC2 AMI or EBS snapshot creation slow? - AWS
The creation of EBS-backed AMIs or EBS snapshots might be slow because of the large amount of data that must be copied to...
Read more >
create ebs snapshot takes a long time? : r/aws - Reddit
The initial snapshot will always take a relatively long time - any additional snapshots will be much faster if a lot of data...
Read more >
How to know the snapshot completion time in AWS EC2?
It can take several hours, but it generally doesn't matter how long it takes. If you need a completely consistent snapshot you shut...
Read more >
EBS Snapshot Pitfalls: Does your backup withstand reality?
A restored EBS volume requires initialization ... Restoring a volume based on an EBS snapshot typically takes a few seconds only. However, the ......
Read more >
Amazon EBS and Snapshot Optimization Strategies for Better ...
Many organizations rely on Amazon Elastic Block Store ( EBS ) to run ... EC2 and EBS for optimal cost and performance *Deep-dive...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found