Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Bucket listing fails for >160 buckets
See original GitHub issueEnvironment info
- NooBaa Version: master-20210629
- Platform: OCP 4.6.16
Actual behavior
- Listing fails for large no. of buckets in system. There is additional 1 bucket - bucket-162 whereas its creation was failed
Expected behavior
- Listing should work fine
Steps to reproduce
- Started a for loop for 200 buckets. At 162th bucket creation, found a failure from app-server CLI ( from which this script is running). The bucket although got created in filesystem and is visible via noobaa bucket status command.
- Attempted listing of all buckets and once listing worked, 2nd time count of the listing failed
[root@hpo-11 ~]# s3u1 ls s3://
urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 's3-noobaa.apps.ocp-akshat-1.cp.fyre.ibm.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 's3-noobaa.apps.ocp-akshat-1.cp.fyre.ibm.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
2021-07-01 01:23:15 bucket-166
2021-07-01 01:23:15 bucket-164
2021-07-01 01:23:15 bucket-165
2021-07-01 01:23:15 bucket-148
2021-07-01 01:23:15 bucket-149
2021-07-01 01:23:15 bucket-146
2021-07-01 01:23:15 bucket-25
2021-07-01 01:23:15 bucket-136
2021-07-01 01:23:15 bucket-133
2021-07-01 01:23:15 bucket-127
2021-07-01 01:23:15 first.bucket
2021-07-01 01:23:15 bucket-157
2021-07-01 01:23:15 bucket-124
2021-07-01 01:23:15 bucket-111
2021-07-01 01:23:15 bucket-95
2021-07-01 01:23:15 bucket-158
2021-07-01 01:23:15 bucket-112
2021-07-01 01:23:15 bucket-99
2021-07-01 01:23:15 bucket-96
2021-07-01 01:23:15 bucket-144
2021-07-01 01:23:15 bucket-139
2021-07-01 01:23:15 bucket-130
2021-07-01 01:23:15 bucket-45
2021-07-01 01:23:15 bucket-42
2021-07-01 01:23:15 bucket-161
2021-07-01 01:23:15 bucket-155
2021-07-01 01:23:15 bucket-154
2021-07-01 01:23:15 bucket-150
2021-07-01 01:23:15 bucket-142
2021-07-01 01:23:15 bucket-140
2021-07-01 01:23:15 bucket-79
2021-07-01 01:23:15 bucket-34
2021-07-01 01:23:15 bucket-30
2021-07-01 01:23:15 bucket-152
2021-07-01 01:23:15 bucket-134
2021-07-01 01:23:15 bucket-98
2021-07-01 01:23:15 bucket-28
2021-07-01 01:23:15 bucket-17
2021-07-01 01:23:15 bucket-10
2021-07-01 01:23:15 bucket-9
2021-07-01 01:23:15 bucket-7
2021-07-01 01:23:15 bucket-132
2021-07-01 01:23:15 bucket-22
2021-07-01 01:23:15 bucket-19
2021-07-01 01:23:15 bucket-16
2021-07-01 01:23:15 bucket-145
2021-07-01 01:23:15 bucket-116
2021-07-01 01:23:15 bucket-80
2021-07-01 01:23:15 bucket-78
2021-07-01 01:23:15 bucket-3
2021-07-01 01:23:15 bucket-141
2021-07-01 01:23:15 bucket-118
2021-07-01 01:23:15 bucket-90
2021-07-01 01:23:15 bucket-26
2021-07-01 01:23:15 bucket-24
2021-07-01 01:23:15 bucket-113
2021-07-01 01:23:15 bucket-117
2021-07-01 01:23:15 bucket-114
2021-07-01 01:23:15 bucket-23
2021-07-01 01:23:15 bucket-5
2021-07-01 01:23:15 bucket-128
2021-07-01 01:23:15 bucket-120
2021-07-01 01:23:15 bucket-109
2021-07-01 01:23:15 bucket-18
2021-07-01 01:23:15 bucket-15
2021-07-01 01:23:15 bucket-105
2021-07-01 01:23:15 bucket-88
2021-07-01 01:23:15 bucket-87
2021-07-01 01:23:15 bucket-4
2021-07-01 01:23:15 bucket-11
2021-07-01 01:23:15 bucket-100
2021-07-01 01:23:15 bucket-81
2021-07-01 01:23:15 bucket-60
2021-07-01 01:23:15 bucket-41
2021-07-01 01:23:15 bucket-39
2021-07-01 01:23:15 bucket-151
2021-07-01 01:23:15 bucket-137
2021-07-01 01:23:15 bucket-82
2021-07-01 01:23:15 bucket-48
2021-07-01 01:23:15 bucket-50
2021-07-01 01:23:15 bucket-159
2021-07-01 01:23:15 bucket-75
2021-07-01 01:23:15 bucket-49
2021-07-01 01:23:15 bucket-35
2021-07-01 01:23:15 bucket-153
2021-07-01 01:23:15 bucket-121
2021-07-01 01:23:15 bucket-103
2021-07-01 01:23:15 bucket-54
2021-07-01 01:23:15 bucket-56
2021-07-01 01:23:15 bucket-92
2021-07-01 01:23:15 bucket-86
2021-07-01 01:23:15 bucket-20
2021-07-01 01:23:15 bucket-14
2021-07-01 01:23:15 bucket-110
2021-07-01 01:23:15 bucket-74
2021-07-01 01:23:15 bucket-76
2021-07-01 01:23:15 bucket-71
2021-07-01 01:23:15 bucket-51
2021-07-01 01:23:15 bucket-162
2021-07-01 01:23:15 bucket-122
2021-07-01 01:23:15 bucket-69
2021-07-01 01:23:15 bucket-40
2021-07-01 01:23:15 bucket-6
2021-07-01 01:23:15 bucket-163
2021-07-01 01:23:15 bucket-125
2021-07-01 01:23:15 bucket-123
2021-07-01 01:23:15 bucket-89
2021-07-01 01:23:15 bucket-21
2021-07-01 01:23:15 bucket-126
2021-07-01 01:23:15 bucket-119
2021-07-01 01:23:15 bucket-93
2021-07-01 01:23:15 bucket-91
2021-07-01 01:23:15 bucket-36
2021-07-01 01:23:15 bucket-84
2021-07-01 01:23:15 bucket-85
2021-07-01 01:23:15 bucket-70
2021-07-01 01:23:15 bucket-53
2021-07-01 01:23:15 bucket-46
2021-07-01 01:23:15 bucket-138
2021-07-01 01:23:15 bucket-101
2021-07-01 01:23:15 bucket-55
2021-07-01 01:23:15 bucket-33
2021-07-01 01:23:15 bucket-27
2021-07-01 01:23:15 bucket-106
2021-07-01 01:23:15 bucket-102
2021-07-01 01:23:15 bucket-66
2021-07-01 01:23:15 bucket-43
2021-07-01 01:23:15 bucket-38
2021-07-01 01:23:15 bucket-13
2021-07-01 01:23:15 bucket-129
2021-07-01 01:23:15 bucket-107
2021-07-01 01:23:15 bucket-12
2021-07-01 01:23:15 bucket-8
2021-07-01 01:23:15 bucket-147
2021-07-01 01:23:15 bucket-108
2021-07-01 01:23:15 bucket-104
2021-07-01 01:23:15 bucket-47
2021-07-01 01:23:15 bucket-37
2021-07-01 01:23:15 bucket-32
2021-07-01 01:23:15 bucket-135
2021-07-01 01:23:15 bucket-94
2021-07-01 01:23:15 bucket-83
2021-07-01 01:23:15 bucket-77
2021-07-01 01:23:15 bucket-61
2021-07-01 01:23:15 bucket-62
2021-07-01 01:23:15 bucket-73
2021-07-01 01:23:15 bucket-72
2021-07-01 01:23:15 bucket-68
2021-07-01 01:23:15 bucket-67
2021-07-01 01:23:15 bucket-64
2021-07-01 01:23:15 bucket-160
2021-07-01 01:23:15 bucket-65
2021-07-01 01:23:15 bucket-63
2021-07-01 01:23:15 bucket-31
2021-07-01 01:23:15 bucket-29
2021-07-01 01:23:15 bucket-58
2021-07-01 01:23:15 bucket-57
2021-07-01 01:23:15 bucket-59
2021-07-01 01:23:15 bucket-52
2021-07-01 01:23:15 bucket-44
[root@hpo-11 ~]# s3u1 ls s3:// |wc -l
urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 's3-noobaa.apps.ocp-akshat-1.cp.fyre.ibm.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 's3-noobaa.apps.ocp-akshat-1.cp.fyre.ibm.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 's3-noobaa.apps.ocp-akshat-1.cp.fyre.ibm.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
An error occurred (504) when calling the ListBuckets operation (reached max retries: 2): Gateway Timeout
0
More information - Screenshots / Logs / Other output
Issue Analytics
- State:
- Created 2 years ago
- Comments:13 (3 by maintainers)
Top Results From Across the Web
Permission issues with: listing s3 buckets
What permission do I need to change to allow listing all s3 buckets? I can run: aws s3 ls s3://bucketname; but I cannot...
Read more >Unable to delete S3 bucket
Hello, I have an S3 bucket that appears to be stuck in a state that makes me ... a region either anymore because...
Read more >listing the top level contents of a s3 bucket with Prefix and ...
As a quick workaround, I list them via client.list_objects . For non-public buckets (or buckets that you can explicitly access):. import boto3 ...
Read more >Uploading objects - Amazon Simple Storage Service
To upload a file larger than 160 GB, use the AWS CLI, AWS SDK, or Amazon S3 REST API ... In the Buckets...
Read more >S3 — Boto3 Docs 1.26.40 documentation - AWS
For information about downloading objects from Requester Pays buckets, ... If the bucket is owned by a different account, the request fails with...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Raised https://github.com/noobaa/noobaa-operator/issues/678
@nimrod-becker Sounds like we should collect the previous logs in the CLI diagnose command, right like we collect the current logs. @akmithal WDYT to open operator issue to request that?