Listing objects fails with SignatureDoesNotMatch if > than 1000 objects
See original GitHub issueThe minio java client 2.0.1
gives me a very strange behaviour as soon as there are more than 1000 objects returned by the listObjects call.
- It lists all objects up to the 1000
- Then it throws the attached error complaining about the signature
- I tested it with the
mc
client, which works like a charm and lists all objects, thus the issue is very likley in the java client code - The error does not depend at all on the content.
Error occurred: error occured
ErrorResponse(code=SignatureDoesNotMatch, message=The request signature we calculated does not match the signature you provided. Check your key and signing method., bucketName=null, objectName=null, resource=/media, requestId=3L137, hostId=3L137)
request={method=GET, url=http://goldbox:9000/media?marker=Videos/Movies/2016/some/path/file.jpg, headers=Host: goldbox:9000
User-Agent: Minio (x86_64; x86_64) minio-java/dev
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20160912T110657Z
Authorization: AWS4-HMAC-SHA256 Credential=P6BE2YPLY0FPHIQ5CVZV/20160912/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=6975bb3352dfc687317cae9e8e66353ae0d219516885db1cb7d584b6905eaf47
}
response={code=403, headers=Accept-Ranges: bytes
Server: Minio/DEVELOPMENT.GOGET (linux; amd64)
Vary: Origin
X-Amz-Request-Id: OR86OFVUFWR6V5DE
Date: Mon, 12 Sep 2016 11:06:15 GMT
Content-Type: text/xml; charset=utf-8
Transfer-Encoding: chunked
OkHttp-Selected-Protocol: http/1.1
OkHttp-Sent-Millis: 1473678417911
OkHttp-Received-Millis: 1473678417913
}
Is there some magical barrier which gets hit when there are more than 1000 items returned?
Issue Analytics
- State:
- Created 7 years ago
- Comments:17 (17 by maintainers)
Top Results From Across the Web
AWS CLI listing S3 buckets gives SignatureDoesNotMatch ...
Found my issue. I had old AWS keys in my environment variables. If you have environment variables named
Read more >Error Responses - Amazon Simple Storage Service
Error Code Description HTTP Status Code
AccessControlListNotSupported The bucket does not allow ACLs. 400 Bad Request
AccessDenied Access Denied 403 Forbidden
BucketAlreadyOwnedByYou 409 Conflict (in all...
Read more >S3 — Boto3 Docs 1.26.29 documentation - Amazon AWS
The request contains a list of up to 1000 keys that you want to delete. In the XML, you provide the object key...
Read more >Java SDK Developer Guide
Object Storage Service. Java SDK Developer Guide. Issue ... In the previous sample code, 1000 objects will be listed, by default.
Read more >REST API Reference - IBM
IBM Cloud Object Storage supports the most commonly used subset of Amazon S3 ... bucket returns a list of objects, limited to 1000...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@IsNull Thanks for finding this bug. I just sent a fix for this issue. Please verify whether it fixes the issue your side.
That is great, thank you! Lucky that I uploaded the test data^^