question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Listing objects fails with SignatureDoesNotMatch if > than 1000 objects

See original GitHub issue

The minio java client 2.0.1 gives me a very strange behaviour as soon as there are more than 1000 objects returned by the listObjects call.

  • It lists all objects up to the 1000
  • Then it throws the attached error complaining about the signature
  • I tested it with the mcclient, which works like a charm and lists all objects, thus the issue is very likley in the java client code
  • The error does not depend at all on the content.
Error occurred: error occured
ErrorResponse(code=SignatureDoesNotMatch, message=The request signature we calculated does not match the signature you provided. Check your key and signing method., bucketName=null, objectName=null, resource=/media, requestId=3L137, hostId=3L137)
request={method=GET, url=http://goldbox:9000/media?marker=Videos/Movies/2016/some/path/file.jpg, headers=Host: goldbox:9000
User-Agent: Minio (x86_64; x86_64) minio-java/dev
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20160912T110657Z
Authorization: AWS4-HMAC-SHA256 Credential=P6BE2YPLY0FPHIQ5CVZV/20160912/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=6975bb3352dfc687317cae9e8e66353ae0d219516885db1cb7d584b6905eaf47
}
response={code=403, headers=Accept-Ranges: bytes
Server: Minio/DEVELOPMENT.GOGET (linux; amd64)
Vary: Origin
X-Amz-Request-Id: OR86OFVUFWR6V5DE
Date: Mon, 12 Sep 2016 11:06:15 GMT
Content-Type: text/xml; charset=utf-8
Transfer-Encoding: chunked
OkHttp-Selected-Protocol: http/1.1
OkHttp-Sent-Millis: 1473678417911
OkHttp-Received-Millis: 1473678417913
}

Is there some magical barrier which gets hit when there are more than 1000 items returned?

Issue Analytics

  • State:closed
  • Created 7 years ago
  • Comments:17 (17 by maintainers)

github_iconTop GitHub Comments

1reaction
balamuruganacommented, Sep 12, 2016

@IsNull Thanks for finding this bug. I just sent a fix for this issue. Please verify whether it fixes the issue your side.

1reaction
IsNullcommented, Sep 12, 2016

That is great, thank you! Lucky that I uploaded the test data^^

Read more comments on GitHub >

github_iconTop Results From Across the Web

AWS CLI listing S3 buckets gives SignatureDoesNotMatch ...
Found my issue. I had old AWS keys in my environment variables. If you have environment variables named
Read more >
Error Responses - Amazon Simple Storage Service
Error Code Description HTTP Status Code AccessControlListNotSupported The bucket does not allow ACLs. 400 Bad Request AccessDenied Access Denied 403 Forbidden BucketAlreadyOwnedByYou 409 Conflict (in all...
Read more >
S3 — Boto3 Docs 1.26.29 documentation - Amazon AWS
The request contains a list of up to 1000 keys that you want to delete. In the XML, you provide the object key...
Read more >
Java SDK Developer Guide
Object Storage Service. Java SDK Developer Guide. Issue ... In the previous sample code, 1000 objects will be listed, by default.
Read more >
REST API Reference - IBM
IBM Cloud Object Storage supports the most commonly used subset of Amazon S3 ... bucket returns a list of objects, limited to 1000...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found