Error offloading:

I’m getting this error when trying to manually offload a topic to s3 bucket.

Broker config

managedLedgerOffloadDriver=aws-s3 s3ManagedLedgerOffloadRegion=us-west-2 s3ManagedLedgerOffloadBucket=mybucket s3ManagedLedgerOffloadServiceEndpoint=https://mybucket.blabla.blabla.com/

Error

Reason: Error offloading: org.apache.bookkeeper.mledger.ManagedLedgerException: java.util.concurrent.CompletionException: org.jclouds.aws.AWSResponseException: request POST https://mybucket.blabla.blabla.com/mybucket/3aab7c02-81ab-470b-badb-7e4e5c74bb2d-ledger-19?uploads HTTP/1.1 failed with code 400, error: AWSError{requestId='....', requestToken='....', code='AuthorizationHeaderMalformed', message='The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'us-west-2'', context='{Region=us-west-2, HostId=....}'}

It doesn’t matter what region a use in s3ManagedLedgerOffloadRegion I’m always getting the same error. (the right region is us-west-2 as shown on the config)

System configuration

Pulsar version: 2.3.0

[lukestephenson-zendesk]

I don’t think this should have been closed. Yes it is related to the configuration of pulsar / S3, but the fact the pulsar logs don’t indicate the problem correctly make it almost impossible to debug.

[addisonj]

I opened a new issue https://github.com/apache/pulsar/issues/9084, to help improve this within core Pulsar.

I agree that there can be improvements made to make this more straight forward! Some of the logging issues would also be a good improvement but it may take us understanding jcloud internals a bit more, as the error is seen essentially in part of initializing jcloud, so it may be difficult to get clearest context about these sort of issues