question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

S3 repository not respecting endpoint param

See original GitHub issue

CrateDB version: 3.0.5

Environment description:

Centos 7.latest Openjdk 1.8.0_181

Problem description: When setting up a repository, specifying the endpoint is not being used and the default is only taken into account

Steps to reproduce:

CREATE REPOSITORY mybackup TYPE s3 WITH (bucket='my-backup', endpoint='https://some-endpoint/', protocol='https')

Relevant log message on master:

failed to create repository [s3][mybackup]
com.amazonaws.SdkClientException: Unable to execute HTTP request: mybackup.s3.amazonaws.com
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleRetryableException(AmazonHttpClient.java:1114) ~[aws-java-sdk-core-1.11.223.jar:?]

As you can see, it’s still trying to use s3.amazonaws.com instead of https://some-endpoint/

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Reactions:1
  • Comments:6 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
seutcommented, Sep 5, 2018

@bputt We’ve fixed it by https://github.com/crate/crate/pull/7635, it will be released with the next 3.0 and 3.1 hotfix releases. Thanks a lot for reporting.

1reaction
izloopcommented, Aug 28, 2018

Hi @bputt - I have reviewed the issue and since I am able to reproduce it as well, this shall be escalated! I will feedback you any update we have on this here!

Thanks for understanding.

Read more comments on GitHub >

github_iconTop Results From Across the Web

S3 repository | Elasticsearch Guide [master] | Elastic
In-progress snapshot/restore tasks will not be preempted by a reload of the client's secure settings. The task will complete using the client as...
Read more >
Best practices for using Amazon S3 endpoints with AWS ...
Navigate to the templates folder of the repository: cd s3-endpoints-and-cfn/templates . · Open the master.template. · Review the conditions and ...
Read more >
AWS S3: The bucket you are attempting to access must be ...
However, I am getting the following error: The bucket you are attempting to access must be addressed using the specified endpoint. Please send...
Read more >
SDK client exception, when configuring S3 Repository in AWS
When trying to create Repository in S3, the following error appears - ... /_snapshot/my_s3_repository, params: {repository=my_s3_repository}
Read more >
Amazon S3 - Fluent Bit: Official Manual
The Amazon S3 output plugin allows you to ingest your records into the S3 cloud ... This option does not affect the normal...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found