`dvc import` from `s3://...` fails when s3 provided by 3rd party provider.
See original GitHub issue- Standard aws client works, if endpoint url provided.
- aws --endpoint-url https://<my-endpoint> s3 ls <my-path>
- DVC repository works, endpoint_url provided
['remote "minio"']
url = s3://<my-path>
endpointurl = <my-endpoint>
However dvc import
fails because no capability to specify endpoint url
More details: https://gist.github.com/bwalsh/1afea0a2499b5e81c507dbc24521038e
Issue Analytics
- State:
- Created 5 years ago
- Reactions:3
- Comments:9 (7 by maintainers)
Top Results From Across the Web
"dvc add -external S3://mybucket/data.csv" is failing with ...
You are using s3://dataset/ in your add --external command. I think that DVC tries to connect to a bucket called dataset and to...
Read more >Metaflow/community - Gitter
However, I am getting a S3 datastore operation _get_s3_object failed (An error occurred (400) when calling the HeadObject operation: Bad Request) ...
Read more >Resolve "Unable to locate credentials" error in ... - Amazon AWS
An "Unable to locate credentials" error indicates that Amazon S3 can't find the credentials to authenticate AWS API calls. To resolve this issue ......
Read more >Resolve "Unable to locate credentials" error in Amazon S3
How do I fix this? Resolution. An "Unable to locate credentials" error indicates that Amazon S3 can't find the credentials to authenticate AWS...
Read more >Data Version Control With Python and DVC - Real Python
But data version control, managing changes to models and datasets, isn't so well established. It's not easy to keep track of all the...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@efiop, I’m going to label this as
documentation
to improve/clarify theremote://
“protocol”@efiop : yes I was aware. The semantics of
dvc import
are clear, it’s the semantics the ofremote://
by import