Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

S3 error : Unable to locate credentials

See original GitHub issue

Hello,

since asynciohttp v3.8.1 was deployed on condaforge 3 days ago while trying to use s3fs with iamRole based credentials in AWS EC2 servers, we are encountering the following errors :

  File "fastparquet/api.py", line 132, in __init__
  File "fsspec/asyn.py", line 91, in wrapper
  File "fsspec/asyn.py", line 71, in sync
  File "fsspec/asyn.py", line 25, in _runner
  File "s3fs/core.py", line 1128, in _isdir
  File "s3fs/core.py", line 580, in _lsdir
  File "aiobotocore/paginate.py", line 32, in __anext__
  File "aiobotocore/client.py", line 142, in _make_api_call
  File "aiobotocore/client.py", line 161, in _make_request
  File "aiobotocore/endpoint.py", line 77, in _send_request
  File "aiobotocore/endpoint.py", line 71, in create_request
  File "aiobotocore/hooks.py", line 27, in _emit
  File "aiobotocore/signers.py", line 16, in handler
  File "aiobotocore/signers.py", line 63, in sign
  File "botocore/auth.py", line 373, in add_auth
botocore.exceptions.NoCredentialsError: Unable to locate credentials

It seems that fixing aiohttp in version v3.7.4.post0 solves this issue.

Not also that we are not encountering the same errors on the same codebase on tasks that are running on Fargate instead of EC2.

I guess it would be good to investigate what happened with aiohttp (which is required by aiobotocore)

Any better solution than fixing aiohttp version is welcome !

Issue Analytics

State:
Created 2 years ago
Reactions:1
Comments:28 (23 by maintainers)

Top GitHub Comments

3reactions

jmleonicommented, Nov 23, 2021

We are trying to reproduce the issue in isolation, from our application with no luck so far. What I can confirm is that it is not working with either aiohttp 3.8.0 nor 3.8.1 but it works fine with version 3.7.4.post0 I will keep you posted if we have a setup that can be exported and that let us reproduce the issue in a consistent manner

1reaction

jmleonicommented, May 20, 2022

@achimgaedke I didn’t take the opportunity yet, but many thanks to you for fixing on this issue, you are a life saver !

Top Results From Across the Web

Resolve "Unable to locate credentials" error in Amazon S3

An "Unable to locate credentials" error indicates that Amazon S3 can't find the credentials to authenticate AWS API calls. To resolve this issue ......

Resolve "Unable to locate credentials" error in Amazon S3

An "Unable to locate credentials" error indicates that Amazon S3 can't find the credentials to authenticate AWS API calls. To resolve this issue, ......

Bash with AWS CLI - unable to locate credentials

The unable to locate credentials error usually occurs when working with different aws profiles and the current terminal can't identify the ...

AWS CLI Unable To Locate Credentials | How To Fix? - Skynats

To resolve the issue of being unable to locate credentials in AWS CLI, our Support team recommends that the user perform all AWS...

AWS CLI Unable To Locate Credentials | A Quick Fix - Bobcares

An “Unable to locate credentials” error indicates that Amazon S3 can't find the credentials to authenticate AWS API calls. In this article, our ......