question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Read/Write files on specific S3 accounts

See original GitHub issue

Say I want to save a file to S3 using a specific account:

df.to_csv('s3://foo/bar/temp.csv')

where my accounts are listed in ~/.aws/credentials:

[default]
aws_access_key_id = XXXX
aws_secret_access_key = XXXX

[foo]
aws_access_key_id = XXXX
aws_secret_access_key = XXXX

[bar]
aws_access_key_id = XXXX
aws_secret_access_key = XXXX

What’s the best or recommended way to do this with Pandas 0.20.2?

Any way to use/specify what account to use when we have multiple of them?

Perhaps related: Does Pandas use boto or boto3?

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Comments:6 (4 by maintainers)

github_iconTop GitHub Comments

7reactions
TomAugspurgercommented, Jun 19, 2019

Yes, I think that request has come up in a few places. I’d be happy to see something like that.

0reactions
alimcmaster1commented, Sep 4, 2020

#35381 closes this. You should now be able to use the storage_options kwarg to pass in “profile”

Read more comments on GitHub >

github_iconTop Results From Across the Web

Allows read and write access to objects in an S3 Bucket
This example shows how you might create an identity-based policy that allows Read and Write access to objects in a specific S3 bucket....
Read more >
AWS S3 Read-Write IAM Policy for specific User - Tufora
In this AWS S3 Read-Write IAM Policy tutorial we will talk about how to create and manage AWS IAM Policies for specific AWS...
Read more >
Provide cross-account access to objects in Amazon S3 buckets
I want to grant another AWS account access to an object that is stored in an Amazon Simple Storage Service (Amazon S3) bucket....
Read more >
How can I grant public read access to some objects ... - YouTube
How can I grant public read access to some objects in my Amazon S3 bucket? 20,738 views20K views. Mar 26 ...
Read more >
S3 bucket access from the same and another AWS account
a resource is the thing that you want to access, in our case an S3 bucket · create a resource-based policy attached to...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found