question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

How to load parquet file from S3 using aws profile_name?

See original GitHub issue

Hi, How can I use the code below with AWS profile_name in order to read parquet files from S3?

df = wr.s3.read_parquet(filepath, dataset=True)

Thanks

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:12 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
nivcohcommented, Aug 28, 2020

Yap, I figured this out 👍 Thank you for the kind help 😃

1reaction
igorborgestcommented, Aug 28, 2020

@nivcoh you can also do the same with boto3.

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to load parquet file from S3 using aws profile_name? #367
Hi, How can I use the code below with AWS profile_name in order to read parquet files from S3? df = wr.s3.read_parquet(filepath, ...
Read more >
Read and Write Parquet file from Amazon S3
Before we read from and write Apache parquet in Amazon S3 using Spark example, first, let's Create a Spark DataFrame from Seq object....
Read more >
How to read parquet file from s3 using dask with specific AWS ...
How to read a parquet file on s3 using dask and specific AWS profile (stored in a credentials file). Dask uses s3fs which...
Read more >
Importing data from Amazon S3 into an RDS for PostgreSQL ...
First, gather the details that you need to supply to the function. These include the name of the table on your RDS for...
Read more >
How to read the parquet file in data frame from AWS S3
Today we are going to learn How to read the parquet file in data frame from AWS S3 First of all, you have...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found