question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

allow connect_args to be passed when creating an SQL engine from a glue connection

See original GitHub issue

To increase the statement timeout on postgres, I need to pass arguments to sqlalchemy to allow queries to run for a longer time before timing out: engine = sqlalchemy.create_engine(pg_conn_string, connect_args={"options": "-c statement_timeout=900s"}) It would be good to allow this option for for awswranger engine = wr.catalog.get_engine(connection='rds-connection-name', connect_args={"options": "-c statement_timeout=900s"})

also your docs are incorrect for the above statement, instead of connection= it reads name= in the example

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:6 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
jasadamscommented, Jul 18, 2020

looks good

starting df_1
df_1 row count: 1374715
df_1 query time: 200s
starting df_2
df_2 row count: 1374715
df_2 query time: 199s
1reaction
igorborgestcommented, Jul 18, 2020

@jasadams thanks a lot for your quick response and great test report.

I was able to find where was the problem and I also added a test case to cover your usage.

Do you mind to test it again?

Read more comments on GitHub >

github_iconTop Results From Across the Web

AWS Glue connection properties
On the AWS Glue console, create a connection to the Amazon RDS Oracle instance. In the connection definition, select Require SSL connection. When...
Read more >
How to connect AWS RDS SQL Server with AWS Glue
AWS Glue can be used to connect to different types of data repositories, crawl the database objects to create a metadata catalog, ...
Read more >
AWS Glue - Unable to connect to mysql - Stack Overflow
After speaking to an AWS Architect, I can confirm that Glue does not work with MySql Version 8 at this time. This is...
Read more >
Getting Started with Apache Iceberg Using AWS Glue and ...
Simply navigate to the Glue Studio dashboard and select “Connectors.” Click on the “Iceberg Connector for Glue 3.0,” and on the next screen...
Read more >
AWS ETL: Insert data to a relational database using Glue Job
I already have a MySQL DB, which is called “magento”, so, let's create a table ... Follow to “Glue” -> “Connections” and click...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found