question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

`GoogleDriveToLocalOperator` gives conn_id error despite not taking conn_id as a param

See original GitHub issue

Apache Airflow version

2.3.2 (latest released)

What happened

When using the GoogleDriveToLocalOperator I receive the below error:

  File "/usr/local/lib/python3.9/site-packages/airflow/models/connection.py", line 430, in get_connection_from_secrets
    raise AirflowNotFoundException(f"The conn_id `{conn_id}` isn't defined")
airflow.exceptions.AirflowNotFoundException: The conn_id `google_cloud_default` isn't defined

but it doesn’t appear that you can add a gcp_conn_id parameter - I receive an error if I try to do this

What you think should happen instead

Not entirely sure but possibly this operator should have a gcp_conn_id param similar to the GoogleDriveToGCSOperator

How to reproduce

Set up a task similar to the below - ensuring the service account has access to the shared folder being accessed

    download_from_gdrive_to_local = GoogleDriveToLocalOperator(
        task_id="download_from_gdrive_to_local",
        folder_id="0ACWYrvwOWlMsUk9PVA",
        file_name="abc.txt",
        output_file="/tmp/abc.txt",
    )

Operating System

macOS 11.5.2

Versions of Apache Airflow Providers

apache-airflow-providers-google - version 6.8.0

Deployment

Astronomer

Deployment details

using astro-runtime:5.0.3

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:5 (4 by maintainers)

github_iconTop GitHub Comments

2reactions
aspaincommented, Jun 16, 2022

👍 will take a stab at it

0reactions
aspaincommented, Jun 30, 2022

PR has been merged 👍

Read more comments on GitHub >

github_iconTop Results From Across the Web

No results found

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found