question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

`BigQueryCreateExternalTableOperator` uses deprecated function

See original GitHub issue

Body

The BigQueryCreateExternalTableOperator uses create_external_table:

https://github.com/apache/airflow/blob/cd49a8b9f64c57b5622025baee9247712c692e72/airflow/providers/google/cloud/operators/bigquery.py#L1131-L1147

this function is deprecated: https://github.com/apache/airflow/blob/511d0ee256b819690ccf0f6b30d12340b1dd7f0a/airflow/providers/google/cloud/hooks/bigquery.py#L598-L602

The task: Refactor/change the operator to replace create_external_table with create_empty_table.

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
cswpycommented, Jun 4, 2022

Thanks for the tip @potiuk. I will come up with something and submit a PR.

0reactions
potiukcommented, Jun 4, 2022

I think it’s better to discuss with the code and in PR - make a draft PR with your proposal and it can be discussed there - it’s far easier this way because the discussion can be focused around the actual code without looking it up and guessing what you really want to do @cswpy.

Read more comments on GitHub >

github_iconTop Results From Across the Web

airflow.providers.google.cloud.operators.bigquery
Executes BigQuery SQL queries in a specific BigQuery database. This operator does not assert idempotency. This operator is deprecated. Please use airflow.
Read more >
Viewing deprecation insights and recommendations
What are deprecation insights and recommendations? Use of deprecated Kubernetes features and APIs detected by GKE. Before you begin; View deprecation ...
Read more >
BigQueryCreateExternalTableOp...
Creates a new external table in the dataset with the data from Google Cloud Storage. The schema to be used for the BigQuery...
Read more >
Updating Airflow
Deprecated PodDefaults and add_xcom_sidecar in airflow.kubernetes.pod_generator ... Users using cluster policy need to rename their policy functions in ...
Read more >
apache-airflow-providers-google - Python package - Snyk
Ensure you're using the healthiest python packages ... Rename hook bigquery function '_bq_cast' to 'bq_cast' (#27543); Use non-deprecated method for on_kill ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found