gcs_to_bigquery using deprecated methods
See original GitHub issueHello,
I’m running Airflow 1.10.10 and using the GCSToBigQueryOperator
from airflow.providers.google.cloud.transfers.gcs_to_bigquery
in order to load data from google cloud storage into a big query table.
Although everything is working as expected, I keep seeing (a lot of) deprecation warnings in my logs:
DeprecationWarning: The bigquery_conn_id parameter has been deprecated. You should pass the gcp_conn_id parameter.
bigquery.py:103: DeprecationWarning: This method will be deprecated. Please use `BigQueryHook.get_client` method`
taskinstance.py:984: DeprecationWarning: This method is deprecated. Please use airflow.providers.google.cloud.hooks.bigquery.BigQueryHook.run_load`
bigquery.py:1614: DeprecationWarning: This method is deprecated. Please use `BigQueryHook.insert_job` method.
Although everything is working well, I’m afraid that in the future those warnings will indeed cause problems. Please update the code and find a way to use the suggested methods instead of the deprecated ones. If any more information is needed from me regarding the warnings or my system I will be happy to add it. Thank you!
Issue Analytics
- State:
- Created 3 years ago
- Comments:11 (8 by maintainers)
Top Results From Across the Web
Use the legacy streaming API | BigQuery - Google Cloud
Shows how to stream data into non-partitioned and time-partitioned BigQuery tables using the tabledata.insertAll method, de-duplicate data, ...
Read more >Deprecated List (gcs-connector-hadoop2 hadoop2-1.9.14 API)
Deprecated Fields. Field and Description. com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystemBase.BLOCK_SIZE_DEFAULT. use ...
Read more >Package apache-airflow-providers-google
Refactor: BigQuery to GCS Operator (#22506). 719135ade0. 2022-03-27. Remove references to deprecated operators/params in PubSub operators (#22519).
Read more >bigquery - Go Packages
To query existing tables, create a Query and call its Read method: q := client.Query(` SELECT year, SUM(number) as num FROM ` +...
Read more >How to extract bucket and file name from a Google Cloud ...
Note: The download_as_string() method is commonly referenced in tutorials for downloading files from GCS. However, it is now deprecated in ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@coopergillan I assigned you to this ticket.
Is this one anything of a priority?