question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

BIgQuery operators from backport packages and DAG Serialization

See original GitHub issue

Dzień Dobry (Good morning),

I heard that the BigQuery operators from Backport packages do not work properly when DAG serialization is enabled on the latest version of Airflow.

KeyError: "Operator Link class 'airflow.providers.google.cloud.operators.bigquery.BigQueryConsoleLink' not registered"

We should confirm this information and make a change to ensure compatibility between the latest version of Airflow and backport packages.

In Airflow 2.0, this error does not occur. It may be related to this change, but I’m not sure. https://github.com/apache/airflow/pull/7327/files

Dużo miłości (Lots of love), Kamil Breguła

CC: @anitakar @kaxil

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:3
  • Comments:8 (8 by maintainers)

github_iconTop GitHub Comments

1reaction
potiukcommented, Aug 5, 2020

Still not that close, k8s fixes have been a pain. At this rate we can look at cutting RCs next week – not happening this week. So yeah I would say we have some time 😃

Purrfect 🐱 !

1reaction
kaxilcommented, Aug 5, 2020

@kaxil @dimberman -> would be great to fif it before 1.10.12 gets released - so if we are very close to cutting 1.10.12 we might speed up testing and fixing this one. Are we very close to release 1.10.12 ?

Still not that close, k8s fixes have been a pain. At this rate we can look at cutting RCs next week – not happening this week. So yeah I would say we have some time 😃

Read more comments on GitHub >

github_iconTop Results From Across the Web

Import operators from backport provider packages
If you import an operator by using its original import path, your DAG uses the original version of the operator that is bundled...
Read more >
[GitHub] [airflow] mik-laj opened a new issue #10171: BIgQuery ...
[GitHub] [airflow] mik-laj opened a new issue #10171: BIgQuery operators from backport packages and DAG Serialization. Posted to commits@airflow.apache.org.
Read more >
[GitHub] [airflow] kaxil commented on issue #10171: BIgQuery ...
[GitHub] [airflow] kaxil commented on issue #10171: BIgQuery operators from backport packages and DAG Serialization · Previous message · View by thread ·...
Read more >
Release a 2nd wave of Backport packages · Issue #10014 · apache ...
Fix BigQuery operators problem with serialization BIgQuery operators from backport packages and DAG Serialization #10171; AWS SES Add Amazon SES hook #10004
Read more >
apache-airflow-backport-providers-google 2021.3.3 - PyPI
This release of the provider package contains third-party library updates, which may require updating your DAG files or custom hooks and operators, ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found