question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Azure Provider related WARNING in webserver (version 2.0.1)

See original GitHub issue

Apache Airflow version: 2.0.1

Kubernetes version (if you are using kubernetes) (use kubectl version): 1.18

Environment: Official Helm Chart with CeleryExecutor

  • Cloud provider or hardware configuration: AWS EKS
  • OS (e.g. from /etc/os-release):
  • Kernel (e.g. uname -a):
  • Install tools:
  • Others:

What happened:

When updated to apache/airflow:2.0.1-python3.7 image, a WARNING message occurs in the webserver.

[2021-02-17 04:06:47,339] {providers_manager.py:299} 
WARNING - Exception when importing 'airflow.providers.microsoft.azure.hooks.wasb.WasbHook' from 
'apache-airflow-providers-microsoft-azure' package: No module named 'azure.storage.blob'

What you expected to happen:

How to reproduce it:

Anything else we need to know:

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:9 (4 by maintainers)

github_iconTop GitHub Comments

14reactions
pl77commented, Mar 11, 2021

For those who might be looking for a simple way to implement these suggestions, I tried solutions from both @omarish and @potiuk and they both worked fine. Easiest way to try them was create a blank text file named, as an example, Dockerfile-potiuk and inside place the commands:

FROM apache/airflow:2.0.1
RUN pip install apache-airflow-providers-microsoft-azure==1.2.0rc1

Then, in the same directory you saved that file, run:

docker build -f ./Dockerfile-potiuk -t apache/airflow:2.0.1 .

If you save with the same tag as the existing file you don’t have to change your docker-compose.yml files and when 2.0.2 is released it’ll supersede this monkey patch when you do your regular docker-compose pull when upgrading (of course, that’s if your image is specified as :latest in your compose file).

I’m sure everyone using airflow is advanced enough to know this already but figured I’d post it just in case someone was struggling.

@potiuk : the rc1 candidate seemed to install just fine but I didn’t have an azure instance to test it against, unfortunately.

10reactions
kaxilcommented, Feb 17, 2021

Try the following command inside the container:

pip uninstall  --yes azure-storage && pip install -U azure-storage-blob apache-airflow-providers-microsoft-azure==1.1.0
Read more comments on GitHub >

github_iconTop Results From Across the Web

Release notes & updates – Azure CLI - Microsoft Learn
Learn about the latest Azure Command-Line Interface (CLI) release notes and updates for both the current and beta versions of the CLI.
Read more >
Release Notes — Airflow Documentation
Add warning if connection type already registered within the provider (#27520) ... [webserver] worker_refresh_interval was 30 seconds for Airflow <=2.0.1.
Read more >
Ansible Tower Release Notes v3.8.6
Introduced Automation Hub as the content provider for Ansible Tower ... in Ansible version 2.8 and higher, for Azure RM, GCE, OpenStack, and...
Read more >
Changelog - Cypress Documentation
Cypress will now warn when detecting unsupported dependencies for component testing. Fixes #22025. cy.type() can now be used to enter datetime values with ......
Read more >
1. Foreman 2.0 Manual
RPM based installations will also upgrade PostgreSQL to use version 12 from SCL instead of the default version 9.2 shipped in EL7 repositories....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found