question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Newest providers incorrectly include `gitpython` and `wheel` in `install_requires`

See original GitHub issue

Apache Airflow Provider(s)

ftp, openfaas, sqlite

Versions of Apache Airflow Providers

I am the maintainer of the Airflow Providers on conda-forge. The providers I listed above are the first 3 I have looked at but I believe all are affected. These are the new releases (as of yesterday) of all providers.

Apache Airflow version

2.2.4 (latest released)

Operating System

Linux (Azure CI)

Deployment

Other Docker-based deployment

Deployment details

This is on conda-forge Azure CI.

What happened

All providers I have looked at (and I suspect all providers) now have gitpython and wheel in their install_requires:

From apache-airflow-providers-ftp-2.1.1.tar.gz:

install_requires = 
	
	gitpython
	wheel

I believe these requirements are incorrect (neither should be needed at install time) and this will make maintaining these packages on conda-forge an absolute nightmare! (It’s already a serious challenge because I get a PR to update each time each provider gets updated.)

What you think should happen instead

These install requirements should be removed.

How to reproduce

Open any of the newly released providers from pypi and look at setup.cfg.

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:14 (13 by maintainers)

github_iconTop GitHub Comments

1reaction
xylarcommented, Mar 26, 2022

Thanks again. Most new providers should be should now be available from conda-forge. There were a few newer ones that I hadn’t added recipes for yet. They’re awaiting review (or review of missing dependencies).

1reaction
xylarcommented, Mar 24, 2022

Yep, I took a look at several more and they also look good.

Read more comments on GitHub >

github_iconTop Results From Across the Web

setuptools, pip and wheel always in latest version? #2364
This is what I would have to prove wrong, correct? 1st case: macOS (sierra 10.12.6), with a brew-installed python3, brew installed pipenv. After ......
Read more >
python - How to write setup.py to include a Git repository as a ...
This solution works for me when I run python setup.py install: setuptools.setup( ..., install_requires=[ 'numpy', 'pandas', 'my_private_pkg' ] ...
Read more >
setup.py - apache/airflow - Sourcegraph
And it is particularly useful when you add a new provider and there is no ... logger.warning("gitpython not found: Cannot compute the git...
Read more >
setup.py - airflow - Git at Google
# To airflow core. They do not have separate providers because they do not have any operators/hooks etc. CORE_EXTRAS_REQUIREMENTS: Dict[ ...
Read more >
github setup py
This action has three parameters: Parameter. how to install git python package. ... To see if you have a recent version installed, issue...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found