Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

How to catch dev dependencies that actually need to be included in the distributed presentations of Meltano?

See original GitHub issue

Just got bit by this with packaging in

It’s a transitive dependency required by tox, but tox is only a dev dependency. So, in CI tests, things look good because dev dependencies are installed by poetry install. But, when meltano is installed from an upstream source or by another tool like pipx, which is the case in end-to-end tests here (pipx install ..), then the transitive dev dependency packaging is not installed and errors are encountered:

$ meltano add orchestrator airflow
2022-06-23T19:10:30.061252Z [info     ] Environment 'dev' is active
No module named 'packaging'

I guess one easy way to ensure we don’t fall in that scenario is to have tests that don’t rely on Poetry to install Meltano.

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:5 (2 by maintainers)

github_iconTop GitHub Comments

edgarrmondragoncommented, Jul 1, 2022

The SDK had this exact issue in the v0.6.0 release so I went ahead and started a PR with nox-poetry, which runs tasks against the installed form of the package using the wheel.

pandemicsyncommented, Jun 27, 2022

At least when running in CI, we could use a pipx-installed version of Meltano instead of the Poetry-installed one.

Probably a better discussion for #6218, but sounds fine - at some point we’d probably want a test mirroring the contributor guide which might end up using poetry.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Meltano: Open Source Data Pipeline Management
Open source, flexible, scales to your needs. Confidently move, transform, and test your data using tools you know with a data engineering workflow...
Read more >
Transcript : GitLab Inc., Q3 2023 Earnings Call, Dec 05, 2022
Thank you for joining us for our fiscal year 2023 third quarter earnings presentation. GitLabs value proposition as a mission-critical DevSecOps ...
Read more >
How to Become The Next 30 Billion $$$ Data Company
The Data World Is in Turmoil, You Need More Than a Product Vision ... of getting contributors involved later on because they actually...
Read more >
jghoman/awesome-apache-airflow - GitHub
Curated list of resources about Apache Airflow. Contribute to jghoman/awesome-apache-airflow development by creating an account on GitHub.
Read more >
Gitlab S-1 -
In short, an entirely new platform for DevOps was needed. ... We were incorporated in the State of Delaware as GitLab Inc. in...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found