question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

rich package version conflict with Airflow2.3.3

See original GitHub issue

Describe the bug I am trying to use data-diff in airflow dags. While installing it on Airflow server, I ran into the following conflict:

apache-airflow 2.3.3 requires rich>=12.4.4, but you have rich 10.16.2 which is incompatible. So, I tried changing the version with poetry inside pyproject.toml file. This step resulted in the following issue:

Resolving dependencies... (4.3s)

  SolverProblemError

  Because preql (0.2.17) depends on rich (>=10.7.0,<11.0.0)
   and no versions of preql match >0.2.17,<0.3.0, preql (>=0.2.17,<0.3.0) requires rich (>=10.7.0,<11.0.0).
  So, because data-diff depends on both rich (12.5.1) and preql (^0.2.17), version solving failed.**

Make sure to include the following (minus sensitive information):

  • poetry add “rich12.5.1”
  • traceback
-Updating dependencies
Resolving dependencies... (4.3s)

  SolverProblemError

  Because preql (0.2.17) depends on rich (>=10.7.0,<11.0.0)
   and no versions of preql match >0.2.17,<0.3.0, preql (>=0.2.17,<0.3.0) requires rich (>=10.7.0,<11.0.0).
  So, because data-diff depends on both rich (12.5.1) and preql (^0.2.17), version solving failed.

  at /opt/homebrew/lib/python3.9/site-packages/poetry/puzzle/solver.py:241 in _solve
      237│             packages = result.packages
      238│         except OverrideNeeded as e:
      239│             return self.solve_in_compatibility_mode(e.overrides, use_latest=use_latest)
      240│         except SolveFailure as e:
    → 241│             raise SolverProblemError(e)
      242│ 
      243│         results = dict(
      244│             depth_first_search(
      245│                 PackageNode(self._package, packages), aggregate_package_nodes

If possible, please paste these as text, and not a screenshot.

Describe the environment

I am using macos monterey12.3 with latest version of data-diff. Screen Shot 2022-08-17 at 11 21 17 am Screen Shot 2022-08-17 at 11 22 17 am

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:6

github_iconTop GitHub Comments

1reaction
erezshcommented, Aug 18, 2022

I will probably merge the fix to master today or tomorrow, and we might make a new release on Monday,

1reaction
erezshcommented, Aug 17, 2022

Thanks for letting us know. We will fix it soon.

Meanwhile, just FYI, you don’t need preql to run data-diff, it’s only for initially seeding the databases with data, for manual tests.

Read more comments on GitHub >

github_iconTop Results From Across the Web

PIP dependency conflicts when upgrading to Airflow
After executing the above command, I wanted to check the Airflow version and I got this error. ModuleNotFoundError: No module named 'pendulum'.
Read more >
Release Notes — Airflow Documentation
Update rich to latest version across the board. ... While DAG Serialization is a strict requirements since Airflow 2, we allowed users to...
Read more >
Conflicts with airflow constraints for airflow 2.2.0 python 3.7
What happened. The versions of flake8 and importlib-metadata specified in the constraints file are incompatible for python 3.7. In the constraints file ......
Read more >
Cloud Composer version list
Version Airflow version Python versions Release date Full su... composer‑2.1.2‑airflow‑2.3.4 2.3.4 3.8.12 December 13, 2022 Decem... composer‑2.1.2‑airflow‑2.2.5 2.2.5 3.8.12 December 13, 2022 Decem... composer‑1.20.2‑airflow‑2.3.4 2.3.4 3.8.12...
Read more >
Airflow Documentation - Read the Docs
Airflow is a platform to programmatically author, schedule and monitor workflows. Use airflow to author workflows as directed acyclic graphs ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found