great_expectations icon indicating copy to clipboard operation
great_expectations copied to clipboard

Published 20 hours ago • verified publisher icon great-expectations

[BUG] marshmallow package conflict with airflow

Open itaise opened this issue 2 years ago • 5 comments

Hi, In great expectations latest version (0.15.21) marshmallow specific packages requirement was added However, this is not compatible with Airflow, for example, the few latest versions: https://raw.githubusercontent.com/apache/airflow/constraints-2.3.4/constraints-3.7.txt https://raw.githubusercontent.com/apache/airflow/constraints-2.3.3/constraints-3.7.txt https://raw.githubusercontent.com/apache/airflow/constraints-2.3.2/constraints-3.7.txt

require an earlier version of marshmallow (3.16 or 3.17), so our builds are failing on pip conflicts.

Can you please check?

Thanks a lot!

itaise avatar Sep 04 '22 07:09 itaise

@cdkini maybe you have some insight on that? Thanks a lot!

itaise avatar Sep 09 '22 05:09 itaise

Hey @itaise @cdkini is working on a fix for this. He'll provide an update soon.

rdodev avatar Sep 12 '22 15:09 rdodev

thanks a lot!

itaise avatar Sep 12 '22 18:09 itaise

Hi, @cdkini @rdodev any updates on this? thanks!

itaise avatar Sep 28 '22 11:09 itaise

Any news?

orenewix avatar Oct 11 '22 08:10 orenewix

@cdkini @rdodev can you please provide an update, if this remains on the next Airflow upgrade Wix will have to stop using GE package

orenewix avatar Oct 24 '22 06:10 orenewix

Apologies for the delayed response @itaise @orenewix.

Our current pin is as follows: marshmallow>=3.7.1,<4.0.0

I believe this was immediately updated after the referenced PR above was merged. Please let me know if you're still seeing issues with these updated bounds.

cdkini avatar Oct 24 '22 13:10 cdkini

Closed as resolved by #6213 ; if this issue persists, feel free to re-open with further context.

austiezr avatar Nov 07 '22 17:11 austiezr