bigflow
bigflow copied to clipboard
A Python framework for data processing on GCP.
We should allow building more than one DAG (but not all) in a single `bf build`.
`bigflow` CLI might provide commands like 'add-job' (or similar) which asks a few questions about the job (beam/pyspark/etc, package / id etc) and generates code for such job with appropriate...
Bumps [protobuf](https://github.com/protocolbuffers/protobuf) from 3.19.4 to 3.19.5. Release notes Sourced from protobuf's releases. Protocol Buffers v3.19.5 C++ Reduce memory consumption of MessageSet parsing This release addresses a Security Advisory for C++...
Using `bigflow.testing.SpawnIsolateMixin` mixin in the test case (like [shown in the docs](https://github.com/allegro/bigflow/blob/5381b7e2d92a1e8ee8279f3062e0dee86228c627/docs/e2e_testing.md?plain=1#L211)) makes underlying, actual errors not visible in the traceback. Regardless of the underlying exception (which can be discovered...
Bumps [certifi](https://github.com/certifi/python-certifi) from 2021.10.8 to 2023.7.22. Commits 8fb96ed 2023.07.22 afe7722 Bump actions/setup-python from 4.6.1 to 4.7.0 (#230) 2038739 Bump dessant/lock-threads from 3.0.0 to 4.0.1 (#229) 44df761 Hash pin Actions and...
Bumps [certifi](https://github.com/certifi/python-certifi) from 2021.10.8 to 2023.7.22. Commits 8fb96ed 2023.07.22 afe7722 Bump actions/setup-python from 4.6.1 to 4.7.0 (#230) 2038739 Bump dessant/lock-threads from 3.0.0 to 4.0.1 (#229) 44df761 Hash pin Actions and...
Bumps [numpy](https://github.com/numpy/numpy) from 1.21.6 to 1.22.0. Release notes Sourced from numpy's releases. v1.22.0 NumPy 1.22.0 Release Notes NumPy 1.22.0 is a big release featuring the work of 153 contributors spread...
Bumps [wheel](https://github.com/pypa/wheel) from 0.37.1 to 0.38.1. Changelog Sourced from wheel's changelog. Release Notes UNRELEASED Updated vendored packaging to 22.0 0.38.4 (2022-11-09) Fixed PKG-INFO conversion in bdist_wheel mangling UTF-8 header values...
Bumps [wheel](https://github.com/pypa/wheel) from 0.37.1 to 0.38.1. Changelog Sourced from wheel's changelog. Release Notes UNRELEASED Updated vendored packaging to 22.0 0.38.4 (2022-11-09) Fixed PKG-INFO conversion in bdist_wheel mangling UTF-8 header values...