Collum Freedman
Collum Freedman
Switch from the current python versioning and dependency management with `pipenv` and `pyenv` to use `uv` instead.
Changes the slack reporting to be managed by a class that initializes a single client connection. The main methods involve providing summarizing statistics from the `all_properties_end` final dataframe as well...
Reconcile the `pipeline-integration` branch with `staging` both of which contains the main changes with the switch over the updated pipeline, additional data validation checks, etc. `pipeline-integration` contains the changes regarding...
**This is a preliminary ticket describing a large overhaul to the ETL pipeline - it will be fleshed out in more parts in the future and so avoid working on...
Before submitting your PR, please confirm that you have done the following: - [x] I have opened my PR against the `staging` branch, NOT against `main` - [x] I've run...
We still need to make decisions regarding our plans for caching data in between runs on GC, and how that will interact between the VM running our pipeline and eventually...
Need to look into the GC account to either restructure the existing resource there or create a new VM that's scheduled to run the new pipeline on a monthly basis....
Currently the data-diffing works by reading from postgres for most recent, two tables of a dataset (by default the complete, output table from the pipeline `all_properties_end`), and doing a granular...
Make slack notifications handled through a single `SlackNotifier` class that handles establishing the client connection and sending any messaging for pipeline run failures or warnings from data-diffing etc. Currently the...
**Describe the bug** The panels filter for "Get Access" is behaving inconsistently; sometimes selecting more options will increase the property count, suggesting that it is using the union of properties...