python_mozetl
python_mozetl copied to clipboard
mozilla
ETL jobs for Firefox Telemetry
Bumps [scipy](https://github.com/scipy/scipy) from 1.5.4 to 1.10.0. Release notes Sourced from scipy's releases. SciPy 1.10.0 Release Notes SciPy 1.10.0 is the culmination of 6 months of hard work. It contains many...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [requests](https://github.com/psf/requests) from 2.25.0 to 2.31.0. Release notes Sourced from requests's releases. v2.31.0 2.31.0 (2023-05-22) Security Versions of Requests between v2.3.0 and v2.30.0 are vulnerable to potential forwarding of Proxy-Authorization...
Bumps [pyspark](https://github.com/apache/spark) from 2.3.2 to 3.2.2. Commits 78a5825 Preparing Spark release v3.2.2-rc1 ba978b3 [SPARK-39099][BUILD] Add dependencies to Dockerfile for building Spark releases 001d8b0 [SPARK-37554][BUILD] Add PyArrow, pandas and plotly to...
Bumps [numpy](https://github.com/numpy/numpy) from 1.19.4 to 1.22.0. Release notes Sourced from numpy's releases. v1.22.0 NumPy 1.22.0 Release Notes NumPy 1.22.0 is a big release featuring the work of 153 contributors spread...
In https://github.com/mozilla/python_mozetl/pull/379, we pinned a few dependencies as CI workarounds (`flake8` and `protobuf`). There are also a couple other dependencies pinned (see https://github.com/mozilla/python_mozetl/pull/374 and https://github.com/mozilla/python_mozetl/pull/377) that could be bumped. For...
Python 3.7 end of life is June 2023. We should update this repo to at least Python 3.8. https://endoflife.date/python
This repository builds images based on Debian Stretch which is no longer supported as of June 2022. We should update to a more recent Debian version. https://endoflife.date/debian
The docs use `m2r` to convert a markdown file into restructured text in order to use Sphinx. That's not working anymore. We could switch from m2r to [MyST](https://myst-parser.readthedocs.io/en/latest/).
The current way of passing creds in airflow for taar jobs is not ideal – the cleanest way to do this right now is probably to write to a GCS...
Commands in mozetl can now take advantage of a single submission script to schedule jobs without the boilerplate. This makes testing the job on EMR and airflow much easier. The...
