[bitnami/airflow] Add libraries libpq-dev python-dev gcc to support installation psycopg2 as dependency

[oktayalizada]

Description of the change

The change introduces three new packages which will be installed in airflow pods to support installation of psycopg2 library from requirements.txt file. Currently if we add psycopg2 library to requirements.txt we will get an error: Error: pg_config executable not found.

Benefits

Possibility to use bitnami images and helm chart to install psycopg2 and other libraries which depend on it

Applicable issues

• fixes #48237
• fixes #19242

[fevisera]

Hi @oktayalizada,

I have built the image locally, and it appears to be quite large:

local/airflow                   latest                        5bc6e03c8bf9   14 minutes ago   3.28GB 
bitnami/airflow                 latest                        8255c5199bb5   3 days ago       1.77GB

I believe the intention in https://github.com/bitnami/charts/issues/19242 was to create a fork rather than modify the bitnami airflow images. Adding these additional packages would need additional analysis, including an assessment of image size and the need for these packages. For instance, adding python-dev may include more packages than necessary.

Please let me know if there are any additional details I may be overlooking.

[oktayalizada]

Hi @fevisera, So you mean airflow will not support installation and usage of psycopg2 library in airflow pods? Can we have maybe a different tag for this specific build (e.g. debian-11-psycopg2)?

[fevisera]

Hi @oktayalizada,

Thank you for your question! I did not mean to imply that Airflow will not support the installation and usage of the psycopg2 library for bitnami/airflow. What I intended to convey is that before adding those new packages, it is essential to conduct a more thorough analysis to assess the image size impact and the actual necessity of these packages.

We already have an ongoing internal task to address adding dependencies feature, which has been created for https://github.com/bitnami/containers/pull/48258. As soon as this functionality becomes available, we will notify you here.

Thank you for proposing this change and bringing it to our attention. If you have any more questions or concerns, please feel free to ask. We appreciate your feedback.