Pankaj Singh

OSS PR: https://github.com/apache/airflow/pull/23767

OSS PR: https://github.com/apache/airflow/pull/23620

OSS PR: https://github.com/apache/airflow/pull/23769

Automate EMR kerberos auth enable cluster creation

2

This PR automate - AWS security configuration creation with auth mechanism Kerberos - Create Kerberos to enable EMR EMR cluster - Generation of keytab and Kerberos principal creation on EMR...

I see the following item is not consistent for docstring - private method docstring, for some private methods we do document the param but for some, we do not -...

Currently, our testing instance keeps running so it makes sense to explore the tradeoff between keeping it running and teardown and setup it up daily. - If we tear it...

Test the timeout parameter for all the Triggers (see Trigger table in airflow )

**Acceptance Criteria**: - [ ] Document steps for Spark docker container spin up - [ ] Document steps to create a connection for Spark-based operator/Sensor

**Please describe the feature you'd like to see** In many places including lineage extractors we notice that we need to know the row count of a table so it would...

**Describe the bug** Earlier we were using `n2-standard-4` type cluster that we had to change `n2-standard-8` while doing benchmarking for bigger files. We also increased our benchmark pod size to...