Ankit Chaurasia comments

Results 57 comments of


                                            Ankit Chaurasia

Performance Issues on Initial Page Load

These queries (https://github.com/apache/airflow/blob/main/airflow/www/views.py#L855, https://github.com/apache/airflow/blob/main/airflow/www/views.py#L860, https://github.com/apache/airflow/blob/main/airflow/www/views.py#L866, and so on) are executed sequentially as specified by @vchiapaikeo. I attempted to run these queries locally with 4000 DAGs, and it took 1.86 seconds...

Performance Issues on Initial Page Load

> Right, makes sense - it sounds like the best solution then may be to wait for @hussein-awala 's AIP on introducing async SQLAlchemy sessions into the codebase (seems like...

Schedular going down for 1-2 minute on every 10 minute as increase completed pods in EKS

This also seems related: https://github.com/apache/airflow/issues/38968

Deferrable operator tasks do not call `on_kill` method when fail or restarted

> @sunank200 @akaul my original solution proposed in https://github.com/apache/airflow/issues/36090#issuecomment-2094972855 had a critical part missing, which means that the solution you implemented (in the BigQuery and DataProc operators) needs to be...

Research:Enhance Testing and Automation for LLM Response Accuracy, accuracy monitoring DAG: automated tests to count docs, test queries, others

@phanikumv this research task is done and we are waiting for a review from Steven. @davidgxue has created further issues which will be done in the next release as discussed...

Need to set class schema for check_schema and create_schema tasks

@mpgreg is this still relevant?

New REST API endpoints for assets

As per discussion with TP, we will pick up `/public/assets/{id}/materialize` once the POC with partitioning strategy change with the execution date is clear.