Ankit Chaurasia comments

Results 57 comments of


                                            Ankit Chaurasia

Set the CI to run and publish benchmark reports once a week

I will help @pankajastro with this task

Document code from example DAGs

@kaxil I think readthedocs has this as part of `Simple ETL workflow`.

Implement Async for native Spark Operators

Yes, `spark-submit` works for the deploy-mode `local`. So `SparkSubmitOperator` example dag works with local spark setup. For `SparkSqlOperator` i am setting up the hive along spark to create a table...

Implement Async for native Spark Operators

`SparkSqlOperator` requires the `spark-sql` to work when it's installed along in the docker. Right now, for deployment mode as `local`, the `SparkSqlOperator` fails as `spark-sql` fails with the following error:...

Move benchmarking config out of codebase to GCS

It doesn't make sense to have the config both on github and GCS.

Add open lineage support for MergeOperator

> Add context to the task in test yup https://github.com/astronomer/astro-sdk/pull/1068/commits/224e4de4d8fed82f8b3f9f38426c205d9c5efa57

Have tests representative of the Astronomer Cloud IDE Python cell usages

@tatiana should we prioritise this task or keep it in icebox?

Use deploy-actions to deploy DAGs to astro cloud

We need to credentials for astro-sdk instead of astronomer-provider @rajaths010494

Use deploy-actions to deploy DAGs to astro cloud

@rajaths010494 to explore deploy actions and provide an estimate.

Fix logic to cancel the external job if the TaskInstance is not in a running or deferred state for BigQueryInsertJobOperator

@thesuperzapper please take a look