astro-sdk
                                
                                 astro-sdk copied to clipboard
                                
                                    astro-sdk copied to clipboard
                            
                            
                            
                        Improvements on OpenLineage implementation
Please describe the feature you'd like to see
- ~~We can add better unit-test cases where we test the output of get_openlineage_facets_on_completeandget_openlineage_facets_on_startright now we rely onMarquez UIto test working~~ We should rename the tests to be more searchable
- We can refactor since this function is too big and as a result of this we can also make them unit-testable https://github.com/astronomer/astro-sdk/blob/e09a88ce86578c8a52cc450d48ab92a9e8ace748/python-sdk/src/astro/sql/operators/load_file.py#L211
- We should also avoid running computations as part of get_openlineage_facets_on_completeorget_openlineage_facets_on_startsince it's a reporting mechanism - https://github.com/astronomer/astro-sdk/blob/e09a88ce86578c8a52cc450d48ab92a9e8ace748/python-sdk/src/astro/sql/operators/load_file.py#L227
- For postgres - If a user creates a table object with a different schema, we are not currently not taking it into account - https://github.com/astronomer/astro-sdk/blob/main/python-sdk/src/astro/databases/postgres.py#L219-L226