sqllineage
sqllineage copied to clipboard
Update sqlalchemy.py
add support get field list from hive metastore mysql database
add support get field list from hive metastore mysql database
Hello. I would like to know what is the purpose of this pull?
Based on typical scenarios, I have a few questions: insert into target_table partition(month_id='202301',day_id='22') select *** from source_tab
-
Should the collected field list be stored in field order? I understand that field order is necessary for subsequent use of the metadata. When column information of target_table is required, the field order determines the mapping relationship of source_table columns.
-
Is it necessary to eliminate or distinguish whether the field is a partition field? The partition field should not be used as a column in the target_table or at least needs to be distinguished
-
It is recommended to use f-string writing method for string instead of splicing
Thank you for your reply. I realize that I have not considered enough, and my thoughts were too simplistic.