datahub
datahub copied to clipboard
fix(ingest/redshift): fix serverless redshift temp table lineage
A session can consist of multiple query_id. If multiple SQL commands are used to create several temp tables in a session, only one temp table lineage will be generated. This PR fixes this issue.
Checklist
- [ ] The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
- [ ] Links to related issues (if applicable)
- [ ] Tests for the changes have been added/updated (if applicable)
- [ ] Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
- [ ] For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub