meltano
dbt code generation for staging models
Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3162
Originally created by @pnadolny13 on 2022-01-13 22:55:43
Initially discussed in office hours and then in https://gitlab.com/meltano/meltano/-/issues/3156#note_810106268 and https://gitlab.com/meltano/meltano/-/issues/2266#note_802349554.
We know quite a bit about the data being loaded if it was managed by Singer. We could have utilities to generate staging tables as accelerators or templates (meaning user intervention is needed).
This could just build our files for us with a best guess baseline which at least accelerates development a bit. Things like casting, deduping (we know primary keys usually), etc. Another main goal of staging is renaming columns, which is a little more subjective. We could have some sort of interactive CLI like when you add a custom extractor where default is to keep the current name or the user could rename it, then that compiles to a sql model file.
This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.
![stale[bot] avatar](https://avatars.githubusercontent.com/in/1724?v=4 "Published by a pub.dev verified publisher"){kind=small}
This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.
