airbyte
airbyte copied to clipboard
Provide a pricing estimate on DBT normalisation operations.
Tell us about the problem you're trying to solve
Since normalisation is run in DBT, we should provide an estimate so users are not thrown off by pricing when running DBT on their warehouses.
DBT returns a JSON of how many records and size of data processed, so we should theoretically be able to figure out how much the job cost.
See https://docs.getdbt.com/reference/artifacts/run-results-json#top-level-keys.
Are you willing to submit a PR?
Remove this with your answer :-)
credits to @ChristopheDuong for the idea.
@cgardens @jrhizor I think this is a very good idea. We can work on this after launch as we worked on incremental normalisation.
This is no longer relevant.