airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

Provide a pricing estimate on DBT normalisation operations.

Open davinchia opened this issue 4 years ago • 2 comments

Tell us about the problem you're trying to solve

Since normalisation is run in DBT, we should provide an estimate so users are not thrown off by pricing when running DBT on their warehouses.

DBT returns a JSON of how many records and size of data processed, so we should theoretically be able to figure out how much the job cost.

See https://docs.getdbt.com/reference/artifacts/run-results-json#top-level-keys.

Are you willing to submit a PR?

Remove this with your answer :-)

davinchia avatar Sep 22 '21 10:09 davinchia

credits to @ChristopheDuong for the idea.

davinchia avatar Sep 22 '21 10:09 davinchia

@cgardens @jrhizor I think this is a very good idea. We can work on this after launch as we worked on incremental normalisation.

davinchia avatar Sep 22 '21 10:09 davinchia

This is no longer relevant.

davinchia avatar Jun 28 '23 18:06 davinchia