[Feature] DWH costs visibility reports

[Maayan-s]

As Elementary has access to the logs of the DWH, we can analyze and create reports that provide visibility into the costs of the DWH.

Use cases we can support:

• Costs per user
• Costs per dataset (table / schema / warehouse), including leveraging our knowledge about dependencies to provide the real cost
• Trends - Datasets and queries that are becoming more expensive over time

As a first step, the insights can be provided as CSV / JSON files or written into tables in the DWH. In the future, we can add reports to the UI and create automated workflows, based on feedback and usage.

Feedback

We would love to hear any feedback / comments / requests about this feature! Specifically what use cases are valuable to you, and if there are others you would want us to address.