elementary icon indicating copy to clipboard operation
elementary copied to clipboard

Allow anomalies test on nested fields

Open JavierLopezT opened this issue 2 years ago • 2 comments

Right now, anomalies tests on nested fields (for instance Struct fields on BigQuery) are not supported, but it's something I definitely need, since a lot of important metrics are stored in struct fields.

Thanks to @Maayan-s I now know that that is because elementary has a flow in the test that checks that the column actually exists and what is it's data type to avoid errors. One possible solution, as suggested by her, would be to create a new nested_field_anomalies test that would just avoid the steps of checking if the column exists and what's it's data type.

I am open to work on this providing that the change is not very time consuming

JavierLopezT avatar May 29 '23 08:05 JavierLopezT

We would love this too!

k-lawecki avatar Nov 20 '23 19:11 k-lawecki

It would be great if this was implemented; we use structs heavily and I cannot use elementary in our models without resorting to workarounds.

Edit: I have no idea what's going on, but my comment triggered some github action, which failed: https://github.com/elementary-data/elementary/actions/runs/9892357654

geo909 avatar Jul 11 '24 13:07 geo909