whylogs icon indicating copy to clipboard operation
whylogs copied to clipboard

filtered segmentation should not require columnar segmentation

Open jamie256 opened this issue 2 years ago • 2 comments

Description

Usability issue with helper functions that create segments for schema override: segmentation on column is simple, but using filters without column segments is error prone. Need to create helper function to simplify.

jamie256 avatar Sep 13 '22 15:09 jamie256

Are you thinking this would be like a helper function that runs a column segmentation before filtering?

Would like more clarity on that first bit.

TheMellyBee avatar Sep 14 '22 17:09 TheMellyBee

No, we have columnar segmentation and utilities for that.

We also have filters which run before column segmentation.

What is awkward here is that you might want to filter based on column values, e.g. subset of the data where "col1=x1", now that might be the full extent to your intended segmentation but whylogs segmentation require you also specify a column for segmentation (which you might not need, so if you segment on col1 things work but its an extraneous requirement to specify that column in this scenario since you already limited the data to only have the single value for that column).

jamie256 avatar Sep 14 '22 19:09 jamie256

This issue is stale. Remove stale label or it will be closed tomorrow.

github-actions[bot] avatar Oct 24 '22 13:10 github-actions[bot]

This issue is stale. Remove stale label or it will be closed tomorrow.

github-actions[bot] avatar Nov 28 '22 13:11 github-actions[bot]

This issue is stale. Remove stale label or it will be closed tomorrow.

github-actions[bot] avatar Jan 02 '23 13:01 github-actions[bot]

This issue is stale. Remove stale label or it will be closed tomorrow.

github-actions[bot] avatar Feb 06 '23 13:02 github-actions[bot]