deequ icon indicating copy to clipboard operation
deequ copied to clipboard

Published 20 hours ago • verified publisher icon awslabs

Can MetricsRepository be partitioned on S3?

Open yauhen-sobaleu opened this issue 4 years ago • 0 comments

Can I partition metric data in MetricsRepository in daily partitions? I am not sure whether it will break things if data in MetricsRepository will be partitioned

e.g.

s3a://bucket/metrics/year=2020/month=9/day=1/supermetrics.json
s3a://bucket/metrics/year=2020/month=9/day=2/supermetrics.json

yauhen-sobaleu avatar Sep 02 '20 11:09 yauhen-sobaleu