Lior Chaga
Lior Chaga
expose per each framework: active used resources offered resources
add framework metrics
When testing upgrade to spark 3.1.1 I've noticed the compression of repeated INT64 columns compression got worse. https://stackoverflow.com/questions/67413589/parquet-compression-degradation-when-upgrading-spark/67455721#67455721 Reading [this file](https://drive.google.com/file/d/1FZx_qAmoX1HDpAVplvFnl2iC83siOCTE/view?usp=sharing) saved with snappy 1.1.2.6, and writing it with higher...