dione icon indicating copy to clipboard operation
dione copied to clipboard

Published 20 hours ago • verified publisher icon paypal

Switch filesDF to HadoopRDD

Open shay1bz opened this issue 3 years ago • 0 comments

current filesDF is both ugly and inefficient in terms of data locality. we should try to switch to something like HadoopRDD/NewHadoopRDD or something more natural to leverage the preferred locations functionality.

shay1bz avatar Jul 28 '21 12:07 shay1bz