Grace (Han) Liu issues

Repositories
Issues
Comments

Results 2 issues of


                                            Grace (Han) Liu

make_reader() is taking forever

I created a large petastorm data that holds more than 50,000 samples of data. Each sample has 80+columns of 1d, 2d and 3d data. I partitioned the data by geohash...

encountered a FileAlreadyExistsException when trying to save array of arrays of arrays (3d array)

I got a FileAlreadyExistsException when I was trying to save a pyspark dataframe that has 3d array columns. The saving worked for me when I only had 1d, 2d, and...