Nick Xie

Is there an example how contour can be achieved? We'd like to have a graph that looks like the following. Thanks 

we are already using dask. Is there any setting to enable to do out-of-core? We are supporting custom filter on other columns, so reading them in is a must. fullpath...

thanks, we changed to parquet and memory comes down significantly but it still only uses a couple of cores for data loading and most of systems other 60 cores are...

The data is in Hadoop HDFS with default block size of 512MB. There are several hundred files, so even without the chunking just the number of files alone should be...

Where is this related code? I can take a look to see if we propose something.

After reading the code, it seems the most logical place to add is a new method in SparkJobBase similar to the validate() and have its returned results settable to JobInfo....

We use the dependent-jar-uri feature, one setting per context, but keep changing config is painful. The uber-jar approach is also messy because it requires constant build integration changes. It would...

> > I have an unrelated question though. Do folks find the file upload API > > useful because they are not able to put files in for example some...

Hi Eric. This is for an use case to integrate with a tool that support csv comma delimited and numpy-style array as an input, but not json. Right now, we...