simaster123

Results 6 comments of simaster123

Update - It looks like installing cbpro through pip does not provide the most up-to-date websocket_client.py. I copied and pasted the code available here in GitHub into package websocket_client.py file...

Further update - while the current code available on GitHub stops the issue from occurring every couple minutes, I'm still encountering the issue every 30 minutes or so. I've added...

Same issue re: disconnecting without telling you, although most of my disconnects are of the type in my prompt - forcibly closed. I added some additional checks in my code...

Personally, I access the Parquet metadata using fastparquet directly, not Dask. As an example: ``` pf = fastparquet.ParquetFile(path_to_parquet_file) all_stats = pf.statistics.copy() all_info = pf.info.copy() ``` There's a lot of data...

As an example to delay the parquet read to utilize dask's parallel processing: ``` @dask.delayed def read_pf(path_to_parquet_file): pf = fastparquet.ParquetFile(path_to_parquet_file) all_stats = pf.statistics.copy() all_info = pf.info.copy() ```

Not sure what the status is on this feature request, but for what it's worth, I'm using --lifetime to deal with sporadic worker stalls. So, in my case, there is...