Akshay Kulkarni

icon indicating a website link akshay-a-kulkarni.github.io

icon location San Diego

Results 1 comments of Akshay Kulkarni

Performance issues when loading data from S3

@shaktishp could you try adding the running this ? ```python ds.dataset( 'location', format=ds.ParquetFileFormat( default_fragment_scan_options=ds.ParquetFragmentScanOptions( pre_buffer=True ) ) ) ``` This _may_ speed up your s3 read time