carbondata icon indicating copy to clipboard operation
carbondata copied to clipboard

[SDK Optimization] Multiple SimpleDateFormat initialization in CarbonReader

Open zhangboren93 opened this issue 2 years ago • 1 comments

I found that reading carbon files from CarbonReader takes long time in "SimpleDateFormat.", see attached file for output of profiling.

https://github.com/apache/carbondata/blob/4b8846d1e6737e7db8a96014818c067c8c253d1f/sdk/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java#L207

I wonder if it is OK if we add some lazy initialization to SimpleDateFormat in the class, and if so should it support multi-threading.

profile.zip

zhangboren93 avatar Jun 22 '22 06:06 zhangboren93

hey @zhangboren93 , Can you please assign to me and please explain the issue?

prajwalbandak avatar Aug 20 '23 15:08 prajwalbandak